Skip to content

Commit f5f94e0

Browse files
committed
Update performance test results [skip ci]
1 parent 785a747 commit f5f94e0

1 file changed

Lines changed: 82 additions & 57 deletions

File tree

performance.md

Lines changed: 82 additions & 57 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
# VFBquery Performance Test Results
22

3-
**Test Date:** 2026-03-12 07:50:46 UTC
4-
**Git Commit:** 32f20df57137ba3bbafab75dec3d4ba411eedbd3
3+
**Test Date:** 2026-03-13 00:44:12 UTC
4+
**Git Commit:** 785a7479273beb29d52275e29fd2e9acb47da8e9
55
**Branch:** main
6-
**Workflow Run:** [22991749861](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/22991749861)
6+
**Workflow Run:** [23030727846](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/23030727846)
77

88
## Test Overview
99

@@ -85,7 +85,9 @@ This performance test measures the execution time of all implemented VFB queries
8585

8686
```
8787
test_01_term_info_queries (src.test.test_query_performance.QueryPerformanceTest)
88-
Test term info query performance ... ok
88+
Test term info query performance ... WARNING: Owlery unavailable for query '<http://purl.obolibrary.org/obo/FBbt_00005106> and <http://purl.obolibrary.org/obo/RO_0002131> some <http://purl.obolibrary.org/obo/FBbt_00003748>': RetryError
89+
Query returned error result for images_neurons(FBbt_00003748), clearing cache entry
90+
FAIL
8991
test_02_neuron_part_queries (src.test.test_query_performance.QueryPerformanceTest)
9092
Test neuron part overlap queries ... ok
9193
test_03_synaptic_queries (src.test.test_query_performance.QueryPerformanceTest)
@@ -109,25 +111,43 @@ Test expression pattern queries ... ok
109111
test_11_transcriptomics_queries (src.test.test_query_performance.QueryPerformanceTest)
110112
Test scRNAseq transcriptomics queries ... ok
111113
test_12_nblast_queries (src.test.test_query_performance.QueryPerformanceTest)
112-
Test NBLAST similarity queries ... ok
114+
Test NBLAST similarity queries ... FAIL
113115
test_13_dataset_template_queries (src.test.test_query_performance.QueryPerformanceTest)
114116
Test dataset and template queries ... FAIL
115117
test_14_publication_transgene_queries (src.test.test_query_performance.QueryPerformanceTest)
116118
Test publication and transgene queries ... ok
117119
120+
======================================================================
121+
FAIL: test_01_term_info_queries (src.test.test_query_performance.QueryPerformanceTest)
122+
Test term info query performance
123+
----------------------------------------------------------------------
124+
Traceback (most recent call last):
125+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 113, in test_01_term_info_queries
126+
self.assertLess(duration, self.THRESHOLD_VERY_SLOW, "term_info query exceeded threshold")
127+
AssertionError: 135.18596053123474 not less than 31.0 : term_info query exceeded threshold
128+
129+
======================================================================
130+
FAIL: test_12_nblast_queries (src.test.test_query_performance.QueryPerformanceTest)
131+
Test NBLAST similarity queries
132+
----------------------------------------------------------------------
133+
Traceback (most recent call last):
134+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 563, in test_12_nblast_queries
135+
self.assertLess(duration, self.THRESHOLD_SLOW, "SimilarMorphologyToPartOfexp exceeded threshold")
136+
AssertionError: 19.358788013458252 not less than 15.0 : SimilarMorphologyToPartOfexp exceeded threshold
137+
118138
======================================================================
119139
FAIL: test_13_dataset_template_queries (src.test.test_query_performance.QueryPerformanceTest)
120140
Test dataset and template queries
121141
----------------------------------------------------------------------
122142
Traceback (most recent call last):
123143
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 660, in test_13_dataset_template_queries
124144
self.assertLess(duration, self.THRESHOLD_MEDIUM, "AllAlignedImages exceeded threshold")
125-
AssertionError: 3.8431692123413086 not less than 3.0 : AllAlignedImages exceeded threshold
145+
AssertionError: 3.483396291732788 not less than 3.0 : AllAlignedImages exceeded threshold
126146
127147
----------------------------------------------------------------------
128-
Ran 15 tests in 119.899s
148+
Ran 15 tests in 225.591s
129149
130-
FAILED (failures=1)
150+
FAILED (failures=3)
131151
VFBquery functions patched with caching support
132152
VFBquery: SOLR caching enabled by default (3-month TTL)
133153
Disable with: export VFBQUERY_CACHE_ENABLED=false
@@ -137,114 +157,107 @@ VFBquery: SOLR caching enabled by default (3-month TTL)
137157
================================================================================
138158
TERM INFO QUERIES
139159
================================================================================
140-
get_term_info (mushroom body): 3.0132s ✅
141-
get_term_info (individual): 2.5560s ✅
160+
get_term_info (mushroom body): 135.1860s ✅
142161
143162
================================================================================
144163
NEURON PART OVERLAP QUERIES
145164
================================================================================
146-
NeuronsPartHere: 2.5068s
165+
NeuronsPartHere: 1.8796s
147166
148167
================================================================================
149168
SYNAPTIC TERMINAL QUERIES
150169
================================================================================
151-
NeuronsSynaptic: 2.6878s
152-
NeuronsPresynapticHere: 1.9972s
153-
NeuronsPostsynapticHere: 2.4136s
154-
NeuronNeuronConnectivity: 2.3535s
170+
NeuronsSynaptic: 1.8015s
171+
NeuronsPresynapticHere: 1.4421s
172+
NeuronsPostsynapticHere: 1.6271s
173+
NeuronNeuronConnectivity: 1.4127s
155174
156175
================================================================================
157176
ANATOMICAL HIERARCHY QUERIES
158177
================================================================================
159-
ComponentsOf: 2.1149s
160-
PartsOf: 2.1400s
161-
SubclassesOf: 1.9167s
178+
ComponentsOf: 1.4070s
179+
PartsOf: 1.4311s
180+
SubclassesOf: 1.5324s
162181
163182
================================================================================
164183
TRACT/NERVE AND LINEAGE QUERIES
165184
================================================================================
166-
NeuronClassesFasciculatingHere: 2.0180s
167-
TractsNervesInnervatingHere: 1.9509s
168-
LineageClonesIn: 1.9476s
185+
NeuronClassesFasciculatingHere: 1.5944s
186+
TractsNervesInnervatingHere: 1.4326s
187+
LineageClonesIn: 1.4302s
169188
170189
================================================================================
171190
IMAGE AND DEVELOPMENTAL QUERIES
172191
================================================================================
173-
ImagesNeurons: 3.4373s
174-
ImagesThatDevelopFrom: 2.0179s
175-
epFrag: 1.9777s
192+
ImagesNeurons: 2.4574s
193+
ImagesThatDevelopFrom: 1.4796s
194+
epFrag: 1.4358s
176195
177196
================================================================================
178197
INSTANCE QUERIES
179198
================================================================================
180-
ListAllAvailableImages: 1.9781s
199+
ListAllAvailableImages: 1.4780s
181200
182201
================================================================================
183202
CONNECTIVITY QUERIES
184203
================================================================================
185-
NeuronNeuronConnectivityQuery: 1.9420s
186-
NeuronRegionConnectivityQuery: 1.9363s
204+
NeuronNeuronConnectivityQuery: 1.4635s
205+
NeuronRegionConnectivityQuery: 1.4624s
187206
188207
================================================================================
189208
SIMILARITY QUERIES (Neo4j NBLAST)
190209
================================================================================
191-
SimilarMorphologyTo: 1.0292s
210+
SimilarMorphologyTo: 0.9191s
192211
193212
================================================================================
194213
NEURON INPUT QUERIES (Neo4j)
195214
================================================================================
196-
NeuronInputsTo: 3.2484s
215+
NeuronInputsTo: 6.1101s
197216
198217
================================================================================
199218
EXPRESSION PATTERN QUERIES (Neo4j)
200219
================================================================================
201-
ExpressionOverlapsHere: 1.3670s
220+
ExpressionOverlapsHere: 1.0085s
202221
└─ Found 3922 total expression patterns, returned 10
203222
204223
================================================================================
205224
TRANSCRIPTOMICS QUERIES (Neo4j scRNAseq)
206225
================================================================================
207-
anatScRNAseqQuery: 1.0158s
226+
anatScRNAseqQuery: 0.7083s
208227
└─ Found 57 total clusters, returned 10
209-
clusterExpression: 40.8975s
228+
clusterExpression: 5.7377s
210229
└─ Found 4588 genes expressed, returned 10
211-
clusterExpression: Skipped (test data may not exist): 40.89745473861694 not less than 15.0 : clusterExpression exceeded threshold
212-
expressionCluster: 0.9319s ✅
230+
expressionCluster: 3.6455s ✅
213231
└─ Found 9 clusters expressing gene
214-
scRNAdatasetData: 0.7729s
232+
scRNAdatasetData: 0.7108s
215233
└─ Found 13 clusters in dataset, returned 10
216234
217235
================================================================================
218236
NBLAST SIMILARITY QUERIES
219237
================================================================================
220-
SimilarMorphologyTo: 1.2162s
238+
SimilarMorphologyTo: 0.8461s
221239
└─ Found 215 NBLAST matches, returned 10
222-
SimilarMorphologyToPartOf: 0.7895s
240+
SimilarMorphologyToPartOf: 0.6881s
223241
└─ Found 0 NBLASTexp matches
224-
SimilarMorphologyToPartOfexp: 0.7605s
242+
SimilarMorphologyToPartOfexp: 19.3588s
225243
└─ Found 0 reverse NBLASTexp matches
226-
SimilarMorphologyToNB: 0.8613s ✅
227-
└─ Found 15 NeuronBridge matches, returned 10
228-
SimilarMorphologyToNBexp: 0.7655s ✅
229-
└─ Found 15 NeuronBridge expression matches, returned 10
230-
✅ All NBLAST similarity queries completed
231244
232245
================================================================================
233246
DATASET/TEMPLATE QUERIES
234247
================================================================================
235-
PaintedDomains: 0.9610s
248+
PaintedDomains: 0.7055s
236249
└─ Found 46 painted domains, returned 10
237-
DatasetImages: 0.8894s
250+
DatasetImages: 0.6232s
238251
└─ Found 46 images in dataset, returned 10
239-
AllAlignedImages: 3.8432s
252+
AllAlignedImages: 3.4834s
240253
└─ Found 546915 aligned images, returned 10
241254
242255
================================================================================
243256
PUBLICATION/TRANSGENE QUERIES
244257
================================================================================
245-
TermsForPub: 0.9519s
258+
TermsForPub: 0.7417s
246259
└─ Found 2 terms for publication
247-
TransgeneExpressionHere: 2.2178s
260+
TransgeneExpressionHere: 3.2818s
248261
└─ Found 2350 transgene expressions, returned 10
249262
✅ All publication/transgene queries completed
250263
@@ -254,25 +267,37 @@ PERFORMANCE TEST SUMMARY
254267
All performance tests completed!
255268
================================================================================
256269
test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
257-
Performance test for specific term info queries. ... ok
270+
Performance test for specific term info queries. ... Cached result incomplete for FBbt_00003748, re-executing function
271+
Cached result incomplete for FBbt_00003748, re-executing function
272+
WARNING: Owlery unavailable for query '<http://purl.obolibrary.org/obo/FBbt_00005106> and <http://purl.obolibrary.org/obo/RO_0002131> some <http://purl.obolibrary.org/obo/FBbt_00003748>': RetryError
273+
Query returned error result for images_neurons(FBbt_00003748), clearing cache entry
274+
FAIL
258275
276+
======================================================================
277+
FAIL: test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
278+
Performance test for specific term info queries.
259279
----------------------------------------------------------------------
260-
Ran 1 test in 4.065s
280+
Traceback (most recent call last):
281+
File "/home/runner/work/VFBquery/VFBquery/src/test/term_info_queries_test.py", line 590, in test_term_info_performance
282+
self.assertLess(duration_1, max_single_query_time,
283+
AssertionError: 32.27715229988098 not less than 10.0 : FBbt_00003748 query took 32.2772s, exceeding 10.0s threshold
261284
262-
OK
285+
----------------------------------------------------------------------
286+
Ran 1 test in 33.749s
287+
288+
FAILED (failures=1)
263289
VFBquery functions patched with caching support
264290
VFBquery: SOLR caching enabled by default (3-month TTL)
265291
Disable with: export VFBQUERY_CACHE_ENABLED=false
266292
267293
==================================================
268294
Performance Test Results:
269295
==================================================
270-
FBbt_00003748 query took: 2.0281 seconds
271-
VFB_00101567 query took: 2.0361 seconds
272-
Total time for both queries: 4.0642 seconds
273-
Performance Level: 🟠 Acceptable (3-6 seconds)
296+
FBbt_00003748 query took: 32.2772 seconds
297+
VFB_00101567 query took: 1.4710 seconds
298+
Total time for both queries: 33.7482 seconds
299+
Performance Level: 🔴 Slow (> 6 seconds)
274300
==================================================
275-
Performance test completed successfully!
276301
```
277302

278303
## Summary
@@ -288,4 +313,4 @@ Track performance trends across commits:
288313
- [GitHub Actions History](https://github.com/VirtualFlyBrain/VFBquery/actions/workflows/performance-test.yml)
289314

290315
---
291-
*Last updated: 2026-03-12 07:50:46 UTC*
316+
*Last updated: 2026-03-13 00:44:12 UTC*

0 commit comments

Comments
 (0)