Skip to content

Commit 304fd44

Browse files
committed
Update performance test results [skip ci]
1 parent 9574a65 commit 304fd44

1 file changed

Lines changed: 64 additions & 66 deletions

File tree

performance.md

Lines changed: 64 additions & 66 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
# VFBquery Performance Test Results
22

3-
**Test Date:** 2026-03-13 00:44:12 UTC
4-
**Git Commit:** 785a7479273beb29d52275e29fd2e9acb47da8e9
3+
**Test Date:** 2026-03-13 01:53:35 UTC
4+
**Git Commit:** 9574a65d76ec76b5237a5f140d7afbca06c2471c
55
**Branch:** main
6-
**Workflow Run:** [23030727846](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/23030727846)
6+
**Workflow Run:** [23032473568](https://github.com/VirtualFlyBrain/VFBquery/actions/runs/23032473568)
77

88
## Test Overview
99

@@ -85,9 +85,7 @@ This performance test measures the execution time of all implemented VFB queries
8585

8686
```
8787
test_01_term_info_queries (src.test.test_query_performance.QueryPerformanceTest)
88-
Test term info query performance ... WARNING: Owlery unavailable for query '<http://purl.obolibrary.org/obo/FBbt_00005106> and <http://purl.obolibrary.org/obo/RO_0002131> some <http://purl.obolibrary.org/obo/FBbt_00003748>': RetryError
89-
Query returned error result for images_neurons(FBbt_00003748), clearing cache entry
90-
FAIL
88+
Test term info query performance ... FAIL
9189
test_02_neuron_part_queries (src.test.test_query_performance.QueryPerformanceTest)
9290
Test neuron part overlap queries ... ok
9391
test_03_synaptic_queries (src.test.test_query_performance.QueryPerformanceTest)
@@ -105,7 +103,7 @@ Test neuron connectivity queries ... ok
105103
test_08_similarity_queries (src.test.test_query_performance.QueryPerformanceTest)
106104
Test NBLAST similarity queries ... ok
107105
test_09_neuron_input_queries (src.test.test_query_performance.QueryPerformanceTest)
108-
Test neuron input/synapse queries ... ok
106+
Test neuron input/synapse queries ... FAIL
109107
test_10_expression_queries (src.test.test_query_performance.QueryPerformanceTest)
110108
Test expression pattern queries ... ok
111109
test_11_transcriptomics_queries (src.test.test_query_performance.QueryPerformanceTest)
@@ -124,7 +122,16 @@ Test term info query performance
124122
Traceback (most recent call last):
125123
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 113, in test_01_term_info_queries
126124
self.assertLess(duration, self.THRESHOLD_VERY_SLOW, "term_info query exceeded threshold")
127-
AssertionError: 135.18596053123474 not less than 31.0 : term_info query exceeded threshold
125+
AssertionError: 115.57269263267517 not less than 31.0 : term_info query exceeded threshold
126+
127+
======================================================================
128+
FAIL: test_09_neuron_input_queries (src.test.test_query_performance.QueryPerformanceTest)
129+
Test neuron input/synapse queries
130+
----------------------------------------------------------------------
131+
Traceback (most recent call last):
132+
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 392, in test_09_neuron_input_queries
133+
self.assertLess(duration, self.THRESHOLD_SLOW, "NeuronInputsTo exceeded threshold")
134+
AssertionError: 35.2425901889801 not less than 15.0 : NeuronInputsTo exceeded threshold
128135
129136
======================================================================
130137
FAIL: test_12_nblast_queries (src.test.test_query_performance.QueryPerformanceTest)
@@ -133,7 +140,7 @@ Test NBLAST similarity queries
133140
Traceback (most recent call last):
134141
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 563, in test_12_nblast_queries
135142
self.assertLess(duration, self.THRESHOLD_SLOW, "SimilarMorphologyToPartOfexp exceeded threshold")
136-
AssertionError: 19.358788013458252 not less than 15.0 : SimilarMorphologyToPartOfexp exceeded threshold
143+
AssertionError: 19.118536710739136 not less than 15.0 : SimilarMorphologyToPartOfexp exceeded threshold
137144
138145
======================================================================
139146
FAIL: test_13_dataset_template_queries (src.test.test_query_performance.QueryPerformanceTest)
@@ -142,12 +149,12 @@ Test dataset and template queries
142149
Traceback (most recent call last):
143150
File "/home/runner/work/VFBquery/VFBquery/src/test/test_query_performance.py", line 660, in test_13_dataset_template_queries
144151
self.assertLess(duration, self.THRESHOLD_MEDIUM, "AllAlignedImages exceeded threshold")
145-
AssertionError: 3.483396291732788 not less than 3.0 : AllAlignedImages exceeded threshold
152+
AssertionError: 11.002952098846436 not less than 3.0 : AllAlignedImages exceeded threshold
146153
147154
----------------------------------------------------------------------
148-
Ran 15 tests in 225.591s
155+
Ran 15 tests in 376.642s
149156
150-
FAILED (failures=3)
157+
FAILED (failures=4)
151158
VFBquery functions patched with caching support
152159
VFBquery: SOLR caching enabled by default (3-month TTL)
153160
Disable with: export VFBQUERY_CACHE_ENABLED=false
@@ -157,107 +164,110 @@ VFBquery: SOLR caching enabled by default (3-month TTL)
157164
================================================================================
158165
TERM INFO QUERIES
159166
================================================================================
160-
get_term_info (mushroom body): 135.1860s ✅
167+
Connection Error: 502 (Bad Gateway)
168+
get_term_info (mushroom body): 115.5727s ✅
161169
162170
================================================================================
163171
NEURON PART OVERLAP QUERIES
164172
================================================================================
165-
NeuronsPartHere: 1.8796s
173+
NeuronsPartHere: 1.7483s
166174
167175
================================================================================
168176
SYNAPTIC TERMINAL QUERIES
169177
================================================================================
170-
NeuronsSynaptic: 1.8015s
171-
NeuronsPresynapticHere: 1.4421s
172-
NeuronsPostsynapticHere: 1.6271s
173-
NeuronNeuronConnectivity: 1.4127s
178+
NeuronsSynaptic: 1.7416s
179+
NeuronsPresynapticHere: 1.3623s
180+
NeuronsPostsynapticHere: 1.4774s
181+
NeuronNeuronConnectivity: 1.4988s
174182
175183
================================================================================
176184
ANATOMICAL HIERARCHY QUERIES
177185
================================================================================
178-
ComponentsOf: 1.4070s
179-
PartsOf: 1.4311s
180-
SubclassesOf: 1.5324s
186+
ComponentsOf: 1.2976s
187+
PartsOf: 1.5265s
188+
SubclassesOf: 1.5216s
181189
182190
================================================================================
183191
TRACT/NERVE AND LINEAGE QUERIES
184192
================================================================================
185-
NeuronClassesFasciculatingHere: 1.5944s
186-
TractsNervesInnervatingHere: 1.4326s
187-
LineageClonesIn: 1.4302s
193+
NeuronClassesFasciculatingHere: 1.2472s
194+
TractsNervesInnervatingHere: 1.2444s
195+
LineageClonesIn: 1.3221s
188196
189197
================================================================================
190198
IMAGE AND DEVELOPMENTAL QUERIES
191199
================================================================================
192-
ImagesNeurons: 2.4574s
193-
ImagesThatDevelopFrom: 1.4796s
194-
epFrag: 1.4358s
200+
ImagesNeurons: 2.2424s
201+
ImagesThatDevelopFrom: 1.2978s
202+
epFrag: 1.2703s
195203
196204
================================================================================
197205
INSTANCE QUERIES
198206
================================================================================
199-
ListAllAvailableImages: 1.4780s
207+
ListAllAvailableImages: 1.2632s
200208
201209
================================================================================
202210
CONNECTIVITY QUERIES
203211
================================================================================
204-
NeuronNeuronConnectivityQuery: 1.4635s
205-
NeuronRegionConnectivityQuery: 1.4624s
212+
NeuronNeuronConnectivityQuery: 1.6336s
213+
NeuronRegionConnectivityQuery: 1.2349s
206214
207215
================================================================================
208216
SIMILARITY QUERIES (Neo4j NBLAST)
209217
================================================================================
210-
SimilarMorphologyTo: 0.9191s
218+
SimilarMorphologyTo: 0.6964s
211219
212220
================================================================================
213221
NEURON INPUT QUERIES (Neo4j)
214222
================================================================================
215-
NeuronInputsTo: 6.1101s
223+
NeuronInputsTo: 35.2426s
216224
217225
================================================================================
218226
EXPRESSION PATTERN QUERIES (Neo4j)
219227
================================================================================
220-
ExpressionOverlapsHere: 1.0085s
228+
ExpressionOverlapsHere: 0.9670s
221229
└─ Found 3922 total expression patterns, returned 10
222230
223231
================================================================================
224232
TRANSCRIPTOMICS QUERIES (Neo4j scRNAseq)
225233
================================================================================
226-
anatScRNAseqQuery: 0.7083s
234+
anatScRNAseqQuery: 0.6615s
227235
└─ Found 57 total clusters, returned 10
228-
clusterExpression: 5.7377s
236+
clusterExpression: 19.8687s
229237
└─ Found 4588 genes expressed, returned 10
230-
expressionCluster: 3.6455s ✅
238+
clusterExpression: Skipped (test data may not exist): 19.868694067001343 not less than 15.0 : clusterExpression exceeded threshold
239+
expressionCluster: 94.9218s ✅
231240
└─ Found 9 clusters expressing gene
232-
scRNAdatasetData: 0.7108s ✅
241+
expressionCluster: Skipped (test data may not exist): 94.9218316078186 not less than 15.0 : expressionCluster exceeded threshold
242+
scRNAdatasetData: 13.5753s ✅
233243
└─ Found 13 clusters in dataset, returned 10
234244
235245
================================================================================
236246
NBLAST SIMILARITY QUERIES
237247
================================================================================
238-
SimilarMorphologyTo: 0.8461s
248+
SimilarMorphologyTo: 0.9534s
239249
└─ Found 215 NBLAST matches, returned 10
240-
SimilarMorphologyToPartOf: 0.6881s
250+
SimilarMorphologyToPartOf: 0.6099s
241251
└─ Found 0 NBLASTexp matches
242-
SimilarMorphologyToPartOfexp: 19.3588s
252+
SimilarMorphologyToPartOfexp: 19.1185s
243253
└─ Found 0 reverse NBLASTexp matches
244254
245255
================================================================================
246256
DATASET/TEMPLATE QUERIES
247257
================================================================================
248-
PaintedDomains: 0.7055s
258+
PaintedDomains: 0.8627s
249259
└─ Found 46 painted domains, returned 10
250-
DatasetImages: 0.6232s
260+
DatasetImages: 0.8944s
251261
└─ Found 46 images in dataset, returned 10
252-
AllAlignedImages: 3.4834s
262+
AllAlignedImages: 11.0030s
253263
└─ Found 546915 aligned images, returned 10
254264
255265
================================================================================
256266
PUBLICATION/TRANSGENE QUERIES
257267
================================================================================
258-
TermsForPub: 0.7417s
268+
TermsForPub: 0.7510s
259269
└─ Found 2 terms for publication
260-
TransgeneExpressionHere: 3.2818s
270+
TransgeneExpressionHere: 5.0399s
261271
└─ Found 2350 transgene expressions, returned 10
262272
✅ All publication/transgene queries completed
263273
@@ -267,37 +277,25 @@ PERFORMANCE TEST SUMMARY
267277
All performance tests completed!
268278
================================================================================
269279
test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
270-
Performance test for specific term info queries. ... Cached result incomplete for FBbt_00003748, re-executing function
271-
Cached result incomplete for FBbt_00003748, re-executing function
272-
WARNING: Owlery unavailable for query '<http://purl.obolibrary.org/obo/FBbt_00005106> and <http://purl.obolibrary.org/obo/RO_0002131> some <http://purl.obolibrary.org/obo/FBbt_00003748>': RetryError
273-
Query returned error result for images_neurons(FBbt_00003748), clearing cache entry
274-
FAIL
275-
276-
======================================================================
277-
FAIL: test_term_info_performance (src.test.term_info_queries_test.TermInfoQueriesTest)
278-
Performance test for specific term info queries.
279-
----------------------------------------------------------------------
280-
Traceback (most recent call last):
281-
File "/home/runner/work/VFBquery/VFBquery/src/test/term_info_queries_test.py", line 590, in test_term_info_performance
282-
self.assertLess(duration_1, max_single_query_time,
283-
AssertionError: 32.27715229988098 not less than 10.0 : FBbt_00003748 query took 32.2772s, exceeding 10.0s threshold
280+
Performance test for specific term info queries. ... ok
284281
285282
----------------------------------------------------------------------
286-
Ran 1 test in 33.749s
283+
Ran 1 test in 2.937s
287284
288-
FAILED (failures=1)
285+
OK
289286
VFBquery functions patched with caching support
290287
VFBquery: SOLR caching enabled by default (3-month TTL)
291288
Disable with: export VFBQUERY_CACHE_ENABLED=false
292289
293290
==================================================
294291
Performance Test Results:
295292
==================================================
296-
FBbt_00003748 query took: 32.2772 seconds
297-
VFB_00101567 query took: 1.4710 seconds
298-
Total time for both queries: 33.7482 seconds
299-
Performance Level: 🔴 Slow (> 6 seconds)
293+
FBbt_00003748 query took: 1.4422 seconds
294+
VFB_00101567 query took: 1.4946 seconds
295+
Total time for both queries: 2.9368 seconds
296+
Performance Level: 🟡 Good (1.5-3 seconds)
300297
==================================================
298+
Performance test completed successfully!
301299
```
302300

303301
## Summary
@@ -313,4 +311,4 @@ Track performance trends across commits:
313311
- [GitHub Actions History](https://github.com/VirtualFlyBrain/VFBquery/actions/workflows/performance-test.yml)
314312

315313
---
316-
*Last updated: 2026-03-13 00:44:12 UTC*
314+
*Last updated: 2026-03-13 01:53:35 UTC*

0 commit comments

Comments
 (0)