Repository navigation
additional checks and data validation tools are included in the RDBES data upload process #231
Description
At the RCG TM 2025, the ISSG Overviews presented a smapling overviews summarizing the data uploaded in CS files, and highligthing some inconsistencies. The group recommended that additional checks and data validation tools are included in the RDBES data upload process, to prevent errors and suggested to post an issue in RDBES gitHub.
Here we present a proposal for these checks, but please, contact the ISSG if further details or clarifications are needed
- DEsampScheme: Don’t allow “National Routine”
- BVvalueMeas: validation rules depend on the variable BVtypeMeas. In the table below there is a proposal for basic checks
| Condition | Type | Basic checks |
|---|---|---|
| BVtypeMeas = Age | Integer | |
| BVtypeMeas = Maturity BVvalUnitScale = SMSF | String | Code List: stages and substages. WKSMSF 2018 Maturity Scale. Table provided by WGBIOP is pesented below |
| BVtypeMeas = Sex | String | Code List: proposed M, F, T, U (for male, female, transitioning or undetermined) |
| BVtypeMeas = InfoGenetic | String | Code List: Y/N (https://vocab.ices.dk/?ref=316) |
| BVtypeMeas = OtolithCollected | String | Code List: Y/N (https://vocab.ices.dk/?ref=316) |
| BVtypeMeas = Stock | String | Code List (ices) |
| BVtypeMeas = ScaleCollected | String | Code List: Y/N (https://vocab.ices.dk/?ref=316) |
| BVtypeMeas = InfoParasite | String | Code List: Y/N (https://vocab.ices.dk/?ref=316) |
| BVtypeMeas = IlliciumCollected | String | Code List: Y/N (https://vocab.ices.dk/?ref=316) |
| BVtypeMeas = InfoGonad | String | Code List: Y/N (https://vocab.ices.dk/?ref=316) |
| BVtypeMeas = SpecimenState | Not sure. Same as SAspecState? https://vocab.ices.dk/?ref=1668 | |
| BVtypeMeas = LengthTotal | Integer | The measured length in mm |
| BVtypeMeas = LengthPinched | Integer | The measured length in mm |
| BVtypeMeas = LengthCarapace | Integer | The measured length in mm |
| BVtypeMeas = LengthMantle | Integer | The measured length in mm |
| BVtypeMeas = WeightLive | Integer | The measured weight in g |
| BVtypeMeas = WeightGutted | Integer | The measured weight in g |
| BVtypeMeas = WeightMeasured | Integer | The measured weight in g |
| BVtypeMeas is not NA | BVvalueMeas cannot be NA |
this is the table provided by WGBIOP for maturity scales:
<style> </style>| Stage | Code | Description |
|---|---|---|
| A. Immature | ||
| B. Developing | Ba | Developing but functionally immature (first-time developer) |
| B. Developing | Bb | Developing and functionally mature |
| C. Spawning | Ca | Actively spawning |
| C. Spawning | Cb | Spawning capable |
| D. Regressing/Regenerating | Da | Regressing |
| D. Regressing/Regenerating | Db | Regenerating |
| E. Omitted spawning | ||
| F. Abnormal |
Metadata
Metadata
Assignees
Labels
No labels
Activity
HenrikK-N commentedon Aug 5, 2026
The checks fit under the additional checks that should be developed, which we are in the process of seeking funding for.