This specifically concerns the info print outs during download and loading:
Example in Download routine:
|
print(f"Downloaded '{file_url}' to '{file_name}'") |
Example in cd.load() rountine:
|
print(f"Importing raw data ...", file=sys.stderr) |
Those could be moved to logging routine for easier and more robust handling. See for example:
|
logger = logging.getLogger(__name__) |
|
if args.LOGLEVEL == 'info': |
|
loglevel = logging.INFO |
|
elif args.LOGLEVEL == 'debug': |
|
loglevel = logging.DEBUG |
|
else: |
|
loglevel = logging.WARNING |
|
|
|
logging.basicConfig( |
|
format="{asctime} - {levelname} - {message}", |
|
style="{", |
|
datefmt="%Y-%m-%d %H:%M", |
|
level=loglevel |
|
) |
|
logger.info("importing datasets...") |
This specifically concerns the info print outs during download and loading:
Example in Download routine:
coderdata/coderdata/download/downloader.py
Line 104 in 8fadc34
Example in
cd.load()rountine:coderdata/coderdata/dataset/dataset.py
Line 433 in 8fadc34
Those could be moved to
loggingroutine for easier and more robust handling. See for example:coderdata/scripts/prepare_data_for_improve.py
Line 14 in 0c724de
coderdata/scripts/prepare_data_for_improve.py
Lines 99 to 111 in 0c724de
coderdata/scripts/prepare_data_for_improve.py
Line 130 in 0c724de