Fix evaluation and other minor issues to adapt to multi-label classification#1595
Fix evaluation and other minor issues to adapt to multi-label classification#1595callzhang wants to merge 17 commits intohankcs:masterfrom
Conversation
This reverts commit 91e9847. On branch master Your branch is up to date with 'origin/master'. Changes to be committed: modified: hanlp/common/component.py modified: hanlp/layers/transformers/loader.py
|
Tried to resolve the conflicts but it seems that you have changed the structure a lot. Any suggestion on how to merge? |
|
Yes, I refactored a lot. Basically, TensorFlow components are renamed to its original name with a TF shuffix. Sorry you have to do a line-by-line merge as I did for merging your commits to the new release. If you'd like to contribute, please rebase on By the way, since 2.1 officially dependents on the wonderful huggingface transformers. It would also be great if you want to use their BERT. Here is some reference codes: 1fe90f7 |
|
I eventually wrote my own script on multi-label classification task. Basically using customized BCE with weights to deal with imbalanced classes and macro-F1 for metrics, as well as AdamW with amsGrad enabled. Aided with data augmentation, the performance achieved better. I will continue to use hanlp as an exploration tool and try to contribute when I can. Thanks! |
|
Sure, feel free to explore 2.1. |
2412ba9 to
f1c1c71
Compare
3be983d to
9b3a786
Compare
No description provided.