91cb6a7de0
Fix passing of kwargs to get_label_quality_scores ( #547 )
...
The functions `_get_consensus_stats` and
`_get_annotator_label_quality_score` take an argument
`label_quality_score_kwargs`, a dictionary of keyword arguments to pass
to `get_label_quality_scores`. When passing a
`label_quality_score_kwargs` dictionary to these functions, using the
unpacking operator is incorrect: that would be an extra level of
unpacking. The _implementations_ of these functions will unpack the
`label_quality_score_kwargs` when calling `get_label_quality_scores`.
This patch fixes the issue and adds a basic regression test.
[skip ci]
2022-11-26 14:41:47 +00:00
d4fe568024
Fix types to work with latest pandas-stubs ( #546 )
...
The latest pandas-stubs (1.5.2.221124) changed the type of
`.apply(f, ...)` such that the function `f` must return either a
`Scalar` or a `Series`. This patch updates the functions to return a
`Series`. Note that this has minimal impact on runtime performance,
because by default, the pd.Series constructor does *not* copy the
underlying data.
[skip ci]
2022-11-26 14:39:33 +00:00
91b5b40ff7
Move mypy configuration to config file ( #545 )
...
This patch moves the `--allow-redefinition` into the `.mypi.ini` file.
Centralizing our mypy config in a single file makes sense, and this way,
if people want to run mypy locally, they don't need to remember to
supply this command-line argument.
2022-11-26 08:07:38 -05:00
a222859569
Improve docs in label error detection methods for classification data + filter/count mypy type annotations ( #543 )
2022-11-23 23:01:36 -08:00
17a82c32fc
Public multilabel quality scores method + softmin aggregation + more tests ( #542 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2022-11-23 18:34:43 -08:00
7139a8fd99
Refactor MultilabelScorer helper methods and tests ( #540 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-20 15:43:23 -08:00
6d8c611fe7
ask for runnable code in Help issue template
2022-11-19 15:55:14 -08:00
d2d481be46
dependencies between classes: multilabel tutorial
2022-11-17 19:14:55 -08:00
c86c51dd23
multilabel tutorial fixes: install colab, set seed, text improvements ( #537 )
...
Co-authored-by: Aditya Thyagarajan <aditya1593@icloud.com >
2022-11-17 07:09:25 -08:00
0727a7da4d
github actions with TF_CPP_MIN_LOG_LEVEL = 3 ( #536 )
...
set environ variable TF_CPP_MIN_LOG_LEVEL = 3 to suppress unnecessary tensorflow prints when building tutorials on github server
2022-11-15 14:11:17 -08:00
4d0ad6ed04
Fix multilabel_py dimensionality ( #535 )
...
* Go from a (2**K,) vector to a (K, 2) matrix of prior probabilities.
2022-11-14 15:19:17 +00:00
ab2679724e
Add multilabel tutorial to index.rst ( #533 )
2022-11-14 13:33:12 +00:00
871f08693c
Fix outdates links to example notebook for multilabel classification ( #534 )
2022-11-14 13:28:00 +00:00
c32335c789
Tutorial for multi-label classification ( #517 )
...
clarification re empty list label, thanks to @elisno
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-11 17:13:56 -08:00
10abd7d191
replace pylint --> flake8 in CI ( #531 )
...
* add flake8 configuration in setup.cfg
2022-11-08 16:08:57 +00:00
886e6aee6e
make mypy v0.990 happy ( #530 )
2022-11-08 09:56:51 +00:00
b6ce88d484
clarify mypy flags
2022-11-08 01:53:38 -08:00
9e1e36fcc3
Add a link for How to Contribute in docs ( #505 )
...
* 📝 add section on how to contribute to project
* 📝 add external link to CONTRIBUTING.md
* move contribution guide link to Guides section
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-08 09:18:46 +00:00
7b9c0cf54e
Remove strong worded requirement for out-of-sample pred probs ( #520 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-07 20:10:07 -08:00
2ff42b849f
Make "contributing" explicit ( #528 )
...
It's nice to say the word "contributing" in the readme, and also, it's
nice to clarify that there are valuable non-code contributions as well.
2022-11-07 12:06:32 -08:00
25025d9275
Validate forgetting factor in EMA ( #527 )
...
- Added runtime check that `0 <= alpha <= 1` to ensure EMA uses proportional weighting.
- Moved all EMA tests to separate class.
2022-11-07 15:56:33 +00:00
aceaa4f25e
Improve tutorials intro language/formatting ( #526 )
2022-11-06 00:34:54 -07:00
f37ba9ff39
support missing classes in multilabel tasks ( #523 )
2022-11-04 15:00:43 -07:00
0f4b6a2aa2
Add Cleanlab Studio Banner ( #525 )
2022-11-04 14:38:46 -07:00
16530f40cf
fix mypy typing ( #524 )
2022-11-04 17:25:50 -04:00
1085faca4a
support missing classes in multiannotator functions ( #519 )
2022-11-03 23:25:03 -07:00
9da372bb4d
typecheck with python v3.10 ( #521 )
...
Thanks @huiwengoh for diagnosing this problem!
2022-11-03 23:17:41 -07:00
cbe3ce0f20
move multilabel functions to utils ( #515 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-03 10:16:28 -07:00
2bff4d5dd6
Better missing class support for label quality scoring ( #518 )
2022-11-02 18:14:16 -07:00
c2d319d0ed
Add support for missing classes ( #511 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-31 16:23:41 -07:00
8ff371c16c
separate word coloring from token-replacement ( #514 )
...
Fixes #513
2022-10-31 14:21:05 +00:00
b12d76b6d1
Multilabel code restructuring with aggregation/scorer functions ( #509 )
...
_find_label_issues_multilabel uses EMA instead of mean-pooling when computing label quality scores
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-28 16:26:39 -07:00
00d7c2157c
studio pointers ( #510 )
2022-10-25 17:51:00 -07:00
738acae810
Point to format label function for multiannotator ( #506 )
2022-10-25 10:52:21 -07:00
f8a831d239
Add internal function to properly format labels ( #504 )
2022-10-24 10:54:59 -07:00
7761aefa18
Trying to fix typings ( #502 )
...
* Add typing for filter.py
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2022-10-20 21:53:11 +00:00
00781ce984
update paper links ( #503 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2022-10-18 00:01:00 -07:00
e060f551fb
supporting multilabel via one-vs-rest reductions ( #483 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-17 12:09:23 -07:00
26fa264344
Extending label quality scores to multilabel data ( #499 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-13 09:56:43 -07:00
57bcfd0a99
Mypy typechecking fix for num_label_errors ( #500 )
2022-10-07 19:43:40 -07:00
c14c84fc49
note about M1 chip requirements
2022-10-05 21:27:53 -07:00
2906bf6292
Update # issues returned by num_label_issues ( #485 )
...
* Added code and test for returning correct num label issues
* Fixed docstring
* Addressed mypy uncertain typing issue
* Added typing and typing checks
* Addressed PR comments
2022-10-05 20:55:49 -07:00
3690d5eed4
fix remaining docs/source links
2022-10-05 17:59:56 -07:00
1f72fd0bc3
fix links that dont work from some branches
2022-10-05 17:52:52 -07:00
42a2f6851f
increment version beyond latest release ( #476 )
2022-10-05 17:43:00 -07:00
7bfdd9169d
Make type checking pass with mypy 0.981 ( #488 )
2022-10-05 17:42:11 -07:00
72c4297c16
Update __init__.py to include major files ( #490 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-05 17:41:13 -07:00
2c6caaf6d6
More instructions on rebuilding stable/older docs from master versions ( #498 )
2022-10-03 23:51:29 -07:00
d27478853f
Asthetic fixes for OOD tutorial ( #493 )
2022-10-03 10:26:14 -07:00
8a567176ad
Update DEVELOPMENT.md with howto add new modules ( #494 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-03 10:24:07 -07:00
Anish Athalye