5a8619a274
Add v2.2.0 to RELEASE_VERSIONS in html_context ( #552 )
CI / Format (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.6 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Check for unused/wildcard imports (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.6 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
CI / Test: Python 3.10 on windows-latest (push) Has been cancelled
CI / Test: Python 3.6 on windows-latest (push) Has been cancelled
CI / Test: Python 3.7 on windows-latest (push) Has been cancelled
CI / Test: Python 3.8 on windows-latest (push) Has been cancelled
CI / Test: Python 3.9 on windows-latest (push) Has been cancelled
CI / Type check (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
2022-11-28 15:47:15 +00:00
95032fadae
update readme for v2.2 ( #551 )
2022-11-28 02:11:42 -08:00
7d9a98b0cf
black formatting
2022-11-28 01:09:52 -08:00
f0226d5f3e
increment version to 2.2
2022-11-28 01:04:55 -08:00
8fda383d2d
point to find_label_issues in multilabel_classification.py
2022-11-28 00:46:56 -08:00
7dd06d14a0
remove unnecessary TF warning suppression statements in tutorials ( #544 )
2022-11-26 11:25:58 -08:00
7b87535e48
Remove unnecessary type: ignore annotations ( #549 )
2022-11-26 14:44:54 +00:00
ecefdbf3d6
Switch CI cron schedule ( #548 )
...
Previously, the CI cron schedule, copy-pasted from a personal project,
ran jobs at 8am UTC (3am EST or 4am EDT) on Saturday. This isn't a great
time to get emails about CI breakages.
This patch switches the schedule so it runs on Monday morning (7am EST /
8am EDT).
[skip ci]
2022-11-26 14:43:55 +00:00
91cb6a7de0
Fix passing of kwargs to get_label_quality_scores ( #547 )
...
The functions `_get_consensus_stats` and
`_get_annotator_label_quality_score` take an argument
`label_quality_score_kwargs`, a dictionary of keyword arguments to pass
to `get_label_quality_scores`. When passing a
`label_quality_score_kwargs` dictionary to these functions, using the
unpacking operator is incorrect: that would be an extra level of
unpacking. The _implementations_ of these functions will unpack the
`label_quality_score_kwargs` when calling `get_label_quality_scores`.
This patch fixes the issue and adds a basic regression test.
[skip ci]
2022-11-26 14:41:47 +00:00
d4fe568024
Fix types to work with latest pandas-stubs ( #546 )
...
The latest pandas-stubs (1.5.2.221124) changed the type of
`.apply(f, ...)` such that the function `f` must return either a
`Scalar` or a `Series`. This patch updates the functions to return a
`Series`. Note that this has minimal impact on runtime performance,
because by default, the pd.Series constructor does *not* copy the
underlying data.
[skip ci]
2022-11-26 14:39:33 +00:00
91b5b40ff7
Move mypy configuration to config file ( #545 )
...
This patch moves the `--allow-redefinition` into the `.mypi.ini` file.
Centralizing our mypy config in a single file makes sense, and this way,
if people want to run mypy locally, they don't need to remember to
supply this command-line argument.
2022-11-26 08:07:38 -05:00
a222859569
Improve docs in label error detection methods for classification data + filter/count mypy type annotations ( #543 )
2022-11-23 23:01:36 -08:00
17a82c32fc
Public multilabel quality scores method + softmin aggregation + more tests ( #542 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2022-11-23 18:34:43 -08:00
7139a8fd99
Refactor MultilabelScorer helper methods and tests ( #540 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-20 15:43:23 -08:00
6d8c611fe7
ask for runnable code in Help issue template
2022-11-19 15:55:14 -08:00
d2d481be46
dependencies between classes: multilabel tutorial
2022-11-17 19:14:55 -08:00
c86c51dd23
multilabel tutorial fixes: install colab, set seed, text improvements ( #537 )
...
Co-authored-by: Aditya Thyagarajan <aditya1593@icloud.com >
2022-11-17 07:09:25 -08:00
0727a7da4d
github actions with TF_CPP_MIN_LOG_LEVEL = 3 ( #536 )
...
set environ variable TF_CPP_MIN_LOG_LEVEL = 3 to suppress unnecessary tensorflow prints when building tutorials on github server
2022-11-15 14:11:17 -08:00
4d0ad6ed04
Fix multilabel_py dimensionality ( #535 )
...
* Go from a (2**K,) vector to a (K, 2) matrix of prior probabilities.
2022-11-14 15:19:17 +00:00
ab2679724e
Add multilabel tutorial to index.rst ( #533 )
2022-11-14 13:33:12 +00:00
871f08693c
Fix outdates links to example notebook for multilabel classification ( #534 )
2022-11-14 13:28:00 +00:00
c32335c789
Tutorial for multi-label classification ( #517 )
...
clarification re empty list label, thanks to @elisno
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-11 17:13:56 -08:00
10abd7d191
replace pylint --> flake8 in CI ( #531 )
...
* add flake8 configuration in setup.cfg
2022-11-08 16:08:57 +00:00
886e6aee6e
make mypy v0.990 happy ( #530 )
2022-11-08 09:56:51 +00:00
b6ce88d484
clarify mypy flags
2022-11-08 01:53:38 -08:00
9e1e36fcc3
Add a link for How to Contribute in docs ( #505 )
...
* 📝 add section on how to contribute to project
* 📝 add external link to CONTRIBUTING.md
* move contribution guide link to Guides section
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-08 09:18:46 +00:00
7b9c0cf54e
Remove strong worded requirement for out-of-sample pred probs ( #520 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-07 20:10:07 -08:00
2ff42b849f
Make "contributing" explicit ( #528 )
...
It's nice to say the word "contributing" in the readme, and also, it's
nice to clarify that there are valuable non-code contributions as well.
2022-11-07 12:06:32 -08:00
25025d9275
Validate forgetting factor in EMA ( #527 )
...
- Added runtime check that `0 <= alpha <= 1` to ensure EMA uses proportional weighting.
- Moved all EMA tests to separate class.
2022-11-07 15:56:33 +00:00
aceaa4f25e
Improve tutorials intro language/formatting ( #526 )
2022-11-06 00:34:54 -07:00
f37ba9ff39
support missing classes in multilabel tasks ( #523 )
2022-11-04 15:00:43 -07:00
0f4b6a2aa2
Add Cleanlab Studio Banner ( #525 )
2022-11-04 14:38:46 -07:00
16530f40cf
fix mypy typing ( #524 )
2022-11-04 17:25:50 -04:00
1085faca4a
support missing classes in multiannotator functions ( #519 )
2022-11-03 23:25:03 -07:00
9da372bb4d
typecheck with python v3.10 ( #521 )
...
Thanks @huiwengoh for diagnosing this problem!
2022-11-03 23:17:41 -07:00
cbe3ce0f20
move multilabel functions to utils ( #515 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-11-03 10:16:28 -07:00
2bff4d5dd6
Better missing class support for label quality scoring ( #518 )
2022-11-02 18:14:16 -07:00
c2d319d0ed
Add support for missing classes ( #511 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-31 16:23:41 -07:00
8ff371c16c
separate word coloring from token-replacement ( #514 )
...
Fixes #513
2022-10-31 14:21:05 +00:00
b12d76b6d1
Multilabel code restructuring with aggregation/scorer functions ( #509 )
...
_find_label_issues_multilabel uses EMA instead of mean-pooling when computing label quality scores
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-28 16:26:39 -07:00
00d7c2157c
studio pointers ( #510 )
2022-10-25 17:51:00 -07:00
738acae810
Point to format label function for multiannotator ( #506 )
2022-10-25 10:52:21 -07:00
f8a831d239
Add internal function to properly format labels ( #504 )
2022-10-24 10:54:59 -07:00
7761aefa18
Trying to fix typings ( #502 )
...
* Add typing for filter.py
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2022-10-20 21:53:11 +00:00
00781ce984
update paper links ( #503 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2022-10-18 00:01:00 -07:00
e060f551fb
supporting multilabel via one-vs-rest reductions ( #483 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-17 12:09:23 -07:00
26fa264344
Extending label quality scores to multilabel data ( #499 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-13 09:56:43 -07:00
57bcfd0a99
Mypy typechecking fix for num_label_errors ( #500 )
2022-10-07 19:43:40 -07:00
c14c84fc49
note about M1 chip requirements
2022-10-05 21:27:53 -07:00
2906bf6292
Update # issues returned by num_label_issues ( #485 )
...
* Added code and test for returning correct num label issues
* Fixed docstring
* Addressed mypy uncertain typing issue
* Added typing and typing checks
* Addressed PR comments
2022-10-05 20:55:49 -07:00
Jonas Mueller