570ecbdcb8
Switch to typing.Self ( #489 )
...
PEP 673 [1] introduces `typing.Self` as a simple way to annotate methods
that return an instance of their class. This patch adopts `typing.Self`.
Because this is only included in Python 3.11, for backwards
compatibility, this patch adds typing-extensions [2], an
officially-supported module that is designed for enabling use of new
type system features on older Python versions.
We don't want to make typing-extensions a runtime dependency, so we add
a guard and only import it when we're `TYPE_CHECKING`.
[1]: https://peps.python.org/pep-0673/
[2]: https://pypi.org/project/typing-extensions/
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-02-19 09:55:41 -05:00
6eb60198e6
update tests to be more stringent ( #635 )
2023-02-15 17:34:11 -08:00
3757637d8c
Fix batched multiprocessing being slower on tall matrices ( #634 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-15 13:14:39 -08:00
c85bc7e589
default n_jobs in label issues batched to =1 ( #633 )
2023-02-13 17:04:55 -08:00
731dd419a1
Support Zarr files in find_label_issues_batched ( #632 )
2023-02-12 23:59:26 -08:00
8c424d3b0d
mypy tpye annotations
2023-02-12 22:06:40 -08:00
f4572dc543
bugfix: missing self.n_jobs
2023-02-12 21:31:59 -08:00
4850050803
label_issues_batched multiprocessing ( #630 )
...
4x speedup (48 cores, 10k classes x 1M examples)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-12 20:25:02 -08:00
2adb8b68b0
Removed $ from shell commands to avoid it being copied ( #625 )
2023-02-12 19:46:45 -08:00
6acc7aead1
Clarify rank.py not for multi-label classification ( #626 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-12 19:45:20 -08:00
4d2753ae05
Fix KerasWrapper summary method ( #631 )
2023-02-12 18:40:52 -08:00
ac98282dcb
add example script for find_label_issues_batched ( #629 )
2023-02-10 18:29:00 -08:00
5319a124d4
Make label_issues_batched documentation appear ( #627 )
2023-02-10 17:30:03 -08:00
686cbf63f1
Method to estimate label issues with limited memory via mini-batches ( #615 )
...
Co-authored-by: clu0 <33559427+clu0@users.noreply.github.com >
2023-02-10 16:59:16 -08:00
d99788b9de
Fixed duplicate issue removal in find_label_issues ( #624 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-10 08:28:29 -08:00
5f6493f509
fix bug: confidences -> confidence ( #623 )
2023-02-09 16:33:47 -08:00
e2611e76a1
upgrade torch in docs ( #607 )
...
* upgrade versions of docs dependencies: torch, torchvision, speechbrain, etc
2023-02-07 13:26:35 -08:00
6aaee8332b
Create new cleanlab.models module ( #601 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-02-07 10:03:32 -08:00
c191d8781d
Fix format compatibility with latest black==23. release ( #620 )
2023-02-07 10:01:45 -08:00
6ed61e0bb3
cap black version in CI ( #618 )
2023-02-02 01:13:59 -08:00
266d9479db
shorten notebook name in link ( #617 )
2023-02-01 22:53:02 -08:00
35d5323479
Fix dictionary type annotation for OutOfDistribution object ( #616 )
...
* Also improve params dict default to be None
2023-02-01 20:07:31 -08:00
0c02ec953b
Add two methods to filter.find_label_issues ( #595 )
...
"low_self_confidence" or "low_ normalized_margin"
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-31 23:26:20 -08:00
5c1ba64bea
Removed duplicate classifier from setup.py ( #612 )
2023-01-30 15:56:40 -08:00
d6f40d89b8
crowdlab paper name update
2023-01-30 10:55:11 -08:00
5f9fd95c45
update crowdlab paper name
2023-01-29 23:48:49 -08:00
888246e2d5
Improve num_label_issues usage of confident_joint to match find_label_issues ( #610 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-27 14:47:02 -08:00
f9d32b1352
Update tabular tutorial with better language ( #609 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-24 21:12:34 -05:00
9f655a7f6a
remove slash at end ( #606 )
2023-01-19 21:04:56 -05:00
b9b981dc01
add cleanlab/projects to ignored URLs check list
2023-01-19 20:57:56 -05:00
2b6c56424d
10x speedup in find_label_issues on linux via better multiprocessing ( #596 )
...
and bug fixes related to partition vs sort
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-19 20:14:03 -05:00
a31b3cac78
tags in links ( #604 )
2023-01-19 16:34:36 -05:00
1cf563c2a1
fix typo in outliers.ipynb ( #603 )
...
occuring -> occurring
2023-01-19 14:55:31 -05:00
503a57adaf
Adding type hints for mypy strict compatibility ( #585 )
...
* Handling missing type & docs in cleanlab/token_classification_utils.py 🏷️
- Added typehints for the cleanlabs/token_classification_utils.py file for mypy strict mode
- Fixed corresponding docstrings refers #587
* Handling missing type & docs in cleanlab/multilabel_classification.py 🏷️
- Fixing all errors for mypy strict for the file
* docs(internal): fix "number of new classes" variable in docstring
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-01-10 13:46:16 +00:00
71e21a983a
remove temp scaling from ensemble active learning when data has single annotator ( #597 )
2023-01-09 14:12:19 -08:00
feb3696924
decide -> suggest
2023-01-09 09:31:11 -08:00
4a5d0653fe
Handle missing type parameters for generic type "ndarray" ( #587 )
...
* refactor(multi-label): 🏷️ parametrize `NDArray`
A generic type variable, `T`, that represents the precision of a data type.
While the data types for probabilities and scores are identical, it conceptually makes sense to define separate type aliases for each.
`np` is only used in defining the floating data type, which is only used for type hints.
* mention shape of array in the docstring description
+ other clarity improvements
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-07 14:45:50 +00:00
7b589f6d63
updating copyright year to include 2023 ( #594 )
2023-01-06 21:25:57 -08:00
ebadffdebe
Use euclidean distance for identifying outliers for lower dimensional features ( #581 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-06 21:25:23 -08:00
fe9efda269
update docs dependencies ( #593 )
2023-01-06 14:22:16 -08:00
d911acc7e8
Remove temp scaling from single annotator case ( #590 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-06 09:54:01 -08:00
fdfb029001
clarify thresholding in issues_from_scores ( #582 )
2023-01-06 08:55:42 -08:00
248bb91378
Revamp text tutorial to use cleanlab Keras wrapper ( #584 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-06 08:53:02 -08:00
7caed93784
Update github actions ( #589 )
...
update: github actions to v3, codecov to v3, setup-python to v4, setup node v2 to v3, setup cache v2 to v3
2023-01-05 21:42:34 -08:00
0d9fee88a9
add maximum line length ( #583 )
...
and clarify where black settings are found in DEVELOPMENT guide
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-04 17:31:16 -08:00
aa1542bd71
Drop python 3.6 support from dependencies in setup.py ( #579 )
2023-01-01 22:03:19 -08:00
36b46c195f
mention applications beyond label error detection in readme ( #580 )
2023-01-01 14:24:53 -08:00
9bca415130
Fix broken link
2022-12-31 10:36:32 -05:00
5c60fb623d
Remove python 3.6 support ( #578 )
2022-12-28 18:25:42 -08:00
2c69094da1
drop python 3.6 from CI ( #577 )
...
followup PR will remove mentions of 3.6 support
2022-12-28 14:40:56 -08:00
Anish Athalye