64edc95630
Introduce Datalab ( #614 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Jesse Cummings <jecummin@mit.edu >
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-04-25 09:26:43 -07:00
ee5ed9bdf0
Ensure multilabel docs appear in the documentation ( #669 )
2023-04-17 15:38:37 -07:00
d45a508ed6
Update softmax to be more numerically stable ( #667 )
2023-04-14 22:23:40 -05:00
f8c1866c58
move methods to multilabel_classification module ( #657 )
...
adds new dataset summarization methods for multilabel settings
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-04-13 21:50:11 -07:00
1e653def93
remove min batch size restriction in LabelInspector ( #665 )
2023-04-11 13:05:02 -07:00
2435a5a27f
Added code block examples for remaining methods in the cleanlab.dataset module ( #663 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-04-07 17:42:13 -07:00
6d67175e2a
Extract function for computating ood scores from distances ( #664 )
...
* extract distance-to-score computation to separate function
* move function to a new internal.outlier module
2023-04-07 18:33:45 +00:00
352d904491
Add Example codeblock to the docstrings of important functions in the dataset module ( #662 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-04-05 21:29:22 -07:00
64c6cfcdd5
Pass confident joint computed in CleanLearning to filter.find_label_issues ( #661 )
2023-04-05 21:21:17 -07:00
29a930df37
bump git version past stable version ( #659 )
2023-03-28 22:42:47 -07:00
7519e5d1f2
update version for 2.3.1 release ( #658 )
CI / Check for unused/wildcard imports (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.10 on windows-latest (push) Has been cancelled
CI / Test: Python 3.7 on windows-latest (push) Has been cancelled
CI / Test: Python 3.8 on windows-latest (push) Has been cancelled
CI / Test: Python 3.9 on windows-latest (push) Has been cancelled
CI / Type check (push) Has been cancelled
CI / Format (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
2023-03-27 23:25:24 -07:00
fa1db6e1d5
Bug fixes + improvements to multiannotator module ( #654 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-03-20 23:36:41 -07:00
00776646a7
Fix bug with call to find_overlapping_issues without specifying labels ( #652 )
...
* fix None labels issue
* build: ➕ add hypothesis to dev dependencies. Used for property-based testing
* test: ✅ test that find_overlapping_classes can run by only providing a confident joint
Resolves #651
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-03-13 15:37:00 +00:00
70a2ed2fa2
Add clipping of small probabilities to address issue #639 ( #647 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-03-12 20:51:03 -07:00
44081c6538
add activelab name to docs ( #648 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-03-12 20:26:04 -07:00
2a16c473fc
post v2.3.0 release version bump ( #646 )
2023-03-12 20:23:37 -07:00
38e1dab34d
bump version number
2023-03-01 00:39:35 -08:00
dbc87116ea
Documentation improvements ( #643 )
2023-02-28 16:06:17 -08:00
570ecbdcb8
Switch to typing.Self ( #489 )
...
PEP 673 [1] introduces `typing.Self` as a simple way to annotate methods
that return an instance of their class. This patch adopts `typing.Self`.
Because this is only included in Python 3.11, for backwards
compatibility, this patch adds typing-extensions [2], an
officially-supported module that is designed for enabling use of new
type system features on older Python versions.
We don't want to make typing-extensions a runtime dependency, so we add
a guard and only import it when we're `TYPE_CHECKING`.
[1]: https://peps.python.org/pep-0673/
[2]: https://pypi.org/project/typing-extensions/
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-02-19 09:55:41 -05:00
3757637d8c
Fix batched multiprocessing being slower on tall matrices ( #634 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-15 13:14:39 -08:00
c85bc7e589
default n_jobs in label issues batched to =1 ( #633 )
2023-02-13 17:04:55 -08:00
731dd419a1
Support Zarr files in find_label_issues_batched ( #632 )
2023-02-12 23:59:26 -08:00
8c424d3b0d
mypy tpye annotations
2023-02-12 22:06:40 -08:00
f4572dc543
bugfix: missing self.n_jobs
2023-02-12 21:31:59 -08:00
4850050803
label_issues_batched multiprocessing ( #630 )
...
4x speedup (48 cores, 10k classes x 1M examples)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-12 20:25:02 -08:00
6acc7aead1
Clarify rank.py not for multi-label classification ( #626 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-12 19:45:20 -08:00
4d2753ae05
Fix KerasWrapper summary method ( #631 )
2023-02-12 18:40:52 -08:00
ac98282dcb
add example script for find_label_issues_batched ( #629 )
2023-02-10 18:29:00 -08:00
686cbf63f1
Method to estimate label issues with limited memory via mini-batches ( #615 )
...
Co-authored-by: clu0 <33559427+clu0@users.noreply.github.com >
2023-02-10 16:59:16 -08:00
d99788b9de
Fixed duplicate issue removal in find_label_issues ( #624 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-10 08:28:29 -08:00
5f6493f509
fix bug: confidences -> confidence ( #623 )
2023-02-09 16:33:47 -08:00
6aaee8332b
Create new cleanlab.models module ( #601 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-02-07 10:03:32 -08:00
c191d8781d
Fix format compatibility with latest black==23. release ( #620 )
2023-02-07 10:01:45 -08:00
35d5323479
Fix dictionary type annotation for OutOfDistribution object ( #616 )
...
* Also improve params dict default to be None
2023-02-01 20:07:31 -08:00
0c02ec953b
Add two methods to filter.find_label_issues ( #595 )
...
"low_self_confidence" or "low_ normalized_margin"
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-31 23:26:20 -08:00
888246e2d5
Improve num_label_issues usage of confident_joint to match find_label_issues ( #610 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-27 14:47:02 -08:00
2b6c56424d
10x speedup in find_label_issues on linux via better multiprocessing ( #596 )
...
and bug fixes related to partition vs sort
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-19 20:14:03 -05:00
503a57adaf
Adding type hints for mypy strict compatibility ( #585 )
...
* Handling missing type & docs in cleanlab/token_classification_utils.py 🏷️
- Added typehints for the cleanlabs/token_classification_utils.py file for mypy strict mode
- Fixed corresponding docstrings refers #587
* Handling missing type & docs in cleanlab/multilabel_classification.py 🏷️
- Fixing all errors for mypy strict for the file
* docs(internal): fix "number of new classes" variable in docstring
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-01-10 13:46:16 +00:00
71e21a983a
remove temp scaling from ensemble active learning when data has single annotator ( #597 )
2023-01-09 14:12:19 -08:00
4a5d0653fe
Handle missing type parameters for generic type "ndarray" ( #587 )
...
* refactor(multi-label): 🏷️ parametrize `NDArray`
A generic type variable, `T`, that represents the precision of a data type.
While the data types for probabilities and scores are identical, it conceptually makes sense to define separate type aliases for each.
`np` is only used in defining the floating data type, which is only used for type hints.
* mention shape of array in the docstring description
+ other clarity improvements
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-07 14:45:50 +00:00
7b589f6d63
updating copyright year to include 2023 ( #594 )
2023-01-06 21:25:57 -08:00
ebadffdebe
Use euclidean distance for identifying outliers for lower dimensional features ( #581 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-06 21:25:23 -08:00
d911acc7e8
Remove temp scaling from single annotator case ( #590 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-06 09:54:01 -08:00
fdfb029001
clarify thresholding in issues_from_scores ( #582 )
2023-01-06 08:55:42 -08:00
248bb91378
Revamp text tutorial to use cleanlab Keras wrapper ( #584 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-01-06 08:53:02 -08:00
27340b0d5f
fix(multi-label docstring example): 📝 make score array two-dimensional ( #573 )
2022-12-23 15:59:23 -08:00
75bac0a284
Specify Sphinx to order functions by source code order ( #571 )
...
also re-order rank.py functions by moving specific types of label-quality scores to be last in file
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-12-22 09:14:44 -08:00
c0b4e58471
multiannotator explanation improvements ( #570 )
...
more clarification when to use active learning vs fixed dataset analysis functions
2022-12-22 00:35:18 -08:00
f61469420b
Multiannotator Active Learning Support ( #538 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-12-21 18:31:24 -08:00
f18279856f
Update version.py ( #550 )
2022-12-16 23:32:41 -08:00
Elías Snorrason