832a544efe
update readme for datalab release ( #713 )
2023-05-12 16:10:10 -07:00
70d70f2a41
multilabel docs formatting fixes ( #717 )
2023-05-12 12:51:59 -07:00
4198e0af33
headers for multilabel_classification modules docs ( #716 )
2023-05-12 12:51:28 -07:00
87d9b73fe7
Clarify when datalab quality score is / isnt comparable ( #710 )
...
* clarify where quality is / isnt comparable
* clarify comparability of quality scores in docstrings
* tell user not to be worried if they dont understand info
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-11 15:34:34 +00:00
7400051a95
Fix unbound knn variable in NonIIDIssueManager ( #709 )
2023-05-10 21:38:47 -07:00
fcc9417a3d
Simplify reporting for outlier issues ( #705 )
2023-05-10 01:49:17 +00:00
c41c837e43
Set non iid num issues with an extra rule ( #707 )
...
* feat(datalab): 👔 count number of non-iid issues differently
* fix broken seeding test
* add significance threshold as a parameter
* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager
* test(datalab): ✅ add more end-to-end tests for non-iid issue checks with Datalab
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-05-10 01:33:25 +00:00
cf5d2a02eb
Added installation instructions for package extras ( #697 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-05-09 15:19:24 -04:00
be1bd6903d
Seed noniid permutation tests ( #694 )
2023-05-08 22:50:11 -07:00
79cc3eb601
DOC: use default rules for shorter, more readable links ( #700 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-05-04 23:51:38 -04:00
5ee2eb8be9
Drop summary scores from Datalab.report() ( #699 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-05-04 22:15:41 -04:00
036dcf3f95
Add testable example codeblock to functions in the dataset module ( #668 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 01:28:19 +00:00
a95a447010
Update tests for custom issue manager example ( #692 )
...
* issuemanager.get_summary->make_summary
* test(datalab): ♻️ move tests for issue managers into their respective test modules
* test(datalab): ✅ add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager
* test(datalab): add __init__.py for discoverability of issue manager tests
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 00:40:27 +00:00
f8b11d37b6
refactor(datalab): ♻️ rename get_summary -> get_issue_summary ( #691 )
...
This only pertains to Datalab/DataIssues. IssueManager has a different method with the get_summary name that is used in a different way.
2023-05-02 19:15:31 +00:00
e33b757fa0
MAINT: standardize documentation and simplify code for outlier ( #689 )
2023-05-01 19:16:19 -04:00
2d00c91f40
Update numpy.typing import and annotations ( #688 )
...
* refactor: ♻️ move numpy.typing under TYPE_CHECKING and add future annotations
2023-05-01 16:58:48 +00:00
9ee78be626
Fix report output formatting ( #687 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-04-28 15:17:41 -04:00
d5e81f0c6d
allow for kwargs in token find_label_issues ( #686 )
2023-04-28 10:28:39 -07:00
5650a87d85
Remove the "health_summary_kwargs" dictionary argument from LabelIssueManager ( #683 )
2023-04-28 00:01:05 +00:00
ff3bdd1e48
Add a less restrictive Reporter.report() method for Datalab ( #680 )
...
Add a new method `Reporter.report()` with fewer restrictions. The existing `get_report()` method is a pure function that returns a string as output. The new `report()` method can have side-effects, such as printing the report.
2023-04-27 18:23:01 +00:00
6353e5473d
Improve Datalab docstrings and fix "See also" block ( #678 )
...
docs(datalab): 🎨 fix indentation in docstring
docs(datalab): 📝 fix see-also block
docs(datalab): 📝 Set path of info return variable to DataIssues.get_info
Autodoc automatically links "info" to "`info <Datalab.info>`, which is not the expected output.
2023-04-25 22:31:41 +00:00
64edc95630
Introduce Datalab ( #614 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Jesse Cummings <jecummin@mit.edu >
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-04-25 09:26:43 -07:00
ee5ed9bdf0
Ensure multilabel docs appear in the documentation ( #669 )
2023-04-17 15:38:37 -07:00
d45a508ed6
Update softmax to be more numerically stable ( #667 )
2023-04-14 22:23:40 -05:00
f8c1866c58
move methods to multilabel_classification module ( #657 )
...
adds new dataset summarization methods for multilabel settings
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-04-13 21:50:11 -07:00
1e653def93
remove min batch size restriction in LabelInspector ( #665 )
2023-04-11 13:05:02 -07:00
2435a5a27f
Added code block examples for remaining methods in the cleanlab.dataset module ( #663 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-04-07 17:42:13 -07:00
6d67175e2a
Extract function for computating ood scores from distances ( #664 )
...
* extract distance-to-score computation to separate function
* move function to a new internal.outlier module
2023-04-07 18:33:45 +00:00
352d904491
Add Example codeblock to the docstrings of important functions in the dataset module ( #662 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-04-05 21:29:22 -07:00
64c6cfcdd5
Pass confident joint computed in CleanLearning to filter.find_label_issues ( #661 )
2023-04-05 21:21:17 -07:00
29a930df37
bump git version past stable version ( #659 )
2023-03-28 22:42:47 -07:00
7519e5d1f2
update version for 2.3.1 release ( #658 )
CI / Check for unused/wildcard imports (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.10 on windows-latest (push) Has been cancelled
CI / Test: Python 3.7 on windows-latest (push) Has been cancelled
CI / Test: Python 3.8 on windows-latest (push) Has been cancelled
CI / Test: Python 3.9 on windows-latest (push) Has been cancelled
CI / Type check (push) Has been cancelled
CI / Format (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
2023-03-27 23:25:24 -07:00
fa1db6e1d5
Bug fixes + improvements to multiannotator module ( #654 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-03-20 23:36:41 -07:00
00776646a7
Fix bug with call to find_overlapping_issues without specifying labels ( #652 )
...
* fix None labels issue
* build: ➕ add hypothesis to dev dependencies. Used for property-based testing
* test: ✅ test that find_overlapping_classes can run by only providing a confident joint
Resolves #651
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-03-13 15:37:00 +00:00
70a2ed2fa2
Add clipping of small probabilities to address issue #639 ( #647 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-03-12 20:51:03 -07:00
44081c6538
add activelab name to docs ( #648 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-03-12 20:26:04 -07:00
2a16c473fc
post v2.3.0 release version bump ( #646 )
2023-03-12 20:23:37 -07:00
38e1dab34d
bump version number
2023-03-01 00:39:35 -08:00
dbc87116ea
Documentation improvements ( #643 )
2023-02-28 16:06:17 -08:00
570ecbdcb8
Switch to typing.Self ( #489 )
...
PEP 673 [1] introduces `typing.Self` as a simple way to annotate methods
that return an instance of their class. This patch adopts `typing.Self`.
Because this is only included in Python 3.11, for backwards
compatibility, this patch adds typing-extensions [2], an
officially-supported module that is designed for enabling use of new
type system features on older Python versions.
We don't want to make typing-extensions a runtime dependency, so we add
a guard and only import it when we're `TYPE_CHECKING`.
[1]: https://peps.python.org/pep-0673/
[2]: https://pypi.org/project/typing-extensions/
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-02-19 09:55:41 -05:00
3757637d8c
Fix batched multiprocessing being slower on tall matrices ( #634 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-15 13:14:39 -08:00
c85bc7e589
default n_jobs in label issues batched to =1 ( #633 )
2023-02-13 17:04:55 -08:00
731dd419a1
Support Zarr files in find_label_issues_batched ( #632 )
2023-02-12 23:59:26 -08:00
8c424d3b0d
mypy tpye annotations
2023-02-12 22:06:40 -08:00
f4572dc543
bugfix: missing self.n_jobs
2023-02-12 21:31:59 -08:00
4850050803
label_issues_batched multiprocessing ( #630 )
...
4x speedup (48 cores, 10k classes x 1M examples)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-12 20:25:02 -08:00
6acc7aead1
Clarify rank.py not for multi-label classification ( #626 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-02-12 19:45:20 -08:00
4d2753ae05
Fix KerasWrapper summary method ( #631 )
2023-02-12 18:40:52 -08:00
ac98282dcb
add example script for find_label_issues_batched ( #629 )
2023-02-10 18:29:00 -08:00
686cbf63f1
Method to estimate label issues with limited memory via mini-batches ( #615 )
...
Co-authored-by: clu0 <33559427+clu0@users.noreply.github.com >
2023-02-10 16:59:16 -08:00
Jonas Mueller