cb51891b06
lowering swap score for multiple labels associated with a box ( #750 )
...
* Lower swap scores for overlapping annotations + Optional arguments correction
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Ulyana <ulya.tkach@gmail.com >
2023-07-12 20:29:20 +05:30
afdb667501
change inspect.getfullargspec to signature in CleanLearning ( #761 )
2023-07-05 11:44:43 -07:00
cb4c05cbff
Add support for high dimensional arrays in CleanLearning( #749 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-06-27 00:12:52 -04:00
9f302200a4
Regression label quality scores ( #572 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-06-23 17:51:46 -07:00
35606fc401
label error detection in semantic segmentation datasets ( #677 )
...
Co-authored-by: Ulyana <ulyana@cleanlab.ai >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-06-23 00:32:08 -07:00
860bd6f551
Dont print recompute joint warning when estimation_method = off_calibrated_custom ( #746 )
2023-06-18 17:02:51 -07:00
299d66f3ec
Update object detection tutorial to clarify out-of-sample predictions ( #745 )
...
* Add out-of-sample clarification to notebook, fix filename check, add unit tests
2023-06-15 13:14:30 -07:00
d3302c074e
include n_jobs in cleanlearning kwargs docstring ( #744 )
2023-06-12 21:09:53 -07:00
7d84aa47cd
Bugfix object detection visualize function( #739 )
2023-06-07 21:11:30 -07:00
bf3b56ca4c
Add note about tensorflow>=2.11 ( #738 )
2023-06-07 17:39:27 -04:00
da65a9727f
identifying label errors in Object Detection data ( #676 )
...
Co-authored-by: Aditya Thyagarajan <aditya1593@icloud.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-06-07 01:12:46 -07:00
43e24ba3f6
Make labels optional in Datalab ( #730 )
...
* feat(datalab): ✨ make labels optional
* test(datalab): ✅ fix test case for comparing empty list/array
2023-06-05 16:04:13 +00:00
114201bf76
ENH: make clipping unnecessary for entropy ( #703 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-05-25 00:49:30 -04:00
72d4595ab8
Delete repeated lines in CleanLearning.save_space ( #724 )
2023-05-19 16:47:28 -04:00
375c76fcea
Include non-iid in default issue checks ( #723 )
...
* flag no more than one example having non-iid issue
* feat(datalab): ✨ add non-iid to default issue checks
2023-05-19 20:30:01 +00:00
6e59db3d15
bump version past v2.4 ( #721 )
2023-05-16 16:31:18 -07:00
832a544efe
update readme for datalab release ( #713 )
2023-05-12 16:10:10 -07:00
70d70f2a41
multilabel docs formatting fixes ( #717 )
2023-05-12 12:51:59 -07:00
4198e0af33
headers for multilabel_classification modules docs ( #716 )
2023-05-12 12:51:28 -07:00
87d9b73fe7
Clarify when datalab quality score is / isnt comparable ( #710 )
...
* clarify where quality is / isnt comparable
* clarify comparability of quality scores in docstrings
* tell user not to be worried if they dont understand info
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-11 15:34:34 +00:00
7400051a95
Fix unbound knn variable in NonIIDIssueManager ( #709 )
2023-05-10 21:38:47 -07:00
fcc9417a3d
Simplify reporting for outlier issues ( #705 )
2023-05-10 01:49:17 +00:00
c41c837e43
Set non iid num issues with an extra rule ( #707 )
...
* feat(datalab): 👔 count number of non-iid issues differently
* fix broken seeding test
* add significance threshold as a parameter
* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager
* test(datalab): ✅ add more end-to-end tests for non-iid issue checks with Datalab
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-05-10 01:33:25 +00:00
cf5d2a02eb
Added installation instructions for package extras ( #697 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-05-09 15:19:24 -04:00
be1bd6903d
Seed noniid permutation tests ( #694 )
2023-05-08 22:50:11 -07:00
79cc3eb601
DOC: use default rules for shorter, more readable links ( #700 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-05-04 23:51:38 -04:00
5ee2eb8be9
Drop summary scores from Datalab.report() ( #699 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-05-04 22:15:41 -04:00
036dcf3f95
Add testable example codeblock to functions in the dataset module ( #668 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 01:28:19 +00:00
a95a447010
Update tests for custom issue manager example ( #692 )
...
* issuemanager.get_summary->make_summary
* test(datalab): ♻️ move tests for issue managers into their respective test modules
* test(datalab): ✅ add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager
* test(datalab): add __init__.py for discoverability of issue manager tests
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 00:40:27 +00:00
f8b11d37b6
refactor(datalab): ♻️ rename get_summary -> get_issue_summary ( #691 )
...
This only pertains to Datalab/DataIssues. IssueManager has a different method with the get_summary name that is used in a different way.
2023-05-02 19:15:31 +00:00
e33b757fa0
MAINT: standardize documentation and simplify code for outlier ( #689 )
2023-05-01 19:16:19 -04:00
2d00c91f40
Update numpy.typing import and annotations ( #688 )
...
* refactor: ♻️ move numpy.typing under TYPE_CHECKING and add future annotations
2023-05-01 16:58:48 +00:00
9ee78be626
Fix report output formatting ( #687 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-04-28 15:17:41 -04:00
d5e81f0c6d
allow for kwargs in token find_label_issues ( #686 )
2023-04-28 10:28:39 -07:00
5650a87d85
Remove the "health_summary_kwargs" dictionary argument from LabelIssueManager ( #683 )
2023-04-28 00:01:05 +00:00
ff3bdd1e48
Add a less restrictive Reporter.report() method for Datalab ( #680 )
...
Add a new method `Reporter.report()` with fewer restrictions. The existing `get_report()` method is a pure function that returns a string as output. The new `report()` method can have side-effects, such as printing the report.
2023-04-27 18:23:01 +00:00
6353e5473d
Improve Datalab docstrings and fix "See also" block ( #678 )
...
docs(datalab): 🎨 fix indentation in docstring
docs(datalab): 📝 fix see-also block
docs(datalab): 📝 Set path of info return variable to DataIssues.get_info
Autodoc automatically links "info" to "`info <Datalab.info>`, which is not the expected output.
2023-04-25 22:31:41 +00:00
64edc95630
Introduce Datalab ( #614 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Jesse Cummings <jecummin@mit.edu >
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-04-25 09:26:43 -07:00
ee5ed9bdf0
Ensure multilabel docs appear in the documentation ( #669 )
2023-04-17 15:38:37 -07:00
d45a508ed6
Update softmax to be more numerically stable ( #667 )
2023-04-14 22:23:40 -05:00
f8c1866c58
move methods to multilabel_classification module ( #657 )
...
adds new dataset summarization methods for multilabel settings
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-04-13 21:50:11 -07:00
1e653def93
remove min batch size restriction in LabelInspector ( #665 )
2023-04-11 13:05:02 -07:00
2435a5a27f
Added code block examples for remaining methods in the cleanlab.dataset module ( #663 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-04-07 17:42:13 -07:00
6d67175e2a
Extract function for computating ood scores from distances ( #664 )
...
* extract distance-to-score computation to separate function
* move function to a new internal.outlier module
2023-04-07 18:33:45 +00:00
352d904491
Add Example codeblock to the docstrings of important functions in the dataset module ( #662 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-04-05 21:29:22 -07:00
64c6cfcdd5
Pass confident joint computed in CleanLearning to filter.find_label_issues ( #661 )
2023-04-05 21:21:17 -07:00
29a930df37
bump git version past stable version ( #659 )
2023-03-28 22:42:47 -07:00
7519e5d1f2
update version for 2.3.1 release ( #658 )
CI / Check for unused/wildcard imports (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.10 on windows-latest (push) Has been cancelled
CI / Test: Python 3.7 on windows-latest (push) Has been cancelled
CI / Test: Python 3.8 on windows-latest (push) Has been cancelled
CI / Test: Python 3.9 on windows-latest (push) Has been cancelled
CI / Type check (push) Has been cancelled
CI / Format (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
2023-03-27 23:25:24 -07:00
fa1db6e1d5
Bug fixes + improvements to multiannotator module ( #654 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-03-20 23:36:41 -07:00
00776646a7
Fix bug with call to find_overlapping_issues without specifying labels ( #652 )
...
* fix None labels issue
* build: ➕ add hypothesis to dev dependencies. Used for property-based testing
* test: ✅ test that find_overlapping_classes can run by only providing a confident joint
Resolves #651
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-03-13 15:37:00 +00:00
Aditya Thyagarajan