文件历史

提交图

49 次代码提交

作者 SHA1 备注 提交日期
Ganesh Tata e25a14772b Make underperforming group issue type user facing in Datalab (#907)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-12-13 16:56:21 +00:00
Elías Snorrason 2e3608a2d8 Predictions for regression in Datalab (#902)
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-12-07 04:26:16 +00:00
Ganesh Tata dee32ad9a1 Underperforming Group Issue Type (#838)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-11-30 16:27:27 +00:00
Pratham Savaliya 79a2760ff6 typo fix in custom_issue_manager.rst (#893) 2023-11-12 21:50:38 -08:00
ABHIJIT PAL 69c8c5318c Add Null Issue Manager (#856)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-10-30 02:42:54 +00:00
Jonas Mueller 8a1ae01213 various tutorials, docs, language updates (#847) 2023-09-08 21:53:55 -07:00
Tata Ganesh 3d50b9859d Add imbalance issue to datalab (#758)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-07-28 18:42:15 +00:00
Elías Snorrason b0fb8e5f77 Move Datalab internals to dedicated internal module (#783) 2023-07-28 16:18:51 +00:00
Yiran Shi bc78816341 Label Issue Detection Extention (#760)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
2023-07-27 15:43:34 -04:00
Sanjana 944c61379d Cleanvision Integration (#679)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-07-25 15:51:53 +00:00
Jonas Mueller 5eb89fc363 link to papers for details of issue types in guide (#752) 2023-06-28 16:04:53 -07:00
Mayank Kumar 9f302200a4 Regression label quality scores (#572)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
2023-06-23 17:51:46 -07:00
Vedang Lad 35606fc401 label error detection in semantic segmentation datasets (#677)
Co-authored-by: Ulyana <ulyana@cleanlab.ai>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-06-23 00:32:08 -07:00
Ulyana da65a9727f identifying label errors in Object Detection data (#676)
Co-authored-by: Aditya Thyagarajan <aditya1593@icloud.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
2023-06-07 01:12:46 -07:00
Jonas Mueller 7ed00cfdf2 clarify order matters for non-IID issue type (#726) 2023-05-22 16:28:16 -07:00
Hui Wen 525b4b236a Datalab docs improvements (#714) 2023-05-12 11:12:44 -07:00
Jonas Mueller 11f23d64f2 Update pseudocode for example issue type in datalab guide (#711)
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
2023-05-11 11:27:05 -07:00
Elías Snorrason c41c837e43 Set non iid num issues with an extra rule (#707)
* feat(datalab): 👔 count number of non-iid issues differently

* fix broken seeding test

* add significance threshold as a parameter

* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager

* test(datalab):  add more end-to-end tests for non-iid issue checks with Datalab

---------

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-05-10 01:33:25 +00:00
Sanjana cf5d2a02eb Added installation instructions for package extras (#697)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
2023-05-09 15:19:24 -04:00
Elías Snorrason be1bd6903d Seed noniid permutation tests (#694) 2023-05-08 22:50:11 -07:00
Yiran Shi 036dcf3f95 Add testable example codeblock to functions in the dataset module (#668)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-05-03 01:28:19 +00:00
Jonas Mueller a95a447010 Update tests for custom issue manager example (#692)
* issuemanager.get_summary->make_summary

* test(datalab): ♻️ move tests for issue managers into their respective test modules

* test(datalab):  add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager

* test(datalab): add __init__.py for discoverability of issue manager tests

---------

Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-05-03 00:40:27 +00:00
Elías Snorrason 9ee78be626 Fix report output formatting (#687)
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
2023-04-28 15:17:41 -04:00
Elías Snorrason 1883cd60ec Add descriptions of issues that Datalab can detect to docs (#682)
* docs(datalab): 📝 add a page that describes the issues that Datalab can detect

* docs(datalab): 📝 rewrite sections on datalab docs page

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-04-28 00:01:59 +00:00
Elías Snorrason 64edc95630 Introduce Datalab (#614)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Jesse Cummings <jecummin@mit.edu>
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
2023-04-25 09:26:43 -07:00
Jonas Mueller ee5ed9bdf0 Ensure multilabel docs appear in the documentation (#669) 2023-04-17 15:38:37 -07:00
Elías Snorrason 6d67175e2a Extract function for computating ood scores from distances (#664)
* extract distance-to-score computation to separate function
* move function to a new internal.outlier module
2023-04-07 18:33:45 +00:00
Hui Wen dbc87116ea Documentation improvements (#643) 2023-02-28 16:06:17 -08:00
Jonas Mueller 5319a124d4 Make label_issues_batched documentation appear (#627) 2023-02-10 17:30:03 -08:00
Hui Wen 6aaee8332b Create new cleanlab.models module (#601)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-02-07 10:03:32 -08:00
Jonas Mueller 17a82c32fc Public multilabel quality scores method + softmin aggregation + more tests (#542)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2022-11-23 18:34:43 -08:00
Aditya Thyagarajan b12d76b6d1 Multilabel code restructuring with aggregation/scorer functions (#509)
_find_label_issues_multilabel uses EMA instead of mean-pooling when computing label quality scores

Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2022-10-28 16:26:39 -07:00
Hui Wen f8a831d239 Add internal function to properly format labels (#504) 2022-10-24 10:54:59 -07:00
Jonas Mueller 1b76f4ff1b Improve docstrings for keras wrapper (#447)
* improved docstrings for keras wrapper

* hide inheritance from keras wrapper docstrings

* black formatting
2022-09-15 15:36:35 -04:00
Jonas Mueller 9240a8c56d rst file for keras wrapper 2022-09-15 10:08:12 -07:00
Jonas Mueller 7ccdb5491f Add keras wrapper to docs (#443)
* Delete huggingface_keras_classifier.py

* Update keras.py

* readme language, remove huggingfacekerasclassifier

* language improvements

* reorder modules

* make keras.py appear in docs
2022-09-15 00:47:31 -07:00
Elías Snorrason fd50f6b9c6 Deploy docs for token classification module (#438)
* docs: 📝 add usage example for get_sentence

Also remove types in docstrings.

* docs: 📝 add usage examples for filter_sentence

* docs: 📝 add page for internal.token_classification_utils

* docs: 📝 remove name of return variable

auto-tagging won't work correctly for the return value if it's not a tuple

* 📝 add pages for modules in cleanlab.token_classification

* fix indentation

* 📝 add token classification api to toctree

* 🎨 format docstrings

* 📝 add usage examples

* update example comment

* 📝 add usage examples

* 📝 add return variable name in docstring

* 📝 remove some hard-coded params types in rank module

Keep more complex parameters hard-coded for now. E.g. "enum"-like parameters.

* 🎨 remove indentation of parameters in docstrings

* 🎨 fix indentation

* colored docstring typo + formatting

* typo: occurence

* probs_merged docstring typo + formatting

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2022-09-14 14:59:26 -07:00
Ulyana 31d2618560 Improve outliers docstring notations (#424)
* Docstring remove args test

* exclude members test

Please enter the commit message for your changes. Lines starting

* Adding params as class instance attribute

* Added autoattribute: params

* Adding autoattribute under class

* Removed no-exclude-members and addded params to members

* autoattribute with indent

* Added annotation params

* Revert to removing default params only

* Removed params as instance var listing

* Consist italics vs code syntax in docstring
2022-09-09 12:55:29 -07:00
Ulyana f6d9fcedde Added cleanlab.outlier into docs index (#408) 2022-09-07 15:57:56 -07:00
Jonas Mueller 31d4370701 Add missing docs pages (#381)
* add files to show docs for recent source code

* temp delete audio tutorial for docs on M1

* black formatting
2022-08-31 02:28:45 -07:00
Anish Athalye dc6fa956cb Make a pass over docs 2022-04-11 13:15:43 -04:00
Anish Athalye 5a6fa0bfe3 Make cleanlab.internal a reference-able module 2022-04-09 07:33:24 -04:00
Anish Athalye dd9f265912 Make cleanlab.experimental a documented module
This lets us cross-reference it.
2022-04-09 07:33:24 -04:00
Anish Athalye 49b3717edc Make coarse-grained pass over docs
This patch fixes many of the egregious issues with docs rendering.
2022-04-09 07:33:24 -04:00
Anish Athalye 0be3c70a6e Move noise_generation into benchmarking module 2022-04-08 20:08:19 -04:00
Jonas Mueller faac915740 mv example_models -> experimental 2022-04-07 01:25:03 -07:00
Jonas Mueller 423e5b0a07 Polish the APIs and file-structure to prepare for 2.0 release (#181)
* Makes some methods private that are not intended to be user-facing.
* Adds experimental module with fasttext.py and coteaching.py
* Adds header descriptions to code files which will render in docs
* Many miscellaneous fixes
2022-04-06 21:04:06 -07:00
Jonas Mueller 7b2340b638 Utilites -> internal submodule refactor (#141)
* utilities -> internals

* docbuilding instructions improvement

* fixup formatting of contributing.md

* change contributor guidelines language to be optional

* line formatting
2022-03-28 09:53:10 -07:00
Wei Jing Lok da686a4006 update doc toc for 2.0 2022-03-24 03:28:14 +08:00