mirrors / cleanlab--cleanlab

文件历史

1,649 提交 54 分支 21 Git 标签
add-train-test-clos-tutorial
提交图

64 次代码提交

作者 SHA1 备注 提交日期
ChG 1d5d3ccb5a Fix typo in issue type description guide for Datalab (#1085) 2024-04-06 02:53:12 +00:00
ChG b751269fdc Add user-facing cleanlab.data_valuation module (#1050) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2024-04-04 01:48:20 +00:00
Sanjana 5dcb57948a Update docs/source/cleanlab/datalab/guide/issue_type_description.rst 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2024-03-11 10:31:19 -07:00
Sanjana Garg 76c6594651 Updated image_key documentation 2024-03-08 12:05:06 -08:00
Jonas Mueller 18851072ae Update some pointers in the content (#1039) 2024-03-07 00:22:38 +00:00
Elías Snorrason 231ab6314d List out issue names for each issue type in Datalab Issue Type Guide (#1024) 
- Show how an issue name is used in Datalab.find_issues()
- Add sphinx_jinja as a dependency for using .rst-templates
 2024-02-23 21:49:19 +00:00
Elías Snorrason d77625671d Various docs updates (#1015) 2024-02-16 05:59:36 +00:00
Yiran Shi 79b16e68d1 Single Class Span Classification Support (#982) 
* add single class span classification support
 2024-02-14 20:17:04 +05:30
Elías Snorrason 22287faa25 Registry docstring updates (#1007) 2024-02-12 20:15:48 -08:00
Elías Snorrason 1ed51aa35a Fix issue summary in report.py to omit undetected issue types (#1003) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2024-02-12 16:53:10 -08:00
Elías Snorrason 16c5866a8b Add Task enum for specifying machine learning task within Datalab (#971) 2024-02-08 15:35:38 -07:00
ChG 89866d53b4 make data valuation issue manager user facing (#925) 
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2024-01-17 17:49:58 +00:00
Ganesh Tata 5e078339a7 Make Null Issue Manager User-Facing (#927) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2024-01-05 14:15:29 +00:00
Jonas Mueller 7eb9967a0b class imbalance scores to still show rarest proportion even when is_i… (#934) 
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2024-01-02 16:39:27 +00:00
Sanjana 002f898ead list params for image issues in Datalab guide (#936) 2023-12-28 23:46:40 +13:00
Ganesh Tata e25a14772b Make underperforming group issue type user facing in Datalab (#907) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-12-13 16:56:21 +00:00
Elías Snorrason 2e3608a2d8 Predictions for regression in Datalab (#902) 
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-12-07 04:26:16 +00:00
Ganesh Tata dee32ad9a1 Underperforming Group Issue Type (#838) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-11-30 16:27:27 +00:00
Pratham Savaliya 79a2760ff6 typo fix in custom_issue_manager.rst (#893) 2023-11-12 21:50:38 -08:00
ABHIJIT PAL 69c8c5318c Add Null Issue Manager (#856) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-10-30 02:42:54 +00:00
Jonas Mueller 8a1ae01213 various tutorials, docs, language updates (#847) 2023-09-08 21:53:55 -07:00
Tata Ganesh 3d50b9859d Add imbalance issue to datalab (#758) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-07-28 18:42:15 +00:00
Elías Snorrason b0fb8e5f77 Move Datalab internals to dedicated internal module (#783) 2023-07-28 16:18:51 +00:00
Yiran Shi bc78816341 Label Issue Detection Extention (#760) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
 2023-07-27 15:43:34 -04:00
Sanjana 944c61379d Cleanvision Integration (#679) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-07-25 15:51:53 +00:00
Jonas Mueller 5eb89fc363 link to papers for details of issue types in guide (#752) 2023-06-28 16:04:53 -07:00
Mayank Kumar 9f302200a4 Regression label quality scores (#572) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
 2023-06-23 17:51:46 -07:00
Vedang Lad 35606fc401 label error detection in semantic segmentation datasets (#677) 
Co-authored-by: Ulyana <ulyana@cleanlab.ai>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-06-23 00:32:08 -07:00
Ulyana da65a9727f identifying label errors in Object Detection data (#676) 
Co-authored-by: Aditya Thyagarajan <aditya1593@icloud.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
 2023-06-07 01:12:46 -07:00
Jonas Mueller 7ed00cfdf2 clarify order matters for non-IID issue type (#726) 2023-05-22 16:28:16 -07:00
Hui Wen 525b4b236a Datalab docs improvements (#714) 2023-05-12 11:12:44 -07:00
Jonas Mueller 11f23d64f2 Update pseudocode for example issue type in datalab guide (#711) 
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
 2023-05-11 11:27:05 -07:00
Elías Snorrason c41c837e43 Set non iid num issues with an extra rule (#707) 
* feat(datalab): 👔 count number of non-iid issues differently

* fix broken seeding test

* add significance threshold as a parameter

* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager

* test(datalab): ✅ add more end-to-end tests for non-iid issue checks with Datalab

---------

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-05-10 01:33:25 +00:00
Sanjana cf5d2a02eb Added installation instructions for package extras (#697) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
 2023-05-09 15:19:24 -04:00
Elías Snorrason be1bd6903d Seed noniid permutation tests (#694) 2023-05-08 22:50:11 -07:00
Yiran Shi 036dcf3f95 Add testable example codeblock to functions in the dataset module (#668) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-05-03 01:28:19 +00:00
Jonas Mueller a95a447010 Update tests for custom issue manager example (#692) 
* issuemanager.get_summary->make_summary

* test(datalab): ♻️ move tests for issue managers into their respective test modules

* test(datalab): ✅ add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager

* test(datalab): add __init__.py for discoverability of issue manager tests

---------

Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-05-03 00:40:27 +00:00
Elías Snorrason 9ee78be626 Fix report output formatting (#687) 
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com>
 2023-04-28 15:17:41 -04:00
Elías Snorrason 1883cd60ec Add descriptions of issues that Datalab can detect to docs (#682) 
* docs(datalab): 📝 add a page that describes the issues that Datalab can detect

* docs(datalab): 📝 rewrite sections on datalab docs page

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-04-28 00:01:59 +00:00
Elías Snorrason 64edc95630 Introduce Datalab (#614) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Jesse Cummings <jecummin@mit.edu>
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
 2023-04-25 09:26:43 -07:00
Jonas Mueller ee5ed9bdf0 Ensure multilabel docs appear in the documentation (#669) 2023-04-17 15:38:37 -07:00
Elías Snorrason 6d67175e2a Extract function for computating ood scores from distances (#664) 
* extract distance-to-score computation to separate function
* move function to a new internal.outlier module
 2023-04-07 18:33:45 +00:00
Hui Wen dbc87116ea Documentation improvements (#643) 2023-02-28 16:06:17 -08:00
Jonas Mueller 5319a124d4 Make label_issues_batched documentation appear (#627) 2023-02-10 17:30:03 -08:00
Hui Wen 6aaee8332b Create new cleanlab.models module (#601) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-02-07 10:03:32 -08:00
Jonas Mueller 17a82c32fc Public multilabel quality scores method + softmin aggregation + more tests (#542) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2022-11-23 18:34:43 -08:00
Aditya Thyagarajan b12d76b6d1 Multilabel code restructuring with aggregation/scorer functions (#509) 
_find_label_issues_multilabel uses EMA instead of mean-pooling when computing label quality scores

Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2022-10-28 16:26:39 -07:00
Hui Wen f8a831d239 Add internal function to properly format labels (#504) 2022-10-24 10:54:59 -07:00
Jonas Mueller 1b76f4ff1b Improve docstrings for keras wrapper (#447) 
* improved docstrings for keras wrapper

* hide inheritance from keras wrapper docstrings

* black formatting
 2022-09-15 15:36:35 -04:00
Jonas Mueller 9240a8c56d rst file for keras wrapper 2022-09-15 10:08:12 -07:00