mirrors / cleanlab--cleanlab

提交

1,649 提交 54 分支 21 Git 标签
add-train-test-clos-tutorial
提交图

1649 次代码提交

此分支
此分支
所有分支
作者 SHA1 备注 提交日期
Reuven Peleg a4b1612528 Update segmentation.ipynb (#948) 2024-01-09 15:00:59 +00:00
Elías Snorrason 3526e4e8db Clarify knn_graph data ordering/formatting when user-provided (#878) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2024-01-08 18:23:31 -08:00
Elías Snorrason 0a03742f52 Refactor batching logic in cleanlab.segmentation.filter.find_label_issues (#918) 2024-01-08 11:30:25 +00:00
Jonas Mueller 594307eda8 link to near duplicate handling code + other tutorial updates (#931) 2024-01-05 14:47:48 +00:00
Ganesh Tata 5e078339a7 Make Null Issue Manager User-Facing (#927) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2024-01-05 14:15:29 +00:00
Elías Snorrason 23af72a2bd Near duplicate score transformation (#943) 2024-01-05 01:04:16 +00:00
Elías Snorrason 9ecfea1316 switch rarest class column to given label column (#940) 
follow-up to #933
 2024-01-03 10:00:56 +00:00
Ganesh Tata b806cba4aa Add imbalance class label to Issues Dataframe (#933) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2024-01-03 08:35:02 +00:00
Jonas Mueller 7eb9967a0b class imbalance scores to still show rarest proportion even when is_i… (#934) 
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2024-01-02 16:39:27 +00:00
Sanjana 002f898ead list params for image issues in Datalab guide (#936) 2023-12-28 23:46:40 +13:00
Ryan Singman bc10585352 Patch: epsilon for near duplicate (#919) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-12-21 13:03:51 +00:00
Elías Snorrason c94f136cb0 Add a section to FAQs on handling near-duplicate examples (#913) 
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
 2023-12-21 10:58:15 +00:00
Yiran Shi 03d5c968b9 Report class metrics for object detection dataset (#877) 
* Add support to per-class metrics for Object detection, thanks @Steven-Yiran
 2023-12-19 09:22:20 +05:30
Jonas Mueller afe1fdb748 remove class imbalance section from the quickstart (#924) 2023-12-18 16:58:43 +00:00
Ganesh Tata 15d39c5703 FEAT: Vectorize loops, bug fix (#917) 
- Vectorize for loops for speedup
- Get null rows correctly
 2023-12-18 15:24:38 +00:00
Ganesh Tata 7b720c8fd8 Add Non-IID section for datalab text tutorial (#916) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-12-15 18:17:41 -08:00
Kyle Gallatin f3a65b8c18 Issue 873 improve mem find label issues (#885) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-12-15 12:20:40 +00:00
Ganesh Tata 3fb20e9596 CI: Run slowest tests at the end and fail early (#900) 2023-12-14 17:59:28 +00:00
Ganesh Tata 4ad0b6e001 Add Class Imbalance issue type to Datalab defaults (#912) 2023-12-14 17:52:41 +00:00
Ganesh Tata e25a14772b Make underperforming group issue type user facing in Datalab (#907) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-12-13 16:56:21 +00:00
Gibson Han e90dea60c7 702 - Shorten Refs of classes and functions (#831) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Co-authored-by: tataganesh <tataganesh95@gmail.com>
 2023-12-07 13:37:16 +00:00
Elías Snorrason 2e3608a2d8 Predictions for regression in Datalab (#902) 
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
 2023-12-07 04:26:16 +00:00
Elías Snorrason 4ac43c0a26 Restrict termcolor dependency to versions below 2.4.0 (#905) 
Temporary fix, to be reverted.
 2023-12-05 01:28:36 +00:00
Ganesh Tata dee32ad9a1 Underperforming Group Issue Type (#838) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-11-30 16:27:27 +00:00
Elías Snorrason e9ee35f075 Test properties of near duplicate sets (#895) 
* create and test strategy for generating knn_graph as test inputs

* test strategy for generating knn_graphs

- Each row has the distances sorted in ascending order in the csr-format.
- The indices of the neighbors are unique within a column and don't have the query point as a neighbor.
- If points a and b are mutual neighbors, they have the same distance between them.

* add property based tests for near-duplicate sets

* flag near-duplicate issues based on items in near duplicate sets.
 2023-11-28 15:06:48 +00:00
Aditya Thyagarajan 09d95dc47f add false negative support for ObjectLab2D (#883) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-11-21 18:39:18 +00:00
Jonas Mueller 3afe8fe480 last sentence of datalab quickstart tutorial 
motivate folks to check out the examples notebook so they see Datalab applied to real dataset
 2023-11-21 00:05:13 -08:00
OrdoAbChao a6d1319327 Introduce regression support to Datalab (#796) 
Preleminary work to ensure that default task  (classification) will work smoothly.

Minimal implementation of label issue manager for regression

- issue_finder.py list_possible_issue_types, list_default_issue_types no longer a static methods as they depend on task and modification of get_available_issue_types for regression

* DataIssues with strategy pattern


- moving list_possible_issue_types and list_default_issue_types from the IssueFinder class to cleanlab/datalab/internal/issue_manager_factory.py

* make different strategies for getting available issue types

add test class for the IssueFinder when the task is regression

* apply black formatter

* avoid mapping labels column for regression in Datalab

* Pass in features to LabelIssueManager for regression

---------

Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-11-20 20:28:53 +00:00
Ganesh Tata 0903c2a361 Non-IID: Test that Datalab prioritizes knn-graph over pred-probs (#897) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-11-16 15:21:59 +00:00
Ganesh Tata aeab1d1577 Extract Common Setup Code in Non-IID Tests for Reusability (#896) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-11-16 10:48:30 +00:00
Pratham Savaliya 79a2760ff6 typo fix in custom_issue_manager.rst (#893) 2023-11-12 21:50:38 -08:00
ChG 5fbf6c0493 Add Data Valuation Issue Manager (#850) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-11-06 17:04:57 +01:00
Jonas Mueller 19efa9ab0b wording 2023-11-04 02:11:32 -07:00
Elías Snorrason afafe4e9f5 Bump lower bounds of datasets library for docs (#880) 
* bump lower bounds of datasets for docs dependencies

* update lower bounds of huggingface_hub in docs requirements
 2023-11-02 14:59:37 +00:00
Elías Snorrason 0344afcf8b Address mypy issue (#879) 2023-11-01 03:49:07 +00:00
ABHIJIT PAL ccb4a90e38 Extend non-iid issue check to run if only pred_probs are provided (#857) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-10-30 02:55:53 +00:00
ABHIJIT PAL 69c8c5318c Add Null Issue Manager (#856) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-10-30 02:42:54 +00:00
Ulyana a28f0f1dad Uly dataset health (#875) 
* Remove datasets from the tutorial that are logits
* Update dataset code
* Change hardcoded expected score in datalab tests
 2023-10-25 01:21:58 +00:00
Jonas Mueller 18fab35bb9 title for docs 2023-10-17 15:37:45 -04:00
Yiran Shi 902fb487c9 Functions to explore object detection dataset (#840) 
Add dataset summary functions+plots to object detection.
---------

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Ulyana <ulyana@cleanlab.ai>
 2023-10-16 13:17:05 -07:00
Samet 8b8bf780aa Add PR template and improve gitignore (#867) 
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-10-11 14:20:13 +00:00
Tata Ganesh 55b838944c List in FAQ: Methods that can be sped up with low_memory=True (#869) 2023-10-11 03:01:50 -07:00
Jonas Mueller bd32f1114b ignore keras.io in link check (#865) 2023-10-06 15:29:19 +09:00
Aditya Thyagarajan ffbddc3a9e mypy linting (#864) 
* mypy linting

* summary without type check

* Add test to confirm np.array can be passed into visualize

---------

Co-authored-by: Ulyana <ulya.tkach@gmail.com>
 2023-10-05 15:54:53 -07:00
Tata Ganesh 6d45971cf8 List comprehension to numpy ops for efficiency (#844) 
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
 2023-09-20 19:19:51 +00:00
Jonas Mueller e9cc53eab7 is->has (#851) 2023-09-16 19:34:18 -07:00
Jonas Mueller 86f6eecfd7 fix link (#852) 2023-09-16 19:06:52 -07:00
Jonas Mueller 7257696693 bump version past latest release (#849) 2023-09-16 19:05:33 -07:00
Jonas Mueller d45537ea7d Update RELEASE_VERSIONS for docs conf.py (#846)
CI / Test: Python 3.7 on windows (push) Has been cancelled
CI / Test: Python 3.10 on windows (push) Has been cancelled
CI / Test: Python 3.8 on windows (push) Has been cancelled
CI / Test: Python 3.9 on windows (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Test without optional dependencies and with minimum compatible versions of dependencies (push) Has been cancelled
CI / Type check (push) Has been cancelled
CI / Format (push) Has been cancelled
CI / Check for unused/wildcard imports (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
v2.5.0 		2023-09-11 07:44:09 -07:00
Jonas Mueller adc38a6a88 code snippet format (#848) 2023-09-09 14:50:51 -07:00