Elías Snorrason
1ab92f7fdc
Update scikit-learn version range
...
CI / Test: Python 3.10 on windows (push) Has been cancelled
CI / Test: Python 3.7 on windows (push) Has been cancelled
CI / Test: Python 3.8 on windows (push) Has been cancelled
CI / Test: Python 3.9 on windows (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Test without optional dependencies and with minimum compatible versions of dependencies (push) Has been cancelled
CI / Type check (push) Has been cancelled
CI / Format (push) Has been cancelled
CI / Check for unused/wildcard imports (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
GitHub Pages / deploy (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
GitHub Pages / links (push) Has been cancelled
Scikit-learn released a new version quite recently. Checking if this affects the deployment stage in CI.
2024-01-19 12:03:20 +00:00
Elías Snorrason
6023eb8a9f
temporarily cap tensorflow version
...
Tensorflow has released version 2.16.0 on PyPI, which is messing with CI where some tests are failing.
This change should be reverted in the near future before our next release.
2024-01-18 16:39:05 +00:00
Elías Snorrason
8c83ae8ae4
Postprocess opengraph urls ( #959 )
...
Update find-replace patterns
2024-01-18 15:01:54 +00:00
Elías Snorrason
9315431410
Add missing ref to url links in OpenGraph metadata ( #958 )
...
Attempt to find-replace meta tags with proper urls
2024-01-17 23:03:12 +00:00
ChG
89866d53b4
make data valuation issue manager user facing ( #925 )
...
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-17 17:49:58 +00:00
Elías Snorrason
15bec56103
Rescale ood scores in outlier package ( #953 )
...
Co-authored-by: Ulyana <ulya.tkach@gmail.com >
2024-01-17 17:42:23 +00:00
Elías Snorrason
a8d2170f0d
add extention to docs for Open Graph metadata ( #881 )
2024-01-16 18:10:50 +00:00
Anish Athalye
1bd16eec41
Ignore hash for GitHub URLs ( #956 )
...
The HTML page returned by GitHub no longer contains ID attributes for
line numbers or headers (from user's Markdown files); the functionality
is implemented in JavaScript now.
2024-01-12 22:16:10 +00:00
Aditya Thyagarajan
b2de6bbefb
add property based test for multilabel classification ( #945 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-10 14:55:09 +00:00
Aditya Thyagarajan
ae085b45b5
ensure near-predicted labels are not flagged as label issue ( #950 )
...
* ensure near-predicted labels are not flagged as label issue
2024-01-10 11:39:28 +05:30
Reuven Peleg
a4b1612528
Update segmentation.ipynb ( #948 )
2024-01-09 15:00:59 +00:00
Elías Snorrason
3526e4e8db
Clarify knn_graph data ordering/formatting when user-provided ( #878 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2024-01-08 18:23:31 -08:00
Elías Snorrason
0a03742f52
Refactor batching logic in cleanlab.segmentation.filter.find_label_issues ( #918 )
2024-01-08 11:30:25 +00:00
Jonas Mueller
594307eda8
link to near duplicate handling code + other tutorial updates ( #931 )
2024-01-05 14:47:48 +00:00
Ganesh Tata
5e078339a7
Make Null Issue Manager User-Facing ( #927 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-05 14:15:29 +00:00
Elías Snorrason
23af72a2bd
Near duplicate score transformation ( #943 )
2024-01-05 01:04:16 +00:00
Elías Snorrason
9ecfea1316
switch rarest class column to given label column ( #940 )
...
follow-up to #933
2024-01-03 10:00:56 +00:00
Ganesh Tata
b806cba4aa
Add imbalance class label to Issues Dataframe ( #933 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-03 08:35:02 +00:00
Jonas Mueller
7eb9967a0b
class imbalance scores to still show rarest proportion even when is_i… ( #934 )
...
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-02 16:39:27 +00:00
Sanjana
002f898ead
list params for image issues in Datalab guide ( #936 )
2023-12-28 23:46:40 +13:00
Ryan Singman
bc10585352
Patch: epsilon for near duplicate ( #919 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-12-21 13:03:51 +00:00
Elías Snorrason
c94f136cb0
Add a section to FAQs on handling near-duplicate examples ( #913 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-12-21 10:58:15 +00:00
Yiran Shi
03d5c968b9
Report class metrics for object detection dataset ( #877 )
...
* Add support to per-class metrics for Object detection, thanks @Steven-Yiran
2023-12-19 09:22:20 +05:30
Jonas Mueller
afe1fdb748
remove class imbalance section from the quickstart ( #924 )
2023-12-18 16:58:43 +00:00
Ganesh Tata
15d39c5703
FEAT: Vectorize loops, bug fix ( #917 )
...
- Vectorize for loops for speedup
- Get null rows correctly
2023-12-18 15:24:38 +00:00
Ganesh Tata
7b720c8fd8
Add Non-IID section for datalab text tutorial ( #916 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-12-15 18:17:41 -08:00
Kyle Gallatin
f3a65b8c18
Issue 873 improve mem find label issues ( #885 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-12-15 12:20:40 +00:00
Ganesh Tata
3fb20e9596
CI: Run slowest tests at the end and fail early ( #900 )
2023-12-14 17:59:28 +00:00
Ganesh Tata
4ad0b6e001
Add Class Imbalance issue type to Datalab defaults ( #912 )
2023-12-14 17:52:41 +00:00
Ganesh Tata
e25a14772b
Make underperforming group issue type user facing in Datalab ( #907 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-12-13 16:56:21 +00:00
Gibson Han
e90dea60c7
702 - Shorten Refs of classes and functions ( #831 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: tataganesh <tataganesh95@gmail.com >
2023-12-07 13:37:16 +00:00
Elías Snorrason
2e3608a2d8
Predictions for regression in Datalab ( #902 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-12-07 04:26:16 +00:00
Elías Snorrason
4ac43c0a26
Restrict termcolor dependency to versions below 2.4.0 ( #905 )
...
Temporary fix, to be reverted.
2023-12-05 01:28:36 +00:00
Ganesh Tata
dee32ad9a1
Underperforming Group Issue Type ( #838 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-30 16:27:27 +00:00
Elías Snorrason
e9ee35f075
Test properties of near duplicate sets ( #895 )
...
* create and test strategy for generating knn_graph as test inputs
* test strategy for generating knn_graphs
- Each row has the distances sorted in ascending order in the csr-format.
- The indices of the neighbors are unique within a column and don't have the query point as a neighbor.
- If points a and b are mutual neighbors, they have the same distance between them.
* add property based tests for near-duplicate sets
* flag near-duplicate issues based on items in near duplicate sets.
2023-11-28 15:06:48 +00:00
Aditya Thyagarajan
09d95dc47f
add false negative support for ObjectLab2D ( #883 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-21 18:39:18 +00:00
Jonas Mueller
3afe8fe480
last sentence of datalab quickstart tutorial
...
motivate folks to check out the examples notebook so they see Datalab applied to real dataset
2023-11-21 00:05:13 -08:00
OrdoAbChao
a6d1319327
Introduce regression support to Datalab ( #796 )
...
Preleminary work to ensure that default task (classification) will work smoothly.
Minimal implementation of label issue manager for regression
- issue_finder.py list_possible_issue_types, list_default_issue_types no longer a static methods as they depend on task and modification of get_available_issue_types for regression
* DataIssues with strategy pattern
- moving list_possible_issue_types and list_default_issue_types from the IssueFinder class to cleanlab/datalab/internal/issue_manager_factory.py
* make different strategies for getting available issue types
add test class for the IssueFinder when the task is regression
* apply black formatter
* avoid mapping labels column for regression in Datalab
* Pass in features to LabelIssueManager for regression
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-20 20:28:53 +00:00
Ganesh Tata
0903c2a361
Non-IID: Test that Datalab prioritizes knn-graph over pred-probs ( #897 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-16 15:21:59 +00:00
Ganesh Tata
aeab1d1577
Extract Common Setup Code in Non-IID Tests for Reusability ( #896 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-16 10:48:30 +00:00
Pratham Savaliya
79a2760ff6
typo fix in custom_issue_manager.rst ( #893 )
2023-11-12 21:50:38 -08:00
ChG
5fbf6c0493
Add Data Valuation Issue Manager ( #850 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-06 17:04:57 +01:00
Jonas Mueller
19efa9ab0b
wording
2023-11-04 02:11:32 -07:00
Elías Snorrason
afafe4e9f5
Bump lower bounds of datasets library for docs ( #880 )
...
* bump lower bounds of datasets for docs dependencies
* update lower bounds of huggingface_hub in docs requirements
2023-11-02 14:59:37 +00:00
Elías Snorrason
0344afcf8b
Address mypy issue ( #879 )
2023-11-01 03:49:07 +00:00
ABHIJIT PAL
ccb4a90e38
Extend non-iid issue check to run if only pred_probs are provided ( #857 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-10-30 02:55:53 +00:00
ABHIJIT PAL
69c8c5318c
Add Null Issue Manager ( #856 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-10-30 02:42:54 +00:00
Ulyana
a28f0f1dad
Uly dataset health ( #875 )
...
* Remove datasets from the tutorial that are logits
* Update dataset code
* Change hardcoded expected score in datalab tests
2023-10-25 01:21:58 +00:00
Jonas Mueller
18fab35bb9
title for docs
2023-10-17 15:37:45 -04:00
Yiran Shi
902fb487c9
Functions to explore object detection dataset ( #840 )
...
Add dataset summary functions+plots to object detection.
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Ulyana <ulyana@cleanlab.ai >
2023-10-16 13:17:05 -07:00