89866d53b4
make data valuation issue manager user facing ( #925 )
...
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-17 17:49:58 +00:00
5e078339a7
Make Null Issue Manager User-Facing ( #927 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-05 14:15:29 +00:00
7eb9967a0b
class imbalance scores to still show rarest proportion even when is_i… ( #934 )
...
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-02 16:39:27 +00:00
002f898ead
list params for image issues in Datalab guide ( #936 )
2023-12-28 23:46:40 +13:00
e25a14772b
Make underperforming group issue type user facing in Datalab ( #907 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-12-13 16:56:21 +00:00
2e3608a2d8
Predictions for regression in Datalab ( #902 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-12-07 04:26:16 +00:00
dee32ad9a1
Underperforming Group Issue Type ( #838 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-30 16:27:27 +00:00
79a2760ff6
typo fix in custom_issue_manager.rst ( #893 )
2023-11-12 21:50:38 -08:00
69c8c5318c
Add Null Issue Manager ( #856 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-10-30 02:42:54 +00:00
8a1ae01213
various tutorials, docs, language updates ( #847 )
2023-09-08 21:53:55 -07:00
3d50b9859d
Add imbalance issue to datalab ( #758 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-07-28 18:42:15 +00:00
b0fb8e5f77
Move Datalab internals to dedicated internal module ( #783 )
2023-07-28 16:18:51 +00:00
bc78816341
Label Issue Detection Extention ( #760 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-07-27 15:43:34 -04:00
944c61379d
Cleanvision Integration ( #679 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-07-25 15:51:53 +00:00
5eb89fc363
link to papers for details of issue types in guide ( #752 )
2023-06-28 16:04:53 -07:00
9f302200a4
Regression label quality scores ( #572 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-06-23 17:51:46 -07:00
35606fc401
label error detection in semantic segmentation datasets ( #677 )
...
Co-authored-by: Ulyana <ulyana@cleanlab.ai >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-06-23 00:32:08 -07:00
da65a9727f
identifying label errors in Object Detection data ( #676 )
...
Co-authored-by: Aditya Thyagarajan <aditya1593@icloud.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-06-07 01:12:46 -07:00
7ed00cfdf2
clarify order matters for non-IID issue type ( #726 )
2023-05-22 16:28:16 -07:00
525b4b236a
Datalab docs improvements ( #714 )
2023-05-12 11:12:44 -07:00
11f23d64f2
Update pseudocode for example issue type in datalab guide ( #711 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-05-11 11:27:05 -07:00
c41c837e43
Set non iid num issues with an extra rule ( #707 )
...
* feat(datalab): 👔 count number of non-iid issues differently
* fix broken seeding test
* add significance threshold as a parameter
* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager
* test(datalab): ✅ add more end-to-end tests for non-iid issue checks with Datalab
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-05-10 01:33:25 +00:00
cf5d2a02eb
Added installation instructions for package extras ( #697 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-05-09 15:19:24 -04:00
be1bd6903d
Seed noniid permutation tests ( #694 )
2023-05-08 22:50:11 -07:00
036dcf3f95
Add testable example codeblock to functions in the dataset module ( #668 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 01:28:19 +00:00
a95a447010
Update tests for custom issue manager example ( #692 )
...
* issuemanager.get_summary->make_summary
* test(datalab): ♻️ move tests for issue managers into their respective test modules
* test(datalab): ✅ add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager
* test(datalab): add __init__.py for discoverability of issue manager tests
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 00:40:27 +00:00
9ee78be626
Fix report output formatting ( #687 )
...
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-04-28 15:17:41 -04:00
1883cd60ec
Add descriptions of issues that Datalab can detect to docs ( #682 )
...
* docs(datalab): 📝 add a page that describes the issues that Datalab can detect
* docs(datalab): 📝 rewrite sections on datalab docs page
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-04-28 00:01:59 +00:00
64edc95630
Introduce Datalab ( #614 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Jesse Cummings <jecummin@mit.edu >
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-04-25 09:26:43 -07:00
ee5ed9bdf0
Ensure multilabel docs appear in the documentation ( #669 )
2023-04-17 15:38:37 -07:00
6d67175e2a
Extract function for computating ood scores from distances ( #664 )
...
* extract distance-to-score computation to separate function
* move function to a new internal.outlier module
2023-04-07 18:33:45 +00:00
dbc87116ea
Documentation improvements ( #643 )
2023-02-28 16:06:17 -08:00
5319a124d4
Make label_issues_batched documentation appear ( #627 )
2023-02-10 17:30:03 -08:00
6aaee8332b
Create new cleanlab.models module ( #601 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-02-07 10:03:32 -08:00
17a82c32fc
Public multilabel quality scores method + softmin aggregation + more tests ( #542 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2022-11-23 18:34:43 -08:00
b12d76b6d1
Multilabel code restructuring with aggregation/scorer functions ( #509 )
...
_find_label_issues_multilabel uses EMA instead of mean-pooling when computing label quality scores
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-10-28 16:26:39 -07:00
f8a831d239
Add internal function to properly format labels ( #504 )
2022-10-24 10:54:59 -07:00
1b76f4ff1b
Improve docstrings for keras wrapper ( #447 )
...
* improved docstrings for keras wrapper
* hide inheritance from keras wrapper docstrings
* black formatting
2022-09-15 15:36:35 -04:00
9240a8c56d
rst file for keras wrapper
2022-09-15 10:08:12 -07:00
7ccdb5491f
Add keras wrapper to docs ( #443 )
...
* Delete huggingface_keras_classifier.py
* Update keras.py
* readme language, remove huggingfacekerasclassifier
* language improvements
* reorder modules
* make keras.py appear in docs
2022-09-15 00:47:31 -07:00
fd50f6b9c6
Deploy docs for token classification module ( #438 )
...
* docs: 📝 add usage example for get_sentence
Also remove types in docstrings.
* docs: 📝 add usage examples for filter_sentence
* docs: 📝 add page for internal.token_classification_utils
* docs: 📝 remove name of return variable
auto-tagging won't work correctly for the return value if it's not a tuple
* 📝 add pages for modules in cleanlab.token_classification
* fix indentation
* 📝 add token classification api to toctree
* 🎨 format docstrings
* 📝 add usage examples
* update example comment
* 📝 add usage examples
* 📝 add return variable name in docstring
* 📝 remove some hard-coded params types in rank module
Keep more complex parameters hard-coded for now. E.g. "enum"-like parameters.
* 🎨 remove indentation of parameters in docstrings
* 🎨 fix indentation
* colored docstring typo + formatting
* typo: occurence
* probs_merged docstring typo + formatting
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-09-14 14:59:26 -07:00
31d2618560
Improve outliers docstring notations ( #424 )
...
* Docstring remove args test
* exclude members test
Please enter the commit message for your changes. Lines starting
* Adding params as class instance attribute
* Added autoattribute: params
* Adding autoattribute under class
* Removed no-exclude-members and addded params to members
* autoattribute with indent
* Added annotation params
* Revert to removing default params only
* Removed params as instance var listing
* Consist italics vs code syntax in docstring
2022-09-09 12:55:29 -07:00
f6d9fcedde
Added cleanlab.outlier into docs index ( #408 )
2022-09-07 15:57:56 -07:00
31d4370701
Add missing docs pages ( #381 )
...
* add files to show docs for recent source code
* temp delete audio tutorial for docs on M1
* black formatting
2022-08-31 02:28:45 -07:00
dc6fa956cb
Make a pass over docs
2022-04-11 13:15:43 -04:00
5a6fa0bfe3
Make cleanlab.internal a reference-able module
2022-04-09 07:33:24 -04:00
dd9f265912
Make cleanlab.experimental a documented module
...
This lets us cross-reference it.
2022-04-09 07:33:24 -04:00
49b3717edc
Make coarse-grained pass over docs
...
This patch fixes many of the egregious issues with docs rendering.
2022-04-09 07:33:24 -04:00
0be3c70a6e
Move noise_generation into benchmarking module
2022-04-08 20:08:19 -04:00
faac915740
mv example_models -> experimental
2022-04-07 01:25:03 -07:00
ChG