e843938185
Added unit test for max prevalence
2023-09-01 16:54:33 +01:00
0a7c05cb8e
Fixed test
2023-08-31 18:24:19 +01:00
fd2506c6b0
Use rare class proportion instead of mean values for imbalance score ( #828 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-08-28 14:24:24 +00:00
83731599be
Expose low memory option for finding label issues in classification ( #791 )
2023-08-11 00:35:51 -04:00
ee65553a05
Increase hypothesis deadline for testing near duplicate sets ( #802 )
2023-08-08 14:46:02 -04:00
3d50b9859d
Add imbalance issue to datalab ( #758 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-07-28 18:42:15 +00:00
b0fb8e5f77
Move Datalab internals to dedicated internal module ( #783 )
2023-07-28 16:18:51 +00:00
bc78816341
Label Issue Detection Extention ( #760 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-07-27 15:43:34 -04:00
cc0fb470d9
Update near-duplicate sets ( #781 )
2023-07-26 17:12:20 +00:00
944c61379d
Cleanvision Integration ( #679 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-07-25 15:51:53 +00:00
43e24ba3f6
Make labels optional in Datalab ( #730 )
...
* feat(datalab): ✨ make labels optional
* test(datalab): ✅ fix test case for comparing empty list/array
2023-06-05 16:04:13 +00:00
375c76fcea
Include non-iid in default issue checks ( #723 )
...
* flag no more than one example having non-iid issue
* feat(datalab): ✨ add non-iid to default issue checks
2023-05-19 20:30:01 +00:00
7400051a95
Fix unbound knn variable in NonIIDIssueManager ( #709 )
2023-05-10 21:38:47 -07:00
fcc9417a3d
Simplify reporting for outlier issues ( #705 )
2023-05-10 01:49:17 +00:00
d16cdd67cf
Suppress too_slow health check for dataset generation strategy ( #706 )
2023-05-10 01:48:45 +00:00
c41c837e43
Set non iid num issues with an extra rule ( #707 )
...
* feat(datalab): 👔 count number of non-iid issues differently
* fix broken seeding test
* add significance threshold as a parameter
* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager
* test(datalab): ✅ add more end-to-end tests for non-iid issue checks with Datalab
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-05-10 01:33:25 +00:00
cf5d2a02eb
Added installation instructions for package extras ( #697 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
Co-authored-by: huiwengoh <45724323+huiwengoh@users.noreply.github.com >
2023-05-09 15:19:24 -04:00
be1bd6903d
Seed noniid permutation tests ( #694 )
2023-05-08 22:50:11 -07:00
5ee2eb8be9
Drop summary scores from Datalab.report() ( #699 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-05-04 22:15:41 -04:00
a95a447010
Update tests for custom issue manager example ( #692 )
...
* issuemanager.get_summary->make_summary
* test(datalab): ♻️ move tests for issue managers into their respective test modules
* test(datalab): ✅ add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager
* test(datalab): add __init__.py for discoverability of issue manager tests
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 00:40:27 +00:00
f8b11d37b6
refactor(datalab): ♻️ rename get_summary -> get_issue_summary ( #691 )
...
This only pertains to Datalab/DataIssues. IssueManager has a different method with the get_summary name that is used in a different way.
2023-05-02 19:15:31 +00:00
5650a87d85
Remove the "health_summary_kwargs" dictionary argument from LabelIssueManager ( #683 )
2023-04-28 00:01:05 +00:00
ff3bdd1e48
Add a less restrictive Reporter.report() method for Datalab ( #680 )
...
Add a new method `Reporter.report()` with fewer restrictions. The existing `get_report()` method is a pure function that returns a string as output. The new `report()` method can have side-effects, such as printing the report.
2023-04-27 18:23:01 +00:00
64edc95630
Introduce Datalab ( #614 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Jesse Cummings <jecummin@mit.edu >
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-04-25 09:26:43 -07:00
Sanjana Garg