文件历史

提交图

18 次代码提交

作者 SHA1 备注 提交日期
Elías Snorrason 2e3608a2d8 Predictions for regression in Datalab (#902)
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-12-07 04:26:16 +00:00
Ganesh Tata dee32ad9a1 Underperforming Group Issue Type (#838)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-11-30 16:27:27 +00:00
Elías Snorrason e9ee35f075 Test properties of near duplicate sets (#895)
* create and test strategy for generating knn_graph as test inputs

* test strategy for generating knn_graphs

- Each row has the distances sorted in ascending order in the csr-format.
- The indices of the neighbors are unique within a column and don't have the query point as a neighbor.
- If points a and b are mutual neighbors, they have the same distance between them.

* add property based tests for near-duplicate sets

* flag near-duplicate issues based on items in near duplicate sets.
2023-11-28 15:06:48 +00:00
ChG 5fbf6c0493 Add Data Valuation Issue Manager (#850)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-11-06 17:04:57 +01:00
ABHIJIT PAL ccb4a90e38 Extend non-iid issue check to run if only pred_probs are provided (#857)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-10-30 02:55:53 +00:00
ABHIJIT PAL 69c8c5318c Add Null Issue Manager (#856)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-10-30 02:42:54 +00:00
Ulyana a28f0f1dad Uly dataset health (#875)
* Remove datasets from the tutorial that are logits
* Update dataset code
* Change hardcoded expected score in datalab tests
2023-10-25 01:21:58 +00:00
Tata Ganesh fd2506c6b0 Use rare class proportion instead of mean values for imbalance score (#828)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-08-28 14:24:24 +00:00
Tata Ganesh 83731599be Expose low memory option for finding label issues in classification (#791) 2023-08-11 00:35:51 -04:00
Elías Snorrason ee65553a05 Increase hypothesis deadline for testing near duplicate sets (#802) 2023-08-08 14:46:02 -04:00
Tata Ganesh 3d50b9859d Add imbalance issue to datalab (#758)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-07-28 18:42:15 +00:00
Elías Snorrason b0fb8e5f77 Move Datalab internals to dedicated internal module (#783) 2023-07-28 16:18:51 +00:00
Elías Snorrason cc0fb470d9 Update near-duplicate sets (#781) 2023-07-26 17:12:20 +00:00
Elías Snorrason 43e24ba3f6 Make labels optional in Datalab (#730)
* feat(datalab):  make labels optional

* test(datalab):  fix test case for comparing empty list/array
2023-06-05 16:04:13 +00:00
Elías Snorrason c41c837e43 Set non iid num issues with an extra rule (#707)
* feat(datalab): 👔 count number of non-iid issues differently

* fix broken seeding test

* add significance threshold as a parameter

* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager

* test(datalab):  add more end-to-end tests for non-iid issue checks with Datalab

---------

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-05-10 01:33:25 +00:00
Elías Snorrason be1bd6903d Seed noniid permutation tests (#694) 2023-05-08 22:50:11 -07:00
Jonas Mueller a95a447010 Update tests for custom issue manager example (#692)
* issuemanager.get_summary->make_summary

* test(datalab): ♻️ move tests for issue managers into their respective test modules

* test(datalab):  add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager

* test(datalab): add __init__.py for discoverability of issue manager tests

---------

Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-05-03 00:40:27 +00:00
Elías Snorrason 64edc95630 Introduce Datalab (#614)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Jesse Cummings <jecummin@mit.edu>
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
2023-04-25 09:26:43 -07:00