文件历史

提交图

11 次代码提交

作者 SHA1 备注 提交日期
Tata Ganesh fd2506c6b0 Use rare class proportion instead of mean values for imbalance score (#828)
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-08-28 14:24:24 +00:00
Tata Ganesh 83731599be Expose low memory option for finding label issues in classification (#791) 2023-08-11 00:35:51 -04:00
Elías Snorrason ee65553a05 Increase hypothesis deadline for testing near duplicate sets (#802) 2023-08-08 14:46:02 -04:00
Tata Ganesh 3d50b9859d Add imbalance issue to datalab (#758)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-07-28 18:42:15 +00:00
Elías Snorrason b0fb8e5f77 Move Datalab internals to dedicated internal module (#783) 2023-07-28 16:18:51 +00:00
Elías Snorrason cc0fb470d9 Update near-duplicate sets (#781) 2023-07-26 17:12:20 +00:00
Elías Snorrason 43e24ba3f6 Make labels optional in Datalab (#730)
* feat(datalab):  make labels optional

* test(datalab):  fix test case for comparing empty list/array
2023-06-05 16:04:13 +00:00
Elías Snorrason c41c837e43 Set non iid num issues with an extra rule (#707)
* feat(datalab): 👔 count number of non-iid issues differently

* fix broken seeding test

* add significance threshold as a parameter

* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager

* test(datalab):  add more end-to-end tests for non-iid issue checks with Datalab

---------

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2023-05-10 01:33:25 +00:00
Elías Snorrason be1bd6903d Seed noniid permutation tests (#694) 2023-05-08 22:50:11 -07:00
Jonas Mueller a95a447010 Update tests for custom issue manager example (#692)
* issuemanager.get_summary->make_summary

* test(datalab): ♻️ move tests for issue managers into their respective test modules

* test(datalab):  add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager

* test(datalab): add __init__.py for discoverability of issue manager tests

---------

Co-authored-by: Elías Snorrason <eliassno@gmail.com>
2023-05-03 00:40:27 +00:00
Elías Snorrason 64edc95630 Introduce Datalab (#614)
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Jesse Cummings <jecummin@mit.edu>
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com>
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com>
2023-04-25 09:26:43 -07:00