* create and test strategy for generating knn_graph as test inputs
* test strategy for generating knn_graphs
- Each row has the distances sorted in ascending order in the csr-format.
- The indices of the neighbors are unique within a column and don't have the query point as a neighbor.
- If points a and b are mutual neighbors, they have the same distance between them.
* add property based tests for near-duplicate sets
* flag near-duplicate issues based on items in near duplicate sets.
Preleminary work to ensure that default task (classification) will work smoothly.
Minimal implementation of label issue manager for regression
- issue_finder.py list_possible_issue_types, list_default_issue_types no longer a static methods as they depend on task and modification of get_available_issue_types for regression
* DataIssues with strategy pattern
- moving list_possible_issue_types and list_default_issue_types from the IssueFinder class to cleanlab/datalab/internal/issue_manager_factory.py
* make different strategies for getting available issue types
add test class for the IssueFinder when the task is regression
* apply black formatter
* avoid mapping labels column for regression in Datalab
* Pass in features to LabelIssueManager for regression
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
* clarify where quality is / isnt comparable
* clarify comparability of quality scores in docstrings
* tell user not to be worried if they dont understand info
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
* feat(datalab): 👔 count number of non-iid issues differently
* fix broken seeding test
* add significance threshold as a parameter
* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager
* test(datalab): ✅ add more end-to-end tests for non-iid issue checks with Datalab
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
* issuemanager.get_summary->make_summary
* test(datalab): ♻️ move tests for issue managers into their respective test modules
* test(datalab): ✅ add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager
* test(datalab): add __init__.py for discoverability of issue manager tests
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
Add a new method `Reporter.report()` with fewer restrictions. The existing `get_report()` method is a pure function that returns a string as output. The new `report()` method can have side-effects, such as printing the report.
docs(datalab): 🎨 fix indentation in docstring
docs(datalab): 📝 fix see-also block
docs(datalab): 📝 Set path of info return variable to DataIssues.get_info
Autodoc automatically links "info" to "`info <Datalab.info>`, which is not the expected output.
Ganesh Tata