980c6ddc07
Extend package support Python 10-14 + relax dependencies ( #1276 )
2026-01-07 14:11:40 -08:00
bed10f5bdf
Fix numpy2 compatibility ( #1224 )
2025-01-10 20:06:05 -08:00
f7a29560ec
Add issue manager for detecting identifier columns in features ( #1120 )
...
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-10-23 14:54:18 +00:00
280db6acac
Assign cluster score for all underperforming clusters ( #1180 )
2024-08-15 19:23:42 +00:00
ffdbe77dc6
Enhance knn-based outlier detection in Datalab ( #1163 )
2024-06-25 15:53:56 +00:00
2a68fd7205
Improve knn graph handling and outlier detection in issue managers ( #1155 )
2024-06-24 23:49:33 +00:00
25b7aaba7e
Improve KNN Graph Construction for Handling Exact Duplicates and Numerical Precision ( #1119 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2024-05-24 14:04:53 +00:00
3effc12d6a
Improve null value checking by switching from np.isnan to pd.isna ( #1096 )
2024-05-23 02:34:29 +00:00
13442e2ed4
Use existing Datalab to audit new data for outliers ( #1112 )
2024-04-24 02:48:23 +00:00
0221f8b0a1
Fix internal multilabel label ( #1087 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-04-10 21:24:18 +00:00
2f2bc1fe18
Refine Scoring and Enhance Stability for Datasets with Identical Examples ( #1056 )
...
Enhance numerical stability and scoring accuracy for datasets with identical features
- Adjust minimum median values to 100x machine epsilon to prevent unstable operations.
- Implement specific scoring logic for outlier and near-duplicate issues in datasets with identical features, ensuring correct scores are assigned in such edge cases.
- Introduce unit tests to validate the expected behavior for datasets comprising entirely identical examples. Check an additional case with an extra unique example.
Related to issue #1055 .
2024-03-19 12:41:49 +00:00
90ac796213
Transform regression label quality scores ( #1032 )
2024-03-05 17:15:21 +00:00
16c5866a8b
Add Task enum for specifying machine learning task within Datalab ( #971 )
2024-02-08 15:35:38 -07:00
070b6e5b42
Fix dev dependencies (pytest and black formatter) ( #975 )
2024-02-01 17:42:56 +00:00
51de77768d
Multilabel Issue Manager for Classification ( #929 )
...
* Add Multilabel label issue manager
* Add task validation in Datalab constructor
* Add type checks for labels in issue managers
* Refactor code to use Datalab for finding label issues in multi-label classification tutorial
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-24 00:14:04 +00:00
89866d53b4
make data valuation issue manager user facing ( #925 )
...
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-17 17:49:58 +00:00
15bec56103
Rescale ood scores in outlier package ( #953 )
...
Co-authored-by: Ulyana <ulya.tkach@gmail.com >
2024-01-17 17:42:23 +00:00
5e078339a7
Make Null Issue Manager User-Facing ( #927 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-05 14:15:29 +00:00
23af72a2bd
Near duplicate score transformation ( #943 )
2024-01-05 01:04:16 +00:00
b806cba4aa
Add imbalance class label to Issues Dataframe ( #933 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-03 08:35:02 +00:00
7eb9967a0b
class imbalance scores to still show rarest proportion even when is_i… ( #934 )
...
Co-authored-by: Ganesh Tata <tataganesh95@gmail.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2024-01-02 16:39:27 +00:00
bc10585352
Patch: epsilon for near duplicate ( #919 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-12-21 13:03:51 +00:00
15d39c5703
FEAT: Vectorize loops, bug fix ( #917 )
...
- Vectorize for loops for speedup
- Get null rows correctly
2023-12-18 15:24:38 +00:00
2e3608a2d8
Predictions for regression in Datalab ( #902 )
...
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-12-07 04:26:16 +00:00
dee32ad9a1
Underperforming Group Issue Type ( #838 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-30 16:27:27 +00:00
e9ee35f075
Test properties of near duplicate sets ( #895 )
...
* create and test strategy for generating knn_graph as test inputs
* test strategy for generating knn_graphs
- Each row has the distances sorted in ascending order in the csr-format.
- The indices of the neighbors are unique within a column and don't have the query point as a neighbor.
- If points a and b are mutual neighbors, they have the same distance between them.
* add property based tests for near-duplicate sets
* flag near-duplicate issues based on items in near duplicate sets.
2023-11-28 15:06:48 +00:00
5fbf6c0493
Add Data Valuation Issue Manager ( #850 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-11-06 17:04:57 +01:00
ccb4a90e38
Extend non-iid issue check to run if only pred_probs are provided ( #857 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-10-30 02:55:53 +00:00
69c8c5318c
Add Null Issue Manager ( #856 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-10-30 02:42:54 +00:00
a28f0f1dad
Uly dataset health ( #875 )
...
* Remove datasets from the tutorial that are logits
* Update dataset code
* Change hardcoded expected score in datalab tests
2023-10-25 01:21:58 +00:00
fd2506c6b0
Use rare class proportion instead of mean values for imbalance score ( #828 )
...
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-08-28 14:24:24 +00:00
83731599be
Expose low memory option for finding label issues in classification ( #791 )
2023-08-11 00:35:51 -04:00
ee65553a05
Increase hypothesis deadline for testing near duplicate sets ( #802 )
2023-08-08 14:46:02 -04:00
3d50b9859d
Add imbalance issue to datalab ( #758 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-07-28 18:42:15 +00:00
b0fb8e5f77
Move Datalab internals to dedicated internal module ( #783 )
2023-07-28 16:18:51 +00:00
cc0fb470d9
Update near-duplicate sets ( #781 )
2023-07-26 17:12:20 +00:00
43e24ba3f6
Make labels optional in Datalab ( #730 )
...
* feat(datalab): ✨ make labels optional
* test(datalab): ✅ fix test case for comparing empty list/array
2023-06-05 16:04:13 +00:00
c41c837e43
Set non iid num issues with an extra rule ( #707 )
...
* feat(datalab): 👔 count number of non-iid issues differently
* fix broken seeding test
* add significance threshold as a parameter
* docs(datalab): 📝 add docs on significance_threshold argument for non-iid issue manager
* test(datalab): ✅ add more end-to-end tests for non-iid issue checks with Datalab
---------
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2023-05-10 01:33:25 +00:00
be1bd6903d
Seed noniid permutation tests ( #694 )
2023-05-08 22:50:11 -07:00
a95a447010
Update tests for custom issue manager example ( #692 )
...
* issuemanager.get_summary->make_summary
* test(datalab): ♻️ move tests for issue managers into their respective test modules
* test(datalab): ✅ add tests for custom issue manager
- Validate scores provided to IssueManager.make_summary
- Move fixture for custom issue manager to conftest.py
- Test make_summary on a "custom" IssueManager
* test(datalab): add __init__.py for discoverability of issue manager tests
---------
Co-authored-by: Elías Snorrason <eliassno@gmail.com >
2023-05-03 00:40:27 +00:00
64edc95630
Introduce Datalab ( #614 )
...
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
Co-authored-by: Jesse Cummings <jecummin@mit.edu >
Co-authored-by: Jesse Cummings <jecummin@users.noreply.github.com >
Co-authored-by: Hui Wen <45724323+huiwengoh@users.noreply.github.com >
2023-04-25 09:26:43 -07:00
Ulyana