6ab83fc37c
language improvements ( #380 )
2022-08-30 16:38:56 -07:00
960c2b4ac1
CL functionality for multiannotator data ( #333 )
...
* setup multiannotator functionality
* add docstring
* add unittests
* edit get label quality with nan helper func
* docstring edits
* handle non overlapping annotators in get_annotator_agreement_with_annotators
* return NaN annotator quality scores for non-overlapping annotators
* add unittest
* add unittests for get_consensus_label tiebreaks
* np.array -> np.ndarray
* add new annotator quality method
* docstring edits
* address comments, docstring changes
* add method to compute improved consensus labels
* separate detailed_label_quality return
* elif statement typo
* changed get_majority_vote_label
* add 'best_quality' as a consensus method
* change lqs kwargs naming
* change lqs kwargs naming
* change unittest function names
* docstring edits
* change get_worst_class to return class with lowest agreement with consensus
* edit method to get annotator lqs, change quality_of_consensus -> consensus_quality_score
* remove unnecessary args
* satisfy mypy checks
* fix mypy issue
* add unittests
* reshuffled order of functions
* address comments
* docstring edit
* change return to always return dict
* add clipping to prevent negative pred_probs
* add tutorial
* add multiannotator to tutorial index
* add newline
* add tiebreaks for best_quality labels and worst_class
* change auto method name to crowdlab
* fix indexing for non numeric anno names
* add test for nonnumeric anno names
* update unittest
* address comments [partially complete]
* edit metadata
* missing /details tag
* bugfix to allow pd Int64 types
* update tutorial
* address comments
2022-08-30 11:29:06 -07:00
1bad2f82a2
Adding functionality for cleanlab to find label errors in token classification datasets ( #347 )
...
* add token_classification functionality
* add typing
* fix typing
* add typing
* fixed typing and black
* fix typing
2022-08-30 09:17:07 -07:00
bf83c553bf
make pred_probs naming consistent in tutorials ( #345 )
...
* rename cv_pred_probs to pred_probs
* revert python version
2022-08-17 19:52:25 -07:00
104e72dc07
typo
2022-08-05 09:27:49 -07:00
4efb7df63f
missing/rare class comment ( #332 )
2022-08-03 12:52:09 -07:00
9a26254adc
language improvements
2022-07-28 13:43:39 -07:00
85844e55cd
section headers in outlier tutorial
2022-07-28 00:11:05 -07:00
a0a8e15346
flip precision-recall plot ( #326 )
2022-07-27 16:37:24 -07:00
86bedb39fa
missing backtick
2022-07-26 17:54:17 -07:00
c6feb2ff40
Improved versioning compatibility for audio tutorial ( #325 )
...
* Addressed issue @292
2022-07-26 15:58:19 -07:00
346d101acd
Clarify language
2022-07-26 12:49:57 -07:00
b481a74d0d
Updated tutorials to include quickstart ( #323 )
...
* Added runnable package versioning for tutorials
Added quickstart at top of tutorials
* Addressed PR comments
* Fixed quickstart to include cleanlearning
* Set correct requirements.txt
* Updated y to labels
* Fixed y-> labels labeling issues
* Updated quickstart message/removed extra dependencies
* remove keras from package-versions
* more concise
* remove pathlib as explicit requirement
* remove pathlib version
* rewording
* true label -> given label
* remove venv from kernelspec
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-07-26 00:52:13 -07:00
d8a207b971
remove broken links
2022-07-25 22:55:27 -07:00
571f29ddcd
model accuracy -> label error detection performance
2022-07-25 21:22:10 -07:00
268e43e6ee
Some FAQ tips on how to improve CleanLearning ( #324 )
...
* cleanlearning tips
* addessed comments
* add a few general tips at the end
* minor edits
* format pred_probs as variable type
* bug fix to pass lint (missing comma)
* fix format for linter
Co-authored-by: Curtis G. Northcutt <curtis.northcutt@gmail.com >
2022-07-25 21:12:50 -07:00
a0e1227ae5
Allow KNN object to be returned by get_outlier_scores, Improved Tutorial ( #319 )
...
* knn return, improved tutorial
* typing fix for tuple
* add timm to docs-requirements
* language improvements
* declare typing of outlier_scores
2022-07-25 12:40:58 -07:00
b8e85284c6
Added outlier detection tutorial into docs ( #310 )
...
* Added outlier detection tutorial into docs
* Switched to pytorch model/dataset implementation
* Fixed image normalization
* Fixed outlier detection for test set
* Added outlier thresholding into tutorial.
* Cleaned output
* Removed unused imports and renamed notebook
* Added outliers notebook to PR
* Added quickstart into tutorial
* Best quickstart header
* Cleaned cell output
* Changed to use subset of original data for speed
* Fixed randomness
* Cleared outputs
* fixed metadata tags
* Fixed metadata
* Cleaned kernel and verified output
* Improved unit test
Changed labels references to classes where apropriate
2022-07-22 15:40:03 -07:00
ffbe47835e
update slack link ( #313 )
...
* update slack link
* slack links in docs
* slack link in ISSUE_TEMPLATE
2022-07-20 18:31:39 -07:00
36bfddc354
Added 4 more FAQs to faq doc ( #303 )
...
* Added new questions in FAQ
* Added 4 other FAQs
* language / code-format edits
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-07-01 18:01:48 -07:00
f7328e8b67
Created FAQ Page in the Cleanlab documentation ( #294 )
...
* Create FAQ page in cleanlab docs
* Add FAQ notebook to store answers to frequently asked questions
* Improved formatting issues for faq page
- added faq to sidebar
* Improved formatting issues for faq page
- added faq to sidebar
- changed email to comply with CLA
* Removed faq numbering
- Removed notebook output metadata
- Added notebook to index for left table link
* Text and example rewritten for clarity
- How do I format labels for cleanlab-- example improved
- How do I format labels for cleanlab-- text amended
- Can't find an answer to your question-- added links
* add links to issues/slack
Co-authored-by: Ulyana Tkachenko <uly@ulyana.lan >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-06-29 10:24:50 -07:00
69551fbd38
downgrade tensorflow-io ( #290 )
...
https://github.com/tensorflow/io/issues/1687
2022-06-24 06:05:03 -07:00
c8701485ba
downgrade huggingface_hub version ( #289 )
...
https://github.com/speechbrain/speechbrain/issues/1459
2022-06-24 05:45:28 -07:00
28a1a7aa0e
Merge pull request #264 from cgnorthcutt/fix_thresholds_multilabel
...
Fix bug. get thresholds broken for multi_label
2022-06-20 11:10:53 -07:00
f918b82d80
Provide example label formats in tutorials ( #279 )
...
* example label formatting
* example label format in text tutorial
* example label format for tabular tutorial
* y -> full_labels
* example label format for audio tutorial
* clarify input shapes in image tutorial
* clarify input shapes in text tutorial
* clarify input shapes in tabular tutorial
* clarify input shapes for audio tutorial
2022-06-16 11:41:56 -07:00
7aa34a33ba
Fix bug. get thresholds broken for multi_label
2022-05-20 21:55:32 -04:00
aede5bd7db
Fix some typos. ( #242 )
2022-04-23 12:17:20 -04:00
73f947e952
Address tutorial points of confusion ( #233 )
...
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on windows-latest (push) Has been cancelled
CI / Test: Python 3.9 on windows-latest (push) Has been cancelled
CI / Format (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.6 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.6 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.10 on windows-latest (push) Has been cancelled
CI / Test: Python 3.6 on windows-latest (push) Has been cancelled
CI / Test: Python 3.7 on windows-latest (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
* address tutorial points of confusion
* fix typo indices k --> num_classes - 1
Co-authored-by: Curtis G. Northcutt <curtis.northcutt@gmail.com >
2022-04-20 14:46:13 -04:00
79a7e8af82
Make small fixes ( #235 )
2022-04-20 14:16:14 -04:00
31c939ff9a
Generalize text tutorial to multiclass datasets ( #229 )
...
* generalize text tutorial to multiclass datasets
* fixed typo
* fixed misspelling
* separate cell for num_classes
less likely to be missed if users skip the previous cell to load their own datasets
* removing pycharm metadata
* print classes
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-04-18 21:34:32 -07:00
7a8104c83f
Add tutorial toc page ( #230 )
...
* add tutorials index page
* update link to all tutorials
* fix old readme links
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-04-18 13:02:24 -07:00
d8ab4e910b
fix black formatting compliance ( #224 )
...
* fix black formatting compliance
* remove codecov for verbose statements
2022-04-17 21:57:15 -04:00
d7c128cd93
Final docs polishing patches ( #223 )
...
* plot_examples named with can skip
* respecify auto overflow handling
2022-04-16 15:46:32 -07:00
766c13b646
Make dataset tutorial runnable on website docs, improve pulldown formatting ( #220 )
...
* tutorial runnable on website, pulldown formatting
* add note re pulldown for colab users
* darkDF, remove auto-overflow handling
* tell colab users they can ignore bottom checks
2022-04-16 14:56:44 -07:00
31d2f2dbd7
add condition to deploy if ref_type is tag
2022-04-16 23:17:48 +08:00
966acf8a61
final tutorial edits. dataset docstrings imp ( #217 )
...
* final tutorial edits. dataset docstrings imp
* add back instructions for user installation
* remove useless pycharm metadata.
* remove extraneous comma
2022-04-15 23:00:17 -04:00
57733c704d
Formats dataset health tutorial ( #216 )
...
* dataset health tutorial pulldown format
* tutorial ordering in sidebar
* pulldown format, bullet format
* reformat pulldown indepth tutorial
* shorten data fetching header
* adjust spacing
2022-04-15 18:15:23 -07:00
1de5853043
Move HTML df display settings
2022-04-15 16:29:58 -07:00
7ea03c6dbe
Move HTML df display settings
2022-04-15 16:29:27 -07:00
09432eb7b6
Configure DataFrame style
2022-04-15 15:57:05 -07:00
9879428c6b
Configure DataFrame style
2022-04-15 15:47:13 -07:00
72a62edac3
Dark plots ( #211 )
...
* white background for plot
* fix quote
* darkplot
2022-04-15 02:18:08 -07:00
9dd8420e67
Tutorial header-levels decreased ( #210 )
...
* tutorial header-levels decreased
* reduce plot size to docs output window
2022-04-14 21:35:14 -07:00
d397cdebb6
Add in-depth tutorial [WIP] ( #208 )
...
* add in-depth tutorial and remove pandas install in tutorials
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-04-14 17:46:58 -07:00
831d55da6b
Revise audio tutorial
...
This patch also simplifies the code a bit by switching from `os.walk` to
`os.listdir`.
2022-04-09 07:33:24 -04:00
993c831294
Revise tabular tutorial
2022-04-09 07:33:24 -04:00
c8566216bd
Revise text tutorial
2022-04-09 07:33:24 -04:00
acd3d040a5
Revise image tutorial
2022-04-09 07:33:24 -04:00
d91597e282
Revise pred_probs_cross_val
2022-04-09 07:33:24 -04:00
973b12205a
more specific filter-warning ( #193 )
...
Should not be using nonspecific filter-warning in tutorials, that is too broad.
2022-04-08 20:44:12 -07:00
Jonas Mueller