92427d10b3
set data to None to avoid warning
2022-09-06 14:06:41 -07:00
bc8de13927
also demonstrate cleanlearning with pred_probs
...
Thanks @elisno for the suggestion!
2022-09-06 14:01:58 -07:00
1375a27beb
faq on predicted labels ( #402 )
2022-09-06 13:35:30 -07:00
1a09ad2703
more instructions for developing docs/tutorials ( #399 )
...
* more instructions for tutorial checklist
* explain examples notebooks
* dependency question
2022-09-05 17:09:37 -07:00
31d4370701
Add missing docs pages ( #381 )
...
* add files to show docs for recent source code
* temp delete audio tutorial for docs on M1
* black formatting
2022-08-31 02:28:45 -07:00
6ab83fc37c
language improvements ( #380 )
2022-08-30 16:38:56 -07:00
960c2b4ac1
CL functionality for multiannotator data ( #333 )
...
* setup multiannotator functionality
* add docstring
* add unittests
* edit get label quality with nan helper func
* docstring edits
* handle non overlapping annotators in get_annotator_agreement_with_annotators
* return NaN annotator quality scores for non-overlapping annotators
* add unittest
* add unittests for get_consensus_label tiebreaks
* np.array -> np.ndarray
* add new annotator quality method
* docstring edits
* address comments, docstring changes
* add method to compute improved consensus labels
* separate detailed_label_quality return
* elif statement typo
* changed get_majority_vote_label
* add 'best_quality' as a consensus method
* change lqs kwargs naming
* change lqs kwargs naming
* change unittest function names
* docstring edits
* change get_worst_class to return class with lowest agreement with consensus
* edit method to get annotator lqs, change quality_of_consensus -> consensus_quality_score
* remove unnecessary args
* satisfy mypy checks
* fix mypy issue
* add unittests
* reshuffled order of functions
* address comments
* docstring edit
* change return to always return dict
* add clipping to prevent negative pred_probs
* add tutorial
* add multiannotator to tutorial index
* add newline
* add tiebreaks for best_quality labels and worst_class
* change auto method name to crowdlab
* fix indexing for non numeric anno names
* add test for nonnumeric anno names
* update unittest
* address comments [partially complete]
* edit metadata
* missing /details tag
* bugfix to allow pd Int64 types
* update tutorial
* address comments
2022-08-30 11:29:06 -07:00
1bad2f82a2
Adding functionality for cleanlab to find label errors in token classification datasets ( #347 )
...
* add token_classification functionality
* add typing
* fix typing
* add typing
* fixed typing and black
* fix typing
2022-08-30 09:17:07 -07:00
bf83c553bf
make pred_probs naming consistent in tutorials ( #345 )
...
* rename cv_pred_probs to pred_probs
* revert python version
2022-08-17 19:52:25 -07:00
5b05bc5f62
update sphinx to v5 ( #327 )
...
* update sphinx to v5
* update autodocsumm version
* autodocsumm v0.2.9
* upgrade furo
Co-authored-by: calebchiam <calebchiam@gmail.com >
2022-08-08 03:14:28 -07:00
104e72dc07
typo
2022-08-05 09:27:49 -07:00
4efb7df63f
missing/rare class comment ( #332 )
2022-08-03 12:52:09 -07:00
9a26254adc
language improvements
2022-07-28 13:43:39 -07:00
85844e55cd
section headers in outlier tutorial
2022-07-28 00:11:05 -07:00
a0a8e15346
flip precision-recall plot ( #326 )
2022-07-27 16:37:24 -07:00
86bedb39fa
missing backtick
2022-07-26 17:54:17 -07:00
c6feb2ff40
Improved versioning compatibility for audio tutorial ( #325 )
...
* Addressed issue @292
2022-07-26 15:58:19 -07:00
346d101acd
Clarify language
2022-07-26 12:49:57 -07:00
b481a74d0d
Updated tutorials to include quickstart ( #323 )
...
* Added runnable package versioning for tutorials
Added quickstart at top of tutorials
* Addressed PR comments
* Fixed quickstart to include cleanlearning
* Set correct requirements.txt
* Updated y to labels
* Fixed y-> labels labeling issues
* Updated quickstart message/removed extra dependencies
* remove keras from package-versions
* more concise
* remove pathlib as explicit requirement
* remove pathlib version
* rewording
* true label -> given label
* remove venv from kernelspec
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-07-26 00:52:13 -07:00
d8a207b971
remove broken links
2022-07-25 22:55:27 -07:00
571f29ddcd
model accuracy -> label error detection performance
2022-07-25 21:22:10 -07:00
268e43e6ee
Some FAQ tips on how to improve CleanLearning ( #324 )
...
* cleanlearning tips
* addessed comments
* add a few general tips at the end
* minor edits
* format pred_probs as variable type
* bug fix to pass lint (missing comma)
* fix format for linter
Co-authored-by: Curtis G. Northcutt <curtis.northcutt@gmail.com >
2022-07-25 21:12:50 -07:00
a0e1227ae5
Allow KNN object to be returned by get_outlier_scores, Improved Tutorial ( #319 )
...
* knn return, improved tutorial
* typing fix for tuple
* add timm to docs-requirements
* language improvements
* declare typing of outlier_scores
2022-07-25 12:40:58 -07:00
a18d4d2c71
patch missing timm in docs-requirements
2022-07-23 15:52:18 -07:00
31545f1e5c
More guidelines added to docs readme ( #321 )
...
* point to tutorial guidelines
* things not to forget for new tutorials
* docstring editing guidelines
2022-07-23 15:49:29 -07:00
008ad080db
Tips for editing the tutorial notebooks ( #320 )
...
* docs editing tips
2022-07-22 18:17:55 -07:00
b8e85284c6
Added outlier detection tutorial into docs ( #310 )
...
* Added outlier detection tutorial into docs
* Switched to pytorch model/dataset implementation
* Fixed image normalization
* Fixed outlier detection for test set
* Added outlier thresholding into tutorial.
* Cleaned output
* Removed unused imports and renamed notebook
* Added outliers notebook to PR
* Added quickstart into tutorial
* Best quickstart header
* Cleaned cell output
* Changed to use subset of original data for speed
* Fixed randomness
* Cleared outputs
* fixed metadata tags
* Fixed metadata
* Cleaned kernel and verified output
* Improved unit test
Changed labels references to classes where apropriate
2022-07-22 15:40:03 -07:00
ffbe47835e
update slack link ( #313 )
...
* update slack link
* slack links in docs
* slack link in ISSUE_TEMPLATE
2022-07-20 18:31:39 -07:00
36bfddc354
Added 4 more FAQs to faq doc ( #303 )
...
* Added new questions in FAQ
* Added 4 other FAQs
* language / code-format edits
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-07-01 18:01:48 -07:00
f7328e8b67
Created FAQ Page in the Cleanlab documentation ( #294 )
...
* Create FAQ page in cleanlab docs
* Add FAQ notebook to store answers to frequently asked questions
* Improved formatting issues for faq page
- added faq to sidebar
* Improved formatting issues for faq page
- added faq to sidebar
- changed email to comply with CLA
* Removed faq numbering
- Removed notebook output metadata
- Added notebook to index for left table link
* Text and example rewritten for clarity
- How do I format labels for cleanlab-- example improved
- How do I format labels for cleanlab-- text amended
- Can't find an answer to your question-- added links
* add links to issues/slack
Co-authored-by: Ulyana Tkachenko <uly@ulyana.lan >
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-06-29 10:24:50 -07:00
942d97e5b8
Updated docs/README to suggest wget install for macOS ( #293 )
...
* Update docs/README to require wget install for Mac
2022-06-27 22:25:47 -07:00
4bd688f51c
update tf_io and hf_hub versions ( #291 )
2022-06-24 06:51:58 -07:00
69551fbd38
downgrade tensorflow-io ( #290 )
...
https://github.com/tensorflow/io/issues/1687
2022-06-24 06:05:03 -07:00
c8701485ba
downgrade huggingface_hub version ( #289 )
...
https://github.com/speechbrain/speechbrain/issues/1459
2022-06-24 05:45:28 -07:00
28a1a7aa0e
Merge pull request #264 from cgnorthcutt/fix_thresholds_multilabel
...
Fix bug. get thresholds broken for multi_label
2022-06-20 11:10:53 -07:00
f918b82d80
Provide example label formats in tutorials ( #279 )
...
* example label formatting
* example label format in text tutorial
* example label format for tabular tutorial
* y -> full_labels
* example label format for audio tutorial
* clarify input shapes in image tutorial
* clarify input shapes in text tutorial
* clarify input shapes in tabular tutorial
* clarify input shapes for audio tutorial
2022-06-16 11:41:56 -07:00
6a810d0027
Instructions to manually add docs' build artifacts ( #234 )
...
* add instructions to manually add docs readme
* fix cloning url and replacement step
2022-05-26 11:51:42 -07:00
160f6d2259
bump TF version used in docs
2022-05-24 23:19:31 -07:00
7aa34a33ba
Fix bug. get thresholds broken for multi_label
2022-05-20 21:55:32 -04:00
4aab0b0a56
create latest_release.txt file ( #231 )
2022-05-19 02:26:46 -07:00
aede5bd7db
Fix some typos. ( #242 )
2022-04-23 12:17:20 -04:00
73f947e952
Address tutorial points of confusion ( #233 )
...
CI / Test: Python 3.9 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on windows-latest (push) Has been cancelled
CI / Test: Python 3.9 on windows-latest (push) Has been cancelled
CI / Format (push) Has been cancelled
CI / Lint Notebooks (push) Has been cancelled
CI / Test: Python 3.10 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.10 on macos-latest (push) Has been cancelled
CI / Test: Python 3.6 on macos-latest (push) Has been cancelled
CI / Test: Python 3.7 on macos-latest (push) Has been cancelled
CI / Test: Python 3.8 on macos-latest (push) Has been cancelled
CI / Test: Python 3.6 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.7 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.8 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.9 on ubuntu-latest (push) Has been cancelled
CI / Test: Python 3.10 on windows-latest (push) Has been cancelled
CI / Test: Python 3.6 on windows-latest (push) Has been cancelled
CI / Test: Python 3.7 on windows-latest (push) Has been cancelled
GitHub Markdown Links / test (push) Has been cancelled
* address tutorial points of confusion
* fix typo indices k --> num_classes - 1
Co-authored-by: Curtis G. Northcutt <curtis.northcutt@gmail.com >
2022-04-20 14:46:13 -04:00
79a7e8af82
Make small fixes ( #235 )
2022-04-20 14:16:14 -04:00
31c939ff9a
Generalize text tutorial to multiclass datasets ( #229 )
...
* generalize text tutorial to multiclass datasets
* fixed typo
* fixed misspelling
* separate cell for num_classes
less likely to be missed if users skip the previous cell to load their own datasets
* removing pycharm metadata
* print classes
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-04-18 21:34:32 -07:00
7a8104c83f
Add tutorial toc page ( #230 )
...
* add tutorials index page
* update link to all tutorials
* fix old readme links
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com >
2022-04-18 13:02:24 -07:00
6eca467809
Remove unneeded alt text
...
The anchor already says "Run in Google Colab", so if the logo fails to
load, it will say "Google Colab Logo Run in Google Colab"; it's better
to have the alt text just be empty.
2022-04-18 08:10:44 -06:00
d8ab4e910b
fix black formatting compliance ( #224 )
...
* fix black formatting compliance
* remove codecov for verbose statements
2022-04-17 21:57:15 -04:00
d7c128cd93
Final docs polishing patches ( #223 )
...
* plot_examples named with can skip
* respecify auto overflow handling
2022-04-16 15:46:32 -07:00
766c13b646
Make dataset tutorial runnable on website docs, improve pulldown formatting ( #220 )
...
* tutorial runnable on website, pulldown formatting
* add note re pulldown for colab users
* darkDF, remove auto-overflow handling
* tell colab users they can ignore bottom checks
2022-04-16 14:56:44 -07:00
bf0239b28b
hardcode v1.0.1 to doc toc
2022-04-17 04:01:02 +08:00
Jonas Mueller