文件历史

提交图

78 次代码提交

作者 SHA1 备注 提交日期
Jonas Mueller 31d4370701 Add missing docs pages (#381)
* add files to show docs for recent source code

* temp delete audio tutorial for docs on M1

* black formatting
2022-08-31 02:28:45 -07:00
Hui Wen 960c2b4ac1 CL functionality for multiannotator data (#333)
* setup multiannotator functionality

* add docstring

* add unittests

* edit get label quality with nan helper func

* docstring edits

* handle non overlapping annotators in get_annotator_agreement_with_annotators

* return NaN annotator quality scores for non-overlapping annotators

* add unittest

* add unittests for get_consensus_label tiebreaks

* np.array -> np.ndarray

* add new annotator quality method

* docstring edits

* address comments, docstring changes

* add method to compute improved consensus labels

* separate detailed_label_quality return

* elif statement typo

* changed get_majority_vote_label

* add 'best_quality' as a consensus method

* change lqs kwargs naming

* change lqs kwargs naming

* change unittest function names

* docstring edits

* change get_worst_class to return class with lowest agreement with consensus

* edit method to get annotator lqs, change quality_of_consensus -> consensus_quality_score

* remove unnecessary args

* satisfy mypy checks

* fix mypy issue

* add unittests

* reshuffled order of functions

* address comments

* docstring edit

* change return to always return dict

* add clipping to prevent negative pred_probs

* add tutorial

* add multiannotator to tutorial index

* add newline

* add tiebreaks for best_quality labels and worst_class

* change auto method name to crowdlab

* fix indexing for non numeric anno names

* add test for nonnumeric anno names

* update unittest

* address comments [partially complete]

* edit metadata

* missing /details tag

* bugfix to allow pd Int64 types

* update tutorial

* address comments
2022-08-30 11:29:06 -07:00
Ulyana b8e85284c6 Added outlier detection tutorial into docs (#310)
* Added outlier detection tutorial into docs

* Switched to pytorch model/dataset implementation

* Fixed image normalization

* Fixed outlier detection for test set

* Added outlier thresholding into tutorial.

* Cleaned output

* Removed unused imports and renamed notebook

* Added outliers notebook to PR

* Added quickstart into tutorial

* Best quickstart header

* Cleaned cell output

* Changed to use subset of original data for speed

* Fixed randomness

* Cleared outputs

* fixed metadata tags

* Fixed metadata

* Cleaned kernel and verified output

* Improved unit test
Changed labels references to classes where apropriate
2022-07-22 15:40:03 -07:00
Ulyana f7328e8b67 Created FAQ Page in the Cleanlab documentation (#294)
* Create FAQ page in cleanlab docs

* Add FAQ notebook to store answers to frequently asked questions

* Improved formatting issues for faq page

- added faq to sidebar

* Improved formatting issues for faq page

- added faq to sidebar
- changed email to comply with CLA

* Removed faq numbering

- Removed notebook output metadata
- Added notebook to index for left table link

* Text and example rewritten for clarity

- How do I format labels for cleanlab-- example improved
- How do I format labels for cleanlab-- text amended
- Can't find an answer to your question-- added links

* add links to issues/slack

Co-authored-by: Ulyana Tkachenko <uly@ulyana.lan>
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2022-06-29 10:24:50 -07:00
Jonas Mueller 57733c704d Formats dataset health tutorial (#216)
* dataset health tutorial pulldown format

* tutorial ordering in sidebar

* pulldown format, bullet format

* reformat pulldown indepth tutorial

* shorten data fetching header

* adjust spacing
2022-04-15 18:15:23 -07:00
Curtis G. Northcutt cd7f0a2f0e improvements to dataset example on quickstart 2022-04-15 21:11:28 -04:00
Curtis G. Northcutt 854478bdc0 Remove links to functions in dataset example 2022-04-15 19:51:15 -04:00
Curtis G. Northcutt d801056513 Dataset example to main page. cl2 tutorial to top 2022-04-15 18:34:00 -04:00
Wei Jing d397cdebb6 Add in-depth tutorial [WIP] (#208)
* add in-depth tutorial and remove pandas install in tutorials

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2022-04-14 17:46:58 -07:00
Jonas Mueller a313b03042 Migration guide for v2 (#200)
Co-authored-by: Anish Athalye <me@anishathalye.com>
2022-04-13 16:51:17 -04:00
Anish Athalye dc6fa956cb Make a pass over docs 2022-04-11 13:15:43 -04:00
Anish Athalye e086fdee74 Standardize how to format names
This follows NumPy style for reST documentation (but not for
Jupyter/Markdown).
2022-04-09 07:33:24 -04:00
Anish Athalye d93f9f3337 Revise quickstart 2022-04-09 07:33:24 -04:00
Anish Athalye 49b3717edc Make coarse-grained pass over docs
This patch fixes many of the egregious issues with docs rendering.
2022-04-09 07:33:24 -04:00
Anish Athalye 0be3c70a6e Move noise_generation into benchmarking module 2022-04-08 20:08:19 -04:00
Jonas Mueller faac915740 mv example_models -> experimental 2022-04-07 01:25:03 -07:00
Jonas Mueller 423e5b0a07 Polish the APIs and file-structure to prepare for 2.0 release (#181)
* Makes some methods private that are not intended to be user-facing.
* Adds experimental module with fasttext.py and coteaching.py
* Adds header descriptions to code files which will render in docs
* Many miscellaneous fixes
2022-04-06 21:04:06 -07:00
Curtis G. Northcutt c4e84624e9 CleanLearning = Machine Learning with cleaned data (#177)
* CleanLearning = Machine Learning with cleaned data

* Replace lnl instance naming with cl everywhere (CleanLearning)

* replace rp (rank pruning) with cl (clearn learning) everywhere

* Clarifying comments. remove unnecessary newlines. fix spelling err
2022-04-06 17:33:04 -04:00
Wei Jing 080c7a841c Add overview for computing out-of-sample predicted probabilities with cross-validation to doc site (#166)
* add pred probs cross val tutorial

Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
2022-04-05 03:34:30 -07:00
Wei Jing 5b6d297b6c Add audio tutorial to doc site (#165)
* add audio tutorial
2022-04-05 03:16:07 -07:00
Wei Jing 1f60745b2c add text tutorial, update notebook titles and naming conventions (#154) 2022-04-04 20:56:34 -07:00
Wei Jing Lok d5dc5564e5 add tabular tutorial 2022-04-01 09:59:01 +08:00
Jonas Mueller 1247f165f2 Improve user-control (#149)
* improved language in docs Quickstart

* LearningWithNoisyLabels refactor to improve API flexibility and UX

* fix LearningWithNoisy rare label handling

* additional arg-checking unit tests
2022-03-30 08:18:38 -07:00
Wei Jing 4c9fb124b1 update quickstart to reflect v2.0 API (#143) 2022-03-28 15:44:41 -07:00
Wei Jing Lok da686a4006 update doc toc for 2.0 2022-03-24 03:28:14 +08:00
Wei Jing aca683ec80 Add image classification tutorial and streamline docs CI/CD (#127) 2022-03-22 19:34:27 -04:00
Curtis G. Northcutt 8f9f3f5380 Major API change. Introducing Cleanlab 2.0 (#128)
* Refactor modules pruning to filter and latent_estimation to count

* Remove polyplex (research) algorithms from cleanlab

* Create new module rank and move scoring functions to rank.

* Rename test to match new module names

* Fixed error in normalized margin. added ranking for arbitrary psx and labels.

* Remove unused tests and methods. add multi-label support for baseline.

* Move baseline methods to filter and delete baseline module.

* change filter.get_noise_indices to filter.find_label_issues

* Rename baseline methods. fill out docstrings.

* Only require 1 example to be left in each class after removing errors. (instead of 5)

* Remove K as a parameter to count.compute_confident_joint

* Add C_argmax and C_ij methods from CL paper to find_label_issues

* Add warnings for new prune methods and frac_noise. Fix tests.

* Add baseline tests to test_rank_filter and delete baseline test

* Remove inverse_noise_matrix parameter in classification call to find_label_issues

* add todo to update docstring with new ranking functions

* 100% tests pass. add multi-label support for prune_method

* Major NOT-backwards-compatible name changes to most components

* More Major NOT-backwards-compatible name changes

* fixed s -> label mistakes

* Several nomenclature updates from PR feedback. models renamed to example models.

* Remove python2 support across all modules.

* major api changes. psx -> pred_probs. prob_given_label -> self_confidence. testing added.

* enable python version 3.9 for pytorch model.

* ran spellcheck

* ran grammar check

* Update count.py

* Update filter.py

* Update setup.py and ci.yml to no longer support Python 2 and py3.4/5

* Increase test coverage and documentation of rank module methods.

* create utils submodule and move util and latent_algebra

* Rename y everywhere to true_labels, and p(true_label=..)

* Enforce positional arguments in methods. Fully remove py2 support.
2022-03-16 06:52:03 -04:00
Wei Jing Lok 6169fdcd43 Add new documentation site 2022-03-01 14:55:51 -05:00