文件历史

提交图

58 次代码提交

作者 SHA1 备注 提交日期
Anish Athalye 11dff1faf4 Standardize code style to Black (#107)
* Set up Black as the code style

* Migrate code style to Black
2022-03-16 21:27:36 -04:00
Curtis G. Northcutt 8f9f3f5380 Major API change. Introducing Cleanlab 2.0 (#128)
* Refactor modules pruning to filter and latent_estimation to count

* Remove polyplex (research) algorithms from cleanlab

* Create new module rank and move scoring functions to rank.

* Rename test to match new module names

* Fixed error in normalized margin. added ranking for arbitrary psx and labels.

* Remove unused tests and methods. add multi-label support for baseline.

* Move baseline methods to filter and delete baseline module.

* change filter.get_noise_indices to filter.find_label_issues

* Rename baseline methods. fill out docstrings.

* Only require 1 example to be left in each class after removing errors. (instead of 5)

* Remove K as a parameter to count.compute_confident_joint

* Add C_argmax and C_ij methods from CL paper to find_label_issues

* Add warnings for new prune methods and frac_noise. Fix tests.

* Add baseline tests to test_rank_filter and delete baseline test

* Remove inverse_noise_matrix parameter in classification call to find_label_issues

* add todo to update docstring with new ranking functions

* 100% tests pass. add multi-label support for prune_method

* Major NOT-backwards-compatible name changes to most components

* More Major NOT-backwards-compatible name changes

* fixed s -> label mistakes

* Several nomenclature updates from PR feedback. models renamed to example models.

* Remove python2 support across all modules.

* major api changes. psx -> pred_probs. prob_given_label -> self_confidence. testing added.

* enable python version 3.9 for pytorch model.

* ran spellcheck

* ran grammar check

* Update count.py

* Update filter.py

* Update setup.py and ci.yml to no longer support Python 2 and py3.4/5

* Increase test coverage and documentation of rank module methods.

* create utils submodule and move util and latent_algebra

* Rename y everywhere to true_labels, and p(true_label=..)

* Enforce positional arguments in methods. Fully remove py2 support.
2022-03-16 06:52:03 -04:00
Wei Jing Lok 6169fdcd43 Add new documentation site 2022-03-01 14:55:51 -05:00
Anish Athalye e27a050236 Remove requirements.txt
This was duplicating content in setup.py (and the two had gotten out of
sync, listing different versions for scipy).

According to the Python Packaging User Guide
(https://packaging.python.org/en/latest/discussions/install-requires-vs-requirements/),
the `install_requires` specifies what a project minimally needs to run
correctly, while the requirements.txt file contains an exhaustive list
of pinned versions for the purpose of repeatable installations of a
complete environment. Cleanlab is a Python package that users will `pip
install`, so we don't need a requirements.txt.

Some related projects like scikit-learn don't have a requirements.txt,
and others that do have such a file use it for a different purpose, e.g.
PyTorch and Keras use the file to list dev dependencies.
2022-02-16 14:18:33 -05:00
Anish Athalye f71cb3b4d0 Ban coverage>=6.3
See https://github.com/nedbat/coveragepy/issues/1312. We can revert this
commit once a newer version of coverage fixes this issue.

coverage==6.3.1
(https://github.com/nedbat/coveragepy/issues/1310#issuecomment-1027499386)
doesn' t fully fix the issue either; hangs become less frequent but are
not eliminated (see e.g. this run of our tests with coverage==6.3.1:
https://github.com/cleanlab/cleanlab/runs/5036277812?check_suite_focus=true).
2022-02-02 07:25:29 -05:00
Anish Athalye ea78f62a8e Run tests on pull request 2022-01-10 06:10:37 -05:00
Anish Athalye 2c1ac19f82 Check code coverage across all platforms
When multiple coverage reports are uploaded to Codecov, it merges the
reports, which is what we want in this situation. So for example, if the
code branches on Python version or OS version, we'll cover those
branches across tests.
2021-12-27 09:41:58 -05:00
Anish Athalye 78b35ac23a Switch to GitHub Actions
This patch switches the CI from Travis-CI to GitHub Actions.

The new CI script drops support for Python 3.4 (EOLed 18 March 2019) and
Python 3.5 (EOLed 13 September 2020), though it keeps support for Python
2.7 (EOLed 1 January 2020). This keeps the CI configuration a lot
simpler.

The new CI script also simplifies code coverage: a single coverage
report is produced for Python 3.9 on Ubuntu. There are no coverage
statistics being collected and uploaded for older versions of Python 3,
Python 2, or other OSes.
2021-12-27 09:41:58 -05:00