certbot/tools
Brad Warren fa67b7ba0f
Remove codecov (#7811)
After getting a +1 from everyone on the team, this PR removes the use of `codecov` from the Certbot repo because we keep having problems with it.

Two noteworthy things about this PR are:

1. I left the text at 4ea98d830b/.azure-pipelines/INSTALL.md (add-a-secret-variable-to-a-pipeline-like-codecov_token) because I think it's useful to document how to set up a secret variable in general.
2. I'm not sure what the text "Option -e makes sure we fail fast and don't submit to codecov." in `tox.cover.py` refers to but it seems incorrect since `-e` isn't accepted or used by the script so I just deleted the line.

As part of this, I said I'd open an issue to track setting up coveralls (which seems to be the only real alternative to codecov) which is at https://github.com/certbot/certbot/issues/7810.

With my change, failure output looks something like:
```
$ tox -e py27-cover
...
Name                                                         Stmts   Miss  Cover   Missing
------------------------------------------------------------------------------------------
certbot/certbot/__init__.py                                      1      0   100%
certbot/certbot/_internal/__init__.py                            0      0   100%
certbot/certbot/_internal/account.py                           191      4    98%   62-63, 206, 337
...
certbot/tests/storage_test.py                                  530      0   100%
certbot/tests/util_test.py                                     374     29    92%   211-213, 480-484, 489-499, 504-511, 545-547, 552-554
------------------------------------------------------------------------------------------
TOTAL                                                        14451    647    96%
Command '['/path/to/certbot/dir/.tox/py27-cover/bin/python', '-m', 'coverage', 'report', '--fail-under', '100', '--include', 'certbot/*', '--show-missing']' returned non-zero exit status 2
Test coverage on certbot did not meet threshold of 100%.
ERROR: InvocationError for command /Users/bmw/Development/certbot/certbot/.tox/py27-cover/bin/python tox.cover.py (exited with code 1)
_________________________________________________________________________________________________________________________________________________________ summary _________________________________________________________________________________________________________________________________________________________
ERROR:   py27-cover: commands failed
```
I printed the exception just so we're not throwing away information.

I think it's also possible we fail for a reason other than the threshold not meeting the percentage, but I've personally never seen this, `coverage report` output is not being captured so hopefully that would inform devs if something else is going on, and saying something like "Test coverage probably did not..." seems like overkill to me personally.

* remove codecov

* remove unused variable group

* remove codecov.yml

* Improve tox.cover.py failure output.
2020-02-27 14:44:39 -08:00
..
_changelog_top.txt Remove list of modified packages from changelog. (#7146) 2019-06-11 14:02:54 -07:00
_release.sh Minor release script improvements (#7697) 2020-01-21 15:53:31 -08:00
_venv_common.py Remove letshelp-certbot (#7761) 2020-02-14 17:19:19 -08:00
deactivate.py Reorganize imports (#7616) 2019-12-09 15:50:20 -05:00
dev_constraints.txt Remove codecov (#7811) 2020-02-27 14:44:39 -08:00
eff-pubkey.pem Add pubkey to tree 2016-03-01 11:21:51 -08:00
extract_changelog.py Reorganize imports (#7616) 2019-12-09 15:50:20 -05:00
half-sign.c Use SHA256 openssl signatures 2016-01-11 14:22:51 -08:00
install_and_test.py Remove letshelp-certbot (#7761) 2020-02-14 17:19:19 -08:00
merge_requirements.py Address review comments 2019-03-04 15:52:38 +02:00
offline-sigrequest.sh Don't require festival during signing. (#6079) 2018-06-07 11:43:45 +03:00
oldest_constraints.txt Remove duplicate pyparsing pin 2020-02-11 14:20:29 -08:00
pip_install.py Reorganize imports (#7616) 2019-12-09 15:50:20 -05:00
pip_install_editable.py Reorganize imports (#7616) 2019-12-09 15:50:20 -05:00
readlink.py Reorganize imports (#7616) 2019-12-09 15:50:20 -05:00
release.sh Release script improvements (#6337) 2018-09-05 14:10:05 -07:00
simple_http_server.py Reorganize imports (#7616) 2019-12-09 15:50:20 -05:00
sphinx-quickstart.sh Don't display todo comments in docs (#7753) 2020-02-06 15:39:47 -08:00
strip_hashes.py Address review comments 2019-03-04 15:52:38 +02:00
venv.py Reorganize imports (#7616) 2019-12-09 15:50:20 -05:00
venv3.py Refactor certbot/ and certbot/tests/ to use the same structure as the other packages (#7544) 2019-11-25 14:28:05 -08:00