certbot/tests
Adrien Ferrand b3d2ac5161 Fail-fast in test/cover/lint scripts (#6487)
After #6485 and #6435, it appears that there is no good reason to not fail fast when test, cover or linting scripts are executed.

This PR ensures to fail fast by invoking commands throught subprocess.check_call instead of subprocess.call, and by removing the handling of non-zero exit code at the end of theses scripts.

As now coverage on Windows is executed with thresholds, I added specific thresholds for this platform. Because some portions of code that are done for Unix platform will not be executed on Windows.

Note that coverage reports from Travis and AppVeyor are accumulated on Codecov. So if a file is covered up to 50 % on Linux, and all other parts are covered on Windows, then coverage is 100 % for Codecov.

Note: that PR also fixes the ability of coverage tests to fail if thresholds are exceeded.

* Use check_call to fail fast in all scripts related to tests/lint/coverage/deploy

* Make specific coverage threshold for windows
2018-11-14 13:57:40 -08:00
..
integration Add and test new nginx parsing abstractions (#6383) 2018-10-19 12:30:32 -07:00
letstest [Windows|Unix] Rewrite bash scripts for tests into python (#6435) 2018-11-07 17:16:16 -08:00
boulder-fetch.sh Clean up boulder-fetch a bit. (#6032) 2018-05-24 10:53:21 -07:00
boulder-integration.sh Separate integration (#5814) 2018-08-29 14:11:13 -07:00
certbot-boulder-integration.sh Check pattern for both old and new openssl (#6450) 2018-10-29 15:56:30 -07:00
display.py Mitigate problems for people who run without -n (#3916) 2016-12-19 12:45:40 -08:00
lock_test.py [Windows|Unix] Rewrite bash scripts for tests into python (#6435) 2018-11-07 17:16:16 -08:00
manual-dns-auth.sh Fix --allow-subset-of-names (#5690) 2018-03-08 11:12:33 -08:00
manual-dns-cleanup.sh Fix --allow-subset-of-names (#5690) 2018-03-08 11:12:33 -08:00
manual-http-auth.sh Enable boulder tests on Python 3 2017-04-15 02:32:18 +08:00
manual-http-cleanup.sh Merge the manual and script plugins (#3890) 2016-12-22 08:24:08 -08:00
modification-check.py Fail-fast in test/cover/lint scripts (#6487) 2018-11-14 13:57:40 -08:00
run_http_server.py Drop support for EOL Python 2.6 and 3.3 2018-02-16 16:14:01 -08:00
tox-boulder-integration.sh Retry failures to start boulder (#5176) 2017-10-12 17:00:13 -07:00