Commit Graph
28200 Commits
Author SHA1 Message Date
Ondřej SurýandMichał Kępień f01d2a4a79 Add the standard $n to each test
(cherry picked from commit 64df488e1e)
2020-01-10 09:29:28 +01:00
Michał Kępień 17bd634119 Merge branch '1407-intermittent-failure-in-the-mkeys-system-test-v9_11' into 'v9_11'
[v9_11] Improve the error handling in mkeys test and use retry_quiet()

See merge request isc-projects/bind9!2840
2020-01-09 13:04:18 +00:00
Ondřej SurýandMichał Kępień 4d372bf012 Wait for 'all zones loaded' message instead of zoneless 'loaded serial' message
(cherry picked from commit b0ad689e16)
2020-01-09 13:37:26 +01:00
Ondřej SurýandMichał Kępień bf644c901c Save all rndc diagnostic output
(cherry picked from commit 3b63c51a64)
2020-01-09 13:36:54 +01:00
Ondřej SurýandMichał Kępień 01feaa2b43 Address ShellCheck warnings
(cherry picked from commit 4ff25c06c1)
2020-01-09 13:31:29 +01:00
Ondřej SurýandMichał Kępień a63cad9647 Improve the error handling in mkeys test and use retry_quiet()
(cherry picked from commit f239d67c1a)
2020-01-09 12:40:54 +01:00
Michał Kępień 9b652af90e Merge branch '1410-intermittent-failure-in-the-resolver-test-v9_11' into 'v9_11'
[v9_11] Resolve "Intermittent failure in the resolver test"

See merge request isc-projects/bind9!2838
2020-01-09 11:15:44 +00:00
Diego FronzaandMichał Kępień 5169c21b2c Improved prefetch disabled test code
Using retry_quiet to test that prefetch is disabled instead of a
standard loop with sleep 1 between each iteration.

(cherry picked from commit 994fc2e822)
2020-01-09 11:45:03 +01:00
Diego FronzaandMichał Kępień 89129a3a85 Fix resolver tests: prefetch 40/41
These two tests were failing basically because in order for prefetching to
happen, the TTL for a given DNS record must be greater than or equal to
the prefetch config value + 9.

The previous TTL for both records was 10, while prefetch value in
configuration was 3, thus making only records with TTL >= 12 elligible
for prefetching.

TTL value for both records was adjusted to the value 13, and prefetch
value was set to 4 (inc by 1), so records with TTL (4 + 9) >= 13 are
elligible for prefetching.

Adjusting prefetch value to 4 gives the test 1 second more to avoid time
problems when sharing resources on a heavy loaded PC.

Also prefetch value in settings is now read by the script and used
by it to corrrectly calculate the amount of time needed to delay before
sending a request to trigger prefetch, adding a bit of flexibility to
fine tune the test in the future.

(cherry picked from commit a711d6f8c0)
2020-01-09 11:44:44 +01:00
Diego FronzaandMichał Kępień f06c1dde90 Fix resolver test: prefetch disabled
The previous test had two problems:
1. It wasn't written specifically for testing what it was supposed to:
prefetch disabled.
2. It could fail in some circunstances if the computer's load is too
high, due to sleeps not taking parallel tests and cpu load into account.

The new test is testing prefetch disabled as follows:
1. It asks for a txt record for a given domain and takes note of the
record's TTL (which is 10).
2. It sleeps for (TTL - 5) = 5 seconds, having a window of 5 seconds to
issue new queries before the record expires from cache.
3. Three(3) queries are executed in a row, with a interval of 1 second
between them, and for each query we verify that the TTL in response is
less than the previous one, thus ensuring that prefetch is disabled (if
it were enabled this record would have been refreshed already and TTL
would be >= the first TTL).

Having a window of 5 seconds to perform 3 queries with a interval of 1
second between them gives the test a reasonable amount of time
to not suffer from a machine with heavy load.

(cherry picked from commit dd524cc893)
2020-01-09 11:32:38 +01:00
Michał Kępień 3fa592b1e7 Merge branch '1401-intermittent-failures-in-the-catz-system-test-v9_11' into 'v9_11'
[v9_11] Debug "Intermittent failures in the catz system test"

See merge request isc-projects/bind9!2836
2020-01-09 10:15:51 +00:00
Mark AndrewsandMichał Kępień ab9e50e683 Increase wait_for_message attempts to 20.
(cherry picked from commit 4dd9ec8919)
2020-01-09 10:47:16 +01:00
Mark AndrewsandMichał Kępień de942601fe save wait_for_message contents
(cherry picked from commit 1334daaec0)
2020-01-09 10:47:16 +01:00
Michal Nowak 6e6ffeb828 Merge branch 'mnowak/1546-Add-out-of-tree-build-to-CI-v9_11' into 'v9_11'
[v9_11] Add out-of-tree build to the CI

See merge request isc-projects/bind9!2834
2020-01-09 09:43:39 +00:00
Michal Nowak 7a5ce785e8 Add out-of-tree build to the CI
Fixes #1546.

(cherry picked from commit 640dd566e9)
2020-01-09 09:43:39 +00:00
Michał Kępień 7b1fa60e08 Merge branch '1401-intermittent-failures-in-the-catz-system-test-v9_11' into 'v9_11'
[v9_11] Resolve "Intermittent failures in the catz system test"

See merge request isc-projects/bind9!2830
2020-01-08 14:58:32 +00:00
Ondřej SurýandMichał Kępień 2756dff680 Use retry() and nextpart*() to simplify catz test
(cherry picked from commit 51b05189f7)
2020-01-08 15:19:17 +01:00
Witold KręcickiandMichał Kępień 0f2ef0ca34 Fix timing issues in catz test
Make the log checks more precise and use the retry() function for
repeating the checks.

(cherry picked from commit 9b43e65c01)
2020-01-08 15:19:17 +01:00
Michał Kępień 609c7dc79e Implement a "read-only" version of nextpart()
The system test helper function nextpart() always updates the "lines
read so far" marker ("<file>.prev") when it is called, which somewhat
limits its flexibility.  Add two new helper functions, nextpartpeek()
and nextpartreset(), so that certain parts of log files can be easily
examined more than once.  Add some documentation to help understand the
purpose of each function in the nextpart*() family.

(cherry picked from commit facb68b22e)
2020-01-08 15:19:17 +01:00
Michał Kępień 9ada12e72f Merge branch '1402-multiple-issues-in-the-runtime-system-test-v9_11' into 'v9_11'
[v9_11] Resolve "Multiple issues in the runtime system test"

See merge request isc-projects/bind9!2827
2020-01-08 12:33:31 +00:00
Michał Kępień 4133648ee0 Only run managed keys tests for builds with crypto 2020-01-08 13:17:10 +01:00
Ondřej SurýandMichał Kępień e2aab0cbf1 Fix multiple issues in named setuid check
(cherry picked from commit 4a6d9ea152)
2020-01-08 13:07:42 +01:00
Evan HuntandMichał Kępień e6d99c2d4e fixed a test failure, some other shell cleanup
(cherry picked from commit dc760867d8)
2020-01-08 13:07:42 +01:00
Ondřej SurýandMichał Kępień fbd685b827 Instead of sleeping for a fixed time, wait for named to log specific message in a loop
(cherry picked from commit 355eb0c288)
2020-01-08 13:07:42 +01:00
Ondřej SurýandMichał Kępień e5881bcff1 Make runtime/tests.sh shellcheck and set -e clean
This mostly comprises of:

* changing the directories in subshell and not ignoring `cd` return code
* handling every error gracefully instead of ignoring the return code

(cherry picked from commit 57b6aeabd5)
2020-01-08 13:07:40 +01:00
Ondřej SurýandMichał Kępień 8b23127687 Further improve the runtime tests to look for a specific instead of generic error
(cherry picked from commit d26e7166a6)
2020-01-08 12:51:14 +01:00
Ondřej SurýandMichał Kępień 66f9d83164 Fix couple of no-op tests to actually test something (configuration files were missing)
(cherry picked from commit 60f335204a)
2020-01-08 12:51:14 +01:00
Ondřej SurýandMichał Kępień 28e2528f02 runtime test: make the pidfiles match the names of configuration files
(cherry picked from commit fe021299e0)
2020-01-08 12:51:04 +01:00
Ondřej SurýandMichał Kępień 774da247bd runtime test: use helper function that kills named and waits for the finish
(cherry picked from commit e9d348bac5)
2020-01-08 12:33:02 +01:00
Ondřej Surý 59bf4d746b Merge branch '1513-inline-system-test-failed-v9_11' into 'v9_11'
Address timing issues in 'inline' system test.

See merge request isc-projects/bind9!2822
2020-01-08 08:08:39 +00:00
Mark AndrewsandOndřej Surý de560f98a2 Address timing issues in 'inline' system test.
"rndc signing -serial <value>" could take longer than a second to
complete.  Loop waiting for update to succeed.

For tests where "rndc signing -serial <value>" is supposed to not
succeed, repeatedly test that we don't get the new serial, then
test that we have the old value.  This should prevent false negatives.

(cherry picked from commit 13fa80ede8)
2020-01-08 08:32:06 +01:00
Michał Kępień d555ee7375 Merge branch 'ondrej/detect-cores-in-system-tests-on-FreeBSD-v9_11' into 'v9_11'
[v9_11] Detect cores on FreeBSD

See merge request isc-projects/bind9!2820
2020-01-07 15:01:07 +00:00
Ondřej SurýandMichał Kępień 1007882fee Detect cores on FreeBSD
(cherry picked from commit 38277ddb0b)
2020-01-07 15:59:37 +01:00
Michał Kępień 0236a2229e Merge branch '1380-autosign-jitter-test-fails-with-no-nsec3param-found-in-axfr-v9_11' into 'v9_11'
[v9_11] Tune the performance of the autosign test

See merge request isc-projects/bind9!2818
2020-01-07 14:56:10 +00:00
Ondřej SurýandMichał Kępień e694c22386 Reduce the minimal numbers of days in jitter test to 5
(cherry picked from commit 4b2911a45a)
2020-01-07 15:53:10 +01:00
Ondřej SurýandMichał Kępień cef4c4f708 Tune the performance of CDS/CDNSKEY deletion test
(cherry picked from commit 76eac9a691)
2020-01-07 15:53:10 +01:00
Ondřej SurýandMichał Kępień 0eab5260fe Tune the performance of oldsigs test
The oldsigs test was checking only for the validity of the A
a.oldsigs.example. resource record and associated DNSSEC signature while
the zone might not have been fully signed yet leading to validation
failures because of bogus signatures on the validation path.

This commit changes the test to test that all old signatures in the
oldsigs.example. zone were replaced and the zone is fully resigned
before running the main check.

(cherry picked from commit 519b047362)
2020-01-07 15:53:07 +01:00
Ondřej SurýandMichał Kępień c76b83c420 Tune the performance of the jitter test
(cherry picked from commit ffb7ae8beb)
2020-01-07 15:50:51 +01:00
Michał Kępień 9eb0f01590 Merge branch '1256-fix-the-jitter-test-2-v9_11' into 'v9_11'
[v9_11] Wait a little bit longer for autosign, bail out on not enough categories

See merge request isc-projects/bind9!2816
2020-01-07 14:43:39 +00:00
Ondřej SurýandMichał Kępień b77d31fa10 Wait a little bit longer for autosign, bail out on not enough categories
(cherry picked from commit f1cbdc5498)
2020-01-07 15:37:54 +01:00
Ondřej SurýandMichał Kępień a40ceb292e Adjust the jitter range to +-3*stddev
(cherry picked from commit d6f68fc4f0)
2020-01-07 15:37:54 +01:00
Michał Kępień 35a1ab9742 Merge branch '1256-fix-the-jitter-test-v9_11' into 'v9_11'
[v9_11] Check if the RRSIG jitter falls <mean-2.5*stddev;mean+2.5*stddev>

See merge request isc-projects/bind9!2814
2020-01-07 14:36:07 +00:00
Ondřej SurýandMichał Kępień 022cb23250 Check if the RRSIG jitter falls into mean+-2.5*stddev range
(cherry picked from commit 0480a95ddf)
2020-01-07 15:34:38 +01:00
Michał Kępień 3f2270538c Merge branch 'ondrej/get-the-backtraces-out-of-system-test-coredumps-v9_11' into 'v9_11'
[v9_11] Get the backtraces out of system test coredumps

See merge request isc-projects/bind9!2812
2020-01-07 14:10:49 +00:00
Ondřej SurýandMichał Kępień 307670dc93 Get better stack traces
(cherry picked from commit d0a0c22433)
2020-01-07 14:59:39 +01:00
Ondřej SurýandMichał Kępień 546f65ffdb Dump the backtrace to stdout when core is found in systest directory
(cherry picked from commit 512dadc8d1)
2020-01-07 14:59:37 +01:00
Michal Nowak 89a3fcabf2 Merge branch 'mnowak/get-the-backtraces-out-of-unit-test-coredumps-v9_11' into 'v9_11'
[v9_11] Gather debug info on broken unit tests

See merge request isc-projects/bind9!2807
2020-01-06 12:06:19 +00:00
Michal Nowak 5b093e717c Gather debug info on broken unit tests
(cherry picked from commit 279933338b4a50c947adab900f3c49b5a39d67e2)
2020-01-06 12:06:18 +00:00
Michał Kępień a3cdca75e7 Merge branch 'michal/misc-doc-fixes-v9_11' into 'v9_11'
[v9_11] Miscellaneous documentation fixes

See merge request isc-projects/bind9!2805
2020-01-03 08:26:14 +00:00
Michał Kępień c473831b73 Fix grammar nit in README 2020-01-03 09:08:09 +01:00