Date and time of the report: 2023-07-18 08:20:20.495588
Analysed period: 2023-06-27 to 2023-07-18.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result
is the outcome of the build, reported by Jenkins. It can be: SUCCESS
, FAILURE
, UNSTABLE
or ABORTED
.test_result
is the summary of the concerned Robot tests. It can be: FAIL
, UNAVAILABLE
or PASS
.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result
.grp_test_result
.grp_success_fail
.For the identification of these sequences, the following mapping applies:
Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
job | Master branch | Release TEN | Release THIRTEEN | Release TWELVE | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | |
suites | ||||||||||||||||
Basic 01-Crud Operations On Vim Targets | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 20.50037 | 20.50037 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 0.000000 | 20.628148 | 20.628148 | 0.000000 |
Basic 05-Instantiation Parameters In Cloud Init | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 20.50037 | 20.50037 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 2.000093 | 18.628056 | 20.628148 | 0.096959 |
Basic 06-Vnf With Charm | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 20.50037 | 20.50037 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 0.000000 | 20.628148 | 20.628148 | 0.000000 |
Basic 07-Secure Key Management | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 20.50037 | 20.50037 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 0.000000 | 20.628148 | 20.628148 | 0.000000 |
Basic 08-Disable Port Security Network Level | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 20.50037 | 20.50037 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 0.000000 | 20.628148 | 20.628148 | 0.000000 |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
Slice 01-Network Slicing | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 20.50037 | 20.50037 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 0.000000 | 20.628148 | 20.628148 | 0.000000 |
Slice 02-Shared Network Slicing | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 20.50037 | 20.50037 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 0.000000 | 20.628148 | 20.628148 | 0.000000 |
Sol003 01-Vnf-Lifecycle-Management | 0.0 | 21.585058 | 21.585058 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 | 0.0 | 20.709387 | 20.709387 | 0.0 | 0.000000 | 20.628148 | 20.628148 | 0.000000 |
basic 23-delete vnf package SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
k8s 10-k8s proxy charms SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
63 rows × 16 columns
job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
---|---|---|---|---|---|---|---|---|
0 | osm-stage_3-merge/master | 2666 | 2023-07-18 01:07:02 | 458601 | FAILURE | UNAVAILABLE | NaN | NaN |
1 | osm-stage_3-merge/v13.0 | 248 | 2023-07-17 20:08:00 | 15641693 | SUCCESS | PASS | 558.0 | 0.0 |
2 | osm-stage_3-merge/v12.0 | 443 | 2023-07-18 00:05:02 | 15526047 | SUCCESS | PASS | 530.0 | 0.0 |
3 | osm-stage_3-merge/v10.0 | 858 | 2023-07-18 03:09:03 | 10118181 | SUCCESS | PASS | 380.0 | 0.0 |
osm-stage_3-merge/master: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/v13.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/v12.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/v10.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/master: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|
osm-stage_3-merge/v13.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|
osm-stage_3-merge/v12.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|
osm-stage_3-merge/v10.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|
Powered by osm-analytics