Date and time of the report: 2025-08-30 08:20:24.675821
Analysed period: 2025-08-09 to 2025-08-30.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result
is the outcome of the build, reported by Jenkins. It can be: SUCCESS
, FAILURE
, UNSTABLE
or ABORTED
.test_result
is the summary of the concerned Robot tests. It can be: FAIL
, UNAVAILABLE
or PASS
.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result
.grp_test_result
.grp_success_fail
.For the identification of these sequences, the following mapping applies:
Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
Empty dataframe. Skipping.
Empty dataframe. Skipping.
Empty dataframe. Skipping.
job | Master branch | Release FOURTEEN | Release SEVENTEEN | Release SIXTEEN | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | |
suites | ||||||||||||||||
Basic 01-Crud Operations On Vim Targets | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
Basic 05-Instantiation Parameters In Cloud Init | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
Basic 06-Vnf With Charm | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
Basic 07-Secure Key Management | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
Basic 08-Disable Port Security Network Level | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
Sa 08-Vnf With Vnf Indicators Snmp | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
Slice 01-Network Slicing | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
Slice 02-Shared Network Slicing | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
Sol003 01-Vnf-Lifecycle-Management | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 20.695324 | 20.695324 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
Sol003 02-Dualstack Ip Vnfm | 0.0 | 21.571725 | 21.571725 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 21.500197 | 21.500197 | 0.0 | 0.0 | 20.658553 | 20.658553 | 0.0 |
62 rows × 16 columns
job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
---|---|---|---|---|---|---|---|---|
0 | osm-stage_3-merge/master | 3472 | 2025-08-30 01:06:39 | 11091897 | SUCCESS | PASS | 485.0 | 0.0 |
1 | osm-stage_3-merge/v17.0 | 235 | 2025-08-30 02:49:40 | 12137871 | UNSTABLE | FAIL | 465.0 | 7.0 |
2 | osm-stage_3-merge/v16.0 | 346 | 2025-08-29 23:01:38 | 11790800 | UNSTABLE | FAIL | 465.0 | 7.0 |
3 | osm-stage_3-merge/v15.0 | 446 | 2025-03-21 03:34:47 | 12254896 | UNSTABLE | FAIL | 448.0 | 7.0 |
4 | osm-stage_3-merge/v14.0 | 763 | 2025-08-29 22:08:42 | 17451462 | UNSTABLE | FAIL | 612.0 | 7.0 |
osm-stage_3-merge/master: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/v17.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
279 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-08-30 04:40:34 | 2025-08-30 04:55:58 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
280 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-08-30 04:55:58 | 2025-08-30 05:29:36 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
281 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-08-30 05:29:36 | 2025-08-30 05:50:35 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v16.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
235 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-08-30 00:49:27 | 2025-08-30 01:04:49 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
236 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-08-30 01:04:49 | 2025-08-30 01:38:22 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
237 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-08-30 01:38:22 | 2025-08-30 01:59:20 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v15.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
88 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-03-21 05:28:39 | 2025-03-21 05:43:58 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
89 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-03-21 05:43:58 | 2025-03-21 06:17:27 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
90 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-03-21 06:17:27 | 2025-03-21 06:38:22 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v14.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
192 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-08-30 01:31:13 | 2025-08-30 01:46:32 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
193 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-08-30 01:46:32 | 2025-08-30 02:20:02 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
194 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-08-30 02:20:02 | 2025-08-30 02:40:52 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/master: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|
osm-stage_3-merge/v17.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
279 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-08-30 04:41:17 | 2025-08-30 04:55:19 |
309 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-08-30 04:56:49 | 2025-08-30 05:10:51 |
314 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-08-30 05:10:53 | 2025-08-30 05:24:55 |
317 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-08-30 05:26:55 | 2025-08-30 05:26:55 |
348 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-08-30 05:31:47 | 2025-08-30 05:45:48 |
349 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-08-30 05:45:48 | 2025-08-30 05:49:17 |
osm-stage_3-merge/v16.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
192 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-08-30 00:50:11 | 2025-08-30 01:04:12 |
222 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-08-30 01:05:38 | 2025-08-30 01:19:39 |
227 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-08-30 01:19:41 | 2025-08-30 01:33:42 |
230 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-08-30 01:35:42 | 2025-08-30 01:35:42 |
261 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-08-30 01:40:31 | 2025-08-30 01:54:32 |
262 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-08-30 01:54:32 | 2025-08-30 01:58:02 |
osm-stage_3-merge/v15.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
10 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:29:21 | 2025-03-21 05:43:21 |
40 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:44:46 | 2025-03-21 05:58:46 |
45 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:58:49 | 2025-03-21 06:12:49 |
48 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-03-21 06:14:49 | 2025-03-21 06:14:49 |
79 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:19:35 | 2025-03-21 06:33:35 |
80 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:33:35 | 2025-03-21 06:37:06 |
osm-stage_3-merge/v14.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
98 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-08-30 01:31:55 | 2025-08-30 01:45:55 |
131 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-08-30 01:47:20 | 2025-08-30 02:01:20 |
138 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-08-30 02:01:22 | 2025-08-30 02:15:23 |
141 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-08-30 02:17:23 | 2025-08-30 02:17:23 |
146 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VDUs After Auto-scaling | Run Keyword If | FAIL | 2025-08-30 02:19:23 | 2025-08-30 02:19:23 |
173 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-08-30 02:22:10 | 2025-08-30 02:36:10 |
175 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-08-30 02:36:10 | 2025-08-30 02:39:39 |
Powered by osm-analytics