Empty dataframe. Skipping.
Empty dataframe. Skipping.
Date and time of the report: 2024-09-23 08:20:19.160671
Analysed period: 2024-09-02 to 2024-09-23.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result is the outcome of the build, reported by Jenkins. It can be: SUCCESS, FAILURE, UNSTABLE or ABORTED.test_result is the summary of the concerned Robot tests. It can be: FAIL, UNAVAILABLE or PASS.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result.grp_test_result.grp_success_fail.For the identification of these sequences, the following mapping applies:
| Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
|---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
Empty dataframe. Skipping.
Empty dataframe. Skipping.
Empty dataframe. Skipping. Empty dataframe. Skipping. Empty dataframe. Skipping. Empty dataframe. Skipping. Empty dataframe. Skipping.
Empty dataframe. Skipping. Empty dataframe. Skipping. Empty dataframe. Skipping. Empty dataframe. Skipping. Empty dataframe. Skipping.
| job | Master branch | |||
|---|---|---|---|---|
| days_failing | days_passing | days_run | error_rate | |
| suites | ||||
| Basic 01-Crud Operations On Vim Targets | 21.499919 | 0.000000 | 21.499919 | 1.0 |
| Basic 05-Instantiation Parameters In Cloud Init | 0.000000 | 21.499919 | 21.499919 | 0.0 |
| Basic 06-Vnf With Charm | 0.000000 | 0.000000 | 0.000000 | 0.0 |
| Basic 07-Secure Key Management | 0.000000 | 0.000000 | 0.000000 | 0.0 |
| Basic 08-Disable Port Security Network Level | 21.499919 | 0.000000 | 21.499919 | 1.0 |
| ... | ... | ... | ... | ... |
| Slice 02-Shared Network Slicing | 0.000000 | 21.499919 | 21.499919 | 0.0 |
| Sol003 01-Vnf-Lifecycle-Management | 0.000000 | 21.499919 | 21.499919 | 0.0 |
| Sol003 02-Dualstack Ip Vnfm | 0.000000 | 21.499919 | 21.499919 | 0.0 |
| basic 23-delete vnf package SOL004 SOL007 | 0.000000 | 0.000000 | 0.000000 | 0.0 |
| k8s 10-k8s proxy charms SOL004 SOL007 | 0.000000 | 0.000000 | 0.000000 | 0.0 |
67 rows × 4 columns
| job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
|---|---|---|---|---|---|---|---|---|
| 0 | osm-stage_3-merge/master | 3121 | 2024-09-23 01:06:08 | 11893012 | UNSTABLE | FAIL | 410.0 | 62.0 |
| 1 | osm-stage_3-merge/v15.0 | 289 | 2024-09-03 02:34:17 | 1376661 | FAILURE | UNAVAILABLE | NaN | NaN |
| 2 | osm-stage_3-merge/v14.0 | 440 | 2024-09-03 22:08:20 | 10526645 | FAILURE | UNAVAILABLE | NaN | NaN |
| 3 | osm-stage_3-merge/v13.0 | 446 | 2024-01-31 21:07:31 | 15541814 | SUCCESS | PASS | 558.0 | 0.0 |
| 4 | osm-stage_3-merge/v12.0 | 856 | 2024-09-04 00:04:21 | 3565414 | FAILURE | UNAVAILABLE | NaN | NaN |
| 5 | osm-stage_3-merge/v10.0 | 1053 | 2024-02-01 04:08:33 | 2336073 | FAILURE | UNAVAILABLE | NaN | NaN |
osm-stage_3-merge/master: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 129 | Basic 01-Crud Operations On Vim Targets | FAIL | 2024-09-23 01:30:35 | 2024-09-23 01:33:45 | 3 | 1 | Create VIM Target With Extra Config | Check For VIM Target Status |
| 131 | Basic 08-Disable Port Security Network Level | FAIL | 2024-09-23 01:36:02 | 2024-09-23 01:41:58 | 8 | 1 | Create VIM With Port Security Disabled | Check For VIM Target Status |
| 138 | Basic 21-Support Of Volumes | FAIL | 2024-09-23 01:52:29 | 2024-09-23 01:53:54 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 142 | Basic 28-Keep Persistent Volumes | FAIL | 2024-09-23 01:59:54 | 2024-09-23 02:01:17 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 145 | Basic 31-Multivdu Volume Multiattach | FAIL | 2024-09-23 02:07:11 | 2024-09-23 02:08:33 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 148 | Epa 03-Crud Operations On Sdnc | FAIL | 2024-09-23 02:12:04 | 2024-09-23 02:13:18 | 2 | 1 | Create Basic SDNC | Wait Until Keyword Succeeds |
| 154 | Heal 01-Volume Vdu Healing | FAIL | 2024-09-23 02:24:54 | 2024-09-23 02:26:26 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 155 | Heal 02-Scale Vdu Healing | FAIL | 2024-09-23 02:26:26 | 2024-09-23 02:27:58 | 7 | 11 | Network Service Instance Test | Create Network Service |
| 156 | Heal 03-Multiple Healing | FAIL | 2024-09-23 02:27:58 | 2024-09-23 02:29:28 | 6 | 12 | Network Service Instance Test | Create Network Service |
| 165 | Sa 01-Vnf With Vim Metrics | FAIL | 2024-09-23 02:51:49 | 2024-09-23 03:07:11 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 166 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2024-09-23 03:07:11 | 2024-09-23 03:40:42 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 167 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2024-09-23 03:40:42 | 2024-09-23 04:02:11 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v15.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
|---|
osm-stage_3-merge/v14.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
|---|
osm-stage_3-merge/v13.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
|---|
osm-stage_3-merge/v12.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
|---|
osm-stage_3-merge/v10.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
|---|
osm-stage_3-merge/master: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 19 | Basic 01-Crud Operations On Vim Targets | Create VIM Target With Extra Config | Check For VIM Target Status | FAIL | 2024-09-23 01:30:39 | 2024-09-23 01:33:41 |
| 25 | Basic 08-Disable Port Security Network Level | Create VIM With Port Security Disabled | Check For VIM Target Status | FAIL | 2024-09-23 01:36:03 | 2024-09-23 01:39:06 |
| 38 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-09-23 01:52:32 | 2024-09-23 01:53:14 |
| 46 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2024-09-23 01:53:15 | 2024-09-23 01:53:15 |
| 50 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2024-09-23 01:53:15 | 2024-09-23 01:53:15 |
| 61 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-09-23 01:59:57 | 2024-09-23 02:00:36 |
| 63 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2024-09-23 02:00:36 | 2024-09-23 02:00:36 |
| 68 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2024-09-23 02:00:36 | 2024-09-23 02:00:36 |
| 72 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2024-09-23 02:00:58 | 2024-09-23 02:00:58 |
| 75 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2024-09-23 02:00:58 | 2024-09-23 02:00:58 |
| 78 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2024-09-23 02:00:58 | 2024-09-23 02:00:58 |
| 79 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2024-09-23 02:00:58 | 2024-09-23 02:00:58 |
| 81 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2024-09-23 02:00:58 | 2024-09-23 02:00:58 |
| 89 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2024-09-23 02:00:58 | 2024-09-23 02:01:00 |
| 90 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2024-09-23 02:01:00 | 2024-09-23 02:01:00 |
| 94 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2024-09-23 02:01:00 | 2024-09-23 02:01:00 |
| 102 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2024-09-23 02:07:15 | 2024-09-23 02:07:54 |
| 105 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2024-09-23 02:07:54 | 2024-09-23 02:07:54 |
| 107 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2024-09-23 02:07:54 | 2024-09-23 02:07:54 |
| 113 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2024-09-23 02:07:54 | 2024-09-23 02:07:54 |
| 125 | Epa 03-Crud Operations On Sdnc | Create Basic SDNC | Wait Until Keyword Succeeds | FAIL | 2024-09-23 02:12:06 | 2024-09-23 02:13:11 |
| 131 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-09-23 02:24:59 | 2024-09-23 02:25:39 |
| 134 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-09-23 02:25:39 | 2024-09-23 02:25:39 |
| 139 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-09-23 02:25:39 | 2024-09-23 02:25:39 |
| 156 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2024-09-23 02:25:40 | 2024-09-23 02:25:40 |
| 159 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2024-09-23 02:25:40 | 2024-09-23 02:25:40 |
| 165 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2024-09-23 02:25:40 | 2024-09-23 02:25:40 |
| 168 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2024-09-23 02:25:40 | 2024-09-23 02:25:40 |
| 170 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-09-23 02:25:40 | 2024-09-23 02:25:40 |
| 185 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-09-23 02:25:40 | 2024-09-23 02:25:40 |
| 203 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-09-23 02:26:33 | 2024-09-23 02:27:11 |
| 206 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 214 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 219 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 229 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 234 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 237 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 239 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 251 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 255 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-09-23 02:27:11 | 2024-09-23 02:27:11 |
| 268 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-09-23 02:28:03 | 2024-09-23 02:28:42 |
| 271 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 279 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 284 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 294 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 306 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 311 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 317 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 320 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 331 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 335 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-09-23 02:28:42 | 2024-09-23 02:28:42 |
| 356 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2024-09-23 02:52:32 | 2024-09-23 03:06:33 |
| 387 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2024-09-23 03:07:59 | 2024-09-23 03:22:00 |
| 392 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2024-09-23 03:22:02 | 2024-09-23 03:36:03 |
| 395 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2024-09-23 03:38:03 | 2024-09-23 03:38:03 |
| 427 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2024-09-23 03:43:24 | 2024-09-23 03:57:25 |
| 428 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2024-09-23 03:57:25 | 2024-09-23 04:00:55 |
osm-stage_3-merge/v15.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime |
|---|
osm-stage_3-merge/v14.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime |
|---|
osm-stage_3-merge/v13.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime |
|---|
osm-stage_3-merge/v12.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime |
|---|
osm-stage_3-merge/v10.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime |
|---|
Powered by osm-analytics