Date and time of the report: 2024-11-24 08:20:22.880414
Analysed period: 2024-11-03 to 2024-11-24.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result is the outcome of the build, reported by Jenkins. It can be: SUCCESS, FAILURE, UNSTABLE or ABORTED.test_result is the summary of the concerned Robot tests. It can be: FAIL, UNAVAILABLE or PASS.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result.grp_test_result.grp_success_fail.For the identification of these sequences, the following mapping applies:
| Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
|---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
| job | Master branch | Release FIFTEEN | Release FOURTEEN | Release SIXTEEN | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | |
| suites | ||||||||||||||||
| Basic 01-Crud Operations On Vim Targets | 0.000000 | 21.561076 | 21.561076 | 0.000000 | 9.499896 | 0.000000 | 9.499896 | 1.0 | 8.684606 | 0.000000 | 8.684606 | 1.0 | 0.0 | 21.647894 | 21.647894 | 0.0 |
| Basic 05-Instantiation Parameters In Cloud Init | 0.000000 | 21.561076 | 21.561076 | 0.000000 | 0.000000 | 9.499896 | 9.499896 | 0.0 | 0.000000 | 8.684606 | 8.684606 | 0.0 | 0.0 | 21.647894 | 21.647894 | 0.0 |
| Basic 06-Vnf With Charm | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.000000 | 8.684606 | 8.684606 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
| Basic 07-Secure Key Management | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.000000 | 8.684606 | 8.684606 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
| Basic 08-Disable Port Security Network Level | 0.000000 | 21.561076 | 21.561076 | 0.000000 | 9.499896 | 0.000000 | 9.499896 | 1.0 | 8.684606 | 0.000000 | 8.684606 | 1.0 | 0.0 | 21.647894 | 21.647894 | 0.0 |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| Slice 02-Shared Network Slicing | 16.561076 | 5.000000 | 21.561076 | 0.768101 | 0.000000 | 9.499896 | 9.499896 | 0.0 | 0.000000 | 8.684606 | 8.684606 | 0.0 | 0.0 | 21.647894 | 21.647894 | 0.0 |
| Sol003 01-Vnf-Lifecycle-Management | 0.000000 | 21.561076 | 21.561076 | 0.000000 | 0.000000 | 9.499896 | 9.499896 | 0.0 | 0.000000 | 8.684606 | 8.684606 | 0.0 | 0.0 | 21.647894 | 21.647894 | 0.0 |
| Sol003 02-Dualstack Ip Vnfm | 0.000000 | 21.561076 | 21.561076 | 0.000000 | 0.000000 | 9.499896 | 9.499896 | 0.0 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.0 | 21.647894 | 21.647894 | 0.0 |
| basic 23-delete vnf package SOL004 SOL007 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
| k8s 10-k8s proxy charms SOL004 SOL007 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.000000 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
67 rows × 16 columns
| job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
|---|---|---|---|---|---|---|---|---|
| 0 | osm-stage_3-merge/master | 3183 | 2024-11-24 02:06:10 | 0 | FAILURE | UNAVAILABLE | NaN | NaN |
| 1 | osm-stage_3-merge/v16.0 | 68 | 2024-11-24 00:01:09 | 11599931 | UNSTABLE | FAIL | 412.0 | 60.0 |
| 2 | osm-stage_3-merge/v15.0 | 328 | 2024-11-24 03:34:10 | 11473673 | UNSTABLE | FAIL | 393.0 | 62.0 |
| 3 | osm-stage_3-merge/v14.0 | 483 | 2024-11-23 23:08:09 | 17060818 | UNSTABLE | FAIL | 544.0 | 59.0 |
osm-stage_3-merge/master: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
|---|
osm-stage_3-merge/v16.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 238 | Basic 21-Support Of Volumes | FAIL | 2024-11-24 00:41:50 | 2024-11-24 00:43:14 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 242 | Basic 28-Keep Persistent Volumes | FAIL | 2024-11-24 00:49:11 | 2024-11-24 00:50:35 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 244 | Basic 30-Ns Ipv6 Profile | FAIL | 2024-11-24 00:52:29 | 2024-11-24 00:57:13 | 11 | 1 | Verify Vnf2 Interfaces | Execute Remote Command Check Rc Return Output |
| 245 | Basic 31-Multivdu Volume Multiattach | FAIL | 2024-11-24 00:57:13 | 2024-11-24 00:58:35 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 254 | Heal 01-Volume Vdu Healing | FAIL | 2024-11-24 01:14:54 | 2024-11-24 01:16:27 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 255 | Heal 02-Scale Vdu Healing | FAIL | 2024-11-24 01:16:27 | 2024-11-24 01:18:00 | 7 | 11 | Network Service Instance Test | Create Network Service |
| 256 | Heal 03-Multiple Healing | FAIL | 2024-11-24 01:18:00 | 2024-11-24 01:19:48 | 6 | 12 | Network Service Instance Test | Create Network Service |
| 265 | Sa 01-Vnf With Vim Metrics | FAIL | 2024-11-24 01:44:54 | 2024-11-24 02:00:16 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 266 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2024-11-24 02:00:16 | 2024-11-24 02:33:49 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 267 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2024-11-24 02:33:49 | 2024-11-24 02:54:46 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v15.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 186 | Basic 01-Crud Operations On Vim Targets | FAIL | 2024-11-24 03:56:10 | 2024-11-24 03:59:19 | 3 | 1 | Create VIM Target With Extra Config | Check For VIM Target Status |
| 188 | Basic 08-Disable Port Security Network Level | FAIL | 2024-11-24 04:01:35 | 2024-11-24 04:07:28 | 8 | 1 | Create VIM With Port Security Disabled | Check For VIM Target Status |
| 195 | Basic 21-Support Of Volumes | FAIL | 2024-11-24 04:18:05 | 2024-11-24 04:19:27 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 199 | Basic 28-Keep Persistent Volumes | FAIL | 2024-11-24 04:25:49 | 2024-11-24 04:27:10 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 201 | Basic 30-Ns Ipv6 Profile | FAIL | 2024-11-24 04:28:59 | 2024-11-24 04:33:57 | 11 | 1 | Verify Vnf2 Interfaces | Execute Remote Command Check Rc Return Output |
| 202 | Basic 31-Multivdu Volume Multiattach | FAIL | 2024-11-24 04:33:57 | 2024-11-24 04:35:16 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 211 | Heal 01-Volume Vdu Healing | FAIL | 2024-11-24 04:50:10 | 2024-11-24 04:51:39 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 212 | Heal 02-Scale Vdu Healing | FAIL | 2024-11-24 04:51:39 | 2024-11-24 04:53:08 | 7 | 11 | Network Service Instance Test | Create Network Service |
| 213 | Heal 03-Multiple Healing | FAIL | 2024-11-24 04:53:08 | 2024-11-24 04:54:36 | 6 | 12 | Network Service Instance Test | Create Network Service |
| 221 | Sa 01-Vnf With Vim Metrics | FAIL | 2024-11-24 05:15:40 | 2024-11-24 05:31:31 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 222 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2024-11-24 05:31:31 | 2024-11-24 06:05:01 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 223 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2024-11-24 06:05:01 | 2024-11-24 06:25:55 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v14.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 129 | Basic 01-Crud Operations On Vim Targets | FAIL | 2024-11-23 23:30:13 | 2024-11-23 23:36:29 | 2 | 2 | Create VIM Target Basic | Check for VIM Target Metric |
| 133 | Basic 08-Disable Port Security Network Level | FAIL | 2024-11-23 23:48:18 | 2024-11-23 23:54:11 | 8 | 1 | Create VIM With Port Security Disabled | Check for VIM Target Status |
| 145 | Basic 21-Support Of Volumes | FAIL | 2024-11-24 00:32:14 | 2024-11-24 00:33:34 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 152 | Basic 28-Keep Persistent Volumes | FAIL | 2024-11-24 00:55:35 | 2024-11-24 00:56:58 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 154 | Basic 30-Ns Ipv6 Profile | FAIL | 2024-11-24 00:58:48 | 2024-11-24 01:03:45 | 11 | 1 | Verify Vnf1 Interfaces | Execute Remote Command Check Rc Return Output |
| 155 | Basic 31-Multivdu Volume Multiattach | FAIL | 2024-11-24 01:03:45 | 2024-11-24 01:05:05 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 164 | Heal 01-Volume Vdu Healing | FAIL | 2024-11-24 01:21:23 | 2024-11-24 01:26:26 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 165 | Heal 02-Scale Vdu Healing | FAIL | 2024-11-24 01:26:26 | 2024-11-24 01:31:27 | 7 | 9 | Network Service Instance Test | Create Network Service |
| 166 | Heal 03-Multiple Healing | FAIL | 2024-11-24 01:31:27 | 2024-11-24 01:36:28 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 179 | Sa 01-Vnf With Vim Metrics | FAIL | 2024-11-24 02:22:25 | 2024-11-24 02:37:44 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 180 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2024-11-24 02:37:44 | 2024-11-24 03:11:46 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 181 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2024-11-24 03:11:46 | 2024-11-24 03:32:37 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/master: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime |
|---|
osm-stage_3-merge/v16.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 961 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 00:41:53 | 2024-11-24 00:42:33 |
| 969 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2024-11-24 00:42:35 | 2024-11-24 00:42:35 |
| 973 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2024-11-24 00:42:35 | 2024-11-24 00:42:35 |
| 984 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 00:49:14 | 2024-11-24 00:49:54 |
| 986 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2024-11-24 00:49:54 | 2024-11-24 00:49:54 |
| 991 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2024-11-24 00:49:54 | 2024-11-24 00:49:54 |
| 995 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2024-11-24 00:50:16 | 2024-11-24 00:50:16 |
| 998 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2024-11-24 00:50:16 | 2024-11-24 00:50:16 |
| 1001 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2024-11-24 00:50:16 | 2024-11-24 00:50:16 |
| 1002 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2024-11-24 00:50:16 | 2024-11-24 00:50:16 |
| 1004 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2024-11-24 00:50:16 | 2024-11-24 00:50:16 |
| 1012 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2024-11-24 00:50:16 | 2024-11-24 00:50:17 |
| 1013 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2024-11-24 00:50:17 | 2024-11-24 00:50:17 |
| 1017 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2024-11-24 00:50:17 | 2024-11-24 00:50:17 |
| 1056 | Basic 30-Ns Ipv6 Profile | Verify Vnf2 Interfaces | Execute Remote Command Check Rc Return Output | FAIL | 2024-11-24 00:55:59 | 2024-11-24 00:56:32 |
| 1079 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 00:57:16 | 2024-11-24 00:57:56 |
| 1082 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2024-11-24 00:57:56 | 2024-11-24 00:57:56 |
| 1084 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2024-11-24 00:57:56 | 2024-11-24 00:57:56 |
| 1090 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2024-11-24 00:57:56 | 2024-11-24 00:57:56 |
| 1103 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 01:14:59 | 2024-11-24 01:15:39 |
| 1106 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:15:39 | 2024-11-24 01:15:39 |
| 1111 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:15:39 | 2024-11-24 01:15:39 |
| 1128 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2024-11-24 01:15:41 | 2024-11-24 01:15:41 |
| 1131 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2024-11-24 01:15:41 | 2024-11-24 01:15:41 |
| 1137 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2024-11-24 01:15:41 | 2024-11-24 01:15:41 |
| 1140 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2024-11-24 01:15:41 | 2024-11-24 01:15:41 |
| 1142 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-11-24 01:15:41 | 2024-11-24 01:15:41 |
| 1157 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:15:41 | 2024-11-24 01:15:41 |
| 1175 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 01:16:34 | 2024-11-24 01:17:13 |
| 1178 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1186 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1191 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1201 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1206 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1209 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1211 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1223 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1227 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:17:13 | 2024-11-24 01:17:13 |
| 1240 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 01:18:05 | 2024-11-24 01:18:45 |
| 1243 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1251 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1256 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1266 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1278 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1283 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1289 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1292 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1303 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1307 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:18:45 | 2024-11-24 01:18:45 |
| 1327 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2024-11-24 01:45:37 | 2024-11-24 01:59:37 |
| 1357 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2024-11-24 02:01:05 | 2024-11-24 02:15:06 |
| 1362 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2024-11-24 02:15:08 | 2024-11-24 02:29:09 |
| 1365 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2024-11-24 02:31:09 | 2024-11-24 02:31:09 |
| 1396 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2024-11-24 02:35:59 | 2024-11-24 02:49:59 |
| 1397 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2024-11-24 02:49:59 | 2024-11-24 02:53:29 |
osm-stage_3-merge/v15.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 494 | Basic 01-Crud Operations On Vim Targets | Create VIM Target With Extra Config | Check For VIM Target Status | FAIL | 2024-11-24 03:56:13 | 2024-11-24 03:59:15 |
| 500 | Basic 08-Disable Port Security Network Level | Create VIM With Port Security Disabled | Check For VIM Target Status | FAIL | 2024-11-24 04:01:36 | 2024-11-24 04:04:38 |
| 513 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 04:18:09 | 2024-11-24 04:18:48 |
| 521 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2024-11-24 04:18:49 | 2024-11-24 04:18:49 |
| 525 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2024-11-24 04:18:49 | 2024-11-24 04:18:49 |
| 536 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 04:25:52 | 2024-11-24 04:26:31 |
| 538 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2024-11-24 04:26:31 | 2024-11-24 04:26:31 |
| 543 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2024-11-24 04:26:31 | 2024-11-24 04:26:31 |
| 547 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2024-11-24 04:26:52 | 2024-11-24 04:26:52 |
| 550 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2024-11-24 04:26:52 | 2024-11-24 04:26:52 |
| 553 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2024-11-24 04:26:52 | 2024-11-24 04:26:52 |
| 554 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2024-11-24 04:26:52 | 2024-11-24 04:26:52 |
| 556 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2024-11-24 04:26:52 | 2024-11-24 04:26:52 |
| 564 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2024-11-24 04:26:52 | 2024-11-24 04:26:54 |
| 565 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2024-11-24 04:26:54 | 2024-11-24 04:26:54 |
| 569 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2024-11-24 04:26:54 | 2024-11-24 04:26:54 |
| 608 | Basic 30-Ns Ipv6 Profile | Verify Vnf2 Interfaces | Execute Remote Command Check Rc Return Output | FAIL | 2024-11-24 04:32:28 | 2024-11-24 04:33:00 |
| 631 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 04:34:00 | 2024-11-24 04:34:39 |
| 634 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2024-11-24 04:34:39 | 2024-11-24 04:34:39 |
| 636 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2024-11-24 04:34:39 | 2024-11-24 04:34:39 |
| 642 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2024-11-24 04:34:39 | 2024-11-24 04:34:39 |
| 655 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 04:50:16 | 2024-11-24 04:50:54 |
| 658 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 04:50:54 | 2024-11-24 04:50:54 |
| 663 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-11-24 04:50:54 | 2024-11-24 04:50:54 |
| 680 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2024-11-24 04:50:55 | 2024-11-24 04:50:55 |
| 683 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2024-11-24 04:50:55 | 2024-11-24 04:50:55 |
| 689 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2024-11-24 04:50:55 | 2024-11-24 04:50:55 |
| 692 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2024-11-24 04:50:55 | 2024-11-24 04:50:55 |
| 694 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-11-24 04:50:55 | 2024-11-24 04:50:55 |
| 709 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 04:50:55 | 2024-11-24 04:50:55 |
| 727 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 04:51:45 | 2024-11-24 04:52:23 |
| 730 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 738 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 743 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 753 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 758 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 761 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 763 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 775 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 779 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 04:52:23 | 2024-11-24 04:52:23 |
| 792 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 04:53:13 | 2024-11-24 04:53:52 |
| 795 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 803 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 808 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 818 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 830 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 835 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 841 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 844 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 855 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 859 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 04:53:52 | 2024-11-24 04:53:52 |
| 880 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2024-11-24 05:16:54 | 2024-11-24 05:30:55 |
| 911 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2024-11-24 05:32:19 | 2024-11-24 05:46:20 |
| 916 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2024-11-24 05:46:22 | 2024-11-24 06:00:22 |
| 919 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2024-11-24 06:02:22 | 2024-11-24 06:02:22 |
| 951 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2024-11-24 06:07:09 | 2024-11-24 06:21:10 |
| 952 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2024-11-24 06:21:10 | 2024-11-24 06:24:40 |
osm-stage_3-merge/v14.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 7 | Basic 01-Crud Operations On Vim Targets | Create VIM Target Basic | Check for VIM Target Metric | FAIL | 2024-11-23 23:30:16 | 2024-11-23 23:33:17 |
| 18 | Basic 01-Crud Operations On Vim Targets | Create VIM Target With Extra Config | Check for VIM Target Status | FAIL | 2024-11-23 23:33:24 | 2024-11-23 23:36:26 |
| 23 | Basic 08-Disable Port Security Network Level | Create VIM With Port Security Disabled | Check for VIM Target Status | FAIL | 2024-11-23 23:48:19 | 2024-11-23 23:51:21 |
| 36 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 00:32:16 | 2024-11-24 00:32:55 |
| 44 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2024-11-24 00:32:57 | 2024-11-24 00:32:57 |
| 48 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2024-11-24 00:32:57 | 2024-11-24 00:32:57 |
| 60 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 00:55:39 | 2024-11-24 00:56:19 |
| 62 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2024-11-24 00:56:19 | 2024-11-24 00:56:19 |
| 68 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2024-11-24 00:56:19 | 2024-11-24 00:56:19 |
| 72 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2024-11-24 00:56:40 | 2024-11-24 00:56:40 |
| 75 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2024-11-24 00:56:40 | 2024-11-24 00:56:40 |
| 78 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2024-11-24 00:56:40 | 2024-11-24 00:56:40 |
| 79 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2024-11-24 00:56:40 | 2024-11-24 00:56:40 |
| 81 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2024-11-24 00:56:40 | 2024-11-24 00:56:40 |
| 89 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2024-11-24 00:56:40 | 2024-11-24 00:56:42 |
| 90 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2024-11-24 00:56:42 | 2024-11-24 00:56:42 |
| 96 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Delete Volume | FAIL | 2024-11-24 00:56:42 | 2024-11-24 00:56:42 |
| 128 | Basic 30-Ns Ipv6 Profile | Verify Vnf1 Interfaces | Execute Remote Command Check Rc Return Output | FAIL | 2024-11-24 01:02:10 | 2024-11-24 01:02:43 |
| 157 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 01:03:48 | 2024-11-24 01:04:27 |
| 160 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2024-11-24 01:04:27 | 2024-11-24 01:04:27 |
| 162 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2024-11-24 01:04:27 | 2024-11-24 01:04:27 |
| 166 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2024-11-24 01:04:27 | 2024-11-24 01:04:27 |
| 179 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 01:21:29 | 2024-11-24 01:25:23 |
| 182 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:25:23 | 2024-11-24 01:25:23 |
| 187 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:25:23 | 2024-11-24 01:25:23 |
| 204 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2024-11-24 01:25:24 | 2024-11-24 01:25:24 |
| 207 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2024-11-24 01:25:24 | 2024-11-24 01:25:24 |
| 214 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2024-11-24 01:25:24 | 2024-11-24 01:25:24 |
| 217 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2024-11-24 01:25:24 | 2024-11-24 01:25:24 |
| 219 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-11-24 01:25:24 | 2024-11-24 01:25:24 |
| 235 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:25:24 | 2024-11-24 01:25:24 |
| 253 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 01:26:33 | 2024-11-24 01:30:25 |
| 256 | Heal 02-Scale Vdu Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2024-11-24 01:30:25 | 2024-11-24 01:30:25 |
| 265 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:30:25 | 2024-11-24 01:30:25 |
| 270 | Heal 02-Scale Vdu Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:30:25 | 2024-11-24 01:30:25 |
| 278 | Heal 02-Scale Vdu Healing | Halt Charm VDU | Variable Should Exist | FAIL | 2024-11-24 01:30:25 | 2024-11-24 01:30:25 |
| 281 | Heal 02-Scale Vdu Healing | Heal Charm VDU | Variable Should Exist | FAIL | 2024-11-24 01:30:25 | 2024-11-24 01:30:25 |
| 283 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2024-11-24 01:30:25 | 2024-11-24 01:30:25 |
| 297 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:30:25 | 2024-11-24 01:30:25 |
| 311 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2024-11-24 01:31:33 | 2024-11-24 01:35:27 |
| 314 | Heal 03-Multiple Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 323 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 328 | Heal 03-Multiple Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 336 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 348 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 354 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 357 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 370 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2024-11-24 01:35:27 | 2024-11-24 01:35:27 |
| 391 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2024-11-24 02:23:07 | 2024-11-24 02:37:07 |
| 424 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2024-11-24 02:39:06 | 2024-11-24 02:53:06 |
| 431 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2024-11-24 02:53:08 | 2024-11-24 03:07:09 |
| 434 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2024-11-24 03:09:09 | 2024-11-24 03:09:09 |
| 439 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VDUs After Auto-scaling | Run Keyword If | FAIL | 2024-11-24 03:11:09 | 2024-11-24 03:11:09 |
| 466 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2024-11-24 03:13:53 | 2024-11-24 03:27:53 |
| 468 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2024-11-24 03:27:53 | 2024-11-24 03:31:23 |
Powered by osm-analytics