Empty dataframe. Skipping.
Date and time of the report: 2025-05-29 08:20:23.050551
Analysed period: 2025-05-08 to 2025-05-29.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result is the outcome of the build, reported by Jenkins. It can be: SUCCESS, FAILURE, UNSTABLE or ABORTED.test_result is the summary of the concerned Robot tests. It can be: FAIL, UNAVAILABLE or PASS.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result.grp_test_result.grp_success_fail.For the identification of these sequences, the following mapping applies:
| Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
|---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
Empty dataframe. Skipping.
Empty dataframe. Skipping.
Empty dataframe. Skipping.
| job | Master branch | Release FOURTEEN | Release SIXTEEN | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | |
| suites | ||||||||||||
| Basic 01-Crud Operations On Vim Targets | 0.0 | 21.500035 | 21.500035 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.586829 | 20.586829 | 0.0 |
| Basic 05-Instantiation Parameters In Cloud Init | 0.0 | 21.500035 | 21.500035 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.586829 | 20.586829 | 0.0 |
| Basic 06-Vnf With Charm | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
| Basic 07-Secure Key Management | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
| Basic 08-Disable Port Security Network Level | 0.0 | 21.500035 | 21.500035 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.586829 | 20.586829 | 0.0 |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| Slice 02-Shared Network Slicing | 0.0 | 21.500035 | 21.500035 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.586829 | 20.586829 | 0.0 |
| Sol003 01-Vnf-Lifecycle-Management | 0.0 | 21.500035 | 21.500035 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.586829 | 20.586829 | 0.0 |
| Sol003 02-Dualstack Ip Vnfm | 0.0 | 21.500035 | 21.500035 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.586829 | 20.586829 | 0.0 |
| basic 23-delete vnf package SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
| k8s 10-k8s proxy charms SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 |
67 rows × 12 columns
| job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
|---|---|---|---|---|---|---|---|---|
| 0 | osm-stage_3-merge/master | 3373 | 2025-05-29 01:06:23 | 12275564 | UNSTABLE | FAIL | 409.0 | 63.0 |
| 1 | osm-stage_3-merge/v16.0 | 255 | 2025-05-28 23:01:22 | 12162369 | UNSTABLE | FAIL | 410.0 | 62.0 |
| 2 | osm-stage_3-merge/v15.0 | 446 | 2025-03-21 03:34:47 | 12254896 | UNSTABLE | FAIL | 448.0 | 7.0 |
| 3 | osm-stage_3-merge/v14.0 | 672 | 2025-05-28 22:08:22 | 19875887 | UNSTABLE | FAIL | 559.0 | 60.0 |
osm-stage_3-merge/master: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 181 | Basic 21-Support Of Volumes | FAIL | 2025-05-29 01:45:13 | 2025-05-29 01:46:40 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 183 | Basic 24-Affinity Groups | FAIL | 2025-05-29 01:46:53 | 2025-05-29 01:49:01 | 6 | 1 | None | None |
| 185 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-29 01:53:29 | 2025-05-29 01:54:57 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 188 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-29 02:01:19 | 2025-05-29 02:02:44 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 197 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-29 02:19:58 | 2025-05-29 02:21:51 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 198 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-29 02:21:51 | 2025-05-29 02:23:31 | 7 | 11 | Network Service Instance Test | Create Network Service |
| 199 | Heal 03-Multiple Healing | FAIL | 2025-05-29 02:23:31 | 2025-05-29 02:25:05 | 6 | 12 | Network Service Instance Test | Create Network Service |
| 200 | Heal 04-Autohealing | FAIL | 2025-05-29 02:25:05 | 2025-05-29 02:37:29 | 12 | 2 | Wait For Autohealing To Be Completed | Wait Until Keyword Succeeds |
| 208 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-29 02:54:32 | 2025-05-29 03:10:31 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 209 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-29 03:10:31 | 2025-05-29 03:44:08 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 210 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-29 03:44:08 | 2025-05-29 04:05:12 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
| 211 | Sa 08-Vnf With Vnf Indicators Snmp | FAIL | 2025-05-29 04:05:12 | 2025-05-29 04:13:31 | 6 | 1 | Instantiate Network Service | Create Network Service |
osm-stage_3-merge/v16.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 283 | Basic 21-Support Of Volumes | FAIL | 2025-05-28 23:42:42 | 2025-05-28 23:44:02 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 285 | Basic 24-Affinity Groups | FAIL | 2025-05-28 23:44:14 | 2025-05-28 23:46:13 | 6 | 1 | None | None |
| 287 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-28 23:50:00 | 2025-05-28 23:51:23 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 290 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-28 23:57:33 | 2025-05-28 23:58:51 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 299 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-29 00:14:12 | 2025-05-29 00:15:40 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 300 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-29 00:15:40 | 2025-05-29 00:17:07 | 7 | 11 | Network Service Instance Test | Create Network Service |
| 301 | Heal 03-Multiple Healing | FAIL | 2025-05-29 00:17:07 | 2025-05-29 00:18:32 | 6 | 12 | Network Service Instance Test | Create Network Service |
| 310 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-29 00:41:56 | 2025-05-29 00:57:47 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 311 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-29 00:57:47 | 2025-05-29 01:31:17 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 312 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-29 01:31:17 | 2025-05-29 01:52:07 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
| 313 | Sa 08-Vnf With Vnf Indicators Snmp | FAIL | 2025-05-29 01:52:07 | 2025-05-29 02:07:12 | 5 | 2 | Instantiate Network Service | Create Network Service |
osm-stage_3-merge/v15.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 164 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-03-21 05:28:39 | 2025-03-21 05:43:58 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 165 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-03-21 05:43:58 | 2025-03-21 06:17:27 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 166 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-03-21 06:17:27 | 2025-03-21 06:38:22 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v14.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 232 | Basic 21-Support Of Volumes | FAIL | 2025-05-28 23:43:42 | 2025-05-28 23:45:03 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 235 | Basic 24-Affinity Groups | FAIL | 2025-05-28 23:54:54 | 2025-05-28 23:56:53 | 6 | 1 | None | None |
| 239 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-29 00:09:08 | 2025-05-29 00:10:32 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 242 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-29 00:16:43 | 2025-05-29 00:18:01 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 251 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-29 00:33:59 | 2025-05-29 00:41:23 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 252 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-29 00:41:23 | 2025-05-29 00:46:58 | 7 | 9 | Network Service Instance Test | Create Network Service |
| 253 | Heal 03-Multiple Healing | FAIL | 2025-05-29 00:46:58 | 2025-05-29 00:51:59 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 259 | K8S 06-K8S Secure Key Management | FAIL | 2025-05-29 01:13:31 | 2025-05-29 01:33:53 | 8 | 4 | Instantiate Charm Network Service | Create Network Service |
| 267 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-29 02:06:01 | 2025-05-29 02:21:21 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 268 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-29 02:21:21 | 2025-05-29 02:54:52 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 269 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-29 02:54:52 | 2025-05-29 03:15:48 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/master: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 89 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 01:45:16 | 2025-05-29 01:45:57 |
| 97 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-29 01:45:59 | 2025-05-29 01:45:59 |
| 101 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-29 01:45:59 | 2025-05-29 01:45:59 |
| 122 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 01:53:32 | 2025-05-29 01:54:13 |
| 124 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-29 01:54:13 | 2025-05-29 01:54:13 |
| 129 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-29 01:54:13 | 2025-05-29 01:54:13 |
| 133 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-29 01:54:37 | 2025-05-29 01:54:37 |
| 136 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-29 01:54:37 | 2025-05-29 01:54:37 |
| 139 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-29 01:54:37 | 2025-05-29 01:54:37 |
| 140 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-29 01:54:37 | 2025-05-29 01:54:37 |
| 142 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-29 01:54:37 | 2025-05-29 01:54:37 |
| 150 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-29 01:54:37 | 2025-05-29 01:54:39 |
| 151 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-29 01:54:39 | 2025-05-29 01:54:39 |
| 155 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2025-05-29 01:54:39 | 2025-05-29 01:54:39 |
| 163 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 02:01:22 | 2025-05-29 02:02:03 |
| 166 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-29 02:02:03 | 2025-05-29 02:02:03 |
| 168 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-29 02:02:03 | 2025-05-29 02:02:03 |
| 174 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-29 02:02:03 | 2025-05-29 02:02:03 |
| 187 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 02:20:04 | 2025-05-29 02:20:44 |
| 190 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 02:20:44 | 2025-05-29 02:20:44 |
| 195 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-29 02:20:44 | 2025-05-29 02:20:44 |
| 212 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-29 02:20:46 | 2025-05-29 02:20:46 |
| 215 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-29 02:20:46 | 2025-05-29 02:20:46 |
| 221 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-29 02:20:46 | 2025-05-29 02:20:46 |
| 224 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-29 02:20:46 | 2025-05-29 02:20:46 |
| 226 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-29 02:20:46 | 2025-05-29 02:20:46 |
| 241 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 02:20:46 | 2025-05-29 02:20:46 |
| 259 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 02:21:58 | 2025-05-29 02:22:37 |
| 262 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 270 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 275 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 285 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 290 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 293 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 295 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 307 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 311 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 02:22:37 | 2025-05-29 02:22:37 |
| 324 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 02:23:36 | 2025-05-29 02:24:17 |
| 327 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 335 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 340 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 350 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 362 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 367 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 373 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 376 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 387 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 391 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 02:24:17 | 2025-05-29 02:24:17 |
| 427 | Heal 04-Autohealing | Wait For Autohealing To Be Completed | Wait Until Keyword Succeeds | FAIL | 2025-05-29 02:26:33 | 2025-05-29 02:36:40 |
| 437 | Heal 04-Autohealing | Check VNF After Healing | Should Not Be Equal | FAIL | 2025-05-29 02:36:44 | 2025-05-29 02:36:44 |
| 455 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-29 02:55:49 | 2025-05-29 03:09:50 |
| 485 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-29 03:11:22 | 2025-05-29 03:25:23 |
| 490 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-29 03:25:26 | 2025-05-29 03:39:27 |
| 493 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-29 03:41:27 | 2025-05-29 03:41:27 |
| 524 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-29 03:46:20 | 2025-05-29 04:00:21 |
| 525 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-29 04:00:21 | 2025-05-29 04:03:51 |
| 534 | Sa 08-Vnf With Vnf Indicators Snmp | Instantiate Network Service | Create Network Service | FAIL | 2025-05-29 04:05:16 | 2025-05-29 04:10:50 |
osm-stage_3-merge/v16.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 970 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 23:42:45 | 2025-05-28 23:43:24 |
| 978 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-28 23:43:25 | 2025-05-28 23:43:25 |
| 982 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-28 23:43:25 | 2025-05-28 23:43:25 |
| 1003 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 23:50:04 | 2025-05-28 23:50:45 |
| 1005 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-28 23:50:45 | 2025-05-28 23:50:45 |
| 1010 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-28 23:50:45 | 2025-05-28 23:50:45 |
| 1014 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-28 23:51:06 | 2025-05-28 23:51:06 |
| 1017 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-28 23:51:06 | 2025-05-28 23:51:06 |
| 1020 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-28 23:51:06 | 2025-05-28 23:51:06 |
| 1021 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-28 23:51:06 | 2025-05-28 23:51:06 |
| 1023 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-28 23:51:06 | 2025-05-28 23:51:06 |
| 1031 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-28 23:51:06 | 2025-05-28 23:51:07 |
| 1032 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-28 23:51:07 | 2025-05-28 23:51:07 |
| 1036 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2025-05-28 23:51:07 | 2025-05-28 23:51:07 |
| 1044 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 23:57:36 | 2025-05-28 23:58:14 |
| 1047 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-28 23:58:14 | 2025-05-28 23:58:14 |
| 1049 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-28 23:58:14 | 2025-05-28 23:58:14 |
| 1055 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-28 23:58:14 | 2025-05-28 23:58:14 |
| 1068 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:14:17 | 2025-05-29 00:14:56 |
| 1071 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:14:56 | 2025-05-29 00:14:56 |
| 1076 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:14:56 | 2025-05-29 00:14:56 |
| 1093 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-29 00:14:57 | 2025-05-29 00:14:57 |
| 1096 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-29 00:14:57 | 2025-05-29 00:14:57 |
| 1102 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-29 00:14:57 | 2025-05-29 00:14:57 |
| 1105 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-29 00:14:57 | 2025-05-29 00:14:57 |
| 1107 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-29 00:14:57 | 2025-05-29 00:14:57 |
| 1122 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:14:57 | 2025-05-29 00:14:57 |
| 1140 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:15:46 | 2025-05-29 00:16:23 |
| 1143 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1151 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1156 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1166 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1171 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1174 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1176 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1188 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1192 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:16:23 | 2025-05-29 00:16:23 |
| 1205 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:17:11 | 2025-05-29 00:17:49 |
| 1208 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1216 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1221 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1231 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1243 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1248 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1254 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1257 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1268 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1272 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:17:49 | 2025-05-29 00:17:49 |
| 1292 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-29 00:43:11 | 2025-05-29 00:57:12 |
| 1322 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-29 00:58:35 | 2025-05-29 01:12:36 |
| 1327 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-29 01:12:38 | 2025-05-29 01:26:39 |
| 1330 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-29 01:28:39 | 2025-05-29 01:28:39 |
| 1361 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-29 01:33:23 | 2025-05-29 01:47:24 |
| 1362 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-29 01:47:24 | 2025-05-29 01:50:54 |
| 1371 | Sa 08-Vnf With Vnf Indicators Snmp | Instantiate Network Service | Create Network Service | FAIL | 2025-05-29 01:52:11 | 2025-05-29 01:57:37 |
| 1376 | Sa 08-Vnf With Vnf Indicators Snmp | Get VNF SNMP Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-29 01:57:37 | 2025-05-29 02:06:37 |
osm-stage_3-merge/v15.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 10 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:29:21 | 2025-03-21 05:43:21 |
| 40 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:44:46 | 2025-03-21 05:58:46 |
| 45 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:58:49 | 2025-03-21 06:12:49 |
| 48 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-03-21 06:14:49 | 2025-03-21 06:14:49 |
| 79 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:19:35 | 2025-03-21 06:33:35 |
| 80 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:33:35 | 2025-03-21 06:37:06 |
osm-stage_3-merge/v14.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 546 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 23:43:45 | 2025-05-28 23:44:24 |
| 554 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-28 23:44:25 | 2025-05-28 23:44:25 |
| 558 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-28 23:44:25 | 2025-05-28 23:44:25 |
| 580 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:09:12 | 2025-05-29 00:09:53 |
| 582 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-29 00:09:53 | 2025-05-29 00:09:53 |
| 588 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-29 00:09:53 | 2025-05-29 00:09:53 |
| 592 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-29 00:10:15 | 2025-05-29 00:10:15 |
| 595 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-29 00:10:15 | 2025-05-29 00:10:15 |
| 598 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-29 00:10:15 | 2025-05-29 00:10:15 |
| 599 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-29 00:10:15 | 2025-05-29 00:10:15 |
| 601 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-29 00:10:15 | 2025-05-29 00:10:15 |
| 609 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-29 00:10:15 | 2025-05-29 00:10:16 |
| 610 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-29 00:10:16 | 2025-05-29 00:10:16 |
| 616 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Delete Volume | FAIL | 2025-05-29 00:10:16 | 2025-05-29 00:10:16 |
| 624 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:16:46 | 2025-05-29 00:17:24 |
| 627 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-29 00:17:24 | 2025-05-29 00:17:24 |
| 629 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-29 00:17:24 | 2025-05-29 00:17:24 |
| 633 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-29 00:17:24 | 2025-05-29 00:17:24 |
| 646 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:34:05 | 2025-05-29 00:40:38 |
| 649 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:40:38 | 2025-05-29 00:40:38 |
| 654 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:40:38 | 2025-05-29 00:40:38 |
| 671 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-29 00:40:40 | 2025-05-29 00:40:40 |
| 674 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-29 00:40:40 | 2025-05-29 00:40:40 |
| 681 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-29 00:40:40 | 2025-05-29 00:40:40 |
| 684 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-29 00:40:40 | 2025-05-29 00:40:40 |
| 686 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-29 00:40:40 | 2025-05-29 00:40:40 |
| 702 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:40:40 | 2025-05-29 00:40:40 |
| 720 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:41:31 | 2025-05-29 00:45:56 |
| 723 | Heal 02-Scale Vdu Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2025-05-29 00:45:56 | 2025-05-29 00:45:56 |
| 732 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:45:56 | 2025-05-29 00:45:56 |
| 737 | Heal 02-Scale Vdu Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:45:56 | 2025-05-29 00:45:56 |
| 745 | Heal 02-Scale Vdu Healing | Halt Charm VDU | Variable Should Exist | FAIL | 2025-05-29 00:45:56 | 2025-05-29 00:45:56 |
| 748 | Heal 02-Scale Vdu Healing | Heal Charm VDU | Variable Should Exist | FAIL | 2025-05-29 00:45:56 | 2025-05-29 00:45:56 |
| 750 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-29 00:45:56 | 2025-05-29 00:45:56 |
| 764 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:45:56 | 2025-05-29 00:45:56 |
| 778 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-29 00:47:05 | 2025-05-29 00:50:58 |
| 781 | Heal 03-Multiple Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 790 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 795 | Heal 03-Multiple Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 803 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 815 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 821 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 824 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 837 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-29 00:50:58 | 2025-05-29 00:50:58 |
| 849 | K8S 06-K8S Secure Key Management | Instantiate Charm Network Service | Create Network Service | FAIL | 2025-05-29 01:13:36 | 2025-05-29 01:28:51 |
| 864 | K8S 06-K8S Secure Key Management | Check Remote Files Created Via Day 1 Operations | Check If remote File Exists | FAIL | 2025-05-29 01:29:31 | 2025-05-29 01:29:33 |
| 866 | K8S 06-K8S Secure Key Management | Execute Day 2 Operations | Execute NS Action | FAIL | 2025-05-29 01:29:33 | 2025-05-29 01:30:37 |
| 868 | K8S 06-K8S Secure Key Management | Check Remote Files Created Via Day 2 Operations | Check If remote File Exists | FAIL | 2025-05-29 01:30:37 | 2025-05-29 01:30:39 |
| 884 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-29 02:06:45 | 2025-05-29 02:20:45 |
| 917 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-29 02:22:10 | 2025-05-29 02:36:11 |
| 924 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-29 02:36:13 | 2025-05-29 02:50:13 |
| 927 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-29 02:52:13 | 2025-05-29 02:52:13 |
| 932 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VDUs After Auto-scaling | Run Keyword If | FAIL | 2025-05-29 02:54:14 | 2025-05-29 02:54:14 |
| 959 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-29 02:57:02 | 2025-05-29 03:11:02 |
| 961 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-29 03:11:02 | 2025-05-29 03:14:33 |
Powered by osm-analytics