Date and time of the report: 2025-05-28 08:20:22.503087
Analysed period: 2025-05-07 to 2025-05-28.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result is the outcome of the build, reported by Jenkins. It can be: SUCCESS, FAILURE, UNSTABLE or ABORTED.test_result is the summary of the concerned Robot tests. It can be: FAIL, UNAVAILABLE or PASS.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result.grp_test_result.grp_success_fail.For the identification of these sequences, the following mapping applies:
| Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
|---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
Empty dataframe. Skipping.
Empty dataframe. Skipping.
Empty dataframe. Skipping.
| job | Master branch | Release FOURTEEN | Release SIXTEEN | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | |
| suites | ||||||||||||
| Basic 01-Crud Operations On Vim Targets | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
| Basic 05-Instantiation Parameters In Cloud Init | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
| Basic 06-Vnf With Charm | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
| Basic 07-Secure Key Management | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
| Basic 08-Disable Port Security Network Level | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| Slice 02-Shared Network Slicing | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
| Sol003 01-Vnf-Lifecycle-Management | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
| Sol003 02-Dualstack Ip Vnfm | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
| basic 23-delete vnf package SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
| k8s 10-k8s proxy charms SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
67 rows × 12 columns
| job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
|---|---|---|---|---|---|---|---|---|
| 0 | osm-stage_3-merge/master | 3372 | 2025-05-28 01:06:22 | 11923161 | UNSTABLE | FAIL | 410.0 | 62.0 |
| 1 | osm-stage_3-merge/v16.0 | 254 | 2025-05-27 23:01:22 | 11350472 | UNSTABLE | FAIL | 412.0 | 60.0 |
| 2 | osm-stage_3-merge/v15.0 | 446 | 2025-03-21 03:34:47 | 12254896 | UNSTABLE | FAIL | 448.0 | 7.0 |
| 3 | osm-stage_3-merge/v14.0 | 671 | 2025-05-27 22:08:27 | 16364646 | UNSTABLE | FAIL | 563.0 | 56.0 |
osm-stage_3-merge/master: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 181 | Basic 21-Support Of Volumes | FAIL | 2025-05-28 01:46:26 | 2025-05-28 01:47:54 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 183 | Basic 24-Affinity Groups | FAIL | 2025-05-28 01:48:06 | 2025-05-28 01:50:17 | 6 | 1 | None | None |
| 185 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-28 01:54:06 | 2025-05-28 01:55:35 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 188 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-28 02:01:39 | 2025-05-28 02:03:06 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 197 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-28 02:20:37 | 2025-05-28 02:22:12 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 198 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-28 02:22:12 | 2025-05-28 02:24:06 | 7 | 11 | Network Service Instance Test | Create Network Service |
| 199 | Heal 03-Multiple Healing | FAIL | 2025-05-28 02:24:06 | 2025-05-28 02:25:40 | 6 | 12 | Network Service Instance Test | Create Network Service |
| 200 | Heal 04-Autohealing | FAIL | 2025-05-28 02:25:40 | 2025-05-28 02:38:09 | 12 | 2 | Wait For Autohealing To Be Completed | Wait Until Keyword Succeeds |
| 208 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-28 02:55:11 | 2025-05-28 03:10:37 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 209 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-28 03:10:37 | 2025-05-28 03:44:12 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 210 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-28 03:44:12 | 2025-05-28 04:05:15 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v16.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 283 | Basic 21-Support Of Volumes | FAIL | 2025-05-27 23:39:24 | 2025-05-27 23:40:44 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 285 | Basic 24-Affinity Groups | FAIL | 2025-05-27 23:40:57 | 2025-05-27 23:42:56 | 6 | 1 | None | None |
| 287 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-27 23:47:14 | 2025-05-27 23:48:36 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 290 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-27 23:55:00 | 2025-05-27 23:56:20 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 299 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-28 00:12:47 | 2025-05-28 00:14:31 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 300 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-28 00:14:31 | 2025-05-28 00:15:59 | 7 | 11 | Network Service Instance Test | Create Network Service |
| 301 | Heal 03-Multiple Healing | FAIL | 2025-05-28 00:15:59 | 2025-05-28 00:17:23 | 6 | 12 | Network Service Instance Test | Create Network Service |
| 310 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-28 00:41:11 | 2025-05-28 00:56:30 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 311 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-28 00:56:30 | 2025-05-28 01:30:32 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 312 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-28 01:30:32 | 2025-05-28 01:51:25 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v15.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 164 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-03-21 05:28:39 | 2025-03-21 05:43:58 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 165 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-03-21 05:43:58 | 2025-03-21 06:17:27 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 166 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-03-21 06:17:27 | 2025-03-21 06:38:22 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v14.0: (full report)
| name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
|---|---|---|---|---|---|---|---|---|
| 232 | Basic 21-Support Of Volumes | FAIL | 2025-05-27 23:21:12 | 2025-05-27 23:22:30 | 6 | 4 | Network Service Instance Test | Create Network Service |
| 235 | Basic 24-Affinity Groups | FAIL | 2025-05-27 23:31:22 | 2025-05-27 23:33:17 | 6 | 1 | None | None |
| 239 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-27 23:44:42 | 2025-05-27 23:46:01 | 5 | 11 | Network Service Instance Test | Create Network Service |
| 242 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-27 23:52:04 | 2025-05-27 23:53:21 | 5 | 4 | Network Service Instance Test | Create Network Service |
| 251 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-28 00:09:34 | 2025-05-28 00:14:28 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 252 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-28 00:14:28 | 2025-05-28 00:19:22 | 7 | 9 | Network Service Instance Test | Create Network Service |
| 253 | Heal 03-Multiple Healing | FAIL | 2025-05-28 00:19:22 | 2025-05-28 00:21:18 | 6 | 10 | Network Service Instance Test | Create Network Service |
| 267 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-28 01:11:25 | 2025-05-28 01:26:43 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
| 268 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-28 01:26:43 | 2025-05-28 02:00:08 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
| 269 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-28 02:00:08 | 2025-05-28 02:21:25 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/master: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 89 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 01:46:30 | 2025-05-28 01:47:10 |
| 97 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-28 01:47:12 | 2025-05-28 01:47:12 |
| 101 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-28 01:47:12 | 2025-05-28 01:47:12 |
| 122 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 01:54:10 | 2025-05-28 01:54:52 |
| 124 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-28 01:54:52 | 2025-05-28 01:54:52 |
| 129 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-28 01:54:52 | 2025-05-28 01:54:52 |
| 133 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
| 136 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
| 139 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
| 140 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
| 142 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
| 150 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:17 |
| 151 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-28 01:55:17 | 2025-05-28 01:55:17 |
| 155 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2025-05-28 01:55:17 | 2025-05-28 01:55:17 |
| 163 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:01:43 | 2025-05-28 02:02:24 |
| 166 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-28 02:02:24 | 2025-05-28 02:02:24 |
| 168 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-28 02:02:24 | 2025-05-28 02:02:24 |
| 174 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-28 02:02:24 | 2025-05-28 02:02:24 |
| 187 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:20:43 | 2025-05-28 02:21:23 |
| 190 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:21:23 | 2025-05-28 02:21:23 |
| 195 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:21:23 | 2025-05-28 02:21:23 |
| 212 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
| 215 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
| 221 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
| 224 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
| 226 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
| 241 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
| 259 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:22:19 | 2025-05-28 02:22:58 |
| 262 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 270 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 275 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 285 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 290 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 293 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 295 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 307 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 311 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
| 324 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:24:11 | 2025-05-28 02:24:52 |
| 327 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 335 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 340 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 350 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 362 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 367 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 373 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 376 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 387 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 391 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
| 427 | Heal 04-Autohealing | Wait For Autohealing To Be Completed | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:27:12 | 2025-05-28 02:37:19 |
| 437 | Heal 04-Autohealing | Check VNF After Healing | Should Not Be Equal | FAIL | 2025-05-28 02:37:23 | 2025-05-28 02:37:23 |
| 455 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:55:56 | 2025-05-28 03:09:57 |
| 485 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-28 03:11:27 | 2025-05-28 03:25:28 |
| 490 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-28 03:25:30 | 2025-05-28 03:39:31 |
| 493 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-28 03:41:31 | 2025-05-28 03:41:31 |
| 524 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-28 03:46:25 | 2025-05-28 04:00:26 |
| 525 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-28 04:00:26 | 2025-05-28 04:03:56 |
osm-stage_3-merge/v16.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 932 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:39:28 | 2025-05-27 23:40:06 |
| 940 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-27 23:40:07 | 2025-05-27 23:40:07 |
| 944 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-27 23:40:07 | 2025-05-27 23:40:07 |
| 965 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:47:18 | 2025-05-27 23:47:56 |
| 967 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-27 23:47:56 | 2025-05-27 23:47:56 |
| 972 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-27 23:47:56 | 2025-05-27 23:47:56 |
| 976 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
| 979 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
| 982 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
| 983 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
| 985 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
| 993 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:20 |
| 994 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-27 23:48:20 | 2025-05-27 23:48:20 |
| 998 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2025-05-27 23:48:20 | 2025-05-27 23:48:20 |
| 1006 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:55:03 | 2025-05-27 23:55:41 |
| 1009 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-27 23:55:41 | 2025-05-27 23:55:41 |
| 1011 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-27 23:55:41 | 2025-05-27 23:55:41 |
| 1017 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-27 23:55:41 | 2025-05-27 23:55:41 |
| 1030 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:12:52 | 2025-05-28 00:13:30 |
| 1033 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:30 | 2025-05-28 00:13:30 |
| 1038 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:13:30 | 2025-05-28 00:13:30 |
| 1055 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 1058 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 1064 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 1067 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 1069 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 1084 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 1102 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:14:37 | 2025-05-28 00:15:14 |
| 1105 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1113 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1118 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1128 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1133 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1136 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1138 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1150 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1154 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
| 1167 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:16:02 | 2025-05-28 00:16:41 |
| 1170 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1178 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1183 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1193 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1205 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1210 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1216 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1219 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1230 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1234 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
| 1254 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-28 00:41:53 | 2025-05-28 00:55:54 |
| 1284 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-28 00:57:51 | 2025-05-28 01:11:52 |
| 1289 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:11:54 | 2025-05-28 01:25:55 |
| 1292 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-28 01:27:55 | 2025-05-28 01:27:55 |
| 1323 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:32:42 | 2025-05-28 01:46:43 |
| 1324 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:46:43 | 2025-05-28 01:50:12 |
osm-stage_3-merge/v15.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 10 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:29:21 | 2025-03-21 05:43:21 |
| 40 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:44:46 | 2025-03-21 05:58:46 |
| 45 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:58:49 | 2025-03-21 06:12:49 |
| 48 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-03-21 06:14:49 | 2025-03-21 06:14:49 |
| 79 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:19:35 | 2025-03-21 06:33:35 |
| 80 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:33:35 | 2025-03-21 06:37:06 |
osm-stage_3-merge/v14.0: (full report)
| suite_name | test_name | keyword_name | status | starttime | endtime | |
|---|---|---|---|---|---|---|
| 534 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:21:16 | 2025-05-27 23:21:54 |
| 542 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-27 23:21:55 | 2025-05-27 23:21:55 |
| 546 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-27 23:21:55 | 2025-05-27 23:21:55 |
| 568 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:44:46 | 2025-05-27 23:45:24 |
| 570 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-27 23:45:24 | 2025-05-27 23:45:24 |
| 576 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-27 23:45:24 | 2025-05-27 23:45:24 |
| 580 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
| 583 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
| 586 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
| 587 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
| 589 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
| 597 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:46 |
| 598 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-27 23:45:46 | 2025-05-27 23:45:46 |
| 604 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Delete Volume | FAIL | 2025-05-27 23:45:46 | 2025-05-27 23:45:46 |
| 612 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:52:07 | 2025-05-27 23:52:46 |
| 615 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-27 23:52:46 | 2025-05-27 23:52:46 |
| 617 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-27 23:52:46 | 2025-05-27 23:52:46 |
| 621 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-27 23:52:46 | 2025-05-27 23:52:46 |
| 634 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:09:40 | 2025-05-28 00:13:29 |
| 637 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:29 | 2025-05-28 00:13:29 |
| 642 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:13:29 | 2025-05-28 00:13:29 |
| 659 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 662 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 669 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 672 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 674 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 690 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
| 708 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:14:35 | 2025-05-28 00:18:24 |
| 711 | Heal 02-Scale Vdu Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
| 720 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
| 725 | Heal 02-Scale Vdu Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
| 733 | Heal 02-Scale Vdu Healing | Halt Charm VDU | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
| 736 | Heal 02-Scale Vdu Healing | Heal Charm VDU | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
| 738 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
| 752 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
| 766 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:19:28 | 2025-05-28 00:20:38 |
| 769 | Heal 03-Multiple Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 778 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 783 | Heal 03-Multiple Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 791 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 803 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 809 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 812 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 825 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
| 846 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:12:07 | 2025-05-28 01:26:07 |
| 879 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:27:30 | 2025-05-28 01:41:30 |
| 886 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:41:33 | 2025-05-28 01:55:33 |
| 889 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-28 01:57:33 | 2025-05-28 01:57:33 |
| 894 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VDUs After Auto-scaling | Run Keyword If | FAIL | 2025-05-28 01:59:33 | 2025-05-28 01:59:33 |
| 921 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:02:46 | 2025-05-28 02:16:46 |
| 923 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:16:46 | 2025-05-28 02:20:16 |
Powered by osm-analytics