Date and time of the report: 2025-05-28 08:20:22.503087
Analysed period: 2025-05-07 to 2025-05-28.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result
is the outcome of the build, reported by Jenkins. It can be: SUCCESS
, FAILURE
, UNSTABLE
or ABORTED
.test_result
is the summary of the concerned Robot tests. It can be: FAIL
, UNAVAILABLE
or PASS
.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result
.grp_test_result
.grp_success_fail
.For the identification of these sequences, the following mapping applies:
Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
Empty dataframe. Skipping.
Empty dataframe. Skipping.
Empty dataframe. Skipping.
job | Master branch | Release FOURTEEN | Release SIXTEEN | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | |
suites | ||||||||||||
Basic 01-Crud Operations On Vim Targets | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
Basic 05-Instantiation Parameters In Cloud Init | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
Basic 06-Vnf With Charm | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
Basic 07-Secure Key Management | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
Basic 08-Disable Port Security Network Level | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
Slice 02-Shared Network Slicing | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
Sol003 01-Vnf-Lifecycle-Management | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 20.623646 | 20.623646 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
Sol003 02-Dualstack Ip Vnfm | 0.0 | 21.500023 | 21.500023 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 20.58684 | 20.58684 | 0.0 |
basic 23-delete vnf package SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
k8s 10-k8s proxy charms SOL004 SOL007 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.000000 | 0.000000 | 0.0 | 0.0 | 0.00000 | 0.00000 | 0.0 |
67 rows × 12 columns
job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
---|---|---|---|---|---|---|---|---|
0 | osm-stage_3-merge/master | 3372 | 2025-05-28 01:06:22 | 11923161 | UNSTABLE | FAIL | 410.0 | 62.0 |
1 | osm-stage_3-merge/v16.0 | 254 | 2025-05-27 23:01:22 | 11350472 | UNSTABLE | FAIL | 412.0 | 60.0 |
2 | osm-stage_3-merge/v15.0 | 446 | 2025-03-21 03:34:47 | 12254896 | UNSTABLE | FAIL | 448.0 | 7.0 |
3 | osm-stage_3-merge/v14.0 | 671 | 2025-05-27 22:08:27 | 16364646 | UNSTABLE | FAIL | 563.0 | 56.0 |
osm-stage_3-merge/master: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
181 | Basic 21-Support Of Volumes | FAIL | 2025-05-28 01:46:26 | 2025-05-28 01:47:54 | 6 | 4 | Network Service Instance Test | Create Network Service |
183 | Basic 24-Affinity Groups | FAIL | 2025-05-28 01:48:06 | 2025-05-28 01:50:17 | 6 | 1 | None | None |
185 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-28 01:54:06 | 2025-05-28 01:55:35 | 5 | 11 | Network Service Instance Test | Create Network Service |
188 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-28 02:01:39 | 2025-05-28 02:03:06 | 5 | 4 | Network Service Instance Test | Create Network Service |
197 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-28 02:20:37 | 2025-05-28 02:22:12 | 6 | 10 | Network Service Instance Test | Create Network Service |
198 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-28 02:22:12 | 2025-05-28 02:24:06 | 7 | 11 | Network Service Instance Test | Create Network Service |
199 | Heal 03-Multiple Healing | FAIL | 2025-05-28 02:24:06 | 2025-05-28 02:25:40 | 6 | 12 | Network Service Instance Test | Create Network Service |
200 | Heal 04-Autohealing | FAIL | 2025-05-28 02:25:40 | 2025-05-28 02:38:09 | 12 | 2 | Wait For Autohealing To Be Completed | Wait Until Keyword Succeeds |
208 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-28 02:55:11 | 2025-05-28 03:10:37 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
209 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-28 03:10:37 | 2025-05-28 03:44:12 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
210 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-28 03:44:12 | 2025-05-28 04:05:15 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v16.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
283 | Basic 21-Support Of Volumes | FAIL | 2025-05-27 23:39:24 | 2025-05-27 23:40:44 | 6 | 4 | Network Service Instance Test | Create Network Service |
285 | Basic 24-Affinity Groups | FAIL | 2025-05-27 23:40:57 | 2025-05-27 23:42:56 | 6 | 1 | None | None |
287 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-27 23:47:14 | 2025-05-27 23:48:36 | 5 | 11 | Network Service Instance Test | Create Network Service |
290 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-27 23:55:00 | 2025-05-27 23:56:20 | 5 | 4 | Network Service Instance Test | Create Network Service |
299 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-28 00:12:47 | 2025-05-28 00:14:31 | 6 | 10 | Network Service Instance Test | Create Network Service |
300 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-28 00:14:31 | 2025-05-28 00:15:59 | 7 | 11 | Network Service Instance Test | Create Network Service |
301 | Heal 03-Multiple Healing | FAIL | 2025-05-28 00:15:59 | 2025-05-28 00:17:23 | 6 | 12 | Network Service Instance Test | Create Network Service |
310 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-28 00:41:11 | 2025-05-28 00:56:30 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
311 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-28 00:56:30 | 2025-05-28 01:30:32 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
312 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-28 01:30:32 | 2025-05-28 01:51:25 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v15.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
164 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-03-21 05:28:39 | 2025-03-21 05:43:58 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
165 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-03-21 05:43:58 | 2025-03-21 06:17:27 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
166 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-03-21 06:17:27 | 2025-03-21 06:38:22 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/v14.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
232 | Basic 21-Support Of Volumes | FAIL | 2025-05-27 23:21:12 | 2025-05-27 23:22:30 | 6 | 4 | Network Service Instance Test | Create Network Service |
235 | Basic 24-Affinity Groups | FAIL | 2025-05-27 23:31:22 | 2025-05-27 23:33:17 | 6 | 1 | None | None |
239 | Basic 28-Keep Persistent Volumes | FAIL | 2025-05-27 23:44:42 | 2025-05-27 23:46:01 | 5 | 11 | Network Service Instance Test | Create Network Service |
242 | Basic 31-Multivdu Volume Multiattach | FAIL | 2025-05-27 23:52:04 | 2025-05-27 23:53:21 | 5 | 4 | Network Service Instance Test | Create Network Service |
251 | Heal 01-Volume Vdu Healing | FAIL | 2025-05-28 00:09:34 | 2025-05-28 00:14:28 | 6 | 10 | Network Service Instance Test | Create Network Service |
252 | Heal 02-Scale Vdu Healing | FAIL | 2025-05-28 00:14:28 | 2025-05-28 00:19:22 | 7 | 9 | Network Service Instance Test | Create Network Service |
253 | Heal 03-Multiple Healing | FAIL | 2025-05-28 00:19:22 | 2025-05-28 00:21:18 | 6 | 10 | Network Service Instance Test | Create Network Service |
267 | Sa 01-Vnf With Vim Metrics | FAIL | 2025-05-28 01:11:25 | 2025-05-28 01:26:43 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
268 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2025-05-28 01:26:43 | 2025-05-28 02:00:08 | 11 | 4 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
269 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2025-05-28 02:00:08 | 2025-05-28 02:21:25 | 14 | 2 | Get Alarm Metric | Wait Until Keyword Succeeds |
osm-stage_3-merge/master: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
89 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 01:46:30 | 2025-05-28 01:47:10 |
97 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-28 01:47:12 | 2025-05-28 01:47:12 |
101 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-28 01:47:12 | 2025-05-28 01:47:12 |
122 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 01:54:10 | 2025-05-28 01:54:52 |
124 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-28 01:54:52 | 2025-05-28 01:54:52 |
129 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-28 01:54:52 | 2025-05-28 01:54:52 |
133 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
136 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
139 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
140 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
142 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:15 |
150 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-28 01:55:15 | 2025-05-28 01:55:17 |
151 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-28 01:55:17 | 2025-05-28 01:55:17 |
155 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2025-05-28 01:55:17 | 2025-05-28 01:55:17 |
163 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:01:43 | 2025-05-28 02:02:24 |
166 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-28 02:02:24 | 2025-05-28 02:02:24 |
168 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-28 02:02:24 | 2025-05-28 02:02:24 |
174 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-28 02:02:24 | 2025-05-28 02:02:24 |
187 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:20:43 | 2025-05-28 02:21:23 |
190 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:21:23 | 2025-05-28 02:21:23 |
195 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:21:23 | 2025-05-28 02:21:23 |
212 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
215 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
221 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
224 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
226 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
241 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:21:24 | 2025-05-28 02:21:24 |
259 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:22:19 | 2025-05-28 02:22:58 |
262 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
270 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
275 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
285 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
290 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
293 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
295 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
307 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
311 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:22:58 | 2025-05-28 02:22:58 |
324 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 02:24:11 | 2025-05-28 02:24:52 |
327 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
335 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
340 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
350 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
362 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
367 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
373 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
376 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
387 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
391 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 02:24:52 | 2025-05-28 02:24:52 |
427 | Heal 04-Autohealing | Wait For Autohealing To Be Completed | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:27:12 | 2025-05-28 02:37:19 |
437 | Heal 04-Autohealing | Check VNF After Healing | Should Not Be Equal | FAIL | 2025-05-28 02:37:23 | 2025-05-28 02:37:23 |
455 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:55:56 | 2025-05-28 03:09:57 |
485 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-28 03:11:27 | 2025-05-28 03:25:28 |
490 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-28 03:25:30 | 2025-05-28 03:39:31 |
493 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-28 03:41:31 | 2025-05-28 03:41:31 |
524 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-28 03:46:25 | 2025-05-28 04:00:26 |
525 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-28 04:00:26 | 2025-05-28 04:03:56 |
osm-stage_3-merge/v16.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
932 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:39:28 | 2025-05-27 23:40:06 |
940 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-27 23:40:07 | 2025-05-27 23:40:07 |
944 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-27 23:40:07 | 2025-05-27 23:40:07 |
965 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:47:18 | 2025-05-27 23:47:56 |
967 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-27 23:47:56 | 2025-05-27 23:47:56 |
972 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-27 23:47:56 | 2025-05-27 23:47:56 |
976 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
979 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
982 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
983 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
985 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:19 |
993 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-27 23:48:19 | 2025-05-27 23:48:20 |
994 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-27 23:48:20 | 2025-05-27 23:48:20 |
998 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Clean Persistent Volumes | FAIL | 2025-05-27 23:48:20 | 2025-05-27 23:48:20 |
1006 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:55:03 | 2025-05-27 23:55:41 |
1009 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-27 23:55:41 | 2025-05-27 23:55:41 |
1011 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-27 23:55:41 | 2025-05-27 23:55:41 |
1017 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-27 23:55:41 | 2025-05-27 23:55:41 |
1030 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:12:52 | 2025-05-28 00:13:30 |
1033 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:30 | 2025-05-28 00:13:30 |
1038 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:13:30 | 2025-05-28 00:13:30 |
1055 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
1058 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
1064 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
1067 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
1069 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
1084 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
1102 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:14:37 | 2025-05-28 00:15:14 |
1105 | Heal 02-Scale Vdu Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1113 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1118 | Heal 02-Scale Vdu Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1128 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU Before Halting VM | Get Vdu Attribute | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1133 | Heal 02-Scale Vdu Healing | Halt Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1136 | Heal 02-Scale Vdu Healing | Heal Manual Scale VDU | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1138 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1150 | Heal 02-Scale Vdu Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1154 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:15:14 | 2025-05-28 00:15:14 |
1167 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:16:02 | 2025-05-28 00:16:41 |
1170 | Heal 03-Multiple Healing | Scale Out Manual Scale VNF | Get Vnf Id | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1178 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1183 | Heal 03-Multiple Healing | Get Manual Scale VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1193 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1205 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU Before Stopping VM | Get Vdu Attribute | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1210 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1216 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1219 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1230 | Heal 03-Multiple Healing | Check Day0 And Day1 In VDU After Healing | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1234 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:16:41 | 2025-05-28 00:16:41 |
1254 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-28 00:41:53 | 2025-05-28 00:55:54 |
1284 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-28 00:57:51 | 2025-05-28 01:11:52 |
1289 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:11:54 | 2025-05-28 01:25:55 |
1292 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-28 01:27:55 | 2025-05-28 01:27:55 |
1323 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:32:42 | 2025-05-28 01:46:43 |
1324 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:46:43 | 2025-05-28 01:50:12 |
osm-stage_3-merge/v15.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
10 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:29:21 | 2025-03-21 05:43:21 |
40 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:44:46 | 2025-03-21 05:58:46 |
45 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-03-21 05:58:49 | 2025-03-21 06:12:49 |
48 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-03-21 06:14:49 | 2025-03-21 06:14:49 |
79 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:19:35 | 2025-03-21 06:33:35 |
80 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-03-21 06:33:35 | 2025-03-21 06:37:06 |
osm-stage_3-merge/v14.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
534 | Basic 21-Support Of Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:21:16 | 2025-05-27 23:21:54 |
542 | Basic 21-Support Of Volumes | Get VNF IP Address | Variable Should Exist | FAIL | 2025-05-27 23:21:55 | 2025-05-27 23:21:55 |
546 | Basic 21-Support Of Volumes | Check VDU disks | Variable Should Exist | FAIL | 2025-05-27 23:21:55 | 2025-05-27 23:21:55 |
568 | Basic 28-Keep Persistent Volumes | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:44:46 | 2025-05-27 23:45:24 |
570 | Basic 28-Keep Persistent Volumes | Check Persistent Volume Counts | Variable Should Exist | FAIL | 2025-05-27 23:45:24 | 2025-05-27 23:45:24 |
576 | Basic 28-Keep Persistent Volumes | Set Persistent Volume Ids | Variable Should Exist | FAIL | 2025-05-27 23:45:24 | 2025-05-27 23:45:24 |
580 | Basic 28-Keep Persistent Volumes | Check Persistent Root Volume in VIM after NS D... | Variable Should Exist | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
583 | Basic 28-Keep Persistent Volumes | Check Persistent Ordinary Volume in VIM after ... | Variable Should Exist | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
586 | Basic 28-Keep Persistent Volumes | Prepare Ns Config With Volume Id | Set Suite Variable | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
587 | Basic 28-Keep Persistent Volumes | Network Service Instance With Existing Volumes... | Create Network Service | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
589 | Basic 28-Keep Persistent Volumes | Verify the Attachment Of Existing Persistent V... | Set Suite Variable | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:45 |
597 | Basic 28-Keep Persistent Volumes | Delete NS Instance With Existing Volumes Test | Delete NS | FAIL | 2025-05-27 23:45:45 | 2025-05-27 23:45:46 |
598 | Basic 28-Keep Persistent Volumes | Check Existence of Persistent Volumes | Variable Should Exist | FAIL | 2025-05-27 23:45:46 | 2025-05-27 23:45:46 |
604 | Basic 28-Keep Persistent Volumes | Delete Persistent Volumes | Delete Volume | FAIL | 2025-05-27 23:45:46 | 2025-05-27 23:45:46 |
612 | Basic 31-Multivdu Volume Multiattach | Network Service Instance Test | Create Network Service | FAIL | 2025-05-27 23:52:07 | 2025-05-27 23:52:46 |
615 | Basic 31-Multivdu Volume Multiattach | Get Vnf ID | Get Vnf Id | FAIL | 2025-05-27 23:52:46 | 2025-05-27 23:52:46 |
617 | Basic 31-Multivdu Volume Multiattach | Get Vnf Management Ip Addresses | Run And Return Rc And Output | FAIL | 2025-05-27 23:52:46 | 2025-05-27 23:52:46 |
621 | Basic 31-Multivdu Volume Multiattach | Ensure that VDUs can share data | Execute Remote Command Check Rc Return Output | FAIL | 2025-05-27 23:52:46 | 2025-05-27 23:52:46 |
634 | Heal 01-Volume Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:09:40 | 2025-05-28 00:13:29 |
637 | Heal 01-Volume Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:29 | 2025-05-28 00:13:29 |
642 | Heal 01-Volume Vdu Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:13:29 | 2025-05-28 00:13:29 |
659 | Heal 01-Volume Vdu Healing | Get Volumes Info | Get Server Property | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
662 | Heal 01-Volume Vdu Healing | Check VDU Disks | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
669 | Heal 01-Volume Vdu Healing | Delete Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
672 | Heal 01-Volume Vdu Healing | Heal Persistent Volume VDU | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
674 | Heal 01-Volume Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
690 | Heal 01-Volume Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:13:31 | 2025-05-28 00:13:31 |
708 | Heal 02-Scale Vdu Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:14:35 | 2025-05-28 00:18:24 |
711 | Heal 02-Scale Vdu Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
720 | Heal 02-Scale Vdu Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
725 | Heal 02-Scale Vdu Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
733 | Heal 02-Scale Vdu Healing | Halt Charm VDU | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
736 | Heal 02-Scale Vdu Healing | Heal Charm VDU | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
738 | Heal 02-Scale Vdu Healing | Check VNF After Healing | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
752 | Heal 02-Scale Vdu Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:18:24 | 2025-05-28 00:18:24 |
766 | Heal 03-Multiple Healing | Network Service Instance Test | Create Network Service | FAIL | 2025-05-28 00:19:28 | 2025-05-28 00:20:38 |
769 | Heal 03-Multiple Healing | Scale Out Charm VNF | Get Vnf Id | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
778 | Heal 03-Multiple Healing | Get VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
783 | Heal 03-Multiple Healing | Get Charm VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
791 | Heal 03-Multiple Healing | Get Volume VNF Info | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
803 | Heal 03-Multiple Healing | Stop VDUs | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
809 | Heal 03-Multiple Healing | Heal VDUs | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
812 | Heal 03-Multiple Healing | Check VNFs After Healing | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
825 | Heal 03-Multiple Healing | Update VIM Objects | Variable Should Exist | FAIL | 2025-05-28 00:20:38 | 2025-05-28 00:20:38 |
846 | Sa 01-Vnf With Vim Metrics | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:12:07 | 2025-05-28 01:26:07 |
879 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:27:30 | 2025-05-28 01:41:30 |
886 | Sa 02-Vnf With Vim Metrics And Autoscaling | Wait VIM-based Metric To Exceed Threshold | Wait Until Keyword Succeeds | FAIL | 2025-05-28 01:41:33 | 2025-05-28 01:55:33 |
889 | Sa 02-Vnf With Vim Metrics And Autoscaling | Check VIM-based Metric Exceeds Threshold After... | Check VIM-based Metric Exceeds Threshold | FAIL | 2025-05-28 01:57:33 | 2025-05-28 01:57:33 |
894 | Sa 02-Vnf With Vim Metrics And Autoscaling | Get VDUs After Auto-scaling | Run Keyword If | FAIL | 2025-05-28 01:59:33 | 2025-05-28 01:59:33 |
921 | Sa 07-Alarms From Sa-Related Vnfs | Get Alarm Metric | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:02:46 | 2025-05-28 02:16:46 |
923 | Sa 07-Alarms From Sa-Related Vnfs | Check Alarms Were Received | Wait Until Keyword Succeeds | FAIL | 2025-05-28 02:16:46 | 2025-05-28 02:20:16 |
Powered by osm-analytics