Analysis of Robot reports from OSM Jenkins

Date and time of the report: 2025-10-19 08:20:23.686012

Analysed period: 2025-09-28 to 2025-10-19.

1. Retrieval of all currrent data for aggregate analytics

Database update:

Retrieving from database...	

DONE

2. Aggregated analysis of stability

2.1 Restricts data to time window for analysis

2.2 Finding sequences of successful builds and Robot reports

Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:

• build_result is the outcome of the build, reported by Jenkins. It can be: SUCCESS, FAILURE, UNSTABLE or ABORTED.
• test_result is the summary of the concerned Robot tests. It can be: FAIL, UNAVAILABLE or PASS.

Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:

1. Successful builds/failed builds in a row: grp_build_result.
2. Successful test reports vs. test reports with fails in a row: grp_test_result.
3. Clean builds and tests vs. failures (of any kind) in a row: grp_success_fail.

For the identification of these sequences, the following mapping applies:

Type of sequence	Relevant state	OK sequence contains	NOK sequence contains	Ignore
grp_build_result	build_result	SUCCESS or UNSTABLE	FAILURE	ABORTED
grp_test_result	test_result	PASS	FAIL	UNAVAILABLE
grp_success_fail	test_result	PASS	FAIL or UNAVAILABLE	N/A

The different groupings of segments are detected and a label is added to each sample...

DONE

Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...

DONE

2.3 Finding sequences of pass/fails per test suite

DONE

3. Reports

3.1 Aggregated success rate per test step

Empty dataframe. Skipping.

3.2 Overall success of Jenkins builds and Robot tests

3.3 Sequences of pass/fails per test suites

Empty dataframe. Skipping.

3.4 Failing days per test suite

Empty dataframe. Skipping.

job	Master branch				Release FOURTEEN				Release SEVENTEEN				Release SIXTEEN
	days_failing	days_passing	days_run	error_rate	days_failing	days_passing	days_run	error_rate	days_failing	days_passing	days_run	error_rate	days_failing	days_passing	days_run	error_rate
suites
Basic 01-Crud Operations On Vim Targets	0.0	21.571007	21.571007	0.0	0.0	20.69463	20.69463	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0
Basic 05-Instantiation Parameters In Cloud Init	0.0	21.571007	21.571007	0.0	0.0	20.69463	20.69463	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0
Basic 06-Vnf With Charm	0.0	0.000000	0.000000	0.0	0.0	20.69463	20.69463	0.0	0.0	0.000000	0.000000	0.0	0.0	0.000000	0.000000	0.0
Basic 07-Secure Key Management	0.0	0.000000	0.000000	0.0	0.0	20.69463	20.69463	0.0	0.0	0.000000	0.000000	0.0	0.0	0.000000	0.000000	0.0
Basic 08-Disable Port Security Network Level	0.0	21.571007	21.571007	0.0	0.0	20.69463	20.69463	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0
...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...
Sa 08-Vnf With Vnf Indicators Snmp	0.0	21.571007	21.571007	0.0	0.0	20.69463	20.69463	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0
Slice 01-Network Slicing	0.0	21.571007	21.571007	0.0	0.0	20.69463	20.69463	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0
Slice 02-Shared Network Slicing	0.0	21.571007	21.571007	0.0	0.0	20.69463	20.69463	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0
Sol003 01-Vnf-Lifecycle-Management	0.0	21.571007	21.571007	0.0	0.0	20.69463	20.69463	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0
Sol003 02-Dualstack Ip Vnfm	0.0	21.571007	21.571007	0.0	0.0	0.00000	0.00000	0.0	0.0	21.499479	21.499479	0.0	0.0	20.657824	20.657824	0.0

62 rows × 16 columns

4. Information about the latest builds of relevant jobs

Latest build of each job

	job	build	timestamp	duration	build_result	test_result	pass_count	fail_count
0	osm-stage_3-merge/master	3523	2025-10-19 01:06:19	10202710	UNSTABLE	FAIL	432.0	53.0
1	osm-stage_3-merge/v17.0	285	2025-10-19 02:49:20	11800928	UNSTABLE	FAIL	422.0	63.0
2	osm-stage_3-merge/v16.0	396	2025-10-18 23:01:18	11219555	UNSTABLE	FAIL	409.0	63.0
3	osm-stage_3-merge/v15.0	446	2025-03-21 03:34:47	12254896	UNSTABLE	FAIL	448.0	7.0
4	osm-stage_3-merge/v14.0	813	2025-10-18 22:08:18	0	FAILURE	UNAVAILABLE	NaN	NaN

Click to see the details of build 3523 of osm-stage_3-merge/master

Click to see the details of build 285 of osm-stage_3-merge/v17.0

Click to see the details of build 396 of osm-stage_3-merge/v16.0

Click to see the details of build 446 of osm-stage_3-merge/v15.0

Click to see the details of build 813 of osm-stage_3-merge/v14.0

Failed test suites per job (if any):

osm-stage_3-merge/master: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
105	Basic 21-Support Of Volumes	FAIL	2025-10-19 01:42:02	2025-10-19 01:43:28	6	4	Network Service Instance Test	Create Network Service
109	Basic 28-Keep Persistent Volumes	FAIL	2025-10-19 01:50:04	2025-10-19 01:51:31	5	11	Network Service Instance Test	Create Network Service
112	Basic 31-Multivdu Volume Multiattach	FAIL	2025-10-19 01:57:54	2025-10-19 01:59:19	5	4	Network Service Instance Test	Create Network Service
115	Epa 03-Crud Operations On Sdnc	FAIL	2025-10-19 02:02:24	2025-10-19 02:03:39	2	1	Create Basic SDNC	Wait Until Keyword Succeeds
122	Heal 01-Volume Vdu Healing	FAIL	2025-10-19 02:44:30	2025-10-19 02:46:04	6	10	Network Service Instance Test	Create Network Service
123	Heal 02-Scale Vdu Healing	FAIL	2025-10-19 02:46:04	2025-10-19 02:47:39	7	11	Network Service Instance Test	Create Network Service
124	Heal 03-Multiple Healing	FAIL	2025-10-19 02:47:39	2025-10-19 02:49:11	6	12	Network Service Instance Test	Create Network Service

osm-stage_3-merge/v17.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
194	Basic 21-Support Of Volumes	FAIL	2025-10-19 03:24:20	2025-10-19 03:25:47	6	4	Network Service Instance Test	Create Network Service
198	Basic 28-Keep Persistent Volumes	FAIL	2025-10-19 03:32:21	2025-10-19 03:33:47	5	11	Network Service Instance Test	Create Network Service
201	Basic 31-Multivdu Volume Multiattach	FAIL	2025-10-19 03:39:50	2025-10-19 03:41:14	5	4	Network Service Instance Test	Create Network Service
204	Epa 03-Crud Operations On Sdnc	FAIL	2025-10-19 03:44:19	2025-10-19 03:45:35	2	1	Create Basic SDNC	Wait Until Keyword Succeeds
207	Gitops 02-Declarative Cluster Registration Oka...	FAIL	2025-10-19 03:49:27	2025-10-19 04:45:46	3	10	Add OKA Packages For The Testsuite	Add OKA Package
211	Heal 01-Volume Vdu Healing	FAIL	2025-10-19 04:53:06	2025-10-19 04:54:40	6	10	Network Service Instance Test	Create Network Service
212	Heal 02-Scale Vdu Healing	FAIL	2025-10-19 04:54:40	2025-10-19 04:56:33	7	11	Network Service Instance Test	Create Network Service
213	Heal 03-Multiple Healing	FAIL	2025-10-19 04:56:33	2025-10-19 04:58:06	6	12	Network Service Instance Test	Create Network Service

osm-stage_3-merge/v16.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
150	Basic 21-Support Of Volumes	FAIL	2025-10-18 23:35:25	2025-10-18 23:36:47	6	4	Network Service Instance Test	Create Network Service
154	Basic 28-Keep Persistent Volumes	FAIL	2025-10-18 23:43:14	2025-10-18 23:44:36	5	11	Network Service Instance Test	Create Network Service
157	Basic 31-Multivdu Volume Multiattach	FAIL	2025-10-18 23:50:49	2025-10-18 23:52:09	5	4	Network Service Instance Test	Create Network Service
160	Epa 03-Crud Operations On Sdnc	FAIL	2025-10-18 23:55:08	2025-10-18 23:56:21	2	1	Create Basic SDNC	Wait Until Keyword Succeeds
166	Heal 01-Volume Vdu Healing	FAIL	2025-10-19 00:07:15	2025-10-19 00:08:45	6	10	Network Service Instance Test	Create Network Service
167	Heal 02-Scale Vdu Healing	FAIL	2025-10-19 00:08:45	2025-10-19 00:10:16	7	11	Network Service Instance Test	Create Network Service
168	Heal 03-Multiple Healing	FAIL	2025-10-19 00:10:16	2025-10-19 00:11:44	6	12	Network Service Instance Test	Create Network Service
173	K8S 13-Two Helm Kdu	FAIL	2025-10-19 00:25:43	2025-10-19 00:34:31	15	3	Delete Network Service Instance	Delete NS
177	Sa 01-Vnf With Vim Metrics	FAIL	2025-10-19 00:39:36	2025-10-19 00:54:57	6	1	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds
178	Sa 02-Vnf With Vim Metrics And Autoscaling	FAIL	2025-10-19 00:54:57	2025-10-19 01:28:31	11	4	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds
179	Sa 07-Alarms From Sa-Related Vnfs	FAIL	2025-10-19 01:28:31	2025-10-19 01:49:26	14	2	Get Alarm Metric	Wait Until Keyword Succeeds

osm-stage_3-merge/v15.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
88	Sa 01-Vnf With Vim Metrics	FAIL	2025-03-21 05:28:39	2025-03-21 05:43:58	6	1	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds
89	Sa 02-Vnf With Vim Metrics And Autoscaling	FAIL	2025-03-21 05:43:58	2025-03-21 06:17:27	11	4	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds
90	Sa 07-Alarms From Sa-Related Vnfs	FAIL	2025-03-21 06:17:27	2025-03-21 06:38:22	14	2	Get Alarm Metric	Wait Until Keyword Succeeds

osm-stage_3-merge/v14.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword

Details of failed tests into failing test suites (if any):

osm-stage_3-merge/master: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
89	Basic 21-Support Of Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 01:42:05	2025-10-19 01:42:45
97	Basic 21-Support Of Volumes	Get VNF IP Address	Variable Should Exist	FAIL	2025-10-19 01:42:47	2025-10-19 01:42:47
101	Basic 21-Support Of Volumes	Check VDU disks	Variable Should Exist	FAIL	2025-10-19 01:42:47	2025-10-19 01:42:47
112	Basic 28-Keep Persistent Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 01:50:08	2025-10-19 01:50:48
114	Basic 28-Keep Persistent Volumes	Check Persistent Volume Counts	Variable Should Exist	FAIL	2025-10-19 01:50:48	2025-10-19 01:50:48
119	Basic 28-Keep Persistent Volumes	Set Persistent Volume Ids	Variable Should Exist	FAIL	2025-10-19 01:50:48	2025-10-19 01:50:48
123	Basic 28-Keep Persistent Volumes	Check Persistent Root Volume in VIM after NS D...	Variable Should Exist	FAIL	2025-10-19 01:51:10	2025-10-19 01:51:10
126	Basic 28-Keep Persistent Volumes	Check Persistent Ordinary Volume in VIM after ...	Variable Should Exist	FAIL	2025-10-19 01:51:10	2025-10-19 01:51:10
129	Basic 28-Keep Persistent Volumes	Prepare Ns Config With Volume Id	Set Suite Variable	FAIL	2025-10-19 01:51:10	2025-10-19 01:51:10
130	Basic 28-Keep Persistent Volumes	Network Service Instance With Existing Volumes...	Create Network Service	FAIL	2025-10-19 01:51:10	2025-10-19 01:51:10
132	Basic 28-Keep Persistent Volumes	Verify the Attachment Of Existing Persistent V...	Set Suite Variable	FAIL	2025-10-19 01:51:10	2025-10-19 01:51:10
140	Basic 28-Keep Persistent Volumes	Delete NS Instance With Existing Volumes Test	Delete NS	FAIL	2025-10-19 01:51:10	2025-10-19 01:51:12
141	Basic 28-Keep Persistent Volumes	Check Existence of Persistent Volumes	Variable Should Exist	FAIL	2025-10-19 01:51:12	2025-10-19 01:51:12
145	Basic 28-Keep Persistent Volumes	Delete Persistent Volumes	Clean Persistent Volumes	FAIL	2025-10-19 01:51:12	2025-10-19 01:51:12
153	Basic 31-Multivdu Volume Multiattach	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 01:57:57	2025-10-19 01:58:38
156	Basic 31-Multivdu Volume Multiattach	Get Vnf ID	Get Vnf Id	FAIL	2025-10-19 01:58:38	2025-10-19 01:58:38
158	Basic 31-Multivdu Volume Multiattach	Get Vnf Management Ip Addresses	Run And Return Rc And Output	FAIL	2025-10-19 01:58:38	2025-10-19 01:58:38
164	Basic 31-Multivdu Volume Multiattach	Ensure that VDUs can share data	Execute Remote Command Check Rc Return Output	FAIL	2025-10-19 01:58:38	2025-10-19 01:58:38
176	Epa 03-Crud Operations On Sdnc	Create Basic SDNC	Wait Until Keyword Succeeds	FAIL	2025-10-19 02:02:25	2025-10-19 02:03:31
182	Heal 01-Volume Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 02:44:35	2025-10-19 02:45:16
185	Heal 01-Volume Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 02:45:16	2025-10-19 02:45:16
190	Heal 01-Volume Vdu Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-19 02:45:16	2025-10-19 02:45:16
207	Heal 01-Volume Vdu Healing	Get Volumes Info	Get Server Property	FAIL	2025-10-19 02:45:17	2025-10-19 02:45:17
210	Heal 01-Volume Vdu Healing	Check VDU Disks	Variable Should Exist	FAIL	2025-10-19 02:45:17	2025-10-19 02:45:17
216	Heal 01-Volume Vdu Healing	Delete Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-19 02:45:17	2025-10-19 02:45:17
219	Heal 01-Volume Vdu Healing	Heal Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-19 02:45:17	2025-10-19 02:45:17
221	Heal 01-Volume Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-19 02:45:17	2025-10-19 02:45:17
236	Heal 01-Volume Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 02:45:17	2025-10-19 02:45:17
254	Heal 02-Scale Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 02:46:11	2025-10-19 02:46:50
257	Heal 02-Scale Vdu Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
265	Heal 02-Scale Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
270	Heal 02-Scale Vdu Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
280	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU Before Halting VM	Get Vdu Attribute	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
285	Heal 02-Scale Vdu Healing	Halt Manual Scale VDU	Variable Should Exist	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
288	Heal 02-Scale Vdu Healing	Heal Manual Scale VDU	Variable Should Exist	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
290	Heal 02-Scale Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
302	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
306	Heal 02-Scale Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 02:46:50	2025-10-19 02:46:50
319	Heal 03-Multiple Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 02:47:43	2025-10-19 02:48:23
322	Heal 03-Multiple Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
330	Heal 03-Multiple Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
335	Heal 03-Multiple Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
345	Heal 03-Multiple Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
357	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU Before Stopping VM	Get Vdu Attribute	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
362	Heal 03-Multiple Healing	Stop VDUs	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
368	Heal 03-Multiple Healing	Heal VDUs	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
371	Heal 03-Multiple Healing	Check VNFs After Healing	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
382	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23
386	Heal 03-Multiple Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 02:48:23	2025-10-19 02:48:23

osm-stage_3-merge/v17.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
837	Basic 21-Support Of Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 03:24:24	2025-10-19 03:25:04
845	Basic 21-Support Of Volumes	Get VNF IP Address	Variable Should Exist	FAIL	2025-10-19 03:25:06	2025-10-19 03:25:06
849	Basic 21-Support Of Volumes	Check VDU disks	Variable Should Exist	FAIL	2025-10-19 03:25:06	2025-10-19 03:25:06
860	Basic 28-Keep Persistent Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 03:32:24	2025-10-19 03:33:04
862	Basic 28-Keep Persistent Volumes	Check Persistent Volume Counts	Variable Should Exist	FAIL	2025-10-19 03:33:04	2025-10-19 03:33:04
867	Basic 28-Keep Persistent Volumes	Set Persistent Volume Ids	Variable Should Exist	FAIL	2025-10-19 03:33:04	2025-10-19 03:33:04
871	Basic 28-Keep Persistent Volumes	Check Persistent Root Volume in VIM after NS D...	Variable Should Exist	FAIL	2025-10-19 03:33:26	2025-10-19 03:33:26
874	Basic 28-Keep Persistent Volumes	Check Persistent Ordinary Volume in VIM after ...	Variable Should Exist	FAIL	2025-10-19 03:33:26	2025-10-19 03:33:26
877	Basic 28-Keep Persistent Volumes	Prepare Ns Config With Volume Id	Set Suite Variable	FAIL	2025-10-19 03:33:26	2025-10-19 03:33:26
878	Basic 28-Keep Persistent Volumes	Network Service Instance With Existing Volumes...	Create Network Service	FAIL	2025-10-19 03:33:26	2025-10-19 03:33:26
880	Basic 28-Keep Persistent Volumes	Verify the Attachment Of Existing Persistent V...	Set Suite Variable	FAIL	2025-10-19 03:33:26	2025-10-19 03:33:26
888	Basic 28-Keep Persistent Volumes	Delete NS Instance With Existing Volumes Test	Delete NS	FAIL	2025-10-19 03:33:26	2025-10-19 03:33:28
889	Basic 28-Keep Persistent Volumes	Check Existence of Persistent Volumes	Variable Should Exist	FAIL	2025-10-19 03:33:28	2025-10-19 03:33:28
893	Basic 28-Keep Persistent Volumes	Delete Persistent Volumes	Clean Persistent Volumes	FAIL	2025-10-19 03:33:28	2025-10-19 03:33:28
901	Basic 31-Multivdu Volume Multiattach	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 03:39:53	2025-10-19 03:40:33
904	Basic 31-Multivdu Volume Multiattach	Get Vnf ID	Get Vnf Id	FAIL	2025-10-19 03:40:33	2025-10-19 03:40:33
906	Basic 31-Multivdu Volume Multiattach	Get Vnf Management Ip Addresses	Run And Return Rc And Output	FAIL	2025-10-19 03:40:33	2025-10-19 03:40:33
912	Basic 31-Multivdu Volume Multiattach	Ensure that VDUs can share data	Execute Remote Command Check Rc Return Output	FAIL	2025-10-19 03:40:33	2025-10-19 03:40:33
924	Epa 03-Crud Operations On Sdnc	Create Basic SDNC	Wait Until Keyword Succeeds	FAIL	2025-10-19 03:44:21	2025-10-19 03:45:27
929	Gitops 02-Declarative Cluster Registration Oka...	Add OKA Packages For The Testsuite	Add OKA Package	FAIL	2025-10-19 03:49:29	2025-10-19 03:54:31
932	Gitops 02-Declarative Cluster Registration Oka...	Register Cluster For Testsuite	Register Cluster	FAIL	2025-10-19 03:54:31	2025-10-19 04:10:57
938	Gitops 02-Declarative Cluster Registration Oka...	Create KSU Namespace For All KSUs	Create KSU	FAIL	2025-10-19 04:10:59	2025-10-19 04:11:01
941	Gitops 02-Declarative Cluster Registration Oka...	Create KSU1 Without Params	Create KSU	FAIL	2025-10-19 04:11:01	2025-10-19 04:11:02
944	Gitops 02-Declarative Cluster Registration Oka...	Create KSU2 With Params	Create KSU	FAIL	2025-10-19 04:11:02	2025-10-19 04:11:04
947	Gitops 02-Declarative Cluster Registration Oka...	Delete KSU2	Delete KSU	FAIL	2025-10-19 04:11:04	2025-10-19 04:11:06
948	Gitops 02-Declarative Cluster Registration Oka...	Delete KSU1	Delete KSU	FAIL	2025-10-19 04:11:06	2025-10-19 04:11:08
949	Gitops 02-Declarative Cluster Registration Oka...	Delete KSU Namespace	Delete KSU	FAIL	2025-10-19 04:11:08	2025-10-19 04:11:09
950	Gitops 02-Declarative Cluster Registration Oka...	Deregister Cluster For Testsuite	Deregister Cluster	FAIL	2025-10-19 04:11:09	2025-10-19 04:23:18
952	Gitops 02-Declarative Cluster Registration Oka...	Delete OKA Packages For The Testsuite	Delete OKA Package	FAIL	2025-10-19 04:23:21	2025-10-19 04:28:23
958	Heal 01-Volume Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 04:53:11	2025-10-19 04:53:51
961	Heal 01-Volume Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 04:53:51	2025-10-19 04:53:51
966	Heal 01-Volume Vdu Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-19 04:53:51	2025-10-19 04:53:51
983	Heal 01-Volume Vdu Healing	Get Volumes Info	Get Server Property	FAIL	2025-10-19 04:53:53	2025-10-19 04:53:53
986	Heal 01-Volume Vdu Healing	Check VDU Disks	Variable Should Exist	FAIL	2025-10-19 04:53:53	2025-10-19 04:53:53
992	Heal 01-Volume Vdu Healing	Delete Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-19 04:53:53	2025-10-19 04:53:53
995	Heal 01-Volume Vdu Healing	Heal Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-19 04:53:53	2025-10-19 04:53:53
997	Heal 01-Volume Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-19 04:53:53	2025-10-19 04:53:53
1012	Heal 01-Volume Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 04:53:53	2025-10-19 04:53:53
1030	Heal 02-Scale Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 04:54:47	2025-10-19 04:55:26
1033	Heal 02-Scale Vdu Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1041	Heal 02-Scale Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1046	Heal 02-Scale Vdu Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1056	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU Before Halting VM	Get Vdu Attribute	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1061	Heal 02-Scale Vdu Healing	Halt Manual Scale VDU	Variable Should Exist	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1064	Heal 02-Scale Vdu Healing	Heal Manual Scale VDU	Variable Should Exist	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1066	Heal 02-Scale Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1078	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1082	Heal 02-Scale Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 04:55:26	2025-10-19 04:55:26
1095	Heal 03-Multiple Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 04:56:38	2025-10-19 04:57:18
1098	Heal 03-Multiple Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1106	Heal 03-Multiple Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1111	Heal 03-Multiple Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1121	Heal 03-Multiple Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1133	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU Before Stopping VM	Get Vdu Attribute	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1138	Heal 03-Multiple Healing	Stop VDUs	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1144	Heal 03-Multiple Healing	Heal VDUs	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1147	Heal 03-Multiple Healing	Check VNFs After Healing	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1158	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18
1162	Heal 03-Multiple Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 04:57:18	2025-10-19 04:57:18

osm-stage_3-merge/v16.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
398	Basic 21-Support Of Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-18 23:35:29	2025-10-18 23:36:08
406	Basic 21-Support Of Volumes	Get VNF IP Address	Variable Should Exist	FAIL	2025-10-18 23:36:09	2025-10-18 23:36:09
410	Basic 21-Support Of Volumes	Check VDU disks	Variable Should Exist	FAIL	2025-10-18 23:36:09	2025-10-18 23:36:09
421	Basic 28-Keep Persistent Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-18 23:43:18	2025-10-18 23:43:57
423	Basic 28-Keep Persistent Volumes	Check Persistent Volume Counts	Variable Should Exist	FAIL	2025-10-18 23:43:57	2025-10-18 23:43:57
428	Basic 28-Keep Persistent Volumes	Set Persistent Volume Ids	Variable Should Exist	FAIL	2025-10-18 23:43:57	2025-10-18 23:43:57
432	Basic 28-Keep Persistent Volumes	Check Persistent Root Volume in VIM after NS D...	Variable Should Exist	FAIL	2025-10-18 23:44:18	2025-10-18 23:44:18
435	Basic 28-Keep Persistent Volumes	Check Persistent Ordinary Volume in VIM after ...	Variable Should Exist	FAIL	2025-10-18 23:44:18	2025-10-18 23:44:18
438	Basic 28-Keep Persistent Volumes	Prepare Ns Config With Volume Id	Set Suite Variable	FAIL	2025-10-18 23:44:18	2025-10-18 23:44:18
439	Basic 28-Keep Persistent Volumes	Network Service Instance With Existing Volumes...	Create Network Service	FAIL	2025-10-18 23:44:18	2025-10-18 23:44:18
441	Basic 28-Keep Persistent Volumes	Verify the Attachment Of Existing Persistent V...	Set Suite Variable	FAIL	2025-10-18 23:44:18	2025-10-18 23:44:18
449	Basic 28-Keep Persistent Volumes	Delete NS Instance With Existing Volumes Test	Delete NS	FAIL	2025-10-18 23:44:18	2025-10-18 23:44:20
450	Basic 28-Keep Persistent Volumes	Check Existence of Persistent Volumes	Variable Should Exist	FAIL	2025-10-18 23:44:20	2025-10-18 23:44:20
454	Basic 28-Keep Persistent Volumes	Delete Persistent Volumes	Clean Persistent Volumes	FAIL	2025-10-18 23:44:20	2025-10-18 23:44:20
462	Basic 31-Multivdu Volume Multiattach	Network Service Instance Test	Create Network Service	FAIL	2025-10-18 23:50:52	2025-10-18 23:51:31
465	Basic 31-Multivdu Volume Multiattach	Get Vnf ID	Get Vnf Id	FAIL	2025-10-18 23:51:31	2025-10-18 23:51:31
467	Basic 31-Multivdu Volume Multiattach	Get Vnf Management Ip Addresses	Run And Return Rc And Output	FAIL	2025-10-18 23:51:31	2025-10-18 23:51:31
473	Basic 31-Multivdu Volume Multiattach	Ensure that VDUs can share data	Execute Remote Command Check Rc Return Output	FAIL	2025-10-18 23:51:31	2025-10-18 23:51:31
485	Epa 03-Crud Operations On Sdnc	Create Basic SDNC	Wait Until Keyword Succeeds	FAIL	2025-10-18 23:55:09	2025-10-18 23:56:14
491	Heal 01-Volume Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 00:07:21	2025-10-19 00:08:00
494	Heal 01-Volume Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 00:08:00	2025-10-19 00:08:00
499	Heal 01-Volume Vdu Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-19 00:08:00	2025-10-19 00:08:00
516	Heal 01-Volume Vdu Healing	Get Volumes Info	Get Server Property	FAIL	2025-10-19 00:08:01	2025-10-19 00:08:01
519	Heal 01-Volume Vdu Healing	Check VDU Disks	Variable Should Exist	FAIL	2025-10-19 00:08:01	2025-10-19 00:08:01
525	Heal 01-Volume Vdu Healing	Delete Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-19 00:08:01	2025-10-19 00:08:01
528	Heal 01-Volume Vdu Healing	Heal Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-19 00:08:01	2025-10-19 00:08:01
530	Heal 01-Volume Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-19 00:08:01	2025-10-19 00:08:01
545	Heal 01-Volume Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 00:08:01	2025-10-19 00:08:01
563	Heal 02-Scale Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 00:08:52	2025-10-19 00:09:30
566	Heal 02-Scale Vdu Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
574	Heal 02-Scale Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
579	Heal 02-Scale Vdu Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
589	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU Before Halting VM	Get Vdu Attribute	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
594	Heal 02-Scale Vdu Healing	Halt Manual Scale VDU	Variable Should Exist	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
597	Heal 02-Scale Vdu Healing	Heal Manual Scale VDU	Variable Should Exist	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
599	Heal 02-Scale Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
611	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
615	Heal 02-Scale Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 00:09:30	2025-10-19 00:09:30
628	Heal 03-Multiple Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-19 00:10:21	2025-10-19 00:11:00
631	Heal 03-Multiple Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
639	Heal 03-Multiple Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
644	Heal 03-Multiple Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
654	Heal 03-Multiple Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
666	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU Before Stopping VM	Get Vdu Attribute	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
671	Heal 03-Multiple Healing	Stop VDUs	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
677	Heal 03-Multiple Healing	Heal VDUs	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
680	Heal 03-Multiple Healing	Check VNFs After Healing	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
691	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
695	Heal 03-Multiple Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-19 00:11:00	2025-10-19 00:11:00
744	K8S 13-Two Helm Kdu	Delete Network Service Instance	Delete NS	FAIL	2025-10-19 00:30:08	2025-10-19 00:34:14
746	K8S 13-Two Helm Kdu	Delete NS Descriptor Test	Delete NSD	FAIL	2025-10-19 00:34:17	2025-10-19 00:34:19
747	K8S 13-Two Helm Kdu	Delete VNF Descriptor Test	Delete VNFD	FAIL	2025-10-19 00:34:19	2025-10-19 00:34:20
758	Sa 01-Vnf With Vim Metrics	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds	FAIL	2025-10-19 00:40:18	2025-10-19 00:54:20
788	Sa 02-Vnf With Vim Metrics And Autoscaling	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds	FAIL	2025-10-19 00:55:46	2025-10-19 01:09:48
793	Sa 02-Vnf With Vim Metrics And Autoscaling	Wait VIM-based Metric To Exceed Threshold	Wait Until Keyword Succeeds	FAIL	2025-10-19 01:09:50	2025-10-19 01:23:51
796	Sa 02-Vnf With Vim Metrics And Autoscaling	Check VIM-based Metric Exceeds Threshold After...	Check VIM-based Metric Exceeds Threshold	FAIL	2025-10-19 01:25:51	2025-10-19 01:25:51
827	Sa 07-Alarms From Sa-Related Vnfs	Get Alarm Metric	Wait Until Keyword Succeeds	FAIL	2025-10-19 01:30:40	2025-10-19 01:44:41
828	Sa 07-Alarms From Sa-Related Vnfs	Check Alarms Were Received	Wait Until Keyword Succeeds	FAIL	2025-10-19 01:44:41	2025-10-19 01:48:11

osm-stage_3-merge/v15.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
10	Sa 01-Vnf With Vim Metrics	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds	FAIL	2025-03-21 05:29:21	2025-03-21 05:43:21
40	Sa 02-Vnf With Vim Metrics And Autoscaling	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds	FAIL	2025-03-21 05:44:46	2025-03-21 05:58:46
45	Sa 02-Vnf With Vim Metrics And Autoscaling	Wait VIM-based Metric To Exceed Threshold	Wait Until Keyword Succeeds	FAIL	2025-03-21 05:58:49	2025-03-21 06:12:49
48	Sa 02-Vnf With Vim Metrics And Autoscaling	Check VIM-based Metric Exceeds Threshold After...	Check VIM-based Metric Exceeds Threshold	FAIL	2025-03-21 06:14:49	2025-03-21 06:14:49
79	Sa 07-Alarms From Sa-Related Vnfs	Get Alarm Metric	Wait Until Keyword Succeeds	FAIL	2025-03-21 06:19:35	2025-03-21 06:33:35
80	Sa 07-Alarms From Sa-Related Vnfs	Check Alarms Were Received	Wait Until Keyword Succeeds	FAIL	2025-03-21 06:33:35	2025-03-21 06:37:06

osm-stage_3-merge/v14.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime

---

---

---

Powered by osm-analytics