Analysis of Robot reports from OSM Jenkins

Date and time of the report: 2025-10-21 08:20:24.615630

Analysed period: 2025-09-30 to 2025-10-21.

1. Retrieval of all currrent data for aggregate analytics

Database update:

Retrieving from database...	

DONE

2. Aggregated analysis of stability

2.1 Restricts data to time window for analysis

2.2 Finding sequences of successful builds and Robot reports

Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:

• build_result is the outcome of the build, reported by Jenkins. It can be: SUCCESS, FAILURE, UNSTABLE or ABORTED.
• test_result is the summary of the concerned Robot tests. It can be: FAIL, UNAVAILABLE or PASS.

Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:

1. Successful builds/failed builds in a row: grp_build_result.
2. Successful test reports vs. test reports with fails in a row: grp_test_result.
3. Clean builds and tests vs. failures (of any kind) in a row: grp_success_fail.

For the identification of these sequences, the following mapping applies:

Type of sequence	Relevant state	OK sequence contains	NOK sequence contains	Ignore
grp_build_result	build_result	SUCCESS or UNSTABLE	FAILURE	ABORTED
grp_test_result	test_result	PASS	FAIL	UNAVAILABLE
grp_success_fail	test_result	PASS	FAIL or UNAVAILABLE	N/A

The different groupings of segments are detected and a label is added to each sample...

DONE

Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...

DONE

2.3 Finding sequences of pass/fails per test suite

DONE

3. Reports

3.1 Aggregated success rate per test step

Empty dataframe. Skipping.

3.2 Overall success of Jenkins builds and Robot tests

3.3 Sequences of pass/fails per test suites

Empty dataframe. Skipping.

3.4 Failing days per test suite

Empty dataframe. Skipping.

job	Master branch				Release FOURTEEN				Release SEVENTEEN				Release SIXTEEN
	days_failing	days_passing	days_run	error_rate	days_failing	days_passing	days_run	error_rate	days_failing	days_passing	days_run	error_rate	days_failing	days_passing	days_run	error_rate
suites
Basic 01-Crud Operations On Vim Targets	0.0	21.570995	21.570995	0.0	0.0	20.694606	20.694606	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0
Basic 05-Instantiation Parameters In Cloud Init	0.0	21.570995	21.570995	0.0	0.0	20.694606	20.694606	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0
Basic 06-Vnf With Charm	0.0	0.000000	0.000000	0.0	0.0	20.694606	20.694606	0.0	0.0	0.000000	0.000000	0.0	0.0	0.000000	0.000000	0.0
Basic 07-Secure Key Management	0.0	0.000000	0.000000	0.0	0.0	20.694606	20.694606	0.0	0.0	0.000000	0.000000	0.0	0.0	0.000000	0.000000	0.0
Basic 08-Disable Port Security Network Level	0.0	21.570995	21.570995	0.0	0.0	20.694606	20.694606	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0
...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...
Sa 08-Vnf With Vnf Indicators Snmp	0.0	21.570995	21.570995	0.0	0.0	20.694606	20.694606	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0
Slice 01-Network Slicing	0.0	21.570995	21.570995	0.0	0.0	20.694606	20.694606	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0
Slice 02-Shared Network Slicing	0.0	21.570995	21.570995	0.0	0.0	20.694606	20.694606	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0
Sol003 01-Vnf-Lifecycle-Management	0.0	21.570995	21.570995	0.0	0.0	20.694606	20.694606	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0
Sol003 02-Dualstack Ip Vnfm	0.0	21.570995	21.570995	0.0	0.0	0.000000	0.000000	0.0	0.0	21.499468	21.499468	0.0	0.0	20.657789	20.657789	0.0

62 rows × 16 columns

4. Information about the latest builds of relevant jobs

Latest build of each job

	job	build	timestamp	duration	build_result	test_result	pass_count	fail_count
0	osm-stage_3-merge/master	3525	2025-10-21 01:06:22	632747	FAILURE	UNAVAILABLE	NaN	NaN
1	osm-stage_3-merge/v17.0	287	2025-10-21 02:49:22	11794303	UNSTABLE	FAIL	422.0	63.0
2	osm-stage_3-merge/v16.0	398	2025-10-20 23:01:22	10986324	UNSTABLE	FAIL	412.0	60.0
3	osm-stage_3-merge/v15.0	446	2025-03-21 03:34:47	12254896	UNSTABLE	FAIL	448.0	7.0
4	osm-stage_3-merge/v14.0	815	2025-10-20 22:08:21	16004556	UNSTABLE	FAIL	563.0	56.0

Click to see the details of build 3525 of osm-stage_3-merge/master

Click to see the details of build 287 of osm-stage_3-merge/v17.0

Click to see the details of build 398 of osm-stage_3-merge/v16.0

Click to see the details of build 446 of osm-stage_3-merge/v15.0

Click to see the details of build 815 of osm-stage_3-merge/v14.0

Failed test suites per job (if any):

osm-stage_3-merge/master: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword

osm-stage_3-merge/v17.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
207	Basic 21-Support Of Volumes	FAIL	2025-10-21 03:23:03	2025-10-21 03:24:30	6	4	Network Service Instance Test	Create Network Service
211	Basic 28-Keep Persistent Volumes	FAIL	2025-10-21 03:31:05	2025-10-21 03:32:32	5	11	Network Service Instance Test	Create Network Service
214	Basic 31-Multivdu Volume Multiattach	FAIL	2025-10-21 03:38:35	2025-10-21 03:40:00	5	4	Network Service Instance Test	Create Network Service
217	Epa 03-Crud Operations On Sdnc	FAIL	2025-10-21 03:43:37	2025-10-21 03:44:52	2	1	Create Basic SDNC	Wait Until Keyword Succeeds
220	Gitops 02-Declarative Cluster Registration Oka...	FAIL	2025-10-21 03:48:42	2025-10-21 04:45:05	3	10	Add OKA Packages For The Testsuite	Add OKA Package
224	Heal 01-Volume Vdu Healing	FAIL	2025-10-21 04:53:00	2025-10-21 04:54:36	6	10	Network Service Instance Test	Create Network Service
225	Heal 02-Scale Vdu Healing	FAIL	2025-10-21 04:54:36	2025-10-21 04:56:13	7	11	Network Service Instance Test	Create Network Service
226	Heal 03-Multiple Healing	FAIL	2025-10-21 04:56:13	2025-10-21 04:57:46	6	12	Network Service Instance Test	Create Network Service

osm-stage_3-merge/v16.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
163	Basic 21-Support Of Volumes	FAIL	2025-10-20 23:35:33	2025-10-20 23:36:57	6	4	Network Service Instance Test	Create Network Service
167	Basic 28-Keep Persistent Volumes	FAIL	2025-10-20 23:43:25	2025-10-20 23:44:49	5	11	Network Service Instance Test	Create Network Service
170	Basic 31-Multivdu Volume Multiattach	FAIL	2025-10-20 23:51:05	2025-10-20 23:52:27	5	4	Network Service Instance Test	Create Network Service
173	Epa 03-Crud Operations On Sdnc	FAIL	2025-10-20 23:56:03	2025-10-20 23:57:17	2	1	Create Basic SDNC	Wait Until Keyword Succeeds
179	Heal 01-Volume Vdu Healing	FAIL	2025-10-21 00:08:23	2025-10-21 00:09:58	6	10	Network Service Instance Test	Create Network Service
180	Heal 02-Scale Vdu Healing	FAIL	2025-10-21 00:09:58	2025-10-21 00:11:31	7	11	Network Service Instance Test	Create Network Service
181	Heal 03-Multiple Healing	FAIL	2025-10-21 00:11:31	2025-10-21 00:13:02	6	12	Network Service Instance Test	Create Network Service
190	Sa 01-Vnf With Vim Metrics	FAIL	2025-10-21 00:35:24	2025-10-21 00:51:19	6	1	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds
191	Sa 02-Vnf With Vim Metrics And Autoscaling	FAIL	2025-10-21 00:51:19	2025-10-21 01:24:54	11	4	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds
192	Sa 07-Alarms From Sa-Related Vnfs	FAIL	2025-10-21 01:24:54	2025-10-21 01:46:27	14	2	Get Alarm Metric	Wait Until Keyword Succeeds

osm-stage_3-merge/v15.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
88	Sa 01-Vnf With Vim Metrics	FAIL	2025-03-21 05:28:39	2025-03-21 05:43:58	6	1	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds
89	Sa 02-Vnf With Vim Metrics And Autoscaling	FAIL	2025-03-21 05:43:58	2025-03-21 06:17:27	11	4	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds
90	Sa 07-Alarms From Sa-Related Vnfs	FAIL	2025-03-21 06:17:27	2025-03-21 06:38:22	14	2	Get Alarm Metric	Wait Until Keyword Succeeds

osm-stage_3-merge/v14.0: (full report)

	name	status	starttime	endtime	pass	fail	failed_test_name	failed_keyword
112	Basic 21-Support Of Volumes	FAIL	2025-10-20 23:18:48	2025-10-20 23:20:07	6	4	Network Service Instance Test	Create Network Service
119	Basic 28-Keep Persistent Volumes	FAIL	2025-10-20 23:40:02	2025-10-20 23:41:23	5	11	Network Service Instance Test	Create Network Service
122	Basic 31-Multivdu Volume Multiattach	FAIL	2025-10-20 23:47:31	2025-10-20 23:48:49	5	4	Network Service Instance Test	Create Network Service
125	Epa 03-Crud Operations On Sdnc	FAIL	2025-10-20 23:52:17	2025-10-20 23:53:25	2	1	Create Basic SDNC	Wait Until Keyword Succeeds
131	Heal 01-Volume Vdu Healing	FAIL	2025-10-21 00:04:12	2025-10-21 00:08:39	6	10	Network Service Instance Test	Create Network Service
132	Heal 02-Scale Vdu Healing	FAIL	2025-10-21 00:08:39	2025-10-21 00:13:05	7	9	Network Service Instance Test	Create Network Service
133	Heal 03-Multiple Healing	FAIL	2025-10-21 00:13:05	2025-10-21 00:16:57	6	10	Network Service Instance Test	Create Network Service
147	Sa 01-Vnf With Vim Metrics	FAIL	2025-10-21 01:06:32	2025-10-21 01:21:52	6	1	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds
148	Sa 02-Vnf With Vim Metrics And Autoscaling	FAIL	2025-10-21 01:21:52	2025-10-21 01:55:52	11	4	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds
149	Sa 07-Alarms From Sa-Related Vnfs	FAIL	2025-10-21 01:55:52	2025-10-21 02:16:40	14	2	Get Alarm Metric	Wait Until Keyword Succeeds

Details of failed tests into failing test suites (if any):

osm-stage_3-merge/master: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime

osm-stage_3-merge/v17.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
878	Basic 21-Support Of Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 03:23:07	2025-10-21 03:23:47
886	Basic 21-Support Of Volumes	Get VNF IP Address	Variable Should Exist	FAIL	2025-10-21 03:23:49	2025-10-21 03:23:49
890	Basic 21-Support Of Volumes	Check VDU disks	Variable Should Exist	FAIL	2025-10-21 03:23:49	2025-10-21 03:23:49
901	Basic 28-Keep Persistent Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 03:31:09	2025-10-21 03:31:49
903	Basic 28-Keep Persistent Volumes	Check Persistent Volume Counts	Variable Should Exist	FAIL	2025-10-21 03:31:49	2025-10-21 03:31:49
908	Basic 28-Keep Persistent Volumes	Set Persistent Volume Ids	Variable Should Exist	FAIL	2025-10-21 03:31:49	2025-10-21 03:31:49
912	Basic 28-Keep Persistent Volumes	Check Persistent Root Volume in VIM after NS D...	Variable Should Exist	FAIL	2025-10-21 03:32:11	2025-10-21 03:32:11
915	Basic 28-Keep Persistent Volumes	Check Persistent Ordinary Volume in VIM after ...	Variable Should Exist	FAIL	2025-10-21 03:32:11	2025-10-21 03:32:11
918	Basic 28-Keep Persistent Volumes	Prepare Ns Config With Volume Id	Set Suite Variable	FAIL	2025-10-21 03:32:11	2025-10-21 03:32:11
919	Basic 28-Keep Persistent Volumes	Network Service Instance With Existing Volumes...	Create Network Service	FAIL	2025-10-21 03:32:11	2025-10-21 03:32:11
921	Basic 28-Keep Persistent Volumes	Verify the Attachment Of Existing Persistent V...	Set Suite Variable	FAIL	2025-10-21 03:32:11	2025-10-21 03:32:11
929	Basic 28-Keep Persistent Volumes	Delete NS Instance With Existing Volumes Test	Delete NS	FAIL	2025-10-21 03:32:11	2025-10-21 03:32:13
930	Basic 28-Keep Persistent Volumes	Check Existence of Persistent Volumes	Variable Should Exist	FAIL	2025-10-21 03:32:13	2025-10-21 03:32:13
934	Basic 28-Keep Persistent Volumes	Delete Persistent Volumes	Clean Persistent Volumes	FAIL	2025-10-21 03:32:13	2025-10-21 03:32:13
942	Basic 31-Multivdu Volume Multiattach	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 03:38:39	2025-10-21 03:39:19
945	Basic 31-Multivdu Volume Multiattach	Get Vnf ID	Get Vnf Id	FAIL	2025-10-21 03:39:19	2025-10-21 03:39:19
947	Basic 31-Multivdu Volume Multiattach	Get Vnf Management Ip Addresses	Run And Return Rc And Output	FAIL	2025-10-21 03:39:19	2025-10-21 03:39:19
953	Basic 31-Multivdu Volume Multiattach	Ensure that VDUs can share data	Execute Remote Command Check Rc Return Output	FAIL	2025-10-21 03:39:19	2025-10-21 03:39:19
965	Epa 03-Crud Operations On Sdnc	Create Basic SDNC	Wait Until Keyword Succeeds	FAIL	2025-10-21 03:43:39	2025-10-21 03:44:45
970	Gitops 02-Declarative Cluster Registration Oka...	Add OKA Packages For The Testsuite	Add OKA Package	FAIL	2025-10-21 03:48:43	2025-10-21 03:53:47
973	Gitops 02-Declarative Cluster Registration Oka...	Register Cluster For Testsuite	Register Cluster	FAIL	2025-10-21 03:53:47	2025-10-21 04:10:14
979	Gitops 02-Declarative Cluster Registration Oka...	Create KSU Namespace For All KSUs	Create KSU	FAIL	2025-10-21 04:10:16	2025-10-21 04:10:18
982	Gitops 02-Declarative Cluster Registration Oka...	Create KSU1 Without Params	Create KSU	FAIL	2025-10-21 04:10:18	2025-10-21 04:10:19
985	Gitops 02-Declarative Cluster Registration Oka...	Create KSU2 With Params	Create KSU	FAIL	2025-10-21 04:10:19	2025-10-21 04:10:21
988	Gitops 02-Declarative Cluster Registration Oka...	Delete KSU2	Delete KSU	FAIL	2025-10-21 04:10:21	2025-10-21 04:10:23
989	Gitops 02-Declarative Cluster Registration Oka...	Delete KSU1	Delete KSU	FAIL	2025-10-21 04:10:23	2025-10-21 04:10:25
990	Gitops 02-Declarative Cluster Registration Oka...	Delete KSU Namespace	Delete KSU	FAIL	2025-10-21 04:10:25	2025-10-21 04:10:26
991	Gitops 02-Declarative Cluster Registration Oka...	Deregister Cluster For Testsuite	Deregister Cluster	FAIL	2025-10-21 04:10:26	2025-10-21 04:22:36
993	Gitops 02-Declarative Cluster Registration Oka...	Delete OKA Packages For The Testsuite	Delete OKA Package	FAIL	2025-10-21 04:22:39	2025-10-21 04:27:42
999	Heal 01-Volume Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 04:53:06	2025-10-21 04:53:46
1002	Heal 01-Volume Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 04:53:46	2025-10-21 04:53:46
1007	Heal 01-Volume Vdu Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-21 04:53:46	2025-10-21 04:53:46
1024	Heal 01-Volume Vdu Healing	Get Volumes Info	Get Server Property	FAIL	2025-10-21 04:53:48	2025-10-21 04:53:48
1027	Heal 01-Volume Vdu Healing	Check VDU Disks	Variable Should Exist	FAIL	2025-10-21 04:53:48	2025-10-21 04:53:48
1033	Heal 01-Volume Vdu Healing	Delete Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-21 04:53:48	2025-10-21 04:53:48
1036	Heal 01-Volume Vdu Healing	Heal Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-21 04:53:48	2025-10-21 04:53:48
1038	Heal 01-Volume Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-21 04:53:48	2025-10-21 04:53:48
1053	Heal 01-Volume Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 04:53:48	2025-10-21 04:53:48
1071	Heal 02-Scale Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 04:54:42	2025-10-21 04:55:22
1074	Heal 02-Scale Vdu Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1082	Heal 02-Scale Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1087	Heal 02-Scale Vdu Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1097	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU Before Halting VM	Get Vdu Attribute	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1102	Heal 02-Scale Vdu Healing	Halt Manual Scale VDU	Variable Should Exist	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1105	Heal 02-Scale Vdu Healing	Heal Manual Scale VDU	Variable Should Exist	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1107	Heal 02-Scale Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1119	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1123	Heal 02-Scale Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 04:55:22	2025-10-21 04:55:22
1136	Heal 03-Multiple Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 04:56:18	2025-10-21 04:56:58
1139	Heal 03-Multiple Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1147	Heal 03-Multiple Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1152	Heal 03-Multiple Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1162	Heal 03-Multiple Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1174	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU Before Stopping VM	Get Vdu Attribute	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1179	Heal 03-Multiple Healing	Stop VDUs	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1185	Heal 03-Multiple Healing	Heal VDUs	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1188	Heal 03-Multiple Healing	Check VNFs After Healing	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1199	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58
1203	Heal 03-Multiple Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 04:56:58	2025-10-21 04:56:58

osm-stage_3-merge/v16.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
482	Basic 21-Support Of Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-20 23:35:36	2025-10-20 23:36:16
490	Basic 21-Support Of Volumes	Get VNF IP Address	Variable Should Exist	FAIL	2025-10-20 23:36:17	2025-10-20 23:36:17
494	Basic 21-Support Of Volumes	Check VDU disks	Variable Should Exist	FAIL	2025-10-20 23:36:17	2025-10-20 23:36:17
505	Basic 28-Keep Persistent Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-20 23:43:28	2025-10-20 23:44:08
507	Basic 28-Keep Persistent Volumes	Check Persistent Volume Counts	Variable Should Exist	FAIL	2025-10-20 23:44:08	2025-10-20 23:44:08
512	Basic 28-Keep Persistent Volumes	Set Persistent Volume Ids	Variable Should Exist	FAIL	2025-10-20 23:44:08	2025-10-20 23:44:08
516	Basic 28-Keep Persistent Volumes	Check Persistent Root Volume in VIM after NS D...	Variable Should Exist	FAIL	2025-10-20 23:44:30	2025-10-20 23:44:30
519	Basic 28-Keep Persistent Volumes	Check Persistent Ordinary Volume in VIM after ...	Variable Should Exist	FAIL	2025-10-20 23:44:30	2025-10-20 23:44:30
522	Basic 28-Keep Persistent Volumes	Prepare Ns Config With Volume Id	Set Suite Variable	FAIL	2025-10-20 23:44:30	2025-10-20 23:44:30
523	Basic 28-Keep Persistent Volumes	Network Service Instance With Existing Volumes...	Create Network Service	FAIL	2025-10-20 23:44:30	2025-10-20 23:44:30
525	Basic 28-Keep Persistent Volumes	Verify the Attachment Of Existing Persistent V...	Set Suite Variable	FAIL	2025-10-20 23:44:30	2025-10-20 23:44:30
533	Basic 28-Keep Persistent Volumes	Delete NS Instance With Existing Volumes Test	Delete NS	FAIL	2025-10-20 23:44:30	2025-10-20 23:44:32
534	Basic 28-Keep Persistent Volumes	Check Existence of Persistent Volumes	Variable Should Exist	FAIL	2025-10-20 23:44:32	2025-10-20 23:44:32
538	Basic 28-Keep Persistent Volumes	Delete Persistent Volumes	Clean Persistent Volumes	FAIL	2025-10-20 23:44:32	2025-10-20 23:44:32
546	Basic 31-Multivdu Volume Multiattach	Network Service Instance Test	Create Network Service	FAIL	2025-10-20 23:51:08	2025-10-20 23:51:48
549	Basic 31-Multivdu Volume Multiattach	Get Vnf ID	Get Vnf Id	FAIL	2025-10-20 23:51:48	2025-10-20 23:51:48
551	Basic 31-Multivdu Volume Multiattach	Get Vnf Management Ip Addresses	Run And Return Rc And Output	FAIL	2025-10-20 23:51:48	2025-10-20 23:51:48
557	Basic 31-Multivdu Volume Multiattach	Ensure that VDUs can share data	Execute Remote Command Check Rc Return Output	FAIL	2025-10-20 23:51:48	2025-10-20 23:51:48
569	Epa 03-Crud Operations On Sdnc	Create Basic SDNC	Wait Until Keyword Succeeds	FAIL	2025-10-20 23:56:05	2025-10-20 23:57:10
575	Heal 01-Volume Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 00:08:29	2025-10-21 00:09:09
578	Heal 01-Volume Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:09:09	2025-10-21 00:09:09
583	Heal 01-Volume Vdu Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-21 00:09:09	2025-10-21 00:09:09
600	Heal 01-Volume Vdu Healing	Get Volumes Info	Get Server Property	FAIL	2025-10-21 00:09:10	2025-10-21 00:09:10
603	Heal 01-Volume Vdu Healing	Check VDU Disks	Variable Should Exist	FAIL	2025-10-21 00:09:10	2025-10-21 00:09:10
609	Heal 01-Volume Vdu Healing	Delete Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-21 00:09:10	2025-10-21 00:09:10
612	Heal 01-Volume Vdu Healing	Heal Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-21 00:09:10	2025-10-21 00:09:10
614	Heal 01-Volume Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-21 00:09:10	2025-10-21 00:09:10
629	Heal 01-Volume Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:09:10	2025-10-21 00:09:10
647	Heal 02-Scale Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 00:10:05	2025-10-21 00:10:43
650	Heal 02-Scale Vdu Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
658	Heal 02-Scale Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
663	Heal 02-Scale Vdu Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
673	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU Before Halting VM	Get Vdu Attribute	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
678	Heal 02-Scale Vdu Healing	Halt Manual Scale VDU	Variable Should Exist	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
681	Heal 02-Scale Vdu Healing	Heal Manual Scale VDU	Variable Should Exist	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
683	Heal 02-Scale Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
695	Heal 02-Scale Vdu Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
699	Heal 02-Scale Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:10:43	2025-10-21 00:10:43
712	Heal 03-Multiple Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 00:11:35	2025-10-21 00:12:15
715	Heal 03-Multiple Healing	Scale Out Manual Scale VNF	Get Vnf Id	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
723	Heal 03-Multiple Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
728	Heal 03-Multiple Healing	Get Manual Scale VNF Info	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
738	Heal 03-Multiple Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
750	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU Before Stopping VM	Get Vdu Attribute	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
755	Heal 03-Multiple Healing	Stop VDUs	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
761	Heal 03-Multiple Healing	Heal VDUs	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
764	Heal 03-Multiple Healing	Check VNFs After Healing	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
775	Heal 03-Multiple Healing	Check Day0 And Day1 In VDU After Healing	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
779	Heal 03-Multiple Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:12:15	2025-10-21 00:12:15
799	Sa 01-Vnf With Vim Metrics	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds	FAIL	2025-10-21 00:36:40	2025-10-21 00:50:42
829	Sa 02-Vnf With Vim Metrics And Autoscaling	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds	FAIL	2025-10-21 00:52:09	2025-10-21 01:06:11
834	Sa 02-Vnf With Vim Metrics And Autoscaling	Wait VIM-based Metric To Exceed Threshold	Wait Until Keyword Succeeds	FAIL	2025-10-21 01:06:13	2025-10-21 01:20:14
837	Sa 02-Vnf With Vim Metrics And Autoscaling	Check VIM-based Metric Exceeds Threshold After...	Check VIM-based Metric Exceeds Threshold	FAIL	2025-10-21 01:22:14	2025-10-21 01:22:15
868	Sa 07-Alarms From Sa-Related Vnfs	Get Alarm Metric	Wait Until Keyword Succeeds	FAIL	2025-10-21 01:27:38	2025-10-21 01:41:40
869	Sa 07-Alarms From Sa-Related Vnfs	Check Alarms Were Received	Wait Until Keyword Succeeds	FAIL	2025-10-21 01:41:40	2025-10-21 01:45:10

osm-stage_3-merge/v15.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
10	Sa 01-Vnf With Vim Metrics	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds	FAIL	2025-03-21 05:29:21	2025-03-21 05:43:21
40	Sa 02-Vnf With Vim Metrics And Autoscaling	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds	FAIL	2025-03-21 05:44:46	2025-03-21 05:58:46
45	Sa 02-Vnf With Vim Metrics And Autoscaling	Wait VIM-based Metric To Exceed Threshold	Wait Until Keyword Succeeds	FAIL	2025-03-21 05:58:49	2025-03-21 06:12:49
48	Sa 02-Vnf With Vim Metrics And Autoscaling	Check VIM-based Metric Exceeds Threshold After...	Check VIM-based Metric Exceeds Threshold	FAIL	2025-03-21 06:14:49	2025-03-21 06:14:49
79	Sa 07-Alarms From Sa-Related Vnfs	Get Alarm Metric	Wait Until Keyword Succeeds	FAIL	2025-03-21 06:19:35	2025-03-21 06:33:35
80	Sa 07-Alarms From Sa-Related Vnfs	Check Alarms Were Received	Wait Until Keyword Succeeds	FAIL	2025-03-21 06:33:35	2025-03-21 06:37:06

osm-stage_3-merge/v14.0: (full report)

	suite_name	test_name	keyword_name	status	starttime	endtime
89	Basic 21-Support Of Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-20 23:18:51	2025-10-20 23:19:29
97	Basic 21-Support Of Volumes	Get VNF IP Address	Variable Should Exist	FAIL	2025-10-20 23:19:31	2025-10-20 23:19:31
101	Basic 21-Support Of Volumes	Check VDU disks	Variable Should Exist	FAIL	2025-10-20 23:19:31	2025-10-20 23:19:31
113	Basic 28-Keep Persistent Volumes	Network Service Instance Test	Create Network Service	FAIL	2025-10-20 23:40:06	2025-10-20 23:40:45
115	Basic 28-Keep Persistent Volumes	Check Persistent Volume Counts	Variable Should Exist	FAIL	2025-10-20 23:40:45	2025-10-20 23:40:45
121	Basic 28-Keep Persistent Volumes	Set Persistent Volume Ids	Variable Should Exist	FAIL	2025-10-20 23:40:45	2025-10-20 23:40:45
125	Basic 28-Keep Persistent Volumes	Check Persistent Root Volume in VIM after NS D...	Variable Should Exist	FAIL	2025-10-20 23:41:06	2025-10-20 23:41:06
128	Basic 28-Keep Persistent Volumes	Check Persistent Ordinary Volume in VIM after ...	Variable Should Exist	FAIL	2025-10-20 23:41:06	2025-10-20 23:41:06
131	Basic 28-Keep Persistent Volumes	Prepare Ns Config With Volume Id	Set Suite Variable	FAIL	2025-10-20 23:41:06	2025-10-20 23:41:06
132	Basic 28-Keep Persistent Volumes	Network Service Instance With Existing Volumes...	Create Network Service	FAIL	2025-10-20 23:41:06	2025-10-20 23:41:06
134	Basic 28-Keep Persistent Volumes	Verify the Attachment Of Existing Persistent V...	Set Suite Variable	FAIL	2025-10-20 23:41:06	2025-10-20 23:41:06
142	Basic 28-Keep Persistent Volumes	Delete NS Instance With Existing Volumes Test	Delete NS	FAIL	2025-10-20 23:41:06	2025-10-20 23:41:08
143	Basic 28-Keep Persistent Volumes	Check Existence of Persistent Volumes	Variable Should Exist	FAIL	2025-10-20 23:41:08	2025-10-20 23:41:08
149	Basic 28-Keep Persistent Volumes	Delete Persistent Volumes	Delete Volume	FAIL	2025-10-20 23:41:08	2025-10-20 23:41:08
157	Basic 31-Multivdu Volume Multiattach	Network Service Instance Test	Create Network Service	FAIL	2025-10-20 23:47:35	2025-10-20 23:48:13
160	Basic 31-Multivdu Volume Multiattach	Get Vnf ID	Get Vnf Id	FAIL	2025-10-20 23:48:13	2025-10-20 23:48:13
162	Basic 31-Multivdu Volume Multiattach	Get Vnf Management Ip Addresses	Run And Return Rc And Output	FAIL	2025-10-20 23:48:13	2025-10-20 23:48:13
166	Basic 31-Multivdu Volume Multiattach	Ensure that VDUs can share data	Execute Remote Command Check Rc Return Output	FAIL	2025-10-20 23:48:13	2025-10-20 23:48:13
178	Epa 03-Crud Operations On Sdnc	Create Basic SDNC	Wait Until Keyword Succeeds	FAIL	2025-10-20 23:52:18	2025-10-20 23:53:22
184	Heal 01-Volume Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 00:04:17	2025-10-21 00:07:37
187	Heal 01-Volume Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:07:37	2025-10-21 00:07:37
192	Heal 01-Volume Vdu Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-21 00:07:37	2025-10-21 00:07:37
209	Heal 01-Volume Vdu Healing	Get Volumes Info	Get Server Property	FAIL	2025-10-21 00:07:39	2025-10-21 00:07:39
212	Heal 01-Volume Vdu Healing	Check VDU Disks	Variable Should Exist	FAIL	2025-10-21 00:07:39	2025-10-21 00:07:39
219	Heal 01-Volume Vdu Healing	Delete Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-21 00:07:39	2025-10-21 00:07:39
222	Heal 01-Volume Vdu Healing	Heal Persistent Volume VDU	Variable Should Exist	FAIL	2025-10-21 00:07:39	2025-10-21 00:07:39
224	Heal 01-Volume Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-21 00:07:39	2025-10-21 00:07:39
240	Heal 01-Volume Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:07:39	2025-10-21 00:07:39
258	Heal 02-Scale Vdu Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 00:08:45	2025-10-21 00:12:04
261	Heal 02-Scale Vdu Healing	Scale Out Charm VNF	Get Vnf Id	FAIL	2025-10-21 00:12:04	2025-10-21 00:12:04
270	Heal 02-Scale Vdu Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:12:04	2025-10-21 00:12:04
275	Heal 02-Scale Vdu Healing	Get Charm VNF Info	Variable Should Exist	FAIL	2025-10-21 00:12:04	2025-10-21 00:12:04
283	Heal 02-Scale Vdu Healing	Halt Charm VDU	Variable Should Exist	FAIL	2025-10-21 00:12:04	2025-10-21 00:12:04
286	Heal 02-Scale Vdu Healing	Heal Charm VDU	Variable Should Exist	FAIL	2025-10-21 00:12:04	2025-10-21 00:12:04
288	Heal 02-Scale Vdu Healing	Check VNF After Healing	Variable Should Exist	FAIL	2025-10-21 00:12:04	2025-10-21 00:12:04
302	Heal 02-Scale Vdu Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:12:04	2025-10-21 00:12:04
316	Heal 03-Multiple Healing	Network Service Instance Test	Create Network Service	FAIL	2025-10-21 00:13:10	2025-10-21 00:15:58
319	Heal 03-Multiple Healing	Scale Out Charm VNF	Get Vnf Id	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
328	Heal 03-Multiple Healing	Get VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
333	Heal 03-Multiple Healing	Get Charm VNF Info	Variable Should Exist	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
341	Heal 03-Multiple Healing	Get Volume VNF Info	Variable Should Exist	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
353	Heal 03-Multiple Healing	Stop VDUs	Variable Should Exist	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
359	Heal 03-Multiple Healing	Heal VDUs	Variable Should Exist	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
362	Heal 03-Multiple Healing	Check VNFs After Healing	Variable Should Exist	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
375	Heal 03-Multiple Healing	Update VIM Objects	Variable Should Exist	FAIL	2025-10-21 00:15:58	2025-10-21 00:15:58
396	Sa 01-Vnf With Vim Metrics	Get VNF VIM-based Metrics	Wait Until Keyword Succeeds	FAIL	2025-10-21 01:07:14	2025-10-21 01:21:14
429	Sa 02-Vnf With Vim Metrics And Autoscaling	Get VNF VIM-based Metric Before Auto-scaling	Wait Until Keyword Succeeds	FAIL	2025-10-21 01:23:12	2025-10-21 01:37:12
436	Sa 02-Vnf With Vim Metrics And Autoscaling	Wait VIM-based Metric To Exceed Threshold	Wait Until Keyword Succeeds	FAIL	2025-10-21 01:37:14	2025-10-21 01:51:15
439	Sa 02-Vnf With Vim Metrics And Autoscaling	Check VIM-based Metric Exceeds Threshold After...	Check VIM-based Metric Exceeds Threshold	FAIL	2025-10-21 01:53:15	2025-10-21 01:53:15
444	Sa 02-Vnf With Vim Metrics And Autoscaling	Get VDUs After Auto-scaling	Run Keyword If	FAIL	2025-10-21 01:55:15	2025-10-21 01:55:15
471	Sa 07-Alarms From Sa-Related Vnfs	Get Alarm Metric	Wait Until Keyword Succeeds	FAIL	2025-10-21 01:57:58	2025-10-21 02:11:59
473	Sa 07-Alarms From Sa-Related Vnfs	Check Alarms Were Received	Wait Until Keyword Succeeds	FAIL	2025-10-21 02:11:59	2025-10-21 02:15:29

---

---

---

Powered by osm-analytics