Analysis of OSM installations

Date and time of the report: 2022-12-01 23:59:07.687537

1. Loading and processing installation events

b'Skipping line 12697: expected 3 fields, saw 12\nSkipping line 12959: expected 3 fields, saw 10\nSkipping line 12960: expected 3 fields, saw 10\nSkipping line 31746: expected 3 fields, saw 5\nSkipping line 33238: expected 3 fields, saw 10\nSkipping line 34063: expected 3 fields, saw 12\nSkipping line 34326: expected 3 fields, saw 5\nSkipping line 35706: expected 3 fields, saw 5\nSkipping line 35814: expected 3 fields, saw 5\nSkipping line 36971: expected 3 fields, saw 5\nSkipping line 67445: expected 3 fields, saw 10\nSkipping line 104588: expected 3 fields, saw 10\nSkipping line 119940: expected 3 fields, saw 10\nSkipping line 129390: expected 3 fields, saw 10\nSkipping line 129721: expected 3 fields, saw 10\nSkipping line 129759: expected 3 fields, saw 10\nSkipping line 132185: expected 3 fields, saw 10\nSkipping line 133635: expected 3 fields, saw 10\nSkipping line 147721: expected 3 fields, saw 10\nSkipping line 158386: expected 3 fields, saw 4\nSkipping line 184174: expected 3 fields, saw 10\nSkipping line 188833: expected 3 fields, saw 10\nSkipping line 199568: expected 3 fields, saw 10\n'

Unknown categories: ['juju_insgs', 'k8s_certmanager_ok', 'deploy_vca_only_ok', 'bootstrap_certificate_authority_ok', 'none', 'because', 'found.', 'is', "''", 'failed', 'k8s_ready_before_helm', 'install_osm_ngsa_ok', 'airflow_ok', 'pushgateway_ok', 'proxy_ok']

Unknown categories: ['juju_insgs', 'k8s_certmanager_ok', 'deploy_vca_only_ok', 'bootstrap_certificate_authority_ok', 'none', "''", 'k8s_ready_before_helm', 'install_osm_ngsa_ok', 'airflow_ok', 'pushgateway_ok', 'proxy_ok']

2. Number of installations

2.1 Number of installations per release

	RELEASE	INSTALLATIONS
0	ReleaseTWELVE	4437
1	ReleaseELEVEN	4022
2	release	2352
3	testing-daily	373
4	ReleaseTEN	104
5	ReleaseFIVE	43
6	ReleaseNINE	32
7	ReleaseELEVEN-daily	25
8	ReleaseEIGHT	19
9	ReleaseSIX	9
10	ReleaseTwelve	7
11	ReleaseSEVEN	5
12	12.0.0rc1	3
13	10.1.1rc1	2
14	ReleaseTWELVE-daily	2
15	11.0.0rc1	1
16	ReleaseNINE-daily	1
17	ReleaseTEN-daily	1
18	7.1.0rc1	1

2.2 Temporal evolution of installations

Summary as of the week of the last sample per release:

	release	timestamp	weekly_installations	total_installations
0	ReleaseTWELVE	2022-12-04	215	4437
1	ReleaseELEVEN	2022-12-04	7	4022
2	release	2022-12-04	39	2352
3	testing-daily	2022-12-04	16	373
4	ReleaseTEN	2022-12-04	1	104
5	ReleaseFIVE	2022-10-02	2	43
6	ReleaseNINE	2022-10-16	1	32
7	ReleaseELEVEN-daily	2022-07-17	4	25
8	ReleaseEIGHT	2022-11-27	2	19
9	ReleaseSIX	2022-05-15	4	9
10	ReleaseTwelve	2022-11-27	7	7
11	ReleaseSEVEN	2022-08-14	2	5
12	12.0.0rc1	2022-07-03	3	3
13	ReleaseTWELVE-daily	2022-11-20	1	2
14	10.1.1rc1	2022-06-05	2	2
15	ReleaseTEN-daily	2022-10-30	1	1
16	11.0.0rc1	2021-12-05	1	1
17	7.1.0rc1	2022-11-27	1	1
18	ReleaseNINE-daily	2022-07-24	1	1

Detail of weekly installations per release (last 36 weeks):

	weekly_installations
release	ReleaseELEVEN	ReleaseELEVEN-daily	ReleaseTWELVE	ReleaseTWELVE-daily	release	testing-daily
timestamp
2022-01-23	169	1	0	0	32	5
2022-01-30	186	0	0	0	38	0
2022-03-20	119	1	0	0	29	1
2022-04-24	130	0	0	0	69	2
2022-05-01	201	0	0	0	129	4
2022-05-08	187	0	0	0	89	0
2022-05-15	202	0	0	0	107	0
2022-05-22	128	0	0	0	94	1
2022-05-29	170	0	0	0	79	1
2022-06-05	124	0	0	0	56	1
2022-06-12	151	13	0	0	59	8
2022-06-19	131	0	0	0	71	7
2022-06-26	196	0	0	0	81	6
2022-07-03	155	0	67	0	63	0
2022-07-10	46	0	151	0	46	2
2022-07-17	54	4	229	0	60	1
2022-07-24	76	0	215	0	75	0
2022-07-31	116	0	184	0	55	0
2022-08-07	48	0	217	1	42	0
2022-08-14	46	0	132	0	82	1
2022-08-21	59	0	221	0	35	0
2022-08-28	42	0	247	0	54	0
2022-09-04	28	0	179	0	64	0
2022-09-11	59	0	174	0	60	0
2022-09-18	29	0	288	0	39	3
2022-09-25	12	0	160	0	33	0
2022-10-02	44	0	145	0	67	3
2022-10-09	41	0	252	0	56	1
2022-10-16	45	0	178	0	43	119
2022-10-23	20	0	235	0	20	124
2022-10-30	8	0	157	0	52	0
2022-11-06	6	0	105	0	26	0
2022-11-13	40	0	181	0	41	7
2022-11-20	28	0	262	1	102	20
2022-11-27	18	0	243	0	91	34
2022-12-04	7	0	215	0	39	16

3. Progress during installation

3.1 Overview of successful installation steps

3.2 Installation funnels per release

Default installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	2	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	3	2	0.666667
3	7.1.0rc1	0	0	0.000000
4	Release ELEVEN	3605	530	0.147018
5	Release ELEVEN-daily	23	2	0.086957
6	Release TWELVE	3458	515	0.148930
7	Release TWELVE-daily	2	2	1.000000
8	ReleaseEIGHT	19	2	0.105263
9	ReleaseFIVE	43	13	0.302326
10	ReleaseNINE	32	1	0.031250
11	ReleaseNINE-daily	1	0	0.000000
12	ReleaseSEVEN	5	0	0.000000
13	ReleaseSIX	8	0	0.000000
14	ReleaseTEN	98	6	0.061224
15	ReleaseTEN-daily	1	0	0.000000
16	ReleaseTwelve	7	0	0.000000
17	release	2352	2232	0.948980
18	testing-daily	76	54	0.710526

Charmed installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	0	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	0	0	0.000000
3	7.1.0rc1	1	0	0.000000
4	Release ELEVEN	401	51	0.127182
5	Release ELEVEN-daily	2	2	1.000000
6	Release TWELVE	968	246	0.254132
7	Release TWELVE-daily	0	0	0.000000
8	ReleaseEIGHT	0	0	0.000000
9	ReleaseFIVE	0	0	0.000000
10	ReleaseNINE	0	0	0.000000
11	ReleaseNINE-daily	0	0	0.000000
12	ReleaseSEVEN	0	0	0.000000
13	ReleaseSIX	0	0	0.000000
14	ReleaseTEN	6	0	0.000000
15	ReleaseTEN-daily	0	0	0.000000
16	ReleaseTwelve	0	0	0.000000
17	release	0	0	0.000000
18	testing-daily	297	153	0.515152

4. Analysis of failed installation attempts

	installation_type	Charmed								Default					Other
	fatal	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd	bootstrap_k8s	charmed_install	...	k8scluster	lxd	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd
location	release
local	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	0	1	0	0	0	0	0	0	0	0	...	4	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	1	24	0	0	0	0	0	0	0	0	...	11	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	36	0	0	0	0	0	0	0	0	0
	testing-daily	1	73	0	0	0	0	0	0	0	0	...	3	2	0	0	0	0	0	0	0	0
public	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	1	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	9	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	1	186	2	0	0	1	0	0	0	0	...	1224	0	0	0	0	2	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	5	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	12	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	2	0	0	0	0	0	0	0	0	...	49	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	4	301	0	0	0	1	0	0	0	0	...	1240	0	0	0	0	0	0	0	2	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	7	0	0	0	0	0	0	0	0	0
	testing-daily	0	1	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0

38 rows × 24 columns

	installation_type	Charmed	Default	Other
	osm_unhealthy	didnotconverge	didnotconverge	didnotconverge
location	release
local	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	0	0
	ReleaseELEVEN	0	0	0
	ReleaseELEVEN-daily	0	0	0
	ReleaseFIVE	0	0	0
	ReleaseNINE	0	0	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	1	0
	ReleaseTEN-daily	0	0	0
	ReleaseTWELVE	0	2	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	94	0
	testing-daily	0	6	0
public	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	2	0
	ReleaseELEVEN	0	257	0
	ReleaseELEVEN-daily	0	2	0
	ReleaseFIVE	0	11	0
	ReleaseNINE	0	1	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	4	0
	ReleaseTEN-daily	0	0	0
	ReleaseTWELVE	0	146	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	81	0
	testing-daily	0	8	0

ANNEX: Analysis of anomalies in progress logs

Last 10 installation attempts with first error at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	because	found.	is	failed
installation_id
1669883446-4TukeyxITMqbDKGq	2022-12-01 09:30:52	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669888639-DvzM5ldA9B39Hpmt	2022-12-01 10:57:29	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669888856-EBVvpeJusWsSLv8p	2022-12-01 11:00:57	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669888930-dojpsg1Lq3VyUAUN	2022-12-01 11:02:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669890543-4aKSAqA2En4mg9vS	2022-12-01 11:29:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669890746-Z84RHXj27AOByoJV	2022-12-01 11:32:27	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669891288-k4i0ksP1J9Om6qo1	2022-12-01 11:41:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669891766-esqhU55DDDkOuZy4	2022-12-01 11:49:27	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669895177-56ccoavEK9bHpL3Z	2022-12-01 12:46:24	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1669927863-T13kZKVCCsCFpFlg	2022-12-01 21:51:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN

Last 10 installation attempts with double change at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	because	found.	is	failed
installation_id
1651089791-0ZOk3w44o84SsglS	2022-04-27 22:03:11	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1652422198-SkkMvcTy3BTAaKnx	2022-05-13 08:09:58	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN
1655630327-RJtTX023a95KG8Z5	2022-06-19 11:18:48	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN
1656750844-hcFMxuu4XtesVvU4	2022-07-02 10:34:05	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN
1658565417-IYxrW5582Mh8VvhP	2022-07-23 10:36:58	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN	NaN	NaN	NaN
1660626996-l40FfPZQ7UUYg7Ml	2022-08-16 07:16:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN	NaN	NaN	NaN
1664716791-bncwUBAZRWvjrLhq	2022-10-02 15:19:52	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	install_k8s_monitoring	NaN	NaN	NaN	NaN	NaN
1667739912-xr1jPdGlwN1AvUzT	2022-11-06 14:05:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1668962162-4Y7MTb5WyRq6TGdr	2022-11-20 17:36:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1669463054-wGgdMfJ6iwrqK3tB	2022-11-26 12:44:14	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN

DONE

---