Analysis of OSM installations

Date and time of the report: 2022-11-20 23:59:09.239777

1. Loading and processing installation events

b'Skipping line 12697: expected 3 fields, saw 12\nSkipping line 12959: expected 3 fields, saw 10\nSkipping line 12960: expected 3 fields, saw 10\nSkipping line 31746: expected 3 fields, saw 5\nSkipping line 33238: expected 3 fields, saw 10\nSkipping line 34063: expected 3 fields, saw 12\nSkipping line 34326: expected 3 fields, saw 5\nSkipping line 35706: expected 3 fields, saw 5\nSkipping line 35814: expected 3 fields, saw 5\nSkipping line 36971: expected 3 fields, saw 5\nSkipping line 67445: expected 3 fields, saw 10\nSkipping line 104588: expected 3 fields, saw 10\nSkipping line 119940: expected 3 fields, saw 10\nSkipping line 129390: expected 3 fields, saw 10\nSkipping line 129721: expected 3 fields, saw 10\nSkipping line 129759: expected 3 fields, saw 10\nSkipping line 132185: expected 3 fields, saw 10\nSkipping line 133635: expected 3 fields, saw 10\nSkipping line 147721: expected 3 fields, saw 10\nSkipping line 158386: expected 3 fields, saw 4\nSkipping line 184174: expected 3 fields, saw 10\nSkipping line 188833: expected 3 fields, saw 10\n'

Unknown categories: ['juju_insgs', 'k8s_certmanager_ok', 'deploy_vca_only_ok', 'bootstrap_certificate_authority_ok', 'none', 'because', 'found.', 'is', "''", 'failed', 'k8s_ready_before_helm', 'install_osm_ngsa_ok', 'airflow_ok', 'pushgateway_ok', 'proxy_ok']

Unknown categories: ['juju_insgs', 'k8s_certmanager_ok', 'deploy_vca_only_ok', 'bootstrap_certificate_authority_ok', 'none', "''", 'k8s_ready_before_helm', 'install_osm_ngsa_ok', 'airflow_ok', 'pushgateway_ok', 'proxy_ok']

2. Number of installations

2.1 Number of installations per release

	RELEASE	INSTALLATIONS
0	ReleaseELEVEN	3997
1	ReleaseTWELVE	3979
2	release	2222
3	testing-daily	323
4	ReleaseTEN	99
5	ReleaseFIVE	43
6	ReleaseNINE	32
7	ReleaseELEVEN-daily	25
8	ReleaseEIGHT	17
9	ReleaseSIX	9
10	ReleaseSEVEN	5
11	12.0.0rc1	3
12	10.1.1rc1	2
13	ReleaseTWELVE-daily	2
14	11.0.0rc1	1
15	ReleaseNINE-daily	1
16	ReleaseTEN-daily	1

2.2 Temporal evolution of installations

Summary as of the week of the last sample per release:

	release	timestamp	weekly_installations	total_installations
0	ReleaseELEVEN	2022-11-20	28	3997
1	ReleaseTWELVE	2022-11-20	262	3979
2	release	2022-11-20	102	2222
3	testing-daily	2022-11-20	20	323
4	ReleaseTEN	2022-11-13	1	99
5	ReleaseFIVE	2022-10-02	2	43
6	ReleaseNINE	2022-10-16	1	32
7	ReleaseELEVEN-daily	2022-07-17	4	25
8	ReleaseEIGHT	2022-10-16	1	17
9	ReleaseSIX	2022-05-15	4	9
10	ReleaseSEVEN	2022-08-14	2	5
11	12.0.0rc1	2022-07-03	3	3
12	ReleaseTWELVE-daily	2022-11-20	1	2
13	10.1.1rc1	2022-06-05	2	2
14	ReleaseTEN-daily	2022-10-30	1	1
15	11.0.0rc1	2021-12-05	1	1
16	ReleaseNINE-daily	2022-07-24	1	1

Detail of weekly installations per release (last 36 weeks):

	weekly_installations
release	ReleaseELEVEN	ReleaseELEVEN-daily	ReleaseTWELVE	ReleaseTWELVE-daily	release	testing-daily
timestamp
2022-01-09	133	0	0	0	37	0
2022-01-16	283	5	0	0	33	1
2022-01-23	169	1	0	0	32	5
2022-01-30	186	0	0	0	38	0
2022-03-20	119	1	0	0	29	1
2022-04-24	130	0	0	0	69	2
2022-05-01	201	0	0	0	129	4
2022-05-08	187	0	0	0	89	0
2022-05-15	202	0	0	0	107	0
2022-05-22	128	0	0	0	94	1
2022-05-29	170	0	0	0	79	1
2022-06-05	124	0	0	0	56	1
2022-06-12	151	13	0	0	59	8
2022-06-19	131	0	0	0	71	7
2022-06-26	196	0	0	0	81	6
2022-07-03	155	0	67	0	63	0
2022-07-10	46	0	151	0	46	2
2022-07-17	54	4	229	0	60	1
2022-07-24	76	0	215	0	75	0
2022-07-31	116	0	184	0	55	0
2022-08-07	48	0	217	1	42	0
2022-08-14	46	0	132	0	82	1
2022-08-21	59	0	221	0	35	0
2022-08-28	42	0	247	0	54	0
2022-09-04	28	0	179	0	64	0
2022-09-11	59	0	174	0	60	0
2022-09-18	29	0	288	0	39	3
2022-09-25	12	0	160	0	33	0
2022-10-02	44	0	145	0	67	3
2022-10-09	41	0	252	0	56	1
2022-10-16	45	0	178	0	43	119
2022-10-23	20	0	235	0	20	124
2022-10-30	8	0	157	0	52	0
2022-11-06	6	0	105	0	26	0
2022-11-13	40	0	181	0	41	7
2022-11-20	28	0	262	1	102	20

3. Progress during installation

3.1 Overview of successful installation steps

3.2 Installation funnels per release

Default installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	2	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	3	2	0.666667
3	Release ELEVEN	3587	528	0.147198
4	Release ELEVEN-daily	23	2	0.086957
5	Release TWELVE	3025	442	0.146116
6	Release TWELVE-daily	2	2	1.000000
7	ReleaseEIGHT	17	2	0.117647
8	ReleaseFIVE	43	13	0.302326
9	ReleaseNINE	32	1	0.031250
10	ReleaseNINE-daily	1	0	0.000000
11	ReleaseSEVEN	5	0	0.000000
12	ReleaseSIX	8	0	0.000000
13	ReleaseTEN	94	5	0.053191
14	ReleaseTEN-daily	1	0	0.000000
15	release	2222	2113	0.950945
16	testing-daily	61	41	0.672131

Charmed installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	0	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	0	0	0.000000
3	Release ELEVEN	394	51	0.129442
4	Release ELEVEN-daily	2	2	1.000000
5	Release TWELVE	943	235	0.249205
6	Release TWELVE-daily	0	0	0.000000
7	ReleaseEIGHT	0	0	0.000000
8	ReleaseFIVE	0	0	0.000000
9	ReleaseNINE	0	0	0.000000
10	ReleaseNINE-daily	0	0	0.000000
11	ReleaseSEVEN	0	0	0.000000
12	ReleaseSIX	0	0	0.000000
13	ReleaseTEN	5	0	0.000000
14	ReleaseTEN-daily	0	0	0.000000
15	release	0	0	0.000000
16	testing-daily	262	127	0.484733

4. Analysis of failed installation attempts

	installation_type	Charmed								Default					Other
	fatal	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd	bootstrap_k8s	charmed_install	...	k8scluster	lxd	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd
location	release
local	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	0	1	0	0	0	0	0	0	0	0	...	4	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	1	24	0	0	0	0	0	0	0	0	...	11	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	30	0	0	0	0	0	0	0	0	0
	testing-daily	1	64	0	0	0	0	0	0	0	0	...	3	2	0	0	0	0	0	0	0	0
public	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	7	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	1	181	2	0	0	1	0	0	0	0	...	1213	0	0	0	0	2	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	5	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	12	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	2	0	0	0	0	0	0	0	0	...	49	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	4	291	0	0	0	1	0	0	0	0	...	1082	0	0	0	0	0	0	0	2	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	7	0	0	0	0	0	0	0	0	0
	testing-daily	0	1	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0

34 rows × 24 columns

	installation_type	Charmed	Default	Other
	osm_unhealthy	didnotconverge	didnotconverge	didnotconverge
location	release
local	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	ReleaseEIGHT	0	0	0
	ReleaseELEVEN	0	0	0
	ReleaseELEVEN-daily	0	0	0
	ReleaseFIVE	0	0	0
	ReleaseNINE	0	0	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	1	0
	ReleaseTEN-daily	0	0	0
	ReleaseTWELVE	0	2	0
	ReleaseTWELVE-daily	0	0	0
	release	0	88	0
	testing-daily	0	3	0
public	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	ReleaseEIGHT	0	2	0
	ReleaseELEVEN	0	256	0
	ReleaseELEVEN-daily	0	2	0
	ReleaseFIVE	0	11	0
	ReleaseNINE	0	1	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	3	0
	ReleaseTEN-daily	0	0	0
	ReleaseTWELVE	0	121	0
	ReleaseTWELVE-daily	0	0	0
	release	0	81	0
	testing-daily	0	8	0

ANNEX: Analysis of anomalies in progress logs

Last 10 installation attempts with first error at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	because	found.	is	failed
installation_id
1667790622-wPCuVuj83bN5gwoD	2022-11-07 04:10:22	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1667801995-dGajE5UOmiy7c9VD	2022-11-07 07:20:01	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1667846468-ulvvvYbkUnxJtFhA	2022-11-07 19:41:07	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1667846599-IoAYCUqpTDBFPXN0	2022-11-07 19:43:18	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1667466484-jFLmdeFNfCN2pf2d	2022-11-10 12:40:32	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1668303052-adxikH1YcD7ExDJj	2022-11-13 02:30:53	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1668511396-YoqaewmY164UJsHV	2022-11-15 12:23:17	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1668760942-pGHNTIG8yBdmPELV	2022-11-18 09:42:23	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN	NaN	NaN
1668913955-FVRArei7ZQQCg2qZ	2022-11-20 04:12:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1668962162-4Y7MTb5WyRq6TGdr	2022-11-20 17:36:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN

Last 10 installation attempts with double change at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	because	found.	is	failed
installation_id
1642155235-g1jTEjut4IKIIlEH	2022-01-14 11:13:54	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN
1651089791-0ZOk3w44o84SsglS	2022-04-27 22:03:11	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1652422198-SkkMvcTy3BTAaKnx	2022-05-13 08:09:58	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN
1655630327-RJtTX023a95KG8Z5	2022-06-19 11:18:48	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN
1656750844-hcFMxuu4XtesVvU4	2022-07-02 10:34:05	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN	NaN	NaN
1658565417-IYxrW5582Mh8VvhP	2022-07-23 10:36:58	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN	NaN	NaN	NaN
1660626996-l40FfPZQ7UUYg7Ml	2022-08-16 07:16:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN	NaN	NaN	NaN
1664716791-bncwUBAZRWvjrLhq	2022-10-02 15:19:52	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	install_k8s_monitoring	NaN	NaN	NaN	NaN	NaN
1667739912-xr1jPdGlwN1AvUzT	2022-11-06 14:05:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN
1668962162-4Y7MTb5WyRq6TGdr	2022-11-20 17:36:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN	NaN	NaN

DONE

---