Analysis of OSM installations

Date and time of the report: 2023-04-11 23:59:05.807964

1. Loading and processing installation events

b'Skipping line 12697: expected 3 fields, saw 12\nSkipping line 12959: expected 3 fields, saw 10\nSkipping line 12960: expected 3 fields, saw 10\nSkipping line 31746: expected 3 fields, saw 5\nSkipping line 33238: expected 3 fields, saw 10\nSkipping line 34063: expected 3 fields, saw 12\nSkipping line 34326: expected 3 fields, saw 5\nSkipping line 35706: expected 3 fields, saw 5\nSkipping line 35814: expected 3 fields, saw 5\nSkipping line 36971: expected 3 fields, saw 5\nSkipping line 67445: expected 3 fields, saw 10\nSkipping line 104588: expected 3 fields, saw 10\nSkipping line 119940: expected 3 fields, saw 10\nSkipping line 129390: expected 3 fields, saw 10\nSkipping line 129721: expected 3 fields, saw 10\nSkipping line 129759: expected 3 fields, saw 10\nSkipping line 132185: expected 3 fields, saw 10\nSkipping line 133635: expected 3 fields, saw 10\nSkipping line 147721: expected 3 fields, saw 10\nSkipping line 158386: expected 3 fields, saw 4\nSkipping line 184174: expected 3 fields, saw 10\nSkipping line 188833: expected 3 fields, saw 10\nSkipping line 199568: expected 3 fields, saw 10\n'
b'Skipping line 279032: expected 3 fields, saw 10\nSkipping line 280005: expected 3 fields, saw 10\n'

Unknown categories: ['1676216882', 'installation_type']
Unknown categories: ['Ch']

Unknown categories: ['Ch']

2. Number of installations

2.1 Number of installations per release

	RELEASE	INSTALLATIONS
0	ReleaseTWELVE	6020
1	ReleaseELEVEN	4252
2	release	3050
3	ReleaseTHIRTEEN	2088
4	testing-daily	474
5	ReleaseTEN	110
6	ReleaseNINE	68
7	ReleaseFIVE	43
8	ReleaseELEVEN-daily	25
9	ReleaseEIGHT	19
10	ReleaseSEVEN	12
11	ReleaseSIX	9
12	ReleaseTwelve	7
13	ReleaseTHIRTEEN-daily	6
14	13.0.0rc2	5
15	7.1.0rc1	4
16	13.0.0rc1	4
17	12.0.0rc1	3
18	ReleaseTWELVE-daily	2
19	10.1.1rc1	2
20	ReleaseNINE-daily	1
21	ReleaseTEN-daily	1
22	11.0.0rc1	1

2.2 Temporal evolution of installations

Summary as of the week of the last sample per release:

	release	timestamp	weekly_installations	total_installations
0	ReleaseTWELVE	2023-03-26	22	6020
1	ReleaseELEVEN	2023-03-26	5	4252
2	release	2023-03-26	7	3050
3	ReleaseTHIRTEEN	2023-03-26	60	2088
4	testing-daily	2023-03-19	4	474
5	ReleaseTEN	2023-03-19	2	110
6	ReleaseNINE	2023-01-22	36	68
7	ReleaseFIVE	2022-10-02	2	43
8	ReleaseELEVEN-daily	2022-07-17	4	25
9	ReleaseEIGHT	2022-11-27	2	19
10	ReleaseSEVEN	2023-02-19	3	12
11	ReleaseSIX	2022-05-15	4	9
12	ReleaseTwelve	2022-11-27	7	7
13	ReleaseTHIRTEEN-daily	2022-12-18	6	6
14	13.0.0rc2	2022-12-11	5	5
15	7.1.0rc1	2023-03-26	2	4
16	13.0.0rc1	2022-12-11	1	4
17	12.0.0rc1	2022-07-03	3	3
18	ReleaseTWELVE-daily	2022-11-20	1	2
19	10.1.1rc1	2022-06-05	2	2
20	ReleaseTEN-daily	2022-10-30	1	1
21	11.0.0rc1	2021-12-05	1	1
22	ReleaseNINE-daily	2022-07-24	1	1

Detail of weekly installations per release (last 36 weeks):

	weekly_installations
release	ReleaseELEVEN	ReleaseTHIRTEEN	ReleaseTHIRTEEN-daily	ReleaseTWELVE	ReleaseTWELVE-daily	release	testing-daily
timestamp
2022-07-24	76	0	0	215	0	75	0
2022-07-31	116	0	0	184	0	55	0
2022-08-07	48	0	0	217	1	42	0
2022-08-14	46	0	0	132	0	82	1
2022-08-21	59	0	0	221	0	35	0
2022-08-28	42	0	0	247	0	54	0
2022-09-04	28	0	0	179	0	64	0
2022-09-11	59	0	0	174	0	60	0
2022-09-18	29	0	0	288	0	39	3
2022-09-25	12	0	0	160	0	33	0
2022-10-02	44	0	0	145	0	67	3
2022-10-09	41	0	0	252	0	56	1
2022-10-16	45	0	0	178	0	43	119
2022-10-23	20	0	0	235	0	20	124
2022-10-30	8	0	0	157	0	52	0
2022-11-06	6	0	0	105	0	26	0
2022-11-13	40	0	0	181	0	41	7
2022-11-20	28	0	0	262	1	102	20
2022-11-27	18	0	0	243	0	91	34
2022-12-04	8	0	0	287	0	50	17
2022-12-11	11	2	0	255	0	50	11
2022-12-18	12	33	6	142	0	65	14
2022-12-25	9	115	0	40	0	37	5
2023-01-01	3	42	0	43	0	15	5
2023-01-08	1	74	0	74	0	44	3
2023-01-15	17	129	0	88	0	39	7
2023-01-22	48	99	0	43	0	50	7
2023-01-29	25	277	0	66	0	56	10
2023-02-05	3	87	0	121	0	52	7
2023-02-12	2	197	0	104	0	52	10
2023-02-19	21	206	0	56	0	51	7
2023-02-26	5	119	0	91	0	43	5
2023-03-05	19	179	0	216	0	56	4
2023-03-12	19	227	0	88	0	35	1
2023-03-19	29	242	0	62	0	35	4
2023-03-26	5	60	0	22	0	7	0

3. Progress during installation

3.1 Overview of successful installation steps

3.2 Installation funnels per release

Default installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	2	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	3	2	0.666667
3	13.0.0rc1	3	3	1.000000
4	13.0.0rc2	0	0	0.000000
5	7.1.0rc1	0	0	0.000000
6	Release ELEVEN	3731	552	0.147950
7	Release ELEVEN-daily	23	2	0.086957
8	Release TWELVE	4553	701	0.153964
9	Release TWELVE-daily	2	2	1.000000
10	ReleaseEIGHT	19	2	0.105263
11	ReleaseFIVE	43	13	0.302326
12	ReleaseNINE	68	2	0.029412
13	ReleaseNINE-daily	1	0	0.000000
14	ReleaseSEVEN	12	0	0.000000
15	ReleaseSIX	8	0	0.000000
16	ReleaseTEN	104	6	0.057692
17	ReleaseTEN-daily	1	0	0.000000
18	ReleaseTHIRTEEN	1554	231	0.148649
19	ReleaseTHIRTEEN-daily	1	1	1.000000
20	ReleaseTwelve	7	0	0.000000
21	release	3050	2911	0.954426
22	testing-daily	82	58	0.707317

Charmed installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	0	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	0	0	0.000000
3	13.0.0rc1	1	1	1.000000
4	13.0.0rc2	5	0	0.000000
5	7.1.0rc1	4	0	0.000000
6	Release ELEVEN	505	53	0.104950
7	Release ELEVEN-daily	2	2	1.000000
8	Release TWELVE	1449	415	0.286404
9	Release TWELVE-daily	0	0	0.000000
10	ReleaseEIGHT	0	0	0.000000
11	ReleaseFIVE	0	0	0.000000
12	ReleaseNINE	0	0	0.000000
13	ReleaseNINE-daily	0	0	0.000000
14	ReleaseSEVEN	0	0	0.000000
15	ReleaseSIX	0	0	0.000000
16	ReleaseTEN	6	0	0.000000
17	ReleaseTEN-daily	0	0	0.000000
18	ReleaseTHIRTEEN	530	129	0.243396
19	ReleaseTHIRTEEN-daily	5	4	0.800000
20	ReleaseTwelve	0	0	0.000000
21	release	0	0	0.000000
22	testing-daily	392	226	0.576531

4. Analysis of failed installation attempts

	installation_type	Charmed								Default					Other
	fatal	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd	bootstrap_k8s	charmed_install	...	k8scluster	lxd	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd
location	release
local	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	0	1	0	0	0	0	0	0	0	0	...	4	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	0	8	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	1	36	0	0	0	0	0	0	0	0	...	11	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	52	0	0	0	0	0	0	0	0	0
	testing-daily	1	89	0	0	0	0	0	0	0	0	...	3	2	0	0	0	0	0	0	0	0
public	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	1	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	3	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	9	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	2	255	2	0	0	1	0	0	0	0	...	1260	0	0	0	0	2	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	5	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	20	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	8	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	2	0	0	0	0	0	0	0	0	...	52	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	4	227	2	0	0	1	1	0	0	0	...	761	1	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	4	407	1	0	0	1	0	0	0	0	...	1545	0	0	0	0	0	0	0	2	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	7	0	0	0	0	0	0	0	0	0
	testing-daily	0	4	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0

46 rows × 24 columns

	installation_type	Charmed	Default	Other
	osm_unhealthy	didnotconverge	didnotconverge	didnotconverge
location	release
local	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	0	0
	ReleaseELEVEN	0	0	0
	ReleaseELEVEN-daily	0	0	0
	ReleaseFIVE	0	0	0
	ReleaseNINE	0	0	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	1	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	4	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	108	0
	testing-daily	0	6	0
public	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	2	0
	ReleaseELEVEN	0	266	0
	ReleaseELEVEN-daily	0	2	0
	ReleaseFIVE	0	11	0
	ReleaseNINE	0	2	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	4	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	70	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	190	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	81	0
	testing-daily	0	8	0

ANNEX: Analysis of anomalies in progress logs

Last 10 installation attempts with first error at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed
installation_id
1677944211-KeVXcj0C2vKeQwYo	2023-03-04 16:36:50	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	docker_ce	NaN	NaN
1678161662-Z6DSDjKkyp9VAv77	2023-03-07 05:01:04	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1678161834-P55qMtHzHBZ81qZ0	2023-03-07 05:03:56	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1678228519-qCq2HkYZUO7Mgtae	2023-03-07 23:35:20	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1678988468-j6IyN40N2NOkH8Oz	2023-03-16 18:41:14	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	docker_ce	NaN	NaN
1679042517-2K7bglnIfTDfmGPZ	2023-03-17 09:41:56	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1679058939-JDRq9qEecprbnk5F	2023-03-17 14:15:39	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1679059019-J9RAZAgFV7vieB7i	2023-03-17 14:16:59	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1679061910-wwyAukSJwFGXAXVh	2023-03-17 15:05:10	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1679137947-6cnYaA2Pkm7W1Hop	2023-03-18 12:12:26	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN

Last 10 installation attempts with double change at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed
installation_id
1652422198-SkkMvcTy3BTAaKnx	2022-05-13 08:09:58	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1655630327-RJtTX023a95KG8Z5	2022-06-19 11:18:48	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1656750844-hcFMxuu4XtesVvU4	2022-07-02 10:34:05	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1658565417-IYxrW5582Mh8VvhP	2022-07-23 10:36:58	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN
1660626996-l40FfPZQ7UUYg7Ml	2022-08-16 07:16:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN
1664716791-bncwUBAZRWvjrLhq	2022-10-02 15:19:52	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	install_k8s_monitoring	NaN	NaN
1667739912-xr1jPdGlwN1AvUzT	2022-11-06 14:05:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1668962162-4Y7MTb5WyRq6TGdr	2022-11-20 17:36:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1669463054-wGgdMfJ6iwrqK3tB	2022-11-26 12:44:14	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN
1674592566-yOVT8wbcL0Tl9pNx	2023-01-24 21:36:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN

DONE

---