Analysis of OSM installations

Date and time of the report: 2023-02-03 23:59:05.475364

1. Loading and processing installation events

b'Skipping line 12697: expected 3 fields, saw 12\nSkipping line 12959: expected 3 fields, saw 10\nSkipping line 12960: expected 3 fields, saw 10\nSkipping line 31746: expected 3 fields, saw 5\nSkipping line 33238: expected 3 fields, saw 10\nSkipping line 34063: expected 3 fields, saw 12\nSkipping line 34326: expected 3 fields, saw 5\nSkipping line 35706: expected 3 fields, saw 5\nSkipping line 35814: expected 3 fields, saw 5\nSkipping line 36971: expected 3 fields, saw 5\nSkipping line 67445: expected 3 fields, saw 10\nSkipping line 104588: expected 3 fields, saw 10\nSkipping line 119940: expected 3 fields, saw 10\nSkipping line 129390: expected 3 fields, saw 10\nSkipping line 129721: expected 3 fields, saw 10\nSkipping line 129759: expected 3 fields, saw 10\nSkipping line 132185: expected 3 fields, saw 10\nSkipping line 133635: expected 3 fields, saw 10\nSkipping line 147721: expected 3 fields, saw 10\nSkipping line 158386: expected 3 fields, saw 4\nSkipping line 184174: expected 3 fields, saw 10\nSkipping line 188833: expected 3 fields, saw 10\nSkipping line 199568: expected 3 fields, saw 10\n'

2. Number of installations

2.1 Number of installations per release

	RELEASE	INSTALLATIONS
0	ReleaseTWELVE	5374
1	ReleaseELEVEN	4152
2	release	2765
3	ReleaseTHIRTEEN	850
4	testing-daily	441
5	ReleaseTEN	107
6	ReleaseNINE	68
7	ReleaseFIVE	43
8	ReleaseELEVEN-daily	25
9	ReleaseEIGHT	19
10	ReleaseSEVEN	9
11	ReleaseSIX	9
12	ReleaseTwelve	7
13	ReleaseTHIRTEEN-daily	6
14	13.0.0rc2	5
15	13.0.0rc1	4
16	12.0.0rc1	3
17	ReleaseTWELVE-daily	2
18	7.1.0rc1	2
19	10.1.1rc1	2
20	ReleaseNINE-daily	1
21	ReleaseTEN-daily	1
22	11.0.0rc1	1

2.2 Temporal evolution of installations

Summary as of the week of the last sample per release:

	release	timestamp	weekly_installations	total_installations
0	ReleaseTWELVE	2023-02-05	114	5374
1	ReleaseELEVEN	2023-02-05	3	4152
2	release	2023-02-05	46	2765
3	ReleaseTHIRTEEN	2023-02-05	79	850
4	testing-daily	2023-02-05	5	441
5	ReleaseTEN	2022-12-11	2	107
6	ReleaseNINE	2023-01-22	36	68
7	ReleaseFIVE	2022-10-02	2	43
8	ReleaseELEVEN-daily	2022-07-17	4	25
9	ReleaseEIGHT	2022-11-27	2	19
10	ReleaseSEVEN	2022-12-25	4	9
11	ReleaseSIX	2022-05-15	4	9
12	ReleaseTwelve	2022-11-27	7	7
13	ReleaseTHIRTEEN-daily	2022-12-18	6	6
14	13.0.0rc2	2022-12-11	5	5
15	13.0.0rc1	2022-12-11	1	4
16	12.0.0rc1	2022-07-03	3	3
17	ReleaseTWELVE-daily	2022-11-20	1	2
18	10.1.1rc1	2022-06-05	2	2
19	7.1.0rc1	2022-12-11	1	2
20	ReleaseTEN-daily	2022-10-30	1	1
21	11.0.0rc1	2021-12-05	1	1
22	ReleaseNINE-daily	2022-07-24	1	1

Detail of weekly installations per release (last 36 weeks):

	weekly_installations
release	ReleaseELEVEN	ReleaseTHIRTEEN	ReleaseTHIRTEEN-daily	ReleaseTWELVE	ReleaseTWELVE-daily	release	testing-daily
timestamp
2022-06-05	124	0	0	0	0	56	1
2022-06-12	151	0	0	0	0	59	8
2022-06-19	131	0	0	0	0	71	7
2022-06-26	196	0	0	0	0	81	6
2022-07-03	155	0	0	67	0	63	0
2022-07-10	46	0	0	151	0	46	2
2022-07-17	54	0	0	229	0	60	1
2022-07-24	76	0	0	215	0	75	0
2022-07-31	116	0	0	184	0	55	0
2022-08-07	48	0	0	217	1	42	0
2022-08-14	46	0	0	132	0	82	1
2022-08-21	59	0	0	221	0	35	0
2022-08-28	42	0	0	247	0	54	0
2022-09-04	28	0	0	179	0	64	0
2022-09-11	59	0	0	174	0	60	0
2022-09-18	29	0	0	288	0	39	3
2022-09-25	12	0	0	160	0	33	0
2022-10-02	44	0	0	145	0	67	3
2022-10-09	41	0	0	252	0	56	1
2022-10-16	45	0	0	178	0	43	119
2022-10-23	20	0	0	235	0	20	124
2022-10-30	8	0	0	157	0	52	0
2022-11-06	6	0	0	105	0	26	0
2022-11-13	40	0	0	181	0	41	7
2022-11-20	28	0	0	262	1	102	20
2022-11-27	18	0	0	243	0	91	34
2022-12-04	8	0	0	287	0	50	17
2022-12-11	11	2	0	255	0	50	11
2022-12-18	12	33	6	142	0	65	14
2022-12-25	9	115	0	40	0	37	5
2023-01-01	3	42	0	43	0	15	5
2023-01-08	1	74	0	74	0	44	3
2023-01-15	17	129	0	88	0	39	7
2023-01-22	48	99	0	43	0	50	7
2023-01-29	25	277	0	66	0	56	10
2023-02-05	3	79	0	114	0	46	5

3. Progress during installation

3.1 Overview of successful installation steps

3.2 Installation funnels per release

Default installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	2	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	3	2	0.666667
3	13.0.0rc1	3	3	1.000000
4	13.0.0rc2	0	0	0.000000
5	7.1.0rc1	0	0	0.000000
6	Release ELEVEN	3678	547	0.148722
7	Release ELEVEN-daily	23	2	0.086957
8	Release TWELVE	4205	648	0.154102
9	Release TWELVE-daily	2	2	1.000000
10	ReleaseEIGHT	19	2	0.105263
11	ReleaseFIVE	43	13	0.302326
12	ReleaseNINE	68	2	0.029412
13	ReleaseNINE-daily	1	0	0.000000
14	ReleaseSEVEN	9	0	0.000000
15	ReleaseSIX	8	0	0.000000
16	ReleaseTEN	101	6	0.059406
17	ReleaseTEN-daily	1	0	0.000000
18	ReleaseTHIRTEEN	647	120	0.185471
19	ReleaseTHIRTEEN-daily	1	1	1.000000
20	ReleaseTwelve	7	0	0.000000
21	release	2765	2643	0.955877
22	testing-daily	78	56	0.717949

Charmed installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	0	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	0	0	0.000000
3	13.0.0rc1	1	1	1.000000
4	13.0.0rc2	5	0	0.000000
5	7.1.0rc1	2	0	0.000000
6	Release ELEVEN	458	53	0.115721
7	Release ELEVEN-daily	2	2	1.000000
8	Release TWELVE	1156	348	0.301038
9	Release TWELVE-daily	0	0	0.000000
10	ReleaseEIGHT	0	0	0.000000
11	ReleaseFIVE	0	0	0.000000
12	ReleaseNINE	0	0	0.000000
13	ReleaseNINE-daily	0	0	0.000000
14	ReleaseSEVEN	0	0	0.000000
15	ReleaseSIX	0	0	0.000000
16	ReleaseTEN	6	0	0.000000
17	ReleaseTEN-daily	0	0	0.000000
18	ReleaseTHIRTEEN	202	58	0.287129
19	ReleaseTHIRTEEN-daily	5	4	0.800000
20	ReleaseTwelve	0	0	0.000000
21	release	0	0	0.000000
22	testing-daily	363	201	0.553719

4. Analysis of failed installation attempts

	installation_type	Charmed								Default					Other
	fatal	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd	bootstrap_k8s	charmed_install	...	k8scluster	lxd	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd
location	release
local	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	0	1	0	0	0	0	0	0	0	0	...	4	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	0	1	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	1	29	0	0	0	0	0	0	0	0	...	11	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	36	0	0	0	0	0	0	0	0	0
	testing-daily	1	88	0	0	0	0	0	0	0	0	...	3	2	0	0	0	0	0	0	0	0
public	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	1	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	2	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	9	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	1	226	2	0	0	1	0	0	0	0	...	1246	0	0	0	0	2	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	5	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	20	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	5	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	2	0	0	0	0	0	0	0	0	...	50	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	2	79	0	0	0	0	1	0	0	0	...	277	1	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	4	336	0	0	0	1	0	0	0	0	...	1467	0	0	0	0	0	0	0	2	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	7	0	0	0	0	0	0	0	0	0
	testing-daily	0	2	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0

46 rows × 24 columns

	installation_type	Charmed	Default	Other
	osm_unhealthy	didnotconverge	didnotconverge	didnotconverge
location	release
local	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	0	0
	ReleaseELEVEN	0	0	0
	ReleaseELEVEN-daily	0	0	0
	ReleaseFIVE	0	0	0
	ReleaseNINE	0	0	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	1	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	4	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	97	0
	testing-daily	0	6	0
public	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	2	0
	ReleaseELEVEN	0	262	0
	ReleaseELEVEN-daily	0	2	0
	ReleaseFIVE	0	11	0
	ReleaseNINE	0	2	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	4	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	40	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	179	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	81	0
	testing-daily	0	8	0

ANNEX: Analysis of anomalies in progress logs

Last 10 installation attempts with first error at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed
installation_id
1674592566-yOVT8wbcL0Tl9pNx	2023-01-24 21:36:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN
1674669155-iHCvFpdr34NHC0yo	2023-01-25 18:52:42	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	install_k8s_monitoring	NaN	NaN
1674676327-5IfKsUnZDftVjjE7	2023-01-25 20:52:17	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1674676839-upIPuR3oJXq7ge46	2023-01-25 21:00:41	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1674708160-UlVvET3dT7y8GeZj	2023-01-26 05:42:43	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1675296886-z6RDgZZQqpr6YWP7	2023-02-02 01:16:16	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	kubelet	NaN
1675143994-YkD7nkiAzOyVCVZb	2023-02-03 13:34:20	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1675144143-CeyLAhFnzRc4uozm	2023-02-03 13:36:49	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1675143995-p3mvK0NDRZTOGE7W	2023-02-03 13:53:23	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1675144630-PLTL2EDbF2yfXpwr	2023-02-03 14:03:58	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN

Last 10 installation attempts with double change at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed
installation_id
1652422198-SkkMvcTy3BTAaKnx	2022-05-13 08:09:58	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1655630327-RJtTX023a95KG8Z5	2022-06-19 11:18:48	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1656750844-hcFMxuu4XtesVvU4	2022-07-02 10:34:05	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1658565417-IYxrW5582Mh8VvhP	2022-07-23 10:36:58	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN
1660626996-l40FfPZQ7UUYg7Ml	2022-08-16 07:16:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN
1664716791-bncwUBAZRWvjrLhq	2022-10-02 15:19:52	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	install_k8s_monitoring	NaN	NaN
1667739912-xr1jPdGlwN1AvUzT	2022-11-06 14:05:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1668962162-4Y7MTb5WyRq6TGdr	2022-11-20 17:36:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1669463054-wGgdMfJ6iwrqK3tB	2022-11-26 12:44:14	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN
1674592566-yOVT8wbcL0Tl9pNx	2023-01-24 21:36:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN

DONE

---