Analysis of OSM installations

Date and time of the report: 2023-06-05 23:59:07.718841

1. Loading and processing installation events

b'Skipping line 12697: expected 3 fields, saw 12\nSkipping line 12959: expected 3 fields, saw 10\nSkipping line 12960: expected 3 fields, saw 10\nSkipping line 31746: expected 3 fields, saw 5\nSkipping line 33238: expected 3 fields, saw 10\nSkipping line 34063: expected 3 fields, saw 12\nSkipping line 34326: expected 3 fields, saw 5\nSkipping line 35706: expected 3 fields, saw 5\nSkipping line 35814: expected 3 fields, saw 5\nSkipping line 36971: expected 3 fields, saw 5\nSkipping line 67445: expected 3 fields, saw 10\nSkipping line 104588: expected 3 fields, saw 10\nSkipping line 119940: expected 3 fields, saw 10\nSkipping line 129390: expected 3 fields, saw 10\nSkipping line 129721: expected 3 fields, saw 10\nSkipping line 129759: expected 3 fields, saw 10\nSkipping line 132185: expected 3 fields, saw 10\nSkipping line 133635: expected 3 fields, saw 10\nSkipping line 147721: expected 3 fields, saw 10\nSkipping line 158386: expected 3 fields, saw 4\nSkipping line 184174: expected 3 fields, saw 10\nSkipping line 188833: expected 3 fields, saw 10\nSkipping line 199568: expected 3 fields, saw 10\n'
b'Skipping line 279032: expected 3 fields, saw 10\nSkipping line 280005: expected 3 fields, saw 10\nSkipping line 310942: expected 3 fields, saw 10\n'

Unknown categories: ['1676216882', 'installation_type']
Unknown categories: ['Ch', 'alertmanager_ok', 'lxd_install_ok', 'juju_client_ok']

Unknown categories: ['Ch', 'alertmanager_ok', 'lxd_install_ok', 'juju_client_ok']

2. Number of installations

2.1 Number of installations per release

	RELEASE	INSTALLATIONS
0	ReleaseTWELVE	6238
1	ReleaseELEVEN	4303
2	release	3391
3	ReleaseTHIRTEEN	2544
4	testing-daily	525
5	ReleaseTEN	117
6	ReleaseNINE	68
7	ReleaseFIVE	43
8	ReleaseELEVEN-daily	25
9	ReleaseEIGHT	19
10	ReleaseSEVEN	12
11	ReleaseSIX	9
12	ReleaseTwelve	7
13	ReleaseTHIRTEEN-daily	7
14	13.0.0rc2	5
15	7.1.0rc1	4
16	13.0.0rc1	4
17	12.0.0rc1	3
18	ReleaseTWELVE-daily	2
19	10.1.1rc1	2
20	ReleaseNINE-daily	1
21	ReleaseTEN-daily	1
22	11.0.0rc1	1

2.2 Temporal evolution of installations

Summary as of the week of the last sample per release:

	release	timestamp	weekly_installations	total_installations
0	ReleaseTWELVE	2023-06-11	5	6238
1	ReleaseELEVEN	2023-06-04	43	4303
2	release	2023-06-11	24	3391
3	ReleaseTHIRTEEN	2023-06-11	20	2544
4	testing-daily	2023-06-11	4	525
5	ReleaseTEN	2023-06-04	3	117
6	ReleaseNINE	2023-01-22	36	68
7	ReleaseFIVE	2022-10-02	2	43
8	ReleaseELEVEN-daily	2022-07-17	4	25
9	ReleaseEIGHT	2022-11-27	2	19
10	ReleaseSEVEN	2023-02-19	3	12
11	ReleaseSIX	2022-05-15	4	9
12	ReleaseTwelve	2022-11-27	7	7
13	ReleaseTHIRTEEN-daily	2023-05-28	1	7
14	13.0.0rc2	2022-12-11	5	5
15	7.1.0rc1	2023-03-26	2	4
16	13.0.0rc1	2022-12-11	1	4
17	12.0.0rc1	2022-07-03	3	3
18	ReleaseTWELVE-daily	2022-11-20	1	2
19	10.1.1rc1	2022-06-05	2	2
20	ReleaseTEN-daily	2022-10-30	1	1
21	11.0.0rc1	2021-12-05	1	1
22	ReleaseNINE-daily	2022-07-24	1	1

Detail of weekly installations per release (last 36 weeks):

	weekly_installations
release	ReleaseELEVEN	ReleaseTHIRTEEN	ReleaseTHIRTEEN-daily	ReleaseTWELVE	ReleaseTWELVE-daily	release	testing-daily
timestamp
2022-08-28	42	0	0	247	0	54	0
2022-09-04	28	0	0	179	0	64	0
2022-09-11	59	0	0	174	0	60	0
2022-09-18	29	0	0	288	0	39	3
2022-09-25	12	0	0	160	0	33	0
2022-10-02	44	0	0	145	0	67	3
2022-10-09	41	0	0	252	0	56	1
2022-10-16	45	0	0	178	0	43	119
2022-10-23	20	0	0	235	0	20	124
2022-10-30	8	0	0	157	0	52	0
2022-11-06	6	0	0	105	0	26	0
2022-11-13	40	0	0	181	0	41	7
2022-11-20	28	0	0	262	1	102	20
2022-11-27	18	0	0	243	0	91	34
2022-12-04	8	0	0	287	0	50	17
2022-12-11	11	2	0	255	0	50	11
2022-12-18	12	33	6	142	0	65	14
2022-12-25	9	115	0	40	0	37	5
2023-01-01	3	42	0	43	0	15	5
2023-01-08	1	74	0	74	0	44	3
2023-01-15	17	129	0	88	0	39	7
2023-01-22	48	99	0	43	0	50	7
2023-01-29	25	277	0	66	0	56	10
2023-02-05	3	87	0	121	0	52	7
2023-02-12	2	197	0	104	0	52	10
2023-02-19	21	206	0	56	0	51	7
2023-02-26	5	119	0	91	0	43	5
2023-03-05	19	179	0	216	0	56	4
2023-03-12	19	227	0	88	0	35	1
2023-03-19	29	242	0	62	0	35	4
2023-03-26	5	60	0	22	0	7	0
2023-05-14	1	80	0	54	0	12	5
2023-05-21	1	110	0	51	0	86	11
2023-05-28	6	96	1	55	0	126	15
2023-06-04	43	150	0	53	0	93	16
2023-06-11	0	20	0	5	0	24	4

3. Progress during installation

3.1 Overview of successful installation steps

3.2 Installation funnels per release

Default installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	2	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	3	2	0.666667
3	13.0.0rc1	3	3	1.000000
4	13.0.0rc2	0	0	0.000000
5	7.1.0rc1	0	0	0.000000
6	Release ELEVEN	3775	555	0.147020
7	Release ELEVEN-daily	23	2	0.086957
8	Release TWELVE	4705	747	0.158767
9	Release TWELVE-daily	2	2	1.000000
10	ReleaseEIGHT	19	2	0.105263
11	ReleaseFIVE	43	13	0.302326
12	ReleaseNINE	68	2	0.029412
13	ReleaseNINE-daily	1	0	0.000000
14	ReleaseSEVEN	12	0	0.000000
15	ReleaseSIX	8	0	0.000000
16	ReleaseTEN	108	6	0.055556
17	ReleaseTEN-daily	1	0	0.000000
18	ReleaseTHIRTEEN	1879	278	0.147951
19	ReleaseTHIRTEEN-daily	2	2	1.000000
20	ReleaseTwelve	7	0	0.000000
21	release	3391	3220	0.949572
22	testing-daily	107	71	0.663551

Charmed installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	0	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	0	0	0.000000
3	13.0.0rc1	1	1	1.000000
4	13.0.0rc2	5	0	0.000000
5	7.1.0rc1	4	0	0.000000
6	Release ELEVEN	512	53	0.103516
7	Release ELEVEN-daily	2	2	1.000000
8	Release TWELVE	1514	442	0.291942
9	Release TWELVE-daily	0	0	0.000000
10	ReleaseEIGHT	0	0	0.000000
11	ReleaseFIVE	0	0	0.000000
12	ReleaseNINE	0	0	0.000000
13	ReleaseNINE-daily	0	0	0.000000
14	ReleaseSEVEN	0	0	0.000000
15	ReleaseSIX	0	0	0.000000
16	ReleaseTEN	9	0	0.000000
17	ReleaseTEN-daily	0	0	0.000000
18	ReleaseTHIRTEEN	660	177	0.268182
19	ReleaseTHIRTEEN-daily	5	4	0.800000
20	ReleaseTwelve	0	0	0.000000
21	release	0	0	0.000000
22	testing-daily	418	226	0.540670

4. Analysis of failed installation attempts

	installation_type	Charmed								Default					Other
	fatal	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd	bootstrap_k8s	charmed_install	...	k8scluster	lxd	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd
location	release
local	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	0	1	0	0	0	0	0	0	0	0	...	4	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	0	10	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	1	42	0	0	0	0	0	0	0	0	...	11	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	74	0	0	0	0	0	0	0	0	0
	testing-daily	1	115	0	0	0	0	0	0	0	0	...	11	2	0	0	0	0	0	0	0	0
public	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	1	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	3	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	9	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	2	259	2	0	0	1	0	0	0	0	...	1276	0	0	0	0	2	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	5	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	20	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	8	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	4	0	0	0	0	0	0	0	0	...	55	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	4	275	2	0	0	2	1	0	0	0	...	936	1	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	4	424	1	0	0	1	0	0	0	0	...	1593	0	0	0	0	0	0	0	2	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	7	0	0	0	0	0	0	0	0	0
	testing-daily	0	4	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0

46 rows × 24 columns

	installation_type	Charmed	Default	Other
	osm_unhealthy	didnotconverge	didnotconverge	didnotconverge
location	release
local	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	0	0
	ReleaseELEVEN	0	0	0
	ReleaseELEVEN-daily	0	0	0
	ReleaseFIVE	0	0	0
	ReleaseNINE	0	0	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	1	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	4	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	134	0
	testing-daily	0	10	0
public	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	2	0
	ReleaseELEVEN	0	268	0
	ReleaseELEVEN-daily	0	2	0
	ReleaseFIVE	0	11	0
	ReleaseNINE	0	2	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	4	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	85	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	202	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	81	0
	testing-daily	0	8	0

ANNEX: Analysis of anomalies in progress logs

Last 10 installation attempts with first error at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed
installation_id
1685617493-ehvxc5aLszjrS4p4	2023-06-01 13:04:54	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN
1685617753-IGYGBFDTjDvcFX51	2023-06-01 13:09:14	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN
1685617843-w0JqCGOIYbh7bTmI	2023-06-01 13:10:43	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN
1685617905-7MPsJr19ZThi4rQM	2023-06-01 13:11:45	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN
1685618332-egZ6aXdngZQFcfMG	2023-06-01 13:18:56	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN
1685621069-1kJJUP1u0EsWWWDa	2023-06-01 14:04:33	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	docker_ce	NaN	NaN
1685621300-thA83SPohTISetfv	2023-06-01 14:08:20	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN
1685622024-nwrnApaKtKP5ENlx	2023-06-01 14:20:24	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN
1685622875-nUIxVjL3BawfEniX	2023-06-01 14:34:35	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN
1685714333-Ug9G3N7NRsmANtea	2023-06-02 15:58:53	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN

Last 10 installation attempts with double change at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed
installation_id
1655630327-RJtTX023a95KG8Z5	2022-06-19 11:18:48	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1656750844-hcFMxuu4XtesVvU4	2022-07-02 10:34:05	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN
1658565417-IYxrW5582Mh8VvhP	2022-07-23 10:36:58	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN
1660626996-l40FfPZQ7UUYg7Ml	2022-08-16 07:16:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN
1664716791-bncwUBAZRWvjrLhq	2022-10-02 15:19:52	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	install_k8s_monitoring	NaN	NaN
1667739912-xr1jPdGlwN1AvUzT	2022-11-06 14:05:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1668962162-4Y7MTb5WyRq6TGdr	2022-11-20 17:36:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN
1669463054-wGgdMfJ6iwrqK3tB	2022-11-26 12:44:14	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN
1674592566-yOVT8wbcL0Tl9pNx	2023-01-24 21:36:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN
1684607828-Kz7phzYblpeefBvE	2023-05-20 20:37:07	public	<NA>	<NA>	ReleaseTWELVE	12	Default	didnotconverge	NaN	NaN	NaN

DONE

---