Analysis of OSM installations

Date and time of the report: 2023-06-11 23:59:07.723895

1. Loading and processing installation events

b'Skipping line 12697: expected 3 fields, saw 12\nSkipping line 12959: expected 3 fields, saw 10\nSkipping line 12960: expected 3 fields, saw 10\nSkipping line 31746: expected 3 fields, saw 5\nSkipping line 33238: expected 3 fields, saw 10\nSkipping line 34063: expected 3 fields, saw 12\nSkipping line 34326: expected 3 fields, saw 5\nSkipping line 35706: expected 3 fields, saw 5\nSkipping line 35814: expected 3 fields, saw 5\nSkipping line 36971: expected 3 fields, saw 5\nSkipping line 67445: expected 3 fields, saw 10\nSkipping line 104588: expected 3 fields, saw 10\nSkipping line 119940: expected 3 fields, saw 10\nSkipping line 129390: expected 3 fields, saw 10\nSkipping line 129721: expected 3 fields, saw 10\nSkipping line 129759: expected 3 fields, saw 10\nSkipping line 132185: expected 3 fields, saw 10\nSkipping line 133635: expected 3 fields, saw 10\nSkipping line 147721: expected 3 fields, saw 10\nSkipping line 158386: expected 3 fields, saw 4\nSkipping line 184174: expected 3 fields, saw 10\nSkipping line 188833: expected 3 fields, saw 10\nSkipping line 199568: expected 3 fields, saw 10\n'
b'Skipping line 279032: expected 3 fields, saw 10\nSkipping line 280005: expected 3 fields, saw 10\nSkipping line 310942: expected 3 fields, saw 10\n'

Unknown categories: ['os_info']

2. Number of installations

2.1 Number of installations per release

	RELEASE	INSTALLATIONS
0	ReleaseTWELVE	6289
1	ReleaseELEVEN	4306
2	release	3468
3	ReleaseTHIRTEEN	2662
4	testing-daily	558
5	ReleaseTEN	117
6	ReleaseNINE	68
7	ReleaseFIVE	43
8	ReleaseELEVEN-daily	25
9	ReleaseEIGHT	19
10	ReleaseSEVEN	12
11	ReleaseSIX	9
12	ReleaseTHIRTEEN-daily	8
13	ReleaseTwelve	7
14	13.0.0rc2	5
15	7.1.0rc1	4
16	13.0.0rc1	4
17	12.0.0rc1	3
18	ReleaseTWELVE-daily	2
19	10.1.1rc1	2
20	ReleaseNINE-daily	1
21	ReleaseTEN-daily	1
22	11.0.0rc1	1

2.2 Temporal evolution of installations

Summary as of the week of the last sample per release:

	release	timestamp	weekly_installations	total_installations
0	ReleaseTWELVE	2023-06-11	56	6289
1	ReleaseELEVEN	2023-06-11	3	4306
2	release	2023-06-11	101	3468
3	ReleaseTHIRTEEN	2023-06-11	138	2662
4	testing-daily	2023-06-11	37	558
5	ReleaseTEN	2023-06-04	3	117
6	ReleaseNINE	2023-01-22	36	68
7	ReleaseFIVE	2022-10-02	2	43
8	ReleaseELEVEN-daily	2022-07-17	4	25
9	ReleaseEIGHT	2022-11-27	2	19
10	ReleaseSEVEN	2023-02-19	3	12
11	ReleaseSIX	2022-05-15	4	9
12	ReleaseTHIRTEEN-daily	2023-06-11	1	8
13	ReleaseTwelve	2022-11-27	7	7
14	13.0.0rc2	2022-12-11	5	5
15	7.1.0rc1	2023-03-26	2	4
16	13.0.0rc1	2022-12-11	1	4
17	12.0.0rc1	2022-07-03	3	3
18	ReleaseTWELVE-daily	2022-11-20	1	2
19	10.1.1rc1	2022-06-05	2	2
20	ReleaseTEN-daily	2022-10-30	1	1
21	11.0.0rc1	2021-12-05	1	1
22	ReleaseNINE-daily	2022-07-24	1	1

Detail of weekly installations per release (last 36 weeks):

	weekly_installations
release	ReleaseELEVEN	ReleaseTHIRTEEN	ReleaseTWELVE	release	testing-daily
timestamp
2022-08-28	42	0	247	54	0
2022-09-04	28	0	179	64	0
2022-09-11	59	0	174	60	0
2022-09-18	29	0	288	39	3
2022-09-25	12	0	160	33	0
2022-10-02	44	0	145	67	3
2022-10-09	41	0	252	56	1
2022-10-16	45	0	178	43	119
2022-10-23	20	0	235	20	124
2022-10-30	8	0	157	52	0
2022-11-06	6	0	105	26	0
2022-11-13	40	0	181	41	7
2022-11-20	28	0	262	102	20
2022-11-27	18	0	243	91	34
2022-12-04	8	0	287	50	17
2022-12-11	11	2	255	50	11
2022-12-18	12	33	142	65	14
2022-12-25	9	115	40	37	5
2023-01-01	3	42	43	15	5
2023-01-08	1	74	74	44	3
2023-01-15	17	129	88	39	7
2023-01-22	48	99	43	50	7
2023-01-29	25	277	66	56	10
2023-02-05	3	87	121	52	7
2023-02-12	2	197	104	52	10
2023-02-19	21	206	56	51	7
2023-02-26	5	119	91	43	5
2023-03-05	19	179	216	56	4
2023-03-12	19	227	88	35	1
2023-03-19	29	242	62	35	4
2023-03-26	5	60	22	7	0
2023-05-14	1	80	54	12	5
2023-05-21	1	110	51	86	11
2023-05-28	6	96	55	126	15
2023-06-04	43	150	53	93	16
2023-06-11	3	138	56	101	37

3. Progress during installation

3.1 Installation funnels per release (full trace)

Default installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	2	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	3	2	0.666667
3	13.0.0rc1	3	3	1.000000
4	13.0.0rc2	0	0	0.000000
5	7.1.0rc1	0	0	0.000000
6	Release ELEVEN	3778	556	0.147168
7	Release ELEVEN-daily	23	2	0.086957
8	Release TWELVE	4742	757	0.159637
9	Release TWELVE-daily	2	2	1.000000
10	ReleaseEIGHT	19	2	0.105263
11	ReleaseFIVE	43	13	0.302326
12	ReleaseNINE	68	2	0.029412
13	ReleaseNINE-daily	1	0	0.000000
14	ReleaseSEVEN	12	0	0.000000
15	ReleaseSIX	8	0	0.000000
16	ReleaseTEN	108	6	0.055556
17	ReleaseTEN-daily	1	0	0.000000
18	ReleaseTHIRTEEN	1948	289	0.148357
19	ReleaseTHIRTEEN-daily	3	3	1.000000
20	ReleaseTwelve	7	0	0.000000
21	release	3468	3287	0.947809
22	testing-daily	127	82	0.645669

Charmed installer:

	RELEASE	TOTAL_INSTALLS	SUCCESSFUL_INSTALLS	SUCCESS_RATIO
0	10.1.1rc1	0	0	0.000000
1	11.0.0rc1	0	0	0.000000
2	12.0.0rc1	0	0	0.000000
3	13.0.0rc1	1	1	1.000000
4	13.0.0rc2	5	0	0.000000
5	7.1.0rc1	4	0	0.000000
6	Release ELEVEN	512	53	0.103516
7	Release ELEVEN-daily	2	2	1.000000
8	Release TWELVE	1528	447	0.292539
9	Release TWELVE-daily	0	0	0.000000
10	ReleaseEIGHT	0	0	0.000000
11	ReleaseFIVE	0	0	0.000000
12	ReleaseNINE	0	0	0.000000
13	ReleaseNINE-daily	0	0	0.000000
14	ReleaseSEVEN	0	0	0.000000
15	ReleaseSIX	0	0	0.000000
16	ReleaseTEN	9	0	0.000000
17	ReleaseTEN-daily	0	0	0.000000
18	ReleaseTHIRTEEN	709	198	0.279267
19	ReleaseTHIRTEEN-daily	5	4	0.800000
20	ReleaseTwelve	0	0	0.000000
21	release	0	0	0.000000
22	testing-daily	431	230	0.533643

3.2 Installation funnels per release (window)

These funnels only take into account the latest installations per release. Per each release, it just takes into account the installations that happened between:

• The last installation of that release.
• 1-month before that last installation.
  • In case an installation is running during that limit, all its achievements will be included.

3.3 Overview of successful installation steps per any release reported in trace (debug only)

4. Analysis of failed installation attempts

	installation_type	Charmed								Default					Other
	fatal	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd	bootstrap_k8s	charmed_install	...	k8scluster	lxd	bootstrap_k8s	charmed_install	deploy_osm	docker_ce	install_k8s_monitoring	juju	k8scluster	lxd
location	release
local	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	0	1	0	0	0	0	0	0	0	0	...	4	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	0	19	0	0	0	0	1	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	1	44	0	0	0	0	0	0	0	0	...	11	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	74	0	0	0	0	0	0	0	0	0
	testing-daily	1	121	0	0	0	0	0	0	0	0	...	12	2	0	0	0	0	0	0	0	0
public	10.1.1rc1	0	0	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0
	11.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	12.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	13.0.0rc1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	13.0.0rc2	0	1	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	7.1.0rc1	0	3	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseEIGHT	0	0	0	0	0	0	0	0	0	0	...	9	0	0	0	0	0	0	0	0	0
	ReleaseELEVEN	2	259	2	0	0	1	0	0	0	0	...	1276	0	0	0	0	2	0	0	0	0
	ReleaseELEVEN-daily	0	0	0	0	0	0	0	0	0	0	...	5	0	0	0	0	0	0	0	0	0
	ReleaseFIVE	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	ReleaseNINE	0	0	0	0	0	0	0	0	0	0	...	20	0	0	0	0	0	0	0	0	0
	ReleaseNINE-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseSEVEN	0	0	0	0	0	0	0	0	0	0	...	8	0	0	0	0	0	0	0	0	0
	ReleaseSIX	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTEN	0	4	0	0	0	0	0	0	0	0	...	55	0	0	0	0	0	0	0	0	0
	ReleaseTEN-daily	0	0	0	0	0	0	0	0	0	0	...	1	0	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN	4	279	2	0	0	2	1	0	0	0	...	972	1	0	0	0	0	0	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTWELVE	4	430	1	0	0	1	0	0	0	0	...	1603	0	0	0	0	0	0	0	2	0
	ReleaseTWELVE-daily	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0
	ReleaseTwelve	0	0	0	0	0	0	0	0	0	0	...	3	0	0	0	0	0	0	0	0	0
	release	0	0	0	0	0	0	0	0	0	0	...	7	0	0	0	0	0	0	0	0	0
	testing-daily	0	4	0	0	0	0	0	0	0	0	...	2	0	0	0	0	0	0	0	0	0

46 rows × 24 columns

	installation_type	Charmed	Default	Other
	osm_unhealthy	didnotconverge	didnotconverge	didnotconverge
location	release
local	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	0	0
	ReleaseELEVEN	0	0	0
	ReleaseELEVEN-daily	0	0	0
	ReleaseFIVE	0	0	0
	ReleaseNINE	0	0	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	1	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	0	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	4	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	150	0
	testing-daily	0	16	0
public	10.1.1rc1	0	0	0
	11.0.0rc1	0	0	0
	12.0.0rc1	0	0	0
	13.0.0rc1	0	0	0
	13.0.0rc2	0	0	0
	7.1.0rc1	0	0	0
	ReleaseEIGHT	0	2	0
	ReleaseELEVEN	0	268	0
	ReleaseELEVEN-daily	0	2	0
	ReleaseFIVE	0	11	0
	ReleaseNINE	0	2	0
	ReleaseNINE-daily	0	0	0
	ReleaseSEVEN	0	0	0
	ReleaseSIX	0	0	0
	ReleaseTEN	0	4	0
	ReleaseTEN-daily	0	0	0
	ReleaseTHIRTEEN	0	85	0
	ReleaseTHIRTEEN-daily	0	0	0
	ReleaseTWELVE	0	202	0
	ReleaseTWELVE-daily	0	0	0
	ReleaseTwelve	0	0	0
	release	0	81	0
	testing-daily	0	8	0

ANNEX: Analysis of anomalies in progress logs

Last 10 installation attempts with first error at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed	os_info
installation_id
1685617905-7MPsJr19ZThi4rQM	2023-06-01 13:11:45	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN
1685618332-egZ6aXdngZQFcfMG	2023-06-01 13:18:56	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN
1685621069-1kJJUP1u0EsWWWDa	2023-06-01 14:04:33	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	docker_ce	NaN	NaN	NaN
1685621300-thA83SPohTISetfv	2023-06-01 14:08:20	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN
1685622024-nwrnApaKtKP5ENlx	2023-06-01 14:20:24	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN
1685622875-nUIxVjL3BawfEniX	2023-06-01 14:34:35	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN
1685714333-Ug9G3N7NRsmANtea	2023-06-02 15:58:53	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	docker_ce	NaN	NaN	NaN
1686254337-U2aW7Mkvhv1gaaxP	2023-06-08 21:58:57	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN
1686317538-IcWVr96aYFDOI17Y	2023-06-09 15:32:17	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	NaN	NaN	NaN	NaN
1686396645-UDboEwxmgzUDGgRv	2023-06-10 13:30:45	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN

Last 10 installation attempts with double change at docker_ce_ok:

	timestamp	location	comment	tags	release	docker_tag	installation_type	osm_unhealthy	fatal	install_k8s_ok	failed	os_info
installation_id
1656750844-hcFMxuu4XtesVvU4	2022-07-02 10:34:05	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	k8scluster	NaN	NaN	NaN
1658565417-IYxrW5582Mh8VvhP	2022-07-23 10:36:58	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN	NaN
1660626996-l40FfPZQ7UUYg7Ml	2022-08-16 07:16:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	juju	NaN	NaN	NaN
1664716791-bncwUBAZRWvjrLhq	2022-10-02 15:19:52	public	<NA>	<NA>	ReleaseELEVEN	11	Default	NaN	install_k8s_monitoring	NaN	NaN	NaN
1667739912-xr1jPdGlwN1AvUzT	2022-11-06 14:05:11	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN
1668962162-4Y7MTb5WyRq6TGdr	2022-11-20 17:36:03	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	NaN	NaN	NaN	NaN
1669463054-wGgdMfJ6iwrqK3tB	2022-11-26 12:44:14	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN	NaN
1674592566-yOVT8wbcL0Tl9pNx	2023-01-24 21:36:35	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	NaN	NaN	NaN
1675296886-z6RDgZZQqpr6YWP7	2023-02-02 01:16:16	public	<NA>	<NA>	ReleaseTWELVE	12	Default	NaN	k8scluster	kubelet	NaN	NaN
1684607828-Kz7phzYblpeefBvE	2023-05-20 20:37:07	public	<NA>	<NA>	ReleaseTWELVE	12	Default	didnotconverge	NaN	NaN	NaN	NaN

DONE

---

Powered by osm-analytics