Date and time of the report: 2023-01-01 08:20:29.095874
Analysed period: 2022-12-11 to 2023-01-01.
Database update:
Retrieving from database...
DONE
Two values retrieved from the build are key to determine the state of the jubs and test suites at a given moment:
build_result
is the outcome of the build, reported by Jenkins. It can be: SUCCESS
, FAILURE
, UNSTABLE
or ABORTED
.test_result
is the summary of the concerned Robot tests. It can be: FAIL
, UNAVAILABLE
or PASS
.Based on these two states, 3 types of temporal sequences of success/failure are identified per builds and test suites:
grp_build_result
.grp_test_result
.grp_success_fail
.For the identification of these sequences, the following mapping applies:
Type of sequence | Relevant state | OK sequence contains | NOK sequence contains | Ignore |
---|---|---|---|---|
grp_build_result |
build_result |
SUCCESS or UNSTABLE |
FAILURE |
ABORTED |
grp_test_result |
test_result |
PASS |
FAIL |
UNAVAILABLE |
grp_success_fail |
test_result |
PASS |
FAIL or UNAVAILABLE |
N/A |
The different groupings of segments are detected and a label is added to each sample...
DONE
Then, the duration of each of the sequences of success/failure is determined and a specific dataframe is built summarizing such sequences, to ease their representation and analysis...
DONE
DONE
job | Master branch | Release TEN | Release THIRTEEN | Release TWELVE | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | days_failing | days_passing | days_run | error_rate | |
suites | ||||||||||||||||
Basic 01-Crud Operations On Vim Targets | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 05-Instantiation Parameters In Cloud Init | 4.375683 | 17.000000 | 21.375683 | 0.204704 | 3.290949 | 18.000000 | 21.290949 | 0.154570 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 2.418738 | 18.999942 | 21.418681 | 0.112927 |
Basic 06-Vnf With Charm | 5.375683 | 16.000000 | 21.375683 | 0.251486 | 3.290949 | 18.000000 | 21.290949 | 0.154570 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 3.418738 | 17.999942 | 21.418681 | 0.159615 |
Basic 07-Secure Key Management | 5.944398 | 15.431285 | 21.375683 | 0.278092 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 3.418738 | 17.999942 | 21.418681 | 0.159615 |
Basic 08-Disable Port Security Network Level | 4.375671 | 17.000012 | 21.375683 | 0.204703 | 5.290914 | 16.000035 | 21.290949 | 0.248505 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 4.418738 | 16.999942 | 21.418681 | 0.206303 |
Basic 09-Manual Vdu Scaling | 3.375671 | 18.000012 | 21.375683 | 0.157921 | 2.290961 | 18.999988 | 21.290949 | 0.107603 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 3.418738 | 17.999942 | 21.418681 | 0.159615 |
Basic 11-Native Charms | 3.375671 | 18.000012 | 21.375683 | 0.157921 | 3.290926 | 18.000023 | 21.290949 | 0.154569 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 3.418738 | 17.999942 | 21.418681 | 0.159615 |
Basic 12-Ns Primitives | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 2.290961 | 18.999988 | 21.290949 | 0.107603 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 1.000000 | 20.418681 | 21.418681 | 0.046688 |
Basic 13-Ns Relations | 3.375671 | 18.000012 | 21.375683 | 0.157921 | 3.290949 | 18.000000 | 21.290949 | 0.154570 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 14-Vnf Relations | 3.375671 | 18.000012 | 21.375683 | 0.157921 | 2.290961 | 18.999988 | 21.290949 | 0.107603 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 15-Rbac Configurations | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 16-Advanced Onboarding And Scaling | 4.375683 | 17.000000 | 21.375683 | 0.204704 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 2.499884 | 18.000058 | 20.499942 | 0.121946 | 3.418738 | 17.999942 | 21.418681 | 0.159615 |
Basic 17-Delete Vnf Package | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 18-Ns Ip Profile | 3.375671 | 18.000012 | 21.375683 | 0.157921 | 2.290961 | 18.999988 | 21.290949 | 0.107603 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 19-Vnf Ip Profile | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 3.290961 | 17.999988 | 21.290949 | 0.154571 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 20-Manual Native Charm Vdu Scaling | 3.375671 | 18.000012 | 21.375683 | 0.157921 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 2.418738 | 18.999942 | 21.418681 | 0.112927 |
Basic 21-Persistent Volumes | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
Basic 21-Support Of Volumes | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 22-Cross Model Relations | 5.375683 | 16.000000 | 21.375683 | 0.251486 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 3.499977 | 16.999965 | 20.499942 | 0.170731 | 5.418738 | 15.999942 | 21.418681 | 0.252991 |
Basic 23-Sol004 Sol007 Packages | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Basic 24-Affinity Groups | 1.999988 | 19.375694 | 21.375683 | 0.093564 | 5.291007 | 15.999942 | 21.290949 | 0.248510 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 4.418750 | 16.999931 | 21.418681 | 0.206304 |
Basic 25-Update Charm In Running Vnf Instance | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 2.418738 | 18.999942 | 21.418681 | 0.112927 |
Basic 26-Secure Helm Execution Environment | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
Basic 27-Update Helm Ee In Running Vnf Instance | 7.375671 | 14.000012 | 21.375683 | 0.345050 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 7.999988 | 12.499954 | 20.499942 | 0.390244 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
Epa 01-Epa Sriov | 3.375671 | 18.000012 | 21.375683 | 0.157921 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 2.418738 | 18.999942 | 21.418681 | 0.112927 |
Epa 02-Additional Capabilities | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 2.418738 | 18.999942 | 21.418681 | 0.112927 |
Epa 03-Crud Operations On Sdnc | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Epa 04-Epa Underlay Sriov | 7.999896 | 13.375787 | 21.375683 | 0.374252 | 14.000035 | 7.290914 | 21.290949 | 0.657558 | 0.500000 | 19.999942 | 20.499942 | 0.024390 | 2.418738 | 18.999942 | 21.418681 | 0.112927 |
Epa 05-Epa Underlay Passthrough | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
Fail 01-Insufficient Resources | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Hackfest Basic | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 3.290961 | 17.999988 | 21.290949 | 0.154571 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Hackfest Cloudinit | 4.375683 | 17.000000 | 21.375683 | 0.204704 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 2.499884 | 18.000058 | 20.499942 | 0.121946 | 4.418738 | 16.999942 | 21.418681 | 0.206303 |
Hackfest Multivdu | 1.000012 | 20.375671 | 21.375683 | 0.046783 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 2.499884 | 18.000058 | 20.499942 | 0.121946 | 5.418738 | 15.999942 | 21.418681 | 0.252991 |
Heal 01-Volume Vdu Healing | 1.431308 | 19.944375 | 21.375683 | 0.066960 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 2.499884 | 18.000058 | 20.499942 | 0.121946 | 4.418738 | 16.999942 | 21.418681 | 0.206303 |
Heal 02-Scale Vdu Healing | 4.806979 | 16.568704 | 21.375683 | 0.224881 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 2.499884 | 18.000058 | 20.499942 | 0.121946 | 4.418738 | 16.999942 | 21.418681 | 0.206303 |
Heal 03-Multiple Healing | 4.806979 | 16.568704 | 21.375683 | 0.224881 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 3.499977 | 16.999965 | 20.499942 | 0.170731 | 4.418738 | 16.999942 | 21.418681 | 0.206303 |
Heal 04-Autohealing | 2.000069 | 19.375613 | 21.375683 | 0.093568 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 2.499884 | 18.000058 | 20.499942 | 0.121946 | 3.000012 | 18.418669 | 21.418681 | 0.140065 |
K8S 01-Create K8S Cluster | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
K8S 02-K8Scluster Creation | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
K8S 03-Simple K8S | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
K8S 04-Openldap Helm | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
K8S 05-K8S Proxy Charms | 1.000012 | 20.375671 | 21.375683 | 0.046783 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 2.499884 | 18.000058 | 20.499942 | 0.121946 | 2.000000 | 19.418681 | 21.418681 | 0.093376 |
K8S 06-K8S Secure Key Management | 4.375683 | 17.000000 | 21.375683 | 0.204704 | 1.000000 | 20.290949 | 21.290949 | 0.046968 | 3.499977 | 16.999965 | 20.499942 | 0.170731 | 4.418738 | 16.999942 | 21.418681 | 0.206303 |
K8S 07-Dummy Helm | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
K8S 08-Simple K8S Scaling | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
K8S 09-Pebble Charm K8S | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
K8S 10-Sol004 Sol007 With K8S Proxy Charms | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 3.499977 | 16.999965 | 20.499942 | 0.170731 | 4.418738 | 16.999942 | 21.418681 | 0.206303 |
K8S 11-Simple Helm K8S Scaling | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
K8S 12-Openldap Helm Day-2 | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Quotas 01-Quota Enforcement | 0.000000 | 21.375683 | 21.375683 | 0.000000 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Sa 01-Vnf With Vim Metrics | 6.806956 | 14.568727 | 21.375683 | 0.318444 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 6.499965 | 13.999977 | 20.499942 | 0.317072 | 6.418715 | 14.999965 | 21.418681 | 0.299678 |
Sa 02-Vnf With Vim Metrics And Autoscaling | 6.806956 | 14.568727 | 21.375683 | 0.318444 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 6.499965 | 13.999977 | 20.499942 | 0.317072 | 6.418715 | 14.999965 | 21.418681 | 0.299678 |
Sa 07-Alarms From Sa-Related Vnfs | 6.375660 | 15.000023 | 21.375683 | 0.298267 | 4.290949 | 17.000000 | 21.290949 | 0.201539 | 7.500000 | 12.999942 | 20.499942 | 0.365855 | 6.418715 | 14.999965 | 21.418681 | 0.299678 |
Sa 08-Vnf With Vnf Indicators Snmp | 16.375671 | 5.000012 | 21.375683 | 0.766089 | 0.000000 | 21.290949 | 21.290949 | 0.000000 | 1.999884 | 18.500058 | 20.499942 | 0.097556 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
Slice 01-Network Slicing | 0.431296 | 20.944387 | 21.375683 | 0.020177 | 2.290961 | 18.999988 | 21.290949 | 0.107603 | 5.499977 | 14.999965 | 20.499942 | 0.268292 | 3.418738 | 17.999942 | 21.418681 | 0.159615 |
Slice 02-Shared Network Slicing | 4.806979 | 16.568704 | 21.375683 | 0.224881 | 2.290961 | 18.999988 | 21.290949 | 0.107603 | 5.500023 | 14.999919 | 20.499942 | 0.268295 | 5.418773 | 15.999907 | 21.418681 | 0.252993 |
Sol003 01-Vnf-Lifecycle-Management | 0.431296 | 20.944387 | 21.375683 | 0.020177 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 20.499942 | 20.499942 | 0.000000 | 0.000000 | 21.418681 | 21.418681 | 0.000000 |
basic 23-delete vnf package SOL004 SOL007 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
k8s 10-k8s proxy charms SOL004 SOL007 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 | 0.000000 |
job | build | timestamp | duration | build_result | test_result | pass_count | fail_count | |
---|---|---|---|---|---|---|---|---|
0 | osm-stage_3-merge/master | 2440 | 2023-01-01 02:06:11 | 154112 | FAILURE | UNAVAILABLE | NaN | NaN |
1 | osm-stage_3-merge/v13.0 | 63 | 2022-12-31 23:07:15 | 14802364 | FAILURE | FAIL | 414.0 | 144.0 |
2 | osm-stage_3-merge/v12.0 | 258 | 2023-01-01 01:04:11 | 139717 | FAILURE | UNAVAILABLE | NaN | NaN |
3 | osm-stage_3-merge/v10.0 | 674 | 2023-01-01 04:08:12 | 576581 | FAILURE | UNAVAILABLE | NaN | NaN |
osm-stage_3-merge/master: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/v13.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword | |
---|---|---|---|---|---|---|---|---|
78 | Basic 06-Vnf With Charm | FAIL | 2022-12-31 23:34:09 | 2022-12-31 23:36:43 | 5 | 7 | Instantiate Charm Network Service | Create Network Service |
79 | Basic 07-Secure Key Management | FAIL | 2022-12-31 23:36:43 | 2022-12-31 23:40:12 | 8 | 4 | Instantiate Nopasswd Charm Network Service | Create Network Service |
80 | Basic 08-Disable Port Security Network Level | FAIL | 2022-12-31 23:40:12 | 2022-12-31 23:42:37 | 7 | 2 | Instantiate Network Service | Create Network Service |
81 | Basic 09-Manual Vdu Scaling | FAIL | 2022-12-31 23:42:37 | 2022-12-31 23:44:36 | 10 | 3 | Perform Manual Vdu Scale Out | Execute Manual VNF Scale |
82 | Basic 11-Native Charms | FAIL | 2022-12-31 23:44:36 | 2022-12-31 23:49:03 | 5 | 4 | Instantiate Charm Network Service | Create Network Service |
83 | Basic 12-Ns Primitives | FAIL | 2022-12-31 23:49:03 | 2022-12-31 23:52:17 | 6 | 3 | Instantiate NS | Create Network Service |
84 | Basic 13-Ns Relations | FAIL | 2022-12-31 23:52:17 | 2022-12-31 23:53:48 | 7 | 1 | Instantiate Charm Network Service | Create Network Service |
85 | Basic 14-Vnf Relations | FAIL | 2022-12-31 23:53:48 | 2022-12-31 23:55:13 | 5 | 1 | Instantiate Charm Network Service | Create Network Service |
87 | Basic 16-Advanced Onboarding And Scaling | FAIL | 2022-12-31 23:55:37 | 2022-12-31 23:57:01 | 5 | 7 | Instantiate Scaling Network Service | Create Network Service |
89 | Basic 18-Ns Ip Profile | FAIL | 2022-12-31 23:57:14 | 2022-12-31 23:59:00 | 5 | 8 | Instantiate Network Service | Create Network Service |
90 | Basic 19-Vnf Ip Profile | FAIL | 2022-12-31 23:59:00 | 2023-01-01 00:00:24 | 5 | 3 | Instantiate Network Service | Create Network Service |
91 | Basic 20-Manual Native Charm Vdu Scaling | FAIL | 2023-01-01 00:00:24 | 2023-01-01 00:04:58 | 10 | 8 | Instantiate Network Service | Create Network Service |
93 | Basic 22-Cross Model Relations | FAIL | 2023-01-01 00:07:20 | 2023-01-01 00:25:22 | 9 | 1 | Instantiate Charm Network Service | Create Network Service |
95 | Basic 24-Affinity Groups | FAIL | 2023-01-01 00:25:35 | 2023-01-01 00:27:02 | 5 | 2 | Network Service Instance Test | Create Network Service |
96 | Basic 25-Update Charm In Running Vnf Instance | FAIL | 2023-01-01 00:27:02 | 2023-01-01 00:29:37 | 6 | 10 | Instantiate Charm Network Service | Create Network Service |
102 | Epa 04-Epa Underlay Sriov | FAIL | 2023-01-01 00:41:48 | 2023-01-01 00:43:31 | 5 | 4 | Instantiate Network Service | Create Network Service |
105 | Hackfest Cloudinit | FAIL | 2023-01-01 00:46:38 | 2023-01-01 00:48:50 | 5 | 4 | Network Service Instance Test | Create Network Service |
106 | Hackfest Multivdu | FAIL | 2023-01-01 00:48:50 | 2023-01-01 00:51:02 | 5 | 4 | Network Service Instance Test | Create Network Service |
107 | Heal 01-Volume Vdu Healing | FAIL | 2023-01-01 00:51:02 | 2023-01-01 00:57:01 | 6 | 10 | Network Service Instance Test | Create Network Service |
108 | Heal 02-Scale Vdu Healing | FAIL | 2023-01-01 00:57:01 | 2023-01-01 00:59:27 | 6 | 9 | Network Service Instance Test | Create Network Service |
109 | Heal 03-Multiple Healing | FAIL | 2023-01-01 00:59:27 | 2023-01-01 01:05:24 | 6 | 10 | Network Service Instance Test | Create Network Service |
110 | Heal 04-Autohealing | FAIL | 2023-01-01 01:05:24 | 2023-01-01 01:10:38 | 12 | 2 | Wait For Autohealing To Be Completed | Check For NS Operation Completed |
114 | K8S 05-K8S Proxy Charms | FAIL | 2023-01-01 01:19:44 | 2023-01-01 01:22:36 | 5 | 6 | Instantiate Charm Network Service | Create Network Service |
115 | K8S 06-K8S Secure Key Management | FAIL | 2023-01-01 01:22:36 | 2023-01-01 01:26:47 | 7 | 5 | Instantiate Charm Network Service | Create Network Service |
119 | K8S 10-Sol004 Sol007 With K8S Proxy Charms | FAIL | 2023-01-01 01:38:55 | 2023-01-01 01:41:48 | 5 | 6 | Instantiate Charm Network Service | Create Network Service |
122 | Sa 01-Vnf With Vim Metrics | FAIL | 2023-01-01 01:47:58 | 2023-01-01 02:03:23 | 6 | 1 | Get VNF VIM-based Metrics | Wait Until Keyword Succeeds |
123 | Sa 02-Vnf With Vim Metrics And Autoscaling | FAIL | 2023-01-01 02:03:23 | 2023-01-01 02:34:55 | 10 | 3 | Get VNF VIM-based Metric Before Auto-scaling | Wait Until Keyword Succeeds |
124 | Sa 07-Alarms From Sa-Related Vnfs | FAIL | 2023-01-01 02:34:55 | 2023-01-01 02:56:02 | 13 | 3 | Instantiate Network Service | Create Network Service |
126 | Slice 01-Network Slicing | FAIL | 2023-01-01 02:58:41 | 2023-01-01 03:03:32 | 8 | 5 | Network Slice Instance Test | Create Network Slice |
127 | Slice 02-Shared Network Slicing | FAIL | 2023-01-01 03:03:32 | 2023-01-01 03:09:39 | 12 | 8 | Network Slice First Instance | Create Network Slice |
osm-stage_3-merge/v12.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/v10.0: (full report)
name | status | starttime | endtime | pass | fail | failed_test_name | failed_keyword |
---|
osm-stage_3-merge/master: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|
osm-stage_3-merge/v13.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime | |
---|---|---|---|---|---|---|
2 | Basic 06-Vnf With Charm | Instantiate Charm Network Service | Create Network Service | FAIL | 2022-12-31 23:34:13 | 2022-12-31 23:36:03 |
5 | Basic 06-Vnf With Charm | Check VNF Charm Application Name | Get Application Name VNF Level Charm | FAIL | 2022-12-31 23:36:03 | 2022-12-31 23:36:03 |
8 | Basic 06-Vnf With Charm | Get Management Ip Addresses | Get Vnf Management Ip Address | FAIL | 2022-12-31 23:36:03 | 2022-12-31 23:36:03 |
14 | Basic 06-Vnf With Charm | Test SSH Access | Variable Should Exist | FAIL | 2022-12-31 23:36:03 | 2022-12-31 23:36:03 |
19 | Basic 06-Vnf With Charm | Check Remote Files Created Via Day 1 Operations | Check If remote File Exists | FAIL | 2022-12-31 23:36:03 | 2022-12-31 23:36:03 |
... | ... | ... | ... | ... | ... | ... |
875 | Slice 02-Shared Network Slicing | Test Middle Ns Ping | Test Connectivity | FAIL | 2023-01-01 03:06:35 | 2023-01-01 03:07:05 |
877 | Slice 02-Shared Network Slicing | Test Middle Vnf SSH Access | Test SSH Connection | FAIL | 2023-01-01 03:07:35 | 2023-01-01 03:07:35 |
878 | Slice 02-Shared Network Slicing | Test First Slice Connectivity | Ping Many | FAIL | 2023-01-01 03:07:35 | 2023-01-01 03:07:35 |
884 | Slice 02-Shared Network Slicing | Get Second Slice Vnf IPs | Get Slice Vnf Ip Addresses | FAIL | 2023-01-01 03:08:12 | 2023-01-01 03:08:17 |
887 | Slice 02-Shared Network Slicing | Test Second Slice Connectivity | Ping Many | FAIL | 2023-01-01 03:08:17 | 2023-01-01 03:08:17 |
140 rows × 6 columns
osm-stage_3-merge/v12.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|
osm-stage_3-merge/v10.0: (full report)
suite_name | test_name | keyword_name | status | starttime | endtime |
---|