-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathverify_msg.log
132 lines (112 loc) · 5.56 KB
/
verify_msg.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
verify_msg/8 time: [53.417 µs 53.692 µs 54.064 µs]
change: [+23.034% +23.937% +24.753%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
9 (9.00%) high mild
2 (2.00%) high severe
verify_msg/16 time: [53.633 µs 53.901 µs 54.183 µs]
change: [+18.754% +19.405% +20.080%] (p = 0.00 < 0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
2 (2.00%) high mild
14 (14.00%) high severe
verify_msg/32 time: [54.029 µs 54.325 µs 54.679 µs]
change: [+22.701% +23.311% +23.975%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
verify_msg/64 time: [43.785 µs 44.019 µs 44.256 µs]
change: [-0.8524% -0.3752% +0.0896%] (p = 0.12 > 0.05)
No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
verify_msg/128 time: [42.812 µs 43.005 µs 43.231 µs]
change: [-1.9253% -1.0084% +0.0209%] (p = 0.04 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
verify_msg/256 time: [43.371 µs 43.537 µs 43.708 µs]
change: [-3.8597% -3.2131% -2.5574%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
verify_msg/512 time: [43.256 µs 43.469 µs 43.717 µs]
change: [-1.3150% -0.6064% +0.2066%] (p = 0.11 > 0.05)
No change in performance detected.
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
verify_msg/1024 time: [45.243 µs 45.386 µs 45.530 µs]
change: [-2.3923% -0.9566% +0.1231%] (p = 0.14 > 0.05)
No change in performance detected.
verify_msg/2048 time: [45.775 µs 45.984 µs 46.215 µs]
change: [-1.4436% -0.7403% +0.0732%] (p = 0.06 > 0.05)
No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
verify_msg/4096 time: [49.102 µs 49.263 µs 49.446 µs]
change: [+0.1454% +0.5625% +0.9976%] (p = 0.01 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
verify_msg/1300 time: [45.013 µs 45.205 µs 45.433 µs]
change: [-3.8359% -3.3221% -2.7850%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low mild
3 (3.00%) high mild
6 (6.00%) high severe
verify_msg/1600 time: [45.951 µs 46.223 µs 46.488 µs]
change: [+1.7674% +2.2961% +2.8209%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) low mild
4 (4.00%) high mild
verify_msg/1900 time: [44.278 µs 44.417 µs 44.579 µs]
change: [-6.2009% -5.2278% -4.2972%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
verify_msg/2200 time: [45.568 µs 45.740 µs 45.913 µs]
change: [-4.1789% -3.7189% -3.3090%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
verify_msg/2500 time: [46.534 µs 46.792 µs 47.075 µs]
change: [-0.2241% +0.3970% +0.9736%] (p = 0.21 > 0.05)
No change in performance detected.
Found 12 outliers among 100 measurements (12.00%)
11 (11.00%) high mild
1 (1.00%) high severe
verify_msg/2800 time: [45.875 µs 46.021 µs 46.188 µs]
change: [-1.9601% -1.6006% -1.2288%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) high mild
7 (7.00%) high severe
verify_msg/3100 time: [47.054 µs 47.209 µs 47.380 µs]
change: [+1.8348% +2.2783% +2.6960%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
verify_msg/3400 time: [46.951 µs 47.247 µs 47.558 µs]
change: [-1.5689% -0.9575% -0.3436%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
verify_msg/3700 time: [47.059 µs 47.314 µs 47.583 µs]
change: [-3.4903% -2.6736% -2.0580%] (p = 0.00 < 0.05)
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
10 (10.00%) high mild
2 (2.00%) high severe
verify_msg/4000 time: [48.603 µs 48.955 µs 49.324 µs]
change: [-1.6903% -0.5087% +0.6446%] (p = 0.42 > 0.05)
No change in performance detected.
Found 9 outliers among 100 measurements (9.00%)
6 (6.00%) high mild
3 (3.00%) high severe