Ticket #1473: first-run.txt

File first-run.txt, 21.9 KB (added by guest, 6 years ago)

first benchmark attempt; subsequent issues and incompleteness addressed in later runs

Line 
1+++ OK, passed 10000 tests.
2warming up
3estimating clock resolution...
4mean is 20.21656 us (40001 iterations)
5found 763 outliers among 39999 samples (1.9%)
6  583 (1.5%) high severe
7estimating cost of a clock call...
8mean is 448.2571 ns (56 iterations)
9found 2 outliers among 56 samples (3.6%)
10  1 (1.8%) high mild
11  1 (1.8%) high severe
12
13benchmarking random/yhc
14collecting 100 samples, 41667 iterations each, in estimated 2.021686 s
15bootstrapping with 100000 resamples
16mean: 437.2069 ns, lb 420.9373 ns, ub 452.3209 ns, ci 0.950
17std dev: 80.67732 ns, lb 74.45956 ns, ub 86.02864 ns, ci 0.950
18variance introduced by outliers: 1.000%
19variance is unaffected by outliers
20
21benchmarking random/ghc
22collecting 100 samples, 62594 iterations each, in estimated 2.021682 s
23bootstrapping with 100000 resamples
24mean: 338.3798 ns, lb 331.2790 ns, ub 349.6781 ns, ci 0.950
25std dev: 45.05835 ns, lb 30.74341 ns, ub 60.31645 ns, ci 0.950
26found 15 outliers among 100 samples (15.0%)
27  14 (14.0%) high severe
28variance introduced by outliers: 1.000%
29variance is unaffected by outliers
30
31benchmarking random/ghc'
32collecting 100 samples, 62585 iterations each, in estimated 2.021665 s
33bootstrapping with 100000 resamples
34mean: 371.1440 ns, lb 357.4714 ns, ub 386.8563 ns, ci 0.950
35std dev: 74.68639 ns, lb 66.16413 ns, ub 82.89191 ns, ci 0.950
36variance introduced by outliers: 1.000%
37variance is unaffected by outliers
38
39benchmarking random/ghc''
40collecting 100 samples, 58323 iterations each, in estimated 2.021673 s
41bootstrapping with 100000 resamples
42mean: 349.8150 ns, lb 349.5067 ns, ub 350.3062 ns, ci 0.950
43std dev: 1.956201 ns, lb 1.375533 ns, ub 2.777103 ns, ci 0.950
44found 11 outliers among 100 samples (11.0%)
45  6 (6.0%) high mild
46  5 (5.0%) high severe
47variance introduced by outliers: 0.990%
48variance is unaffected by outliers
49
50benchmarking random/ghc'''
51collecting 100 samples, 54776 iterations each, in estimated 2.021674 s
52bootstrapping with 100000 resamples
53mean: 370.7883 ns, lb 370.5112 ns, ub 371.1272 ns, ci 0.950
54std dev: 1.572425 ns, lb 1.252304 ns, ub 2.054747 ns, ci 0.950
55found 6 outliers among 100 samples (6.0%)
56  3 (3.0%) high mild
57  2 (2.0%) high severe
58variance introduced by outliers: 0.990%
59variance is unaffected by outliers
60
61benchmarking shakespeare/yhc
62collecting 100 samples, 1 iterations each, in estimated 236.5609 s
63bootstrapping with 100000 resamples
64mean: 873.7709 ms, lb 872.2065 ms, ub 875.3828 ms, ci 0.950
65std dev: 8.126732 ms, lb 7.080755 ms, ub 9.703043 ms, ci 0.950
66found 2 outliers among 100 samples (2.0%)
67variance introduced by outliers: 0.990%
68variance is unaffected by outliers
69
70benchmarking shakespeare/ghc
71collecting 100 samples, 1 iterations each, in estimated 70.93210 s
72bootstrapping with 100000 resamples
73mean: 745.0271 ms, lb 743.8867 ms, ub 745.7055 ms, ci 0.950
74std dev: 4.398868 ms, lb 2.785873 ms, ub 8.094876 ms, ci 0.950
75found 7 outliers among 100 samples (7.0%)
76  1 (1.0%) low severe
77  5 (5.0%) high mild
78  1 (1.0%) high severe
79variance introduced by outliers: 0.990%
80variance is unaffected by outliers
81
82benchmarking shakespeare/ghc'
83collecting 100 samples, 1 iterations each, in estimated 47.00270 s
84bootstrapping with 100000 resamples
85mean: 481.4967 ms, lb 480.9441 ms, ub 482.2515 ms, ci 0.950
86std dev: 3.292770 ms, lb 2.597678 ms, ub 4.468298 ms, ci 0.950
87found 5 outliers among 100 samples (5.0%)
88  3 (3.0%) high mild
89  2 (2.0%) high severe
90variance introduced by outliers: 0.990%
91variance is unaffected by outliers
92
93benchmarking shakespeare/ghc''
94collecting 100 samples, 1 iterations each, in estimated 47.02730 s
95bootstrapping with 100000 resamples
96mean: 462.0538 ms, lb 461.7042 ms, ub 462.5768 ms, ci 0.950
97std dev: 2.155592 ms, lb 1.636385 ms, ub 3.310065 ms, ci 0.950
98found 14 outliers among 100 samples (14.0%)
99  8 (8.0%) high mild
100  6 (6.0%) high severe
101variance introduced by outliers: 0.990%
102variance is unaffected by outliers
103
104benchmarking shakespeare/ghc'''
105collecting 100 samples, 1 iterations each, in estimated 47.56901 s
106bootstrapping with 100000 resamples
107mean: 464.0884 ms, lb 463.8393 ms, ub 464.6077 ms, ci 0.950
108std dev: 1.771522 ms, lb 1.036507 ms, ub 3.333125 ms, ci 0.950
109found 10 outliers among 100 samples (10.0%)
110  7 (7.0%) high mild
111  3 (3.0%) high severe
112variance introduced by outliers: 0.990%
113variance is unaffected by outliers
114
115benchmarking space/yhc
116collecting 100 samples, 61912 iterations each, in estimated 2.021660 s
117bootstrapping with 100000 resamples
118mean: 327.7873 ns, lb 326.9686 ns, ub 329.9020 ns, ci 0.950
119std dev: 6.235530 ns, lb 2.907026 ns, ub 11.61758 ns, ci 0.950
120found 6 outliers among 100 samples (6.0%)
121  2 (2.0%) high mild
122  4 (4.0%) high severe
123variance introduced by outliers: 0.996%
124variance is unaffected by outliers
125
126benchmarking space/ghc
127collecting 100 samples, 61484 iterations each, in estimated 2.021664 s
128bootstrapping with 100000 resamples
129mean: 327.5850 ns, lb 327.1890 ns, ub 329.3809 ns, ci 0.950
130std dev: 3.671413 ns, lb 458.7065 ps, ub 8.694302 ns, ci 0.950
131found 6 outliers among 100 samples (6.0%)
132  4 (4.0%) high mild
133  2 (2.0%) high severe
134variance introduced by outliers: 0.990%
135variance is unaffected by outliers
136
137benchmarking space/ghc'
138collecting 100 samples, 61734 iterations each, in estimated 2.021687 s
139bootstrapping with 100000 resamples
140mean: 326.6733 ns, lb 326.5919 ns, ub 326.7802 ns, ci 0.950
141std dev: 475.6722 ps, lb 377.6895 ps, ub 620.1166 ps, ci 0.950
142found 4 outliers among 100 samples (4.0%)
143  3 (3.0%) high severe
144variance introduced by outliers: 0.990%
145variance is unaffected by outliers
146
147benchmarking space/ghc''
148collecting 100 samples, 62461 iterations each, in estimated 2.021659 s
149bootstrapping with 100000 resamples
150mean: 326.6367 ns, lb 326.3237 ns, ub 327.2559 ns, ci 0.950
151std dev: 2.164281 ns, lb 1.272209 ns, ub 3.372457 ns, ci 0.950
152found 8 outliers among 100 samples (8.0%)
153  2 (2.0%) high mild
154  6 (6.0%) high severe
155variance introduced by outliers: 0.990%
156variance is unaffected by outliers
157
158benchmarking space/ghc'''
159collecting 100 samples, 61745 iterations each, in estimated 2.021688 s
160bootstrapping with 100000 resamples
161mean: 327.9048 ns, lb 327.8173 ns, ub 328.0179 ns, ci 0.950
162std dev: 507.6252 ps, lb 406.3954 ps, ub 642.8486 ps, ci 0.950
163found 8 outliers among 100 samples (8.0%)
164  5 (5.0%) high mild
165  3 (3.0%) high severe
166variance introduced by outliers: 0.990%
167variance is unaffected by outliers
168
169benchmarking b/yhc
170collecting 100 samples, 60282 iterations each, in estimated 2.021682 s
171bootstrapping with 100000 resamples
172mean: 333.4063 ns, lb 332.5687 ns, ub 334.2282 ns, ci 0.950
173std dev: 4.252035 ns, lb 3.982128 ns, ub 4.668193 ns, ci 0.950
174variance introduced by outliers: 0.990%
175variance is unaffected by outliers
176
177benchmarking b/ghc
178collecting 100 samples, 61774 iterations each, in estimated 2.021671 s
179bootstrapping with 100000 resamples
180mean: 325.4779 ns, lb 325.3785 ns, ub 325.6915 ns, ci 0.950
181std dev: 713.6833 ps, lb 378.0530 ps, ub 1.359438 ns, ci 0.950
182found 6 outliers among 100 samples (6.0%)
183  4 (4.0%) high mild
184  2 (2.0%) high severe
185variance introduced by outliers: 0.990%
186variance is unaffected by outliers
187
188benchmarking b/ghc'
189collecting 100 samples, 62291 iterations each, in estimated 2.021663 s
190bootstrapping with 100000 resamples
191mean: 325.0181 ns, lb 324.4986 ns, ub 327.4329 ns, ci 0.950
192std dev: 4.950164 ns, lb 382.7273 ps, ub 11.77793 ns, ci 0.950
193found 6 outliers among 100 samples (6.0%)
194  4 (4.0%) high mild
195  2 (2.0%) high severe
196variance introduced by outliers: 0.993%
197variance is unaffected by outliers
198
199benchmarking b/ghc''
200collecting 100 samples, 62384 iterations each, in estimated 2.021663 s
201bootstrapping with 100000 resamples
202mean: 326.4223 ns, lb 326.3305 ns, ub 326.5397 ns, ci 0.950
203std dev: 529.6046 ps, lb 428.5708 ps, ub 692.1507 ps, ci 0.950
204found 3 outliers among 100 samples (3.0%)
205  2 (2.0%) high mild
206  1 (1.0%) high severe
207variance introduced by outliers: 0.990%
208variance is unaffected by outliers
209
210benchmarking b/ghc'''
211collecting 100 samples, 57804 iterations each, in estimated 2.021683 s
212bootstrapping with 100000 resamples
213mean: 354.8783 ns, lb 353.8682 ns, ub 357.2783 ns, ci 0.950
214std dev: 7.515500 ns, lb 3.557060 ns, ub 13.69849 ns, ci 0.950
215found 11 outliers among 100 samples (11.0%)
216  1 (1.0%) low severe
217  2 (2.0%) high mild
218  7 (7.0%) high severe
219variance introduced by outliers: 0.997%
220variance is unaffected by outliers
221
222benchmarking t/yhc
223collecting 100 samples, 61910 iterations each, in estimated 2.021685 s
224bootstrapping with 100000 resamples
225mean: 324.5318 ns, lb 324.4540 ns, ub 324.6356 ns, ci 0.950
226std dev: 456.0292 ps, lb 352.1474 ps, ub 711.6578 ps, ci 0.950
227found 2 outliers among 100 samples (2.0%)
228  1 (1.0%) high severe
229variance introduced by outliers: 0.990%
230variance is unaffected by outliers
231
232benchmarking t/ghc
233collecting 100 samples, 57220 iterations each, in estimated 2.021679 s
234bootstrapping with 100000 resamples
235mean: 355.4858 ns, lb 354.1155 ns, ub 358.2012 ns, ci 0.950
236std dev: 9.452790 ns, lb 5.459942 ns, ub 14.81949 ns, ci 0.950
237found 8 outliers among 100 samples (8.0%)
238  2 (2.0%) high mild
239  6 (6.0%) high severe
240variance introduced by outliers: 0.998%
241variance is unaffected by outliers
242
243benchmarking t/ghc'
244collecting 100 samples, 62160 iterations each, in estimated 2.021685 s
245bootstrapping with 100000 resamples
246mean: 328.4570 ns, lb 327.5841 ns, ub 330.6128 ns, ci 0.950
247std dev: 6.536254 ns, lb 2.411616 ns, ub 12.44300 ns, ci 0.950
248found 11 outliers among 100 samples (11.0%)
249  9 (9.0%) high severe
250variance introduced by outliers: 0.996%
251variance is unaffected by outliers
252
253benchmarking t/ghc''
254collecting 100 samples, 62226 iterations each, in estimated 2.021681 s
255bootstrapping with 100000 resamples
256mean: 327.0440 ns, lb 326.8794 ns, ub 327.3510 ns, ci 0.950
257std dev: 1.109832 ns, lb 708.8036 ps, ub 1.891486 ns, ci 0.950
258found 9 outliers among 100 samples (9.0%)
259  3 (3.0%) high mild
260  6 (6.0%) high severe
261variance introduced by outliers: 0.990%
262variance is unaffected by outliers
263
264benchmarking t/ghc'''
265collecting 100 samples, 62361 iterations each, in estimated 2.021666 s
266bootstrapping with 100000 resamples
267mean: 327.6291 ns, lb 327.1824 ns, ub 329.3937 ns, ci 0.950
268std dev: 4.076802 ns, lb 690.5312 ps, ub 9.587286 ns, ci 0.950
269found 9 outliers among 100 samples (9.0%)
270  5 (5.0%) high mild
271  3 (3.0%) high severe
272variance introduced by outliers: 0.990%
273variance is unaffected by outliers
274
275benchmarking n/yhc
276collecting 100 samples, 62206 iterations each, in estimated 2.021665 s
277bootstrapping with 100000 resamples
278mean: 326.7284 ns, lb 325.5118 ns, ub 329.1181 ns, ci 0.950
279std dev: 8.274068 ns, lb 4.771196 ns, ub 12.70819 ns, ci 0.950
280found 13 outliers among 100 samples (13.0%)
281  6 (6.0%) high mild
282  7 (7.0%) high severe
283variance introduced by outliers: 0.998%
284variance is unaffected by outliers
285
286benchmarking n/ghc
287collecting 100 samples, 62040 iterations each, in estimated 2.021664 s
288bootstrapping with 100000 resamples
289mean: 327.9464 ns, lb 326.9462 ns, ub 330.1200 ns, ci 0.950
290std dev: 7.214102 ns, lb 3.900595 ns, ub 11.89661 ns, ci 0.950
291found 8 outliers among 100 samples (8.0%)
292  7 (7.0%) high severe
293variance introduced by outliers: 0.997%
294variance is unaffected by outliers
295
296benchmarking n/ghc'
297collecting 100 samples, 62049 iterations each, in estimated 2.021687 s
298bootstrapping with 100000 resamples
299mean: 327.5773 ns, lb 327.0489 ns, ub 328.9809 ns, ci 0.950
300std dev: 4.093176 ns, lb 1.947346 ns, ub 8.439635 ns, ci 0.950
301found 8 outliers among 100 samples (8.0%)
302  2 (2.0%) high mild
303  6 (6.0%) high severe
304variance introduced by outliers: 0.990%
305variance is unaffected by outliers
306
307benchmarking n/ghc''
308collecting 100 samples, 56756 iterations each, in estimated 2.021659 s
309bootstrapping with 100000 resamples
310mean: 359.0402 ns, lb 358.9588 ns, ub 359.1671 ns, ci 0.950
311std dev: 513.9091 ps, lb 358.7966 ps, ub 761.7090 ps, ci 0.950
312found 8 outliers among 100 samples (8.0%)
313  5 (5.0%) high mild
314  3 (3.0%) high severe
315variance introduced by outliers: 0.990%
316variance is unaffected by outliers
317
318benchmarking n/ghc'''
319collecting 100 samples, 62249 iterations each, in estimated 2.021659 s
320bootstrapping with 100000 resamples
321mean: 325.8984 ns, lb 325.8307 ns, ub 325.9918 ns, ci 0.950
322std dev: 405.4053 ps, lb 317.7749 ps, ub 630.2802 ps, ci 0.950
323found 1 outliers among 100 samples (1.0%)
324  1 (1.0%) high severe
325variance introduced by outliers: 0.990%
326variance is unaffected by outliers
327
328benchmarking r/yhc
329collecting 100 samples, 62270 iterations each, in estimated 2.021661 s
330bootstrapping with 100000 resamples
331mean: 327.7083 ns, lb 327.1649 ns, ub 330.0260 ns, ci 0.950
332std dev: 4.920746 ns, lb 815.0337 ps, ub 11.53927 ns, ci 0.950
333found 13 outliers among 100 samples (13.0%)
334  8 (8.0%) high mild
335  5 (5.0%) high severe
336variance introduced by outliers: 0.993%
337variance is unaffected by outliers
338
339benchmarking r/ghc
340collecting 100 samples, 60366 iterations each, in estimated 2.021666 s
341bootstrapping with 100000 resamples
342mean: 338.4675 ns, lb 337.9754 ns, ub 339.0380 ns, ci 0.950
343std dev: 2.710929 ns, lb 2.229301 ns, ub 4.012433 ns, ci 0.950
344found 1 outliers among 100 samples (1.0%)
345  1 (1.0%) high severe
346variance introduced by outliers: 0.990%
347variance is unaffected by outliers
348
349benchmarking r/ghc'
350collecting 100 samples, 62568 iterations each, in estimated 2.021685 s
351bootstrapping with 100000 resamples
352mean: 325.5019 ns, lb 325.3385 ns, ub 325.9580 ns, ci 0.950
353std dev: 1.282830 ns, lb 551.4862 ps, ub 2.734440 ns, ci 0.950
354found 5 outliers among 100 samples (5.0%)
355  3 (3.0%) high severe
356variance introduced by outliers: 0.990%
357variance is unaffected by outliers
358
359benchmarking r/ghc''
360collecting 100 samples, 62458 iterations each, in estimated 2.021675 s
361bootstrapping with 100000 resamples
362mean: 326.1579 ns, lb 324.9973 ns, ub 329.9109 ns, ci 0.950
363std dev: 9.078263 ns, lb 748.0074 ps, ub 19.86850 ns, ci 0.950
364found 8 outliers among 100 samples (8.0%)
365  2 (2.0%) high mild
366  6 (6.0%) high severe
367variance introduced by outliers: 0.998%
368variance is unaffected by outliers
369
370benchmarking r/ghc'''
371collecting 100 samples, 62046 iterations each, in estimated 2.021679 s
372bootstrapping with 100000 resamples
373mean: 326.3934 ns, lb 325.8750 ns, ub 328.7738 ns, ci 0.950
374std dev: 4.886729 ns, lb 490.7322 ps, ub 11.60747 ns, ci 0.950
375found 5 outliers among 100 samples (5.0%)
376  3 (3.0%) high mild
377  2 (2.0%) high severe
378variance introduced by outliers: 0.993%
379variance is unaffected by outliers
380
381benchmarking f/yhc
382collecting 100 samples, 61886 iterations each, in estimated 2.021667 s
383bootstrapping with 100000 resamples
384mean: 327.2833 ns, lb 327.2142 ns, ub 327.3820 ns, ci 0.950
385std dev: 418.4109 ps, lb 292.6377 ps, ub 705.9323 ps, ci 0.950
386found 4 outliers among 100 samples (4.0%)
387  1 (1.0%) low severe
388  2 (2.0%) high mild
389  1 (1.0%) high severe
390variance introduced by outliers: 0.990%
391variance is unaffected by outliers
392
393benchmarking f/ghc
394collecting 100 samples, 61999 iterations each, in estimated 2.021659 s
395bootstrapping with 100000 resamples
396mean: 328.9185 ns, lb 327.8254 ns, ub 331.2555 ns, ci 0.950
397std dev: 7.828876 ns, lb 4.050064 ns, ub 13.15889 ns, ci 0.950
398found 12 outliers among 100 samples (12.0%)
399  11 (11.0%) high severe
400variance introduced by outliers: 0.997%
401variance is unaffected by outliers
402
403benchmarking f/ghc'
404collecting 100 samples, 62329 iterations each, in estimated 2.021672 s
405bootstrapping with 100000 resamples
406mean: 326.8028 ns, lb 326.4569 ns, ub 327.2809 ns, ci 0.950
407std dev: 2.074634 ns, lb 1.655168 ns, ub 2.858061 ns, ci 0.950
408found 12 outliers among 100 samples (12.0%)
409  8 (8.0%) high mild
410  4 (4.0%) high severe
411variance introduced by outliers: 0.990%
412variance is unaffected by outliers
413
414benchmarking f/ghc''
415collecting 100 samples, 61941 iterations each, in estimated 2.021683 s
416bootstrapping with 100000 resamples
417mean: 444.4427 ns, lb 428.7950 ns, ub 458.2793 ns, ci 0.950
418std dev: 75.38444 ns, lb 67.34978 ns, ub 81.73042 ns, ci 0.950
419variance introduced by outliers: 1.000%
420variance is unaffected by outliers
421
422benchmarking f/ghc'''
423collecting 100 samples, 41008 iterations each, in estimated 2.021682 s
424bootstrapping with 100000 resamples
425mean: 491.5863 ns, lb 491.2362 ns, ub 492.8158 ns, ci 0.950
426std dev: 3.016209 ns, lb 776.9534 ps, ub 6.884899 ns, ci 0.950
427found 5 outliers among 100 samples (5.0%)
428  2 (2.0%) high mild
429  3 (3.0%) high severe
430variance introduced by outliers: 0.990%
431variance is unaffected by outliers
432
433benchmarking v/yhc
434collecting 100 samples, 61296 iterations each, in estimated 2.021660 s
435bootstrapping with 100000 resamples
436mean: 334.4202 ns, lb 333.3102 ns, ub 335.5636 ns, ci 0.950
437std dev: 5.780129 ns, lb 5.200623 ns, ub 6.492636 ns, ci 0.950
438variance introduced by outliers: 0.995%
439variance is unaffected by outliers
440
441benchmarking v/ghc
442collecting 100 samples, 58627 iterations each, in estimated 2.021674 s
443bootstrapping with 100000 resamples
444mean: 345.6648 ns, lb 345.2655 ns, ub 346.1889 ns, ci 0.950
445std dev: 2.327147 ns, lb 1.835688 ns, ub 3.257330 ns, ci 0.950
446found 21 outliers among 100 samples (21.0%)
447  9 (9.0%) low mild
448  9 (9.0%) high mild
449  3 (3.0%) high severe
450variance introduced by outliers: 0.990%
451variance is unaffected by outliers
452
453benchmarking v/ghc'
454collecting 100 samples, 62037 iterations each, in estimated 2.021680 s
455bootstrapping with 100000 resamples
456mean: 328.4826 ns, lb 327.6818 ns, ub 330.5474 ns, ci 0.950
457std dev: 5.958699 ns, lb 1.292321 ns, ub 11.43492 ns, ci 0.950
458found 11 outliers among 100 samples (11.0%)
459  11 (11.0%) high severe
460variance introduced by outliers: 0.995%
461variance is unaffected by outliers
462
463benchmarking v/ghc''
464collecting 100 samples, 61722 iterations each, in estimated 2.021676 s
465bootstrapping with 100000 resamples
466mean: 328.6033 ns, lb 328.1757 ns, ub 329.7676 ns, ci 0.950
467std dev: 3.357614 ns, lb 1.524959 ns, ub 7.068491 ns, ci 0.950
468found 14 outliers among 100 samples (14.0%)
469  5 (5.0%) high mild
470  9 (9.0%) high severe
471variance introduced by outliers: 0.990%
472variance is unaffected by outliers
473
474benchmarking v/ghc'''
475collecting 100 samples, 61837 iterations each, in estimated 2.021663 s
476bootstrapping with 100000 resamples
477mean: 328.8473 ns, lb 327.6507 ns, ub 331.0984 ns, ci 0.950
478std dev: 8.150761 ns, lb 4.932282 ns, ub 12.75202 ns, ci 0.950
479found 14 outliers among 100 samples (14.0%)
480  4 (4.0%) high mild
481  10 (10.0%) high severe
482variance introduced by outliers: 0.997%
483variance is unaffected by outliers
484
485benchmarking xa0/yhc
486collecting 100 samples, 62188 iterations each, in estimated 2.021668 s
487bootstrapping with 100000 resamples
488mean: 325.4608 ns, lb 325.3886 ns, ub 325.5738 ns, ci 0.950
489std dev: 455.6982 ps, lb 326.5464 ps, ub 732.4994 ps, ci 0.950
490found 3 outliers among 100 samples (3.0%)
491  2 (2.0%) high severe
492variance introduced by outliers: 0.990%
493variance is unaffected by outliers
494
495benchmarking xa0/ghc
496collecting 100 samples, 61982 iterations each, in estimated 2.021669 s
497bootstrapping with 100000 resamples
498mean: 328.6896 ns, lb 327.7043 ns, ub 331.2309 ns, ci 0.950
499std dev: 7.212611 ns, lb 1.276307 ns, ub 13.30533 ns, ci 0.950
500found 9 outliers among 100 samples (9.0%)
501  5 (5.0%) high mild
502  4 (4.0%) high severe
503variance introduced by outliers: 0.997%
504variance is unaffected by outliers
505
506benchmarking xa0/ghc'
507collecting 100 samples, 61048 iterations each, in estimated 2.021675 s
508bootstrapping with 100000 resamples
509mean: 330.1470 ns, lb 329.2093 ns, ub 332.5624 ns, ci 0.950
510std dev: 7.118127 ns, lb 2.614118 ns, ub 13.67536 ns, ci 0.950
511found 14 outliers among 100 samples (14.0%)
512  4 (4.0%) high mild
513  10 (10.0%) high severe
514variance introduced by outliers: 0.997%
515variance is unaffected by outliers
516
517benchmarking xa0/ghc''
518collecting 100 samples, 59657 iterations each, in estimated 2.021665 s
519bootstrapping with 100000 resamples
520mean: 329.0974 ns, lb 328.2419 ns, ub 331.3152 ns, ci 0.950
521std dev: 6.249528 ns, lb 691.7427 ps, ub 12.26040 ns, ci 0.950
522found 5 outliers among 100 samples (5.0%)
523  5 (5.0%) high severe
524variance introduced by outliers: 0.996%
525variance is unaffected by outliers
526
527benchmarking xa0/ghc'''
528collecting 100 samples, 61676 iterations each, in estimated 2.021672 s
529bootstrapping with 100000 resamples
530mean: 328.7045 ns, lb 328.4596 ns, ub 329.1293 ns, ci 0.950
531std dev: 1.605902 ns, lb 1.080179 ns, ub 2.651774 ns, ci 0.950
532found 12 outliers among 100 samples (12.0%)
533  5 (5.0%) high mild
534  7 (7.0%) high severe
535variance introduced by outliers: 0.990%
536variance is unaffected by outliers
537
538benchmarking xff/yhc
539collecting 100 samples, 61180 iterations each, in estimated 2.021662 s
540bootstrapping with 100000 resamples
541mean: 331.4134 ns, lb 330.2917 ns, ub 333.8960 ns, ci 0.950
542std dev: 8.094708 ns, lb 4.345765 ns, ub 13.88452 ns, ci 0.950
543found 16 outliers among 100 samples (16.0%)
544  14 (14.0%) high severe
545variance introduced by outliers: 0.997%
546variance is unaffected by outliers
547
548benchmarking xff/ghc
549collecting 100 samples, 57799 iterations each, in estimated 2.021677 s
550bootstrapping with 100000 resamples
551mean: 351.4228 ns, lb 350.6154 ns, ub 354.1887 ns, ci 0.950
552std dev: 6.755467 ns, lb 2.062965 ns, ub 15.11857 ns, ci 0.950
553found 8 outliers among 100 samples (8.0%)
554  7 (7.0%) high severe
555variance introduced by outliers: 0.996%
556variance is unaffected by outliers
557
558benchmarking xff/ghc'
559collecting 100 samples, 61593 iterations each, in estimated 2.021663 s
560bootstrapping with 100000 resamples
561mean: 327.8465 ns, lb 326.9639 ns, ub 330.1371 ns, ci 0.950
562std dev: 6.458741 ns, lb 749.1200 ps, ub 12.83608 ns, ci 0.950
563found 6 outliers among 100 samples (6.0%)
564  2 (2.0%) high mild
565  4 (4.0%) high severe
566variance introduced by outliers: 0.996%
567variance is unaffected by outliers
568
569benchmarking xff/ghc''
570collecting 100 samples, 61941 iterations each, in estimated 2.021661 s
571bootstrapping with 100000 resamples
572mean: 326.8865 ns, lb 326.5003 ns, ub 327.4992 ns, ci 0.950
573std dev: 2.438838 ns, lb 1.688061 ns, ub 3.322329 ns, ci 0.950
574found 13 outliers among 100 samples (13.0%)
575  12 (12.0%) high severe
576variance introduced by outliers: 0.990%
577variance is unaffected by outliers
578
579benchmarking xff/ghc'''
580collecting 100 samples, 62183 iterations each, in estimated 2.021687 s
581bootstrapping with 100000 resamples
582mean: 328.9897 ns, lb 328.7275 ns, ub 329.5247 ns, ci 0.950
583std dev: 1.851640 ns, lb 1.061196 ns, ub 2.987915 ns, ci 0.950
584found 8 outliers among 100 samples (8.0%)
585  7 (7.0%) high severe
586variance introduced by outliers: 0.990%
587variance is unaffected by outliers