Ticket #1473: fifth-run.txt

File fifth-run.txt, 29.5 KB (added by guest, 4 years ago)
Line 
1+++ OK, passed 10000 tests.
2warming up
3estimating clock resolution...
4mean is 13.69772 us (40001 iterations)
5found 796 outliers among 39999 samples (2.0%)
6  693 (1.7%) high severe
7estimating cost of a clock call...
8mean is 292.8680 ns (86 iterations)
9found 3 outliers among 86 samples (3.5%)
10  3 (3.5%) high severe
11
12benchmarking random/ghc
13collecting 100 samples, 41239 iterations each, in estimated 1.369773 s
14bootstrapping with 100000 resamples
15mean: 333.1579 ns, lb 332.5237 ns, ub 334.3738 ns, ci 0.950
16std dev: 4.388565 ns, lb 2.443628 ns, ub 6.576465 ns, ci 0.950
17found 12 outliers among 100 samples (12.0%)
18  6 (6.0%) high mild
19  6 (6.0%) high severe
20variance introduced by outliers: 0.991%
21variance is unaffected by outliers
22
23benchmarking random/ghc'
24collecting 100 samples, 41551 iterations each, in estimated 1.369797 s
25bootstrapping with 100000 resamples
26mean: 469.3658 ns, lb 455.7159 ns, ub 480.1615 ns, ci 0.950
27std dev: 61.62991 ns, lb 50.21117 ns, ub 71.71410 ns, ci 0.950
28found 23 outliers among 100 samples (23.0%)
29  17 (17.0%) low severe
30  3 (3.0%) high mild
31  3 (3.0%) high severe
32variance introduced by outliers: 1.000%
33variance is unaffected by outliers
34
35benchmarking random/ghc''
36collecting 100 samples, 27573 iterations each, in estimated 1.369813 s
37bootstrapping with 100000 resamples
38mean: 497.7853 ns, lb 497.3555 ns, ub 499.4616 ns, ci 0.950
39std dev: 3.841733 ns, lb 804.8691 ps, ub 8.983406 ns, ci 0.950
40found 5 outliers among 100 samples (5.0%)
41  3 (3.0%) high mild
42  2 (2.0%) high severe
43variance introduced by outliers: 0.990%
44variance is unaffected by outliers
45
46benchmarking random/ghc'''
47collecting 100 samples, 27554 iterations each, in estimated 1.369791 s
48bootstrapping with 100000 resamples
49mean: 498.0933 ns, lb 497.6616 ns, ub 499.6958 ns, ci 0.950
50std dev: 3.796600 ns, lb 926.4635 ps, ub 8.774292 ns, ci 0.950
51found 9 outliers among 100 samples (9.0%)
52  3 (3.0%) low mild
53  2 (2.0%) high mild
54  4 (4.0%) high severe
55variance introduced by outliers: 0.990%
56variance is unaffected by outliers
57
58benchmarking random/ffi'
59collecting 100 samples, 41320 iterations each, in estimated 1.369803 s
60bootstrapping with 100000 resamples
61mean: 331.7183 ns, lb 331.6255 ns, ub 331.8607 ns, ci 0.950
62std dev: 577.7277 ps, lb 410.3072 ps, ub 841.6733 ps, ci 0.950
63found 6 outliers among 100 samples (6.0%)
64  2 (2.0%) high mild
65  4 (4.0%) high severe
66variance introduced by outliers: 0.990%
67variance is unaffected by outliers
68
69benchmarking random/ffi
70collecting 100 samples, 41143 iterations each, in estimated 1.369772 s
71bootstrapping with 100000 resamples
72mean: 331.6409 ns, lb 331.5586 ns, ub 331.7528 ns, ci 0.950
73std dev: 489.5827 ps, lb 385.1928 ps, ub 651.0954 ps, ci 0.950
74found 10 outliers among 100 samples (10.0%)
75  7 (7.0%) high mild
76  3 (3.0%) high severe
77variance introduced by outliers: 0.990%
78variance is unaffected by outliers
79
80benchmarking shakespeare/ghc-dryrun
81collecting 100 samples, 1 iterations each, in estimated 200.0631 s
82bootstrapping with 100000 resamples
83mean: 981.7819 ms, lb 949.2342 ms, ub 1.010001 s, ci 0.950
84std dev: 155.0204 ms, lb 138.1863 ms, ub 167.5609 ms, ci 0.950
85variance introduced by outliers: 2.999%
86variance is slightly inflated by outliers
87
88benchmarking shakespeare/ghc-dryrun
89collecting 100 samples, 1 iterations each, in estimated 103.5126 s
90bootstrapping with 100000 resamples
91mean: 1.064981 s, lb 1.064321 s, ub 1.065444 s, ci 0.950
92std dev: 2.780338 ms, lb 1.728770 ms, ub 4.897888 ms, ci 0.950
93found 6 outliers among 100 samples (6.0%)
94  1 (1.0%) low severe
95  4 (4.0%) high severe
96variance introduced by outliers: 0.990%
97variance is unaffected by outliers
98
99benchmarking shakespeare/ghc
100collecting 100 samples, 1 iterations each, in estimated 104.9579 s
101bootstrapping with 100000 resamples
102mean: 1.041066 s, lb 1.039274 s, ub 1.043777 s, ci 0.950
103std dev: 11.23228 ms, lb 8.244467 ms, ub 15.49020 ms, ci 0.950
104found 20 outliers among 100 samples (20.0%)
105  2 (2.0%) high mild
106  18 (18.0%) high severe
107variance introduced by outliers: 0.990%
108variance is unaffected by outliers
109
110benchmarking shakespeare/ghc'
111collecting 100 samples, 1 iterations each, in estimated 70.24450 s
112bootstrapping with 100000 resamples
113mean: 686.9629 ms, lb 686.2021 ms, ub 688.0309 ms, ci 0.950
114std dev: 4.593568 ms, lb 3.582164 ms, ub 6.143645 ms, ci 0.950
115found 12 outliers among 100 samples (12.0%)
116  8 (8.0%) high mild
117  4 (4.0%) high severe
118variance introduced by outliers: 0.990%
119variance is unaffected by outliers
120
121benchmarking shakespeare/ghc''
122collecting 100 samples, 1 iterations each, in estimated 69.74661 s
123bootstrapping with 100000 resamples
124mean: 686.6314 ms, lb 685.8547 ms, ub 687.6162 ms, ci 0.950
125std dev: 4.458797 ms, lb 3.658333 ms, ub 5.597150 ms, ci 0.950
126found 7 outliers among 100 samples (7.0%)
127  5 (5.0%) high mild
128  2 (2.0%) high severe
129variance introduced by outliers: 0.990%
130variance is unaffected by outliers
131
132benchmarking shakespeare/ghc'''
133collecting 100 samples, 1 iterations each, in estimated 71.01040 s
134bootstrapping with 100000 resamples
135mean: 692.4435 ms, lb 686.2218 ms, ub 694.2697 ms, ci 0.950
136std dev: 15.65698 ms, lb 4.611371 ms, ub 35.65417 ms, ci 0.950
137found 20 outliers among 100 samples (20.0%)
138  2 (2.0%) low severe
139  9 (9.0%) high mild
140  9 (9.0%) high severe
141variance introduced by outliers: 0.997%
142variance is unaffected by outliers
143
144benchmarking shakespeare/ffi'
145collecting 100 samples, 1 iterations each, in estimated 85.82368 s
146bootstrapping with 100000 resamples
147mean: 603.1230 ms, lb 594.0248 ms, ub 618.2545 ms, ci 0.950
148std dev: 59.21260 ms, lb 38.34971 ms, ub 83.61235 ms, ci 0.950
149found 14 outliers among 100 samples (14.0%)
150  13 (13.0%) high severe
151variance introduced by outliers: 1.000%
152variance is unaffected by outliers
153
154benchmarking shakespeare/ghc
155collecting 100 samples, 41315 iterations each, in estimated 1.369772 s
156bootstrapping with 100000 resamples
157mean: 338.4810 ns, lb 334.3166 ns, ub 353.1995 ns, ci 0.950
158std dev: 35.32359 ns, lb 9.265119 ns, ub 79.63561 ns, ci 0.950
159found 14 outliers among 100 samples (14.0%)
160  4 (4.0%) high mild
161  10 (10.0%) high severe
162variance introduced by outliers: 1.000%
163variance is unaffected by outliers
164
165benchmarking shakespeare/ghc'
166collecting 100 samples, 41155 iterations each, in estimated 1.369798 s
167bootstrapping with 100000 resamples
168mean: 332.1048 ns, lb 331.9790 ns, ub 332.2854 ns, ci 0.950
169std dev: 765.8919 ps, lb 585.8790 ps, ub 1.070964 ns, ci 0.950
170found 8 outliers among 100 samples (8.0%)
171  5 (5.0%) high mild
172  3 (3.0%) high severe
173variance introduced by outliers: 0.990%
174variance is unaffected by outliers
175
176benchmarking shakespeare/ghc''
177collecting 100 samples, 41226 iterations each, in estimated 1.369776 s
178bootstrapping with 100000 resamples
179mean: 334.2687 ns, lb 332.4581 ns, ub 337.8608 ns, ci 0.950
180std dev: 12.55083 ns, lb 7.313125 ns, ub 19.44991 ns, ci 0.950
181found 9 outliers among 100 samples (9.0%)
182  4 (4.0%) high mild
183  5 (5.0%) high severe
184variance introduced by outliers: 0.999%
185variance is unaffected by outliers
186
187benchmarking shakespeare/ghc'''
188collecting 100 samples, 41077 iterations each, in estimated 1.369772 s
189bootstrapping with 100000 resamples
190mean: 433.5087 ns, lb 416.6793 ns, ub 449.7423 ns, ci 0.950
191std dev: 85.13032 ns, lb 79.80841 ns, ub 99.73477 ns, ci 0.950
192variance introduced by outliers: 1.000%
193variance is unaffected by outliers
194
195benchmarking shakespeare/ffi'
196collecting 100 samples, 41272 iterations each, in estimated 1.369788 s
197bootstrapping with 100000 resamples
198mean: 332.3381 ns, lb 331.9996 ns, ub 333.0213 ns, ci 0.950
199std dev: 2.372903 ns, lb 1.336829 ns, ub 3.899541 ns, ci 0.950
200found 8 outliers among 100 samples (8.0%)
201  2 (2.0%) high mild
202  6 (6.0%) high severe
203variance introduced by outliers: 0.990%
204variance is unaffected by outliers
205
206benchmarking shakespeare/ffi
207collecting 100 samples, 41098 iterations each, in estimated 1.369784 s
208bootstrapping with 100000 resamples
209mean: 332.7634 ns, lb 332.6404 ns, ub 332.9465 ns, ci 0.950
210std dev: 760.3509 ps, lb 559.5263 ps, ub 1.054961 ns, ci 0.950
211found 7 outliers among 100 samples (7.0%)
212  6 (6.0%) high severe
213variance introduced by outliers: 0.990%
214variance is unaffected by outliers
215
216benchmarking space/ghc
217collecting 100 samples, 27383 iterations each, in estimated 1.369818 s
218bootstrapping with 100000 resamples
219mean: 341.1159 ns, lb 337.6547 ns, ub 347.3481 ns, ci 0.950
220std dev: 23.02116 ns, lb 14.35589 ns, ub 33.96971 ns, ci 0.950
221found 7 outliers among 100 samples (7.0%)
222  6 (6.0%) high severe
223variance introduced by outliers: 1.000%
224variance is unaffected by outliers
225
226benchmarking space/ghc'
227collecting 100 samples, 40952 iterations each, in estimated 1.369790 s
228bootstrapping with 100000 resamples
229mean: 332.5430 ns, lb 332.3740 ns, ub 332.7751 ns, ci 0.950
230std dev: 1.003460 ns, lb 784.1002 ps, ub 1.328784 ns, ci 0.950
231found 9 outliers among 100 samples (9.0%)
232  5 (5.0%) high mild
233  4 (4.0%) high severe
234variance introduced by outliers: 0.990%
235variance is unaffected by outliers
236
237benchmarking space/ghc''
238collecting 100 samples, 27329 iterations each, in estimated 1.369781 s
239bootstrapping with 100000 resamples
240mean: 498.1327 ns, lb 497.9117 ns, ub 498.5072 ns, ci 0.950
241std dev: 1.441409 ns, lb 984.6865 ps, ub 2.405484 ns, ci 0.950
242found 6 outliers among 100 samples (6.0%)
243  3 (3.0%) high mild
244  3 (3.0%) high severe
245variance introduced by outliers: 0.990%
246variance is unaffected by outliers
247
248benchmarking space/ghc'''
249collecting 100 samples, 27444 iterations each, in estimated 1.369774 s
250bootstrapping with 100000 resamples
251mean: 500.0428 ns, lb 499.8225 ns, ub 500.3591 ns, ci 0.950
252std dev: 1.336651 ns, lb 996.9317 ps, ub 1.734112 ns, ci 0.950
253found 7 outliers among 100 samples (7.0%)
254  7 (7.0%) high severe
255variance introduced by outliers: 0.990%
256variance is unaffected by outliers
257
258benchmarking space/ffi'
259collecting 100 samples, 27396 iterations each, in estimated 1.369810 s
260bootstrapping with 100000 resamples
261mean: 503.8238 ns, lb 501.8268 ns, ub 511.2993 ns, ci 0.950
262std dev: 17.14070 ns, lb 4.608505 ns, ub 39.13309 ns, ci 0.950
263found 12 outliers among 100 samples (12.0%)
264  3 (3.0%) high mild
265  8 (8.0%) high severe
266variance introduced by outliers: 0.999%
267variance is unaffected by outliers
268
269benchmarking space/ffi
270collecting 100 samples, 27534 iterations each, in estimated 1.369819 s
271bootstrapping with 100000 resamples
272mean: 508.2465 ns, lb 504.5353 ns, ub 516.7141 ns, ci 0.950
273std dev: 27.41531 ns, lb 14.96258 ns, ub 50.49213 ns, ci 0.950
274found 14 outliers among 100 samples (14.0%)
275  5 (5.0%) high mild
276  9 (9.0%) high severe
277variance introduced by outliers: 0.999%
278variance is unaffected by outliers
279
280benchmarking b/ghc
281collecting 100 samples, 27215 iterations each, in estimated 1.369810 s
282bootstrapping with 100000 resamples
283mean: 500.9332 ns, lb 500.6914 ns, ub 501.2853 ns, ci 0.950
284std dev: 1.475711 ns, lb 1.107208 ns, ub 1.998438 ns, ci 0.950
285found 9 outliers among 100 samples (9.0%)
286  4 (4.0%) high mild
287  5 (5.0%) high severe
288variance introduced by outliers: 0.990%
289variance is unaffected by outliers
290
291benchmarking b/ghc'
292collecting 100 samples, 27230 iterations each, in estimated 1.369812 s
293bootstrapping with 100000 resamples
294mean: 500.6668 ns, lb 500.4722 ns, ub 500.9640 ns, ci 0.950
295std dev: 1.216264 ns, lb 915.0519 ps, ub 1.869807 ns, ci 0.950
296found 6 outliers among 100 samples (6.0%)
297  3 (3.0%) high mild
298  3 (3.0%) high severe
299variance introduced by outliers: 0.990%
300variance is unaffected by outliers
301
302benchmarking b/ghc''
303collecting 100 samples, 27397 iterations each, in estimated 1.369781 s
304bootstrapping with 100000 resamples
305mean: 503.2574 ns, lb 501.4749 ns, ub 509.1463 ns, ci 0.950
306std dev: 14.71995 ns, lb 4.839170 ns, ub 32.60113 ns, ci 0.950
307found 9 outliers among 100 samples (9.0%)
308  5 (5.0%) high mild
309  4 (4.0%) high severe
310variance introduced by outliers: 0.998%
311variance is unaffected by outliers
312
313benchmarking b/ghc'''
314collecting 100 samples, 27303 iterations each, in estimated 1.369809 s
315bootstrapping with 100000 resamples
316mean: 502.8211 ns, lb 502.5033 ns, ub 503.2852 ns, ci 0.950
317std dev: 1.949601 ns, lb 1.448389 ns, ub 2.643464 ns, ci 0.950
318found 9 outliers among 100 samples (9.0%)
319  7 (7.0%) high severe
320variance introduced by outliers: 0.990%
321variance is unaffected by outliers
322
323benchmarking b/ffi'
324collecting 100 samples, 27476 iterations each, in estimated 1.369772 s
325bootstrapping with 100000 resamples
326mean: 505.1542 ns, lb 503.4344 ns, ub 513.3778 ns, ci 0.950
327std dev: 16.59454 ns, lb 988.5598 ps, ub 39.53829 ns, ci 0.950
328found 7 outliers among 100 samples (7.0%)
329  3 (3.0%) high mild
330  3 (3.0%) high severe
331variance introduced by outliers: 0.999%
332variance is unaffected by outliers
333
334benchmarking b/ffi
335collecting 100 samples, 27316 iterations each, in estimated 1.369805 s
336bootstrapping with 100000 resamples
337mean: 511.6558 ns, lb 508.5475 ns, ub 517.5280 ns, ci 0.950
338std dev: 21.22834 ns, lb 12.81618 ns, ub 32.46103 ns, ci 0.950
339found 11 outliers among 100 samples (11.0%)
340  6 (6.0%) high mild
341  5 (5.0%) high severe
342variance introduced by outliers: 0.999%
343variance is unaffected by outliers
344
345benchmarking t/ghc
346collecting 100 samples, 27227 iterations each, in estimated 1.369819 s
347bootstrapping with 100000 resamples
348mean: 503.6257 ns, lb 502.2820 ns, ub 508.9651 ns, ci 0.950
349std dev: 12.16792 ns, lb 2.166762 ns, ub 28.53332 ns, ci 0.950
350found 15 outliers among 100 samples (15.0%)
351  7 (7.0%) high mild
352  8 (8.0%) high severe
353variance introduced by outliers: 0.997%
354variance is unaffected by outliers
355
356benchmarking t/ghc'
357collecting 100 samples, 27339 iterations each, in estimated 1.369785 s
358bootstrapping with 100000 resamples
359mean: 503.2893 ns, lb 502.8465 ns, ub 503.8395 ns, ci 0.950
360std dev: 2.528691 ns, lb 2.126155 ns, ub 2.998347 ns, ci 0.950
361found 10 outliers among 100 samples (10.0%)
362  10 (10.0%) high mild
363variance introduced by outliers: 0.990%
364variance is unaffected by outliers
365
366benchmarking t/ghc''
367collecting 100 samples, 26976 iterations each, in estimated 1.369792 s
368bootstrapping with 100000 resamples
369mean: 503.8722 ns, lb 503.3773 ns, ub 505.7597 ns, ci 0.950
370std dev: 4.372231 ns, lb 1.017249 ns, ub 10.12754 ns, ci 0.950
371found 6 outliers among 100 samples (6.0%)
372  4 (4.0%) high mild
373  2 (2.0%) high severe
374variance introduced by outliers: 0.990%
375variance is unaffected by outliers
376
377benchmarking t/ghc'''
378collecting 100 samples, 27251 iterations each, in estimated 1.369778 s
379bootstrapping with 100000 resamples
380mean: 504.2855 ns, lb 504.0724 ns, ub 504.5973 ns, ci 0.950
381std dev: 1.305339 ns, lb 954.5595 ps, ub 1.887825 ns, ci 0.950
382found 12 outliers among 100 samples (12.0%)
383  8 (8.0%) high mild
384  3 (3.0%) high severe
385variance introduced by outliers: 0.990%
386variance is unaffected by outliers
387
388benchmarking t/ffi'
389collecting 100 samples, 27369 iterations each, in estimated 1.369775 s
390bootstrapping with 100000 resamples
391mean: 505.1888 ns, lb 503.2085 ns, ub 509.8152 ns, ci 0.950
392std dev: 14.66735 ns, lb 7.621633 ns, ub 26.34629 ns, ci 0.950
393found 10 outliers among 100 samples (10.0%)
394  3 (3.0%) high mild
395  7 (7.0%) high severe
396variance introduced by outliers: 0.998%
397variance is unaffected by outliers
398
399benchmarking t/ffi
400collecting 100 samples, 27316 iterations each, in estimated 1.369785 s
401bootstrapping with 100000 resamples
402mean: 512.4493 ns, lb 508.5384 ns, ub 520.6108 ns, ci 0.950
403std dev: 27.77033 ns, lb 16.43621 ns, ub 50.97264 ns, ci 0.950
404found 19 outliers among 100 samples (19.0%)
405  5 (5.0%) high mild
406  14 (14.0%) high severe
407variance introduced by outliers: 0.999%
408variance is unaffected by outliers
409
410benchmarking n/ghc
411collecting 100 samples, 27225 iterations each, in estimated 1.369818 s
412bootstrapping with 100000 resamples
413mean: 511.9607 ns, lb 508.2564 ns, ub 520.1800 ns, ci 0.950
414std dev: 26.93237 ns, lb 14.79747 ns, ub 49.34191 ns, ci 0.950
415found 14 outliers among 100 samples (14.0%)
416  6 (6.0%) high mild
417  8 (8.0%) high severe
418variance introduced by outliers: 0.999%
419variance is unaffected by outliers
420
421benchmarking n/ghc'
422collecting 100 samples, 40997 iterations each, in estimated 1.369804 s
423bootstrapping with 100000 resamples
424mean: 337.2034 ns, lb 336.6752 ns, ub 338.1807 ns, ci 0.950
425std dev: 3.564216 ns, lb 2.049871 ns, ub 5.286732 ns, ci 0.950
426found 13 outliers among 100 samples (13.0%)
427  7 (7.0%) high mild
428  5 (5.0%) high severe
429variance introduced by outliers: 0.990%
430variance is unaffected by outliers
431
432benchmarking n/ghc''
433collecting 100 samples, 39989 iterations each, in estimated 1.369802 s
434bootstrapping with 100000 resamples
435mean: 388.7845 ns, lb 373.5949 ns, ub 407.1418 ns, ci 0.950
436std dev: 85.40236 ns, lb 74.49011 ns, ub 101.1783 ns, ci 0.950
437variance introduced by outliers: 1.000%
438variance is unaffected by outliers
439
440benchmarking n/ghc'''
441collecting 100 samples, 40468 iterations each, in estimated 1.369780 s
442bootstrapping with 100000 resamples
443mean: 335.3939 ns, lb 334.3418 ns, ub 338.5456 ns, ci 0.950
444std dev: 8.473106 ns, lb 3.424320 ns, ub 18.13350 ns, ci 0.950
445found 12 outliers among 100 samples (12.0%)
446  4 (4.0%) high mild
447  8 (8.0%) high severe
448variance introduced by outliers: 0.998%
449variance is unaffected by outliers
450
451benchmarking n/ffi'
452collecting 100 samples, 40798 iterations each, in estimated 1.369804 s
453bootstrapping with 100000 resamples
454mean: 335.6690 ns, lb 335.5699 ns, ub 335.8764 ns, ci 0.950
455std dev: 704.5406 ps, lb 413.9430 ps, ub 1.352886 ns, ci 0.950
456found 7 outliers among 100 samples (7.0%)
457  2 (2.0%) high mild
458  5 (5.0%) high severe
459variance introduced by outliers: 0.990%
460variance is unaffected by outliers
461
462benchmarking n/ffi
463collecting 100 samples, 40879 iterations each, in estimated 1.369787 s
464bootstrapping with 100000 resamples
465mean: 336.2930 ns, lb 335.9400 ns, ub 336.9649 ns, ci 0.950
466std dev: 2.417584 ns, lb 1.490113 ns, ub 3.889910 ns, ci 0.950
467found 11 outliers among 100 samples (11.0%)
468  3 (3.0%) high mild
469  8 (8.0%) high severe
470variance introduced by outliers: 0.990%
471variance is unaffected by outliers
472
473benchmarking r/ghc
474collecting 100 samples, 41002 iterations each, in estimated 1.369777 s
475bootstrapping with 100000 resamples
476mean: 334.7913 ns, lb 334.7034 ns, ub 334.8862 ns, ci 0.950
477std dev: 471.1819 ps, lb 369.9792 ps, ub 638.6186 ps, ci 0.950
478found 10 outliers among 100 samples (10.0%)
479  1 (1.0%) low severe
480  7 (7.0%) high mild
481  2 (2.0%) high severe
482variance introduced by outliers: 0.990%
483variance is unaffected by outliers
484
485benchmarking r/ghc'
486collecting 100 samples, 35839 iterations each, in estimated 1.369775 s
487bootstrapping with 100000 resamples
488mean: 337.9553 ns, lb 335.9415 ns, ub 344.1225 ns, ci 0.950
489std dev: 16.22064 ns, lb 5.743097 ns, ub 35.18350 ns, ci 0.950
490found 13 outliers among 100 samples (13.0%)
491  10 (10.0%) high mild
492  3 (3.0%) high severe
493variance introduced by outliers: 0.999%
494variance is unaffected by outliers
495
496benchmarking r/ghc''
497collecting 100 samples, 41092 iterations each, in estimated 1.369779 s
498bootstrapping with 100000 resamples
499mean: 371.1476 ns, lb 359.0843 ns, ub 386.3012 ns, ci 0.950
500std dev: 68.89331 ns, lb 57.56173 ns, ub 79.83899 ns, ci 0.950
501found 24 outliers among 100 samples (24.0%)
502  23 (23.0%) high severe
503variance introduced by outliers: 1.000%
504variance is unaffected by outliers
505
506benchmarking r/ghc'''
507collecting 100 samples, 40886 iterations each, in estimated 1.369784 s
508bootstrapping with 100000 resamples
509mean: 336.3931 ns, lb 335.3998 ns, ub 339.5342 ns, ci 0.950
510std dev: 8.165020 ns, lb 3.062073 ns, ub 17.95257 ns, ci 0.950
511found 14 outliers among 100 samples (14.0%)
512  3 (3.0%) high mild
513  11 (11.0%) high severe
514variance introduced by outliers: 0.997%
515variance is unaffected by outliers
516
517benchmarking r/ffi'
518collecting 100 samples, 27293 iterations each, in estimated 1.369804 s
519bootstrapping with 100000 resamples
520mean: 456.0534 ns, lb 439.6429 ns, ub 470.9500 ns, ci 0.950
521std dev: 80.21440 ns, lb 72.19903 ns, ub 86.49997 ns, ci 0.950
522variance introduced by outliers: 1.000%
523variance is unaffected by outliers
524
525benchmarking r/ffi
526collecting 100 samples, 41060 iterations each, in estimated 1.369773 s
527bootstrapping with 100000 resamples
528mean: 333.4649 ns, lb 333.3175 ns, ub 333.8073 ns, ci 0.950
529std dev: 1.087940 ns, lb 564.1312 ps, ub 2.185724 ns, ci 0.950
530found 6 outliers among 100 samples (6.0%)
531  3 (3.0%) high mild
532  3 (3.0%) high severe
533variance introduced by outliers: 0.990%
534variance is unaffected by outliers
535
536benchmarking f/ghc
537collecting 100 samples, 41239 iterations each, in estimated 1.369773 s
538bootstrapping with 100000 resamples
539mean: 337.9204 ns, lb 335.4167 ns, ub 347.1712 ns, ci 0.950
540std dev: 21.38501 ns, lb 4.944687 ns, ub 48.33959 ns, ci 0.950
541found 14 outliers among 100 samples (14.0%)
542  3 (3.0%) high mild
543  10 (10.0%) high severe
544variance introduced by outliers: 1.000%
545variance is unaffected by outliers
546
547benchmarking f/ghc'
548collecting 100 samples, 27288 iterations each, in estimated 1.369811 s
549bootstrapping with 100000 resamples
550mean: 501.2798 ns, lb 500.9596 ns, ub 501.7470 ns, ci 0.950
551std dev: 1.960630 ns, lb 1.479331 ns, ub 2.827376 ns, ci 0.950
552found 7 outliers among 100 samples (7.0%)
553  3 (3.0%) high mild
554  4 (4.0%) high severe
555variance introduced by outliers: 0.990%
556variance is unaffected by outliers
557
558benchmarking f/ghc''
559collecting 100 samples, 38820 iterations each, in estimated 1.369797 s
560bootstrapping with 100000 resamples
561mean: 372.5777 ns, lb 360.3532 ns, ub 391.7289 ns, ci 0.950
562std dev: 77.57376 ns, lb 57.64774 ns, ub 122.6602 ns, ci 0.950
563found 20 outliers among 100 samples (20.0%)
564  4 (4.0%) high mild
565  16 (16.0%) high severe
566variance introduced by outliers: 1.000%
567variance is unaffected by outliers
568
569benchmarking f/ghc'''
570collecting 100 samples, 40965 iterations each, in estimated 1.369793 s
571bootstrapping with 100000 resamples
572mean: 335.6815 ns, lb 335.3254 ns, ub 336.4436 ns, ci 0.950
573std dev: 2.532700 ns, lb 1.415577 ns, ub 4.435225 ns, ci 0.950
574found 12 outliers among 100 samples (12.0%)
575  5 (5.0%) high mild
576  7 (7.0%) high severe
577variance introduced by outliers: 0.990%
578variance is unaffected by outliers
579
580benchmarking f/ffi'
581collecting 100 samples, 40870 iterations each, in estimated 1.369783 s
582bootstrapping with 100000 resamples
583mean: 334.3478 ns, lb 333.0262 ns, ub 337.7899 ns, ci 0.950
584std dev: 9.539132 ns, lb 467.2181 ps, ub 18.75929 ns, ci 0.950
585found 7 outliers among 100 samples (7.0%)
586  4 (4.0%) high mild
587  3 (3.0%) high severe
588variance introduced by outliers: 0.998%
589variance is unaffected by outliers
590
591benchmarking f/ffi
592collecting 100 samples, 40637 iterations each, in estimated 1.369794 s
593bootstrapping with 100000 resamples
594mean: 338.0487 ns, lb 336.0664 ns, ub 341.8975 ns, ci 0.950
595std dev: 13.68011 ns, lb 7.914291 ns, ub 21.13930 ns, ci 0.950
596found 17 outliers among 100 samples (17.0%)
597  6 (6.0%) high mild
598  11 (11.0%) high severe
599variance introduced by outliers: 0.999%
600variance is unaffected by outliers
601
602benchmarking v/ghc
603collecting 100 samples, 41070 iterations each, in estimated 1.369792 s
604bootstrapping with 100000 resamples
605mean: 333.9703 ns, lb 333.8149 ns, ub 334.1728 ns, ci 0.950
606std dev: 899.6965 ps, lb 721.6719 ps, ub 1.104448 ns, ci 0.950
607found 10 outliers among 100 samples (10.0%)
608  5 (5.0%) high mild
609  5 (5.0%) high severe
610variance introduced by outliers: 0.990%
611variance is unaffected by outliers
612
613benchmarking v/ghc'
614collecting 100 samples, 41092 iterations each, in estimated 1.369779 s
615bootstrapping with 100000 resamples
616mean: 333.9760 ns, lb 333.8852 ns, ub 334.1067 ns, ci 0.950
617std dev: 552.7317 ps, lb 419.8846 ps, ub 750.3200 ps, ci 0.950
618found 12 outliers among 100 samples (12.0%)
619  7 (7.0%) high mild
620  5 (5.0%) high severe
621variance introduced by outliers: 0.990%
622variance is unaffected by outliers
623
624benchmarking v/ghc''
625collecting 100 samples, 41042 iterations each, in estimated 1.369799 s
626bootstrapping with 100000 resamples
627mean: 338.5002 ns, lb 336.3046 ns, ub 343.6349 ns, ci 0.950
628std dev: 16.27087 ns, lb 8.114121 ns, ub 31.45278 ns, ci 0.950
629found 19 outliers among 100 samples (19.0%)
630  2 (2.0%) high mild
631  17 (17.0%) high severe
632variance introduced by outliers: 0.999%
633variance is unaffected by outliers
634
635benchmarking v/ghc'''
636collecting 100 samples, 40771 iterations each, in estimated 1.369772 s
637bootstrapping with 100000 resamples
638mean: 333.4159 ns, lb 333.2882 ns, ub 333.6020 ns, ci 0.950
639std dev: 780.9862 ps, lb 586.9756 ps, ub 1.082490 ns, ci 0.950
640found 7 outliers among 100 samples (7.0%)
641  3 (3.0%) high mild
642  4 (4.0%) high severe
643variance introduced by outliers: 0.990%
644variance is unaffected by outliers
645
646benchmarking v/ffi'
647collecting 100 samples, 40816 iterations each, in estimated 1.369785 s
648bootstrapping with 100000 resamples
649mean: 334.2612 ns, lb 334.0264 ns, ub 334.5600 ns, ci 0.950
650std dev: 1.350690 ns, lb 1.114956 ns, ub 1.636520 ns, ci 0.950
651found 8 outliers among 100 samples (8.0%)
652  8 (8.0%) high mild
653variance introduced by outliers: 0.990%
654variance is unaffected by outliers
655
656benchmarking v/ffi
657collecting 100 samples, 41029 iterations each, in estimated 1.369798 s
658bootstrapping with 100000 resamples
659mean: 334.3927 ns, lb 334.2452 ns, ub 334.6069 ns, ci 0.950
660std dev: 898.4338 ps, lb 679.2847 ps, ub 1.194989 ns, ci 0.950
661found 9 outliers among 100 samples (9.0%)
662  5 (5.0%) high mild
663  4 (4.0%) high severe
664variance introduced by outliers: 0.990%
665variance is unaffected by outliers
666
667benchmarking xa0/ghc
668collecting 100 samples, 41055 iterations each, in estimated 1.369800 s
669bootstrapping with 100000 resamples
670mean: 337.2105 ns, lb 335.5540 ns, ub 340.9900 ns, ci 0.950
671std dev: 12.18136 ns, lb 5.526050 ns, ub 20.72076 ns, ci 0.950
672found 16 outliers among 100 samples (16.0%)
673  6 (6.0%) high mild
674  10 (10.0%) high severe
675variance introduced by outliers: 0.999%
676variance is unaffected by outliers
677
678benchmarking xa0/ghc'
679collecting 100 samples, 41225 iterations each, in estimated 1.369803 s
680bootstrapping with 100000 resamples
681mean: 333.3973 ns, lb 333.2588 ns, ub 333.6612 ns, ci 0.950
682std dev: 946.4621 ps, lb 581.3513 ps, ub 1.607080 ns, ci 0.950
683found 10 outliers among 100 samples (10.0%)
684  6 (6.0%) high mild
685  4 (4.0%) high severe
686variance introduced by outliers: 0.990%
687variance is unaffected by outliers
688
689benchmarking xa0/ghc''
690collecting 100 samples, 40871 iterations each, in estimated 1.369772 s
691bootstrapping with 100000 resamples
692mean: 334.4555 ns, lb 333.1125 ns, ub 337.9793 ns, ci 0.950
693std dev: 9.782277 ns, lb 804.0550 ps, ub 19.86414 ns, ci 0.950
694found 10 outliers among 100 samples (10.0%)
695  5 (5.0%) high mild
696  5 (5.0%) high severe
697variance introduced by outliers: 0.998%
698variance is unaffected by outliers
699
700benchmarking xa0/ghc'''
701collecting 100 samples, 41051 iterations each, in estimated 1.369786 s
702bootstrapping with 100000 resamples
703mean: 332.4284 ns, lb 332.3365 ns, ub 332.5897 ns, ci 0.950
704std dev: 606.3422 ps, lb 410.3725 ps, ub 1.075444 ns, ci 0.950
705found 7 outliers among 100 samples (7.0%)
706  4 (4.0%) high mild
707  3 (3.0%) high severe
708variance introduced by outliers: 0.990%
709variance is unaffected by outliers
710
711benchmarking xa0/ffi'
712collecting 100 samples, 40941 iterations each, in estimated 1.369794 s
713bootstrapping with 100000 resamples
714mean: 337.1041 ns, lb 335.7040 ns, ub 339.7735 ns, ci 0.950
715std dev: 9.568360 ns, lb 5.813967 ns, ub 14.63197 ns, ci 0.950
716found 16 outliers among 100 samples (16.0%)
717  5 (5.0%) high mild
718  11 (11.0%) high severe
719variance introduced by outliers: 0.998%
720variance is unaffected by outliers
721
722benchmarking xa0/ffi
723collecting 100 samples, 40844 iterations each, in estimated 1.369803 s
724bootstrapping with 100000 resamples
725mean: 336.3716 ns, lb 336.1813 ns, ub 336.6395 ns, ci 0.950
726std dev: 1.148115 ns, lb 861.7941 ps, ub 1.517364 ns, ci 0.950
727found 10 outliers among 100 samples (10.0%)
728  3 (3.0%) high mild
729  6 (6.0%) high severe
730variance introduced by outliers: 0.990%
731variance is unaffected by outliers
732
733benchmarking xff/ghc
734collecting 100 samples, 40926 iterations each, in estimated 1.369799 s
735bootstrapping with 100000 resamples
736mean: 339.4825 ns, lb 336.9846 ns, ub 343.7930 ns, ci 0.950
737std dev: 16.52336 ns, lb 10.80402 ns, ub 23.24877 ns, ci 0.950
738found 8 outliers among 100 samples (8.0%)
739  8 (8.0%) high severe
740variance introduced by outliers: 0.999%
741variance is unaffected by outliers
742
743benchmarking xff/ghc'
744collecting 100 samples, 40961 iterations each, in estimated 1.369778 s
745bootstrapping with 100000 resamples
746mean: 334.8707 ns, lb 334.7014 ns, ub 335.1143 ns, ci 0.950
747std dev: 1.029057 ns, lb 766.8710 ps, ub 1.387869 ns, ci 0.950
748found 8 outliers among 100 samples (8.0%)
749  3 (3.0%) high mild
750  5 (5.0%) high severe
751variance introduced by outliers: 0.990%
752variance is unaffected by outliers
753
754benchmarking xff/ghc''
755collecting 100 samples, 40771 iterations each, in estimated 1.369787 s
756bootstrapping with 100000 resamples
757mean: 335.9241 ns, lb 334.4623 ns, ub 339.5979 ns, ci 0.950
758std dev: 10.42524 ns, lb 937.4611 ps, ub 19.11416 ns, ci 0.950
759found 9 outliers among 100 samples (9.0%)
760  8 (8.0%) high severe
761variance introduced by outliers: 0.998%
762variance is unaffected by outliers
763
764benchmarking xff/ghc'''
765collecting 100 samples, 41025 iterations each, in estimated 1.369784 s
766bootstrapping with 100000 resamples
767mean: 334.5904 ns, lb 334.4362 ns, ub 334.8287 ns, ci 0.950
768std dev: 964.6287 ps, lb 681.0348 ps, ub 1.319471 ns, ci 0.950
769found 7 outliers among 100 samples (7.0%)
770  6 (6.0%) high severe
771variance introduced by outliers: 0.990%
772variance is unaffected by outliers
773
774benchmarking xff/ffi'
775collecting 100 samples, 40703 iterations each, in estimated 1.369798 s
776bootstrapping with 100000 resamples
777mean: 338.0728 ns, lb 336.4829 ns, ub 341.8242 ns, ci 0.950
778std dev: 12.24461 ns, lb 5.463051 ns, ub 20.68281 ns, ci 0.950
779found 4 outliers among 100 samples (4.0%)
780  3 (3.0%) high severe
781variance introduced by outliers: 0.999%
782variance is unaffected by outliers
783
784benchmarking xff/ffi
785collecting 100 samples, 40974 iterations each, in estimated 1.369780 s
786bootstrapping with 100000 resamples
787mean: 334.7298 ns, lb 334.6585 ns, ub 334.8111 ns, ci 0.950
788std dev: 389.1930 ps, lb 337.8143 ps, ub 450.1513 ps, ci 0.950
789found 5 outliers among 100 samples (5.0%)
790  5 (5.0%) high mild
791variance introduced by outliers: 0.990%
792variance is unaffected by outliers