# Ticket #1473: fifth-run.txt

File fifth-run.txt, 29.5 KB (added by guest, 6 years ago) |
---|

Line | |
---|---|

1 | +++ OK, passed 10000 tests. |

2 | warming up |

3 | estimating clock resolution... |

4 | mean is 13.69772 us (40001 iterations) |

5 | found 796 outliers among 39999 samples (2.0%) |

6 | 693 (1.7%) high severe |

7 | estimating cost of a clock call... |

8 | mean is 292.8680 ns (86 iterations) |

9 | found 3 outliers among 86 samples (3.5%) |

10 | 3 (3.5%) high severe |

11 | |

12 | benchmarking random/ghc |

13 | collecting 100 samples, 41239 iterations each, in estimated 1.369773 s |

14 | bootstrapping with 100000 resamples |

15 | mean: 333.1579 ns, lb 332.5237 ns, ub 334.3738 ns, ci 0.950 |

16 | std dev: 4.388565 ns, lb 2.443628 ns, ub 6.576465 ns, ci 0.950 |

17 | found 12 outliers among 100 samples (12.0%) |

18 | 6 (6.0%) high mild |

19 | 6 (6.0%) high severe |

20 | variance introduced by outliers: 0.991% |

21 | variance is unaffected by outliers |

22 | |

23 | benchmarking random/ghc' |

24 | collecting 100 samples, 41551 iterations each, in estimated 1.369797 s |

25 | bootstrapping with 100000 resamples |

26 | mean: 469.3658 ns, lb 455.7159 ns, ub 480.1615 ns, ci 0.950 |

27 | std dev: 61.62991 ns, lb 50.21117 ns, ub 71.71410 ns, ci 0.950 |

28 | found 23 outliers among 100 samples (23.0%) |

29 | 17 (17.0%) low severe |

30 | 3 (3.0%) high mild |

31 | 3 (3.0%) high severe |

32 | variance introduced by outliers: 1.000% |

33 | variance is unaffected by outliers |

34 | |

35 | benchmarking random/ghc'' |

36 | collecting 100 samples, 27573 iterations each, in estimated 1.369813 s |

37 | bootstrapping with 100000 resamples |

38 | mean: 497.7853 ns, lb 497.3555 ns, ub 499.4616 ns, ci 0.950 |

39 | std dev: 3.841733 ns, lb 804.8691 ps, ub 8.983406 ns, ci 0.950 |

40 | found 5 outliers among 100 samples (5.0%) |

41 | 3 (3.0%) high mild |

42 | 2 (2.0%) high severe |

43 | variance introduced by outliers: 0.990% |

44 | variance is unaffected by outliers |

45 | |

46 | benchmarking random/ghc''' |

47 | collecting 100 samples, 27554 iterations each, in estimated 1.369791 s |

48 | bootstrapping with 100000 resamples |

49 | mean: 498.0933 ns, lb 497.6616 ns, ub 499.6958 ns, ci 0.950 |

50 | std dev: 3.796600 ns, lb 926.4635 ps, ub 8.774292 ns, ci 0.950 |

51 | found 9 outliers among 100 samples (9.0%) |

52 | 3 (3.0%) low mild |

53 | 2 (2.0%) high mild |

54 | 4 (4.0%) high severe |

55 | variance introduced by outliers: 0.990% |

56 | variance is unaffected by outliers |

57 | |

58 | benchmarking random/ffi' |

59 | collecting 100 samples, 41320 iterations each, in estimated 1.369803 s |

60 | bootstrapping with 100000 resamples |

61 | mean: 331.7183 ns, lb 331.6255 ns, ub 331.8607 ns, ci 0.950 |

62 | std dev: 577.7277 ps, lb 410.3072 ps, ub 841.6733 ps, ci 0.950 |

63 | found 6 outliers among 100 samples (6.0%) |

64 | 2 (2.0%) high mild |

65 | 4 (4.0%) high severe |

66 | variance introduced by outliers: 0.990% |

67 | variance is unaffected by outliers |

68 | |

69 | benchmarking random/ffi |

70 | collecting 100 samples, 41143 iterations each, in estimated 1.369772 s |

71 | bootstrapping with 100000 resamples |

72 | mean: 331.6409 ns, lb 331.5586 ns, ub 331.7528 ns, ci 0.950 |

73 | std dev: 489.5827 ps, lb 385.1928 ps, ub 651.0954 ps, ci 0.950 |

74 | found 10 outliers among 100 samples (10.0%) |

75 | 7 (7.0%) high mild |

76 | 3 (3.0%) high severe |

77 | variance introduced by outliers: 0.990% |

78 | variance is unaffected by outliers |

79 | |

80 | benchmarking shakespeare/ghc-dryrun |

81 | collecting 100 samples, 1 iterations each, in estimated 200.0631 s |

82 | bootstrapping with 100000 resamples |

83 | mean: 981.7819 ms, lb 949.2342 ms, ub 1.010001 s, ci 0.950 |

84 | std dev: 155.0204 ms, lb 138.1863 ms, ub 167.5609 ms, ci 0.950 |

85 | variance introduced by outliers: 2.999% |

86 | variance is slightly inflated by outliers |

87 | |

88 | benchmarking shakespeare/ghc-dryrun |

89 | collecting 100 samples, 1 iterations each, in estimated 103.5126 s |

90 | bootstrapping with 100000 resamples |

91 | mean: 1.064981 s, lb 1.064321 s, ub 1.065444 s, ci 0.950 |

92 | std dev: 2.780338 ms, lb 1.728770 ms, ub 4.897888 ms, ci 0.950 |

93 | found 6 outliers among 100 samples (6.0%) |

94 | 1 (1.0%) low severe |

95 | 4 (4.0%) high severe |

96 | variance introduced by outliers: 0.990% |

97 | variance is unaffected by outliers |

98 | |

99 | benchmarking shakespeare/ghc |

100 | collecting 100 samples, 1 iterations each, in estimated 104.9579 s |

101 | bootstrapping with 100000 resamples |

102 | mean: 1.041066 s, lb 1.039274 s, ub 1.043777 s, ci 0.950 |

103 | std dev: 11.23228 ms, lb 8.244467 ms, ub 15.49020 ms, ci 0.950 |

104 | found 20 outliers among 100 samples (20.0%) |

105 | 2 (2.0%) high mild |

106 | 18 (18.0%) high severe |

107 | variance introduced by outliers: 0.990% |

108 | variance is unaffected by outliers |

109 | |

110 | benchmarking shakespeare/ghc' |

111 | collecting 100 samples, 1 iterations each, in estimated 70.24450 s |

112 | bootstrapping with 100000 resamples |

113 | mean: 686.9629 ms, lb 686.2021 ms, ub 688.0309 ms, ci 0.950 |

114 | std dev: 4.593568 ms, lb 3.582164 ms, ub 6.143645 ms, ci 0.950 |

115 | found 12 outliers among 100 samples (12.0%) |

116 | 8 (8.0%) high mild |

117 | 4 (4.0%) high severe |

118 | variance introduced by outliers: 0.990% |

119 | variance is unaffected by outliers |

120 | |

121 | benchmarking shakespeare/ghc'' |

122 | collecting 100 samples, 1 iterations each, in estimated 69.74661 s |

123 | bootstrapping with 100000 resamples |

124 | mean: 686.6314 ms, lb 685.8547 ms, ub 687.6162 ms, ci 0.950 |

125 | std dev: 4.458797 ms, lb 3.658333 ms, ub 5.597150 ms, ci 0.950 |

126 | found 7 outliers among 100 samples (7.0%) |

127 | 5 (5.0%) high mild |

128 | 2 (2.0%) high severe |

129 | variance introduced by outliers: 0.990% |

130 | variance is unaffected by outliers |

131 | |

132 | benchmarking shakespeare/ghc''' |

133 | collecting 100 samples, 1 iterations each, in estimated 71.01040 s |

134 | bootstrapping with 100000 resamples |

135 | mean: 692.4435 ms, lb 686.2218 ms, ub 694.2697 ms, ci 0.950 |

136 | std dev: 15.65698 ms, lb 4.611371 ms, ub 35.65417 ms, ci 0.950 |

137 | found 20 outliers among 100 samples (20.0%) |

138 | 2 (2.0%) low severe |

139 | 9 (9.0%) high mild |

140 | 9 (9.0%) high severe |

141 | variance introduced by outliers: 0.997% |

142 | variance is unaffected by outliers |

143 | |

144 | benchmarking shakespeare/ffi' |

145 | collecting 100 samples, 1 iterations each, in estimated 85.82368 s |

146 | bootstrapping with 100000 resamples |

147 | mean: 603.1230 ms, lb 594.0248 ms, ub 618.2545 ms, ci 0.950 |

148 | std dev: 59.21260 ms, lb 38.34971 ms, ub 83.61235 ms, ci 0.950 |

149 | found 14 outliers among 100 samples (14.0%) |

150 | 13 (13.0%) high severe |

151 | variance introduced by outliers: 1.000% |

152 | variance is unaffected by outliers |

153 | |

154 | benchmarking shakespeare/ghc |

155 | collecting 100 samples, 41315 iterations each, in estimated 1.369772 s |

156 | bootstrapping with 100000 resamples |

157 | mean: 338.4810 ns, lb 334.3166 ns, ub 353.1995 ns, ci 0.950 |

158 | std dev: 35.32359 ns, lb 9.265119 ns, ub 79.63561 ns, ci 0.950 |

159 | found 14 outliers among 100 samples (14.0%) |

160 | 4 (4.0%) high mild |

161 | 10 (10.0%) high severe |

162 | variance introduced by outliers: 1.000% |

163 | variance is unaffected by outliers |

164 | |

165 | benchmarking shakespeare/ghc' |

166 | collecting 100 samples, 41155 iterations each, in estimated 1.369798 s |

167 | bootstrapping with 100000 resamples |

168 | mean: 332.1048 ns, lb 331.9790 ns, ub 332.2854 ns, ci 0.950 |

169 | std dev: 765.8919 ps, lb 585.8790 ps, ub 1.070964 ns, ci 0.950 |

170 | found 8 outliers among 100 samples (8.0%) |

171 | 5 (5.0%) high mild |

172 | 3 (3.0%) high severe |

173 | variance introduced by outliers: 0.990% |

174 | variance is unaffected by outliers |

175 | |

176 | benchmarking shakespeare/ghc'' |

177 | collecting 100 samples, 41226 iterations each, in estimated 1.369776 s |

178 | bootstrapping with 100000 resamples |

179 | mean: 334.2687 ns, lb 332.4581 ns, ub 337.8608 ns, ci 0.950 |

180 | std dev: 12.55083 ns, lb 7.313125 ns, ub 19.44991 ns, ci 0.950 |

181 | found 9 outliers among 100 samples (9.0%) |

182 | 4 (4.0%) high mild |

183 | 5 (5.0%) high severe |

184 | variance introduced by outliers: 0.999% |

185 | variance is unaffected by outliers |

186 | |

187 | benchmarking shakespeare/ghc''' |

188 | collecting 100 samples, 41077 iterations each, in estimated 1.369772 s |

189 | bootstrapping with 100000 resamples |

190 | mean: 433.5087 ns, lb 416.6793 ns, ub 449.7423 ns, ci 0.950 |

191 | std dev: 85.13032 ns, lb 79.80841 ns, ub 99.73477 ns, ci 0.950 |

192 | variance introduced by outliers: 1.000% |

193 | variance is unaffected by outliers |

194 | |

195 | benchmarking shakespeare/ffi' |

196 | collecting 100 samples, 41272 iterations each, in estimated 1.369788 s |

197 | bootstrapping with 100000 resamples |

198 | mean: 332.3381 ns, lb 331.9996 ns, ub 333.0213 ns, ci 0.950 |

199 | std dev: 2.372903 ns, lb 1.336829 ns, ub 3.899541 ns, ci 0.950 |

200 | found 8 outliers among 100 samples (8.0%) |

201 | 2 (2.0%) high mild |

202 | 6 (6.0%) high severe |

203 | variance introduced by outliers: 0.990% |

204 | variance is unaffected by outliers |

205 | |

206 | benchmarking shakespeare/ffi |

207 | collecting 100 samples, 41098 iterations each, in estimated 1.369784 s |

208 | bootstrapping with 100000 resamples |

209 | mean: 332.7634 ns, lb 332.6404 ns, ub 332.9465 ns, ci 0.950 |

210 | std dev: 760.3509 ps, lb 559.5263 ps, ub 1.054961 ns, ci 0.950 |

211 | found 7 outliers among 100 samples (7.0%) |

212 | 6 (6.0%) high severe |

213 | variance introduced by outliers: 0.990% |

214 | variance is unaffected by outliers |

215 | |

216 | benchmarking space/ghc |

217 | collecting 100 samples, 27383 iterations each, in estimated 1.369818 s |

218 | bootstrapping with 100000 resamples |

219 | mean: 341.1159 ns, lb 337.6547 ns, ub 347.3481 ns, ci 0.950 |

220 | std dev: 23.02116 ns, lb 14.35589 ns, ub 33.96971 ns, ci 0.950 |

221 | found 7 outliers among 100 samples (7.0%) |

222 | 6 (6.0%) high severe |

223 | variance introduced by outliers: 1.000% |

224 | variance is unaffected by outliers |

225 | |

226 | benchmarking space/ghc' |

227 | collecting 100 samples, 40952 iterations each, in estimated 1.369790 s |

228 | bootstrapping with 100000 resamples |

229 | mean: 332.5430 ns, lb 332.3740 ns, ub 332.7751 ns, ci 0.950 |

230 | std dev: 1.003460 ns, lb 784.1002 ps, ub 1.328784 ns, ci 0.950 |

231 | found 9 outliers among 100 samples (9.0%) |

232 | 5 (5.0%) high mild |

233 | 4 (4.0%) high severe |

234 | variance introduced by outliers: 0.990% |

235 | variance is unaffected by outliers |

236 | |

237 | benchmarking space/ghc'' |

238 | collecting 100 samples, 27329 iterations each, in estimated 1.369781 s |

239 | bootstrapping with 100000 resamples |

240 | mean: 498.1327 ns, lb 497.9117 ns, ub 498.5072 ns, ci 0.950 |

241 | std dev: 1.441409 ns, lb 984.6865 ps, ub 2.405484 ns, ci 0.950 |

242 | found 6 outliers among 100 samples (6.0%) |

243 | 3 (3.0%) high mild |

244 | 3 (3.0%) high severe |

245 | variance introduced by outliers: 0.990% |

246 | variance is unaffected by outliers |

247 | |

248 | benchmarking space/ghc''' |

249 | collecting 100 samples, 27444 iterations each, in estimated 1.369774 s |

250 | bootstrapping with 100000 resamples |

251 | mean: 500.0428 ns, lb 499.8225 ns, ub 500.3591 ns, ci 0.950 |

252 | std dev: 1.336651 ns, lb 996.9317 ps, ub 1.734112 ns, ci 0.950 |

253 | found 7 outliers among 100 samples (7.0%) |

254 | 7 (7.0%) high severe |

255 | variance introduced by outliers: 0.990% |

256 | variance is unaffected by outliers |

257 | |

258 | benchmarking space/ffi' |

259 | collecting 100 samples, 27396 iterations each, in estimated 1.369810 s |

260 | bootstrapping with 100000 resamples |

261 | mean: 503.8238 ns, lb 501.8268 ns, ub 511.2993 ns, ci 0.950 |

262 | std dev: 17.14070 ns, lb 4.608505 ns, ub 39.13309 ns, ci 0.950 |

263 | found 12 outliers among 100 samples (12.0%) |

264 | 3 (3.0%) high mild |

265 | 8 (8.0%) high severe |

266 | variance introduced by outliers: 0.999% |

267 | variance is unaffected by outliers |

268 | |

269 | benchmarking space/ffi |

270 | collecting 100 samples, 27534 iterations each, in estimated 1.369819 s |

271 | bootstrapping with 100000 resamples |

272 | mean: 508.2465 ns, lb 504.5353 ns, ub 516.7141 ns, ci 0.950 |

273 | std dev: 27.41531 ns, lb 14.96258 ns, ub 50.49213 ns, ci 0.950 |

274 | found 14 outliers among 100 samples (14.0%) |

275 | 5 (5.0%) high mild |

276 | 9 (9.0%) high severe |

277 | variance introduced by outliers: 0.999% |

278 | variance is unaffected by outliers |

279 | |

280 | benchmarking b/ghc |

281 | collecting 100 samples, 27215 iterations each, in estimated 1.369810 s |

282 | bootstrapping with 100000 resamples |

283 | mean: 500.9332 ns, lb 500.6914 ns, ub 501.2853 ns, ci 0.950 |

284 | std dev: 1.475711 ns, lb 1.107208 ns, ub 1.998438 ns, ci 0.950 |

285 | found 9 outliers among 100 samples (9.0%) |

286 | 4 (4.0%) high mild |

287 | 5 (5.0%) high severe |

288 | variance introduced by outliers: 0.990% |

289 | variance is unaffected by outliers |

290 | |

291 | benchmarking b/ghc' |

292 | collecting 100 samples, 27230 iterations each, in estimated 1.369812 s |

293 | bootstrapping with 100000 resamples |

294 | mean: 500.6668 ns, lb 500.4722 ns, ub 500.9640 ns, ci 0.950 |

295 | std dev: 1.216264 ns, lb 915.0519 ps, ub 1.869807 ns, ci 0.950 |

296 | found 6 outliers among 100 samples (6.0%) |

297 | 3 (3.0%) high mild |

298 | 3 (3.0%) high severe |

299 | variance introduced by outliers: 0.990% |

300 | variance is unaffected by outliers |

301 | |

302 | benchmarking b/ghc'' |

303 | collecting 100 samples, 27397 iterations each, in estimated 1.369781 s |

304 | bootstrapping with 100000 resamples |

305 | mean: 503.2574 ns, lb 501.4749 ns, ub 509.1463 ns, ci 0.950 |

306 | std dev: 14.71995 ns, lb 4.839170 ns, ub 32.60113 ns, ci 0.950 |

307 | found 9 outliers among 100 samples (9.0%) |

308 | 5 (5.0%) high mild |

309 | 4 (4.0%) high severe |

310 | variance introduced by outliers: 0.998% |

311 | variance is unaffected by outliers |

312 | |

313 | benchmarking b/ghc''' |

314 | collecting 100 samples, 27303 iterations each, in estimated 1.369809 s |

315 | bootstrapping with 100000 resamples |

316 | mean: 502.8211 ns, lb 502.5033 ns, ub 503.2852 ns, ci 0.950 |

317 | std dev: 1.949601 ns, lb 1.448389 ns, ub 2.643464 ns, ci 0.950 |

318 | found 9 outliers among 100 samples (9.0%) |

319 | 7 (7.0%) high severe |

320 | variance introduced by outliers: 0.990% |

321 | variance is unaffected by outliers |

322 | |

323 | benchmarking b/ffi' |

324 | collecting 100 samples, 27476 iterations each, in estimated 1.369772 s |

325 | bootstrapping with 100000 resamples |

326 | mean: 505.1542 ns, lb 503.4344 ns, ub 513.3778 ns, ci 0.950 |

327 | std dev: 16.59454 ns, lb 988.5598 ps, ub 39.53829 ns, ci 0.950 |

328 | found 7 outliers among 100 samples (7.0%) |

329 | 3 (3.0%) high mild |

330 | 3 (3.0%) high severe |

331 | variance introduced by outliers: 0.999% |

332 | variance is unaffected by outliers |

333 | |

334 | benchmarking b/ffi |

335 | collecting 100 samples, 27316 iterations each, in estimated 1.369805 s |

336 | bootstrapping with 100000 resamples |

337 | mean: 511.6558 ns, lb 508.5475 ns, ub 517.5280 ns, ci 0.950 |

338 | std dev: 21.22834 ns, lb 12.81618 ns, ub 32.46103 ns, ci 0.950 |

339 | found 11 outliers among 100 samples (11.0%) |

340 | 6 (6.0%) high mild |

341 | 5 (5.0%) high severe |

342 | variance introduced by outliers: 0.999% |

343 | variance is unaffected by outliers |

344 | |

345 | benchmarking t/ghc |

346 | collecting 100 samples, 27227 iterations each, in estimated 1.369819 s |

347 | bootstrapping with 100000 resamples |

348 | mean: 503.6257 ns, lb 502.2820 ns, ub 508.9651 ns, ci 0.950 |

349 | std dev: 12.16792 ns, lb 2.166762 ns, ub 28.53332 ns, ci 0.950 |

350 | found 15 outliers among 100 samples (15.0%) |

351 | 7 (7.0%) high mild |

352 | 8 (8.0%) high severe |

353 | variance introduced by outliers: 0.997% |

354 | variance is unaffected by outliers |

355 | |

356 | benchmarking t/ghc' |

357 | collecting 100 samples, 27339 iterations each, in estimated 1.369785 s |

358 | bootstrapping with 100000 resamples |

359 | mean: 503.2893 ns, lb 502.8465 ns, ub 503.8395 ns, ci 0.950 |

360 | std dev: 2.528691 ns, lb 2.126155 ns, ub 2.998347 ns, ci 0.950 |

361 | found 10 outliers among 100 samples (10.0%) |

362 | 10 (10.0%) high mild |

363 | variance introduced by outliers: 0.990% |

364 | variance is unaffected by outliers |

365 | |

366 | benchmarking t/ghc'' |

367 | collecting 100 samples, 26976 iterations each, in estimated 1.369792 s |

368 | bootstrapping with 100000 resamples |

369 | mean: 503.8722 ns, lb 503.3773 ns, ub 505.7597 ns, ci 0.950 |

370 | std dev: 4.372231 ns, lb 1.017249 ns, ub 10.12754 ns, ci 0.950 |

371 | found 6 outliers among 100 samples (6.0%) |

372 | 4 (4.0%) high mild |

373 | 2 (2.0%) high severe |

374 | variance introduced by outliers: 0.990% |

375 | variance is unaffected by outliers |

376 | |

377 | benchmarking t/ghc''' |

378 | collecting 100 samples, 27251 iterations each, in estimated 1.369778 s |

379 | bootstrapping with 100000 resamples |

380 | mean: 504.2855 ns, lb 504.0724 ns, ub 504.5973 ns, ci 0.950 |

381 | std dev: 1.305339 ns, lb 954.5595 ps, ub 1.887825 ns, ci 0.950 |

382 | found 12 outliers among 100 samples (12.0%) |

383 | 8 (8.0%) high mild |

384 | 3 (3.0%) high severe |

385 | variance introduced by outliers: 0.990% |

386 | variance is unaffected by outliers |

387 | |

388 | benchmarking t/ffi' |

389 | collecting 100 samples, 27369 iterations each, in estimated 1.369775 s |

390 | bootstrapping with 100000 resamples |

391 | mean: 505.1888 ns, lb 503.2085 ns, ub 509.8152 ns, ci 0.950 |

392 | std dev: 14.66735 ns, lb 7.621633 ns, ub 26.34629 ns, ci 0.950 |

393 | found 10 outliers among 100 samples (10.0%) |

394 | 3 (3.0%) high mild |

395 | 7 (7.0%) high severe |

396 | variance introduced by outliers: 0.998% |

397 | variance is unaffected by outliers |

398 | |

399 | benchmarking t/ffi |

400 | collecting 100 samples, 27316 iterations each, in estimated 1.369785 s |

401 | bootstrapping with 100000 resamples |

402 | mean: 512.4493 ns, lb 508.5384 ns, ub 520.6108 ns, ci 0.950 |

403 | std dev: 27.77033 ns, lb 16.43621 ns, ub 50.97264 ns, ci 0.950 |

404 | found 19 outliers among 100 samples (19.0%) |

405 | 5 (5.0%) high mild |

406 | 14 (14.0%) high severe |

407 | variance introduced by outliers: 0.999% |

408 | variance is unaffected by outliers |

409 | |

410 | benchmarking n/ghc |

411 | collecting 100 samples, 27225 iterations each, in estimated 1.369818 s |

412 | bootstrapping with 100000 resamples |

413 | mean: 511.9607 ns, lb 508.2564 ns, ub 520.1800 ns, ci 0.950 |

414 | std dev: 26.93237 ns, lb 14.79747 ns, ub 49.34191 ns, ci 0.950 |

415 | found 14 outliers among 100 samples (14.0%) |

416 | 6 (6.0%) high mild |

417 | 8 (8.0%) high severe |

418 | variance introduced by outliers: 0.999% |

419 | variance is unaffected by outliers |

420 | |

421 | benchmarking n/ghc' |

422 | collecting 100 samples, 40997 iterations each, in estimated 1.369804 s |

423 | bootstrapping with 100000 resamples |

424 | mean: 337.2034 ns, lb 336.6752 ns, ub 338.1807 ns, ci 0.950 |

425 | std dev: 3.564216 ns, lb 2.049871 ns, ub 5.286732 ns, ci 0.950 |

426 | found 13 outliers among 100 samples (13.0%) |

427 | 7 (7.0%) high mild |

428 | 5 (5.0%) high severe |

429 | variance introduced by outliers: 0.990% |

430 | variance is unaffected by outliers |

431 | |

432 | benchmarking n/ghc'' |

433 | collecting 100 samples, 39989 iterations each, in estimated 1.369802 s |

434 | bootstrapping with 100000 resamples |

435 | mean: 388.7845 ns, lb 373.5949 ns, ub 407.1418 ns, ci 0.950 |

436 | std dev: 85.40236 ns, lb 74.49011 ns, ub 101.1783 ns, ci 0.950 |

437 | variance introduced by outliers: 1.000% |

438 | variance is unaffected by outliers |

439 | |

440 | benchmarking n/ghc''' |

441 | collecting 100 samples, 40468 iterations each, in estimated 1.369780 s |

442 | bootstrapping with 100000 resamples |

443 | mean: 335.3939 ns, lb 334.3418 ns, ub 338.5456 ns, ci 0.950 |

444 | std dev: 8.473106 ns, lb 3.424320 ns, ub 18.13350 ns, ci 0.950 |

445 | found 12 outliers among 100 samples (12.0%) |

446 | 4 (4.0%) high mild |

447 | 8 (8.0%) high severe |

448 | variance introduced by outliers: 0.998% |

449 | variance is unaffected by outliers |

450 | |

451 | benchmarking n/ffi' |

452 | collecting 100 samples, 40798 iterations each, in estimated 1.369804 s |

453 | bootstrapping with 100000 resamples |

454 | mean: 335.6690 ns, lb 335.5699 ns, ub 335.8764 ns, ci 0.950 |

455 | std dev: 704.5406 ps, lb 413.9430 ps, ub 1.352886 ns, ci 0.950 |

456 | found 7 outliers among 100 samples (7.0%) |

457 | 2 (2.0%) high mild |

458 | 5 (5.0%) high severe |

459 | variance introduced by outliers: 0.990% |

460 | variance is unaffected by outliers |

461 | |

462 | benchmarking n/ffi |

463 | collecting 100 samples, 40879 iterations each, in estimated 1.369787 s |

464 | bootstrapping with 100000 resamples |

465 | mean: 336.2930 ns, lb 335.9400 ns, ub 336.9649 ns, ci 0.950 |

466 | std dev: 2.417584 ns, lb 1.490113 ns, ub 3.889910 ns, ci 0.950 |

467 | found 11 outliers among 100 samples (11.0%) |

468 | 3 (3.0%) high mild |

469 | 8 (8.0%) high severe |

470 | variance introduced by outliers: 0.990% |

471 | variance is unaffected by outliers |

472 | |

473 | benchmarking r/ghc |

474 | collecting 100 samples, 41002 iterations each, in estimated 1.369777 s |

475 | bootstrapping with 100000 resamples |

476 | mean: 334.7913 ns, lb 334.7034 ns, ub 334.8862 ns, ci 0.950 |

477 | std dev: 471.1819 ps, lb 369.9792 ps, ub 638.6186 ps, ci 0.950 |

478 | found 10 outliers among 100 samples (10.0%) |

479 | 1 (1.0%) low severe |

480 | 7 (7.0%) high mild |

481 | 2 (2.0%) high severe |

482 | variance introduced by outliers: 0.990% |

483 | variance is unaffected by outliers |

484 | |

485 | benchmarking r/ghc' |

486 | collecting 100 samples, 35839 iterations each, in estimated 1.369775 s |

487 | bootstrapping with 100000 resamples |

488 | mean: 337.9553 ns, lb 335.9415 ns, ub 344.1225 ns, ci 0.950 |

489 | std dev: 16.22064 ns, lb 5.743097 ns, ub 35.18350 ns, ci 0.950 |

490 | found 13 outliers among 100 samples (13.0%) |

491 | 10 (10.0%) high mild |

492 | 3 (3.0%) high severe |

493 | variance introduced by outliers: 0.999% |

494 | variance is unaffected by outliers |

495 | |

496 | benchmarking r/ghc'' |

497 | collecting 100 samples, 41092 iterations each, in estimated 1.369779 s |

498 | bootstrapping with 100000 resamples |

499 | mean: 371.1476 ns, lb 359.0843 ns, ub 386.3012 ns, ci 0.950 |

500 | std dev: 68.89331 ns, lb 57.56173 ns, ub 79.83899 ns, ci 0.950 |

501 | found 24 outliers among 100 samples (24.0%) |

502 | 23 (23.0%) high severe |

503 | variance introduced by outliers: 1.000% |

504 | variance is unaffected by outliers |

505 | |

506 | benchmarking r/ghc''' |

507 | collecting 100 samples, 40886 iterations each, in estimated 1.369784 s |

508 | bootstrapping with 100000 resamples |

509 | mean: 336.3931 ns, lb 335.3998 ns, ub 339.5342 ns, ci 0.950 |

510 | std dev: 8.165020 ns, lb 3.062073 ns, ub 17.95257 ns, ci 0.950 |

511 | found 14 outliers among 100 samples (14.0%) |

512 | 3 (3.0%) high mild |

513 | 11 (11.0%) high severe |

514 | variance introduced by outliers: 0.997% |

515 | variance is unaffected by outliers |

516 | |

517 | benchmarking r/ffi' |

518 | collecting 100 samples, 27293 iterations each, in estimated 1.369804 s |

519 | bootstrapping with 100000 resamples |

520 | mean: 456.0534 ns, lb 439.6429 ns, ub 470.9500 ns, ci 0.950 |

521 | std dev: 80.21440 ns, lb 72.19903 ns, ub 86.49997 ns, ci 0.950 |

522 | variance introduced by outliers: 1.000% |

523 | variance is unaffected by outliers |

524 | |

525 | benchmarking r/ffi |

526 | collecting 100 samples, 41060 iterations each, in estimated 1.369773 s |

527 | bootstrapping with 100000 resamples |

528 | mean: 333.4649 ns, lb 333.3175 ns, ub 333.8073 ns, ci 0.950 |

529 | std dev: 1.087940 ns, lb 564.1312 ps, ub 2.185724 ns, ci 0.950 |

530 | found 6 outliers among 100 samples (6.0%) |

531 | 3 (3.0%) high mild |

532 | 3 (3.0%) high severe |

533 | variance introduced by outliers: 0.990% |

534 | variance is unaffected by outliers |

535 | |

536 | benchmarking f/ghc |

537 | collecting 100 samples, 41239 iterations each, in estimated 1.369773 s |

538 | bootstrapping with 100000 resamples |

539 | mean: 337.9204 ns, lb 335.4167 ns, ub 347.1712 ns, ci 0.950 |

540 | std dev: 21.38501 ns, lb 4.944687 ns, ub 48.33959 ns, ci 0.950 |

541 | found 14 outliers among 100 samples (14.0%) |

542 | 3 (3.0%) high mild |

543 | 10 (10.0%) high severe |

544 | variance introduced by outliers: 1.000% |

545 | variance is unaffected by outliers |

546 | |

547 | benchmarking f/ghc' |

548 | collecting 100 samples, 27288 iterations each, in estimated 1.369811 s |

549 | bootstrapping with 100000 resamples |

550 | mean: 501.2798 ns, lb 500.9596 ns, ub 501.7470 ns, ci 0.950 |

551 | std dev: 1.960630 ns, lb 1.479331 ns, ub 2.827376 ns, ci 0.950 |

552 | found 7 outliers among 100 samples (7.0%) |

553 | 3 (3.0%) high mild |

554 | 4 (4.0%) high severe |

555 | variance introduced by outliers: 0.990% |

556 | variance is unaffected by outliers |

557 | |

558 | benchmarking f/ghc'' |

559 | collecting 100 samples, 38820 iterations each, in estimated 1.369797 s |

560 | bootstrapping with 100000 resamples |

561 | mean: 372.5777 ns, lb 360.3532 ns, ub 391.7289 ns, ci 0.950 |

562 | std dev: 77.57376 ns, lb 57.64774 ns, ub 122.6602 ns, ci 0.950 |

563 | found 20 outliers among 100 samples (20.0%) |

564 | 4 (4.0%) high mild |

565 | 16 (16.0%) high severe |

566 | variance introduced by outliers: 1.000% |

567 | variance is unaffected by outliers |

568 | |

569 | benchmarking f/ghc''' |

570 | collecting 100 samples, 40965 iterations each, in estimated 1.369793 s |

571 | bootstrapping with 100000 resamples |

572 | mean: 335.6815 ns, lb 335.3254 ns, ub 336.4436 ns, ci 0.950 |

573 | std dev: 2.532700 ns, lb 1.415577 ns, ub 4.435225 ns, ci 0.950 |

574 | found 12 outliers among 100 samples (12.0%) |

575 | 5 (5.0%) high mild |

576 | 7 (7.0%) high severe |

577 | variance introduced by outliers: 0.990% |

578 | variance is unaffected by outliers |

579 | |

580 | benchmarking f/ffi' |

581 | collecting 100 samples, 40870 iterations each, in estimated 1.369783 s |

582 | bootstrapping with 100000 resamples |

583 | mean: 334.3478 ns, lb 333.0262 ns, ub 337.7899 ns, ci 0.950 |

584 | std dev: 9.539132 ns, lb 467.2181 ps, ub 18.75929 ns, ci 0.950 |

585 | found 7 outliers among 100 samples (7.0%) |

586 | 4 (4.0%) high mild |

587 | 3 (3.0%) high severe |

588 | variance introduced by outliers: 0.998% |

589 | variance is unaffected by outliers |

590 | |

591 | benchmarking f/ffi |

592 | collecting 100 samples, 40637 iterations each, in estimated 1.369794 s |

593 | bootstrapping with 100000 resamples |

594 | mean: 338.0487 ns, lb 336.0664 ns, ub 341.8975 ns, ci 0.950 |

595 | std dev: 13.68011 ns, lb 7.914291 ns, ub 21.13930 ns, ci 0.950 |

596 | found 17 outliers among 100 samples (17.0%) |

597 | 6 (6.0%) high mild |

598 | 11 (11.0%) high severe |

599 | variance introduced by outliers: 0.999% |

600 | variance is unaffected by outliers |

601 | |

602 | benchmarking v/ghc |

603 | collecting 100 samples, 41070 iterations each, in estimated 1.369792 s |

604 | bootstrapping with 100000 resamples |

605 | mean: 333.9703 ns, lb 333.8149 ns, ub 334.1728 ns, ci 0.950 |

606 | std dev: 899.6965 ps, lb 721.6719 ps, ub 1.104448 ns, ci 0.950 |

607 | found 10 outliers among 100 samples (10.0%) |

608 | 5 (5.0%) high mild |

609 | 5 (5.0%) high severe |

610 | variance introduced by outliers: 0.990% |

611 | variance is unaffected by outliers |

612 | |

613 | benchmarking v/ghc' |

614 | collecting 100 samples, 41092 iterations each, in estimated 1.369779 s |

615 | bootstrapping with 100000 resamples |

616 | mean: 333.9760 ns, lb 333.8852 ns, ub 334.1067 ns, ci 0.950 |

617 | std dev: 552.7317 ps, lb 419.8846 ps, ub 750.3200 ps, ci 0.950 |

618 | found 12 outliers among 100 samples (12.0%) |

619 | 7 (7.0%) high mild |

620 | 5 (5.0%) high severe |

621 | variance introduced by outliers: 0.990% |

622 | variance is unaffected by outliers |

623 | |

624 | benchmarking v/ghc'' |

625 | collecting 100 samples, 41042 iterations each, in estimated 1.369799 s |

626 | bootstrapping with 100000 resamples |

627 | mean: 338.5002 ns, lb 336.3046 ns, ub 343.6349 ns, ci 0.950 |

628 | std dev: 16.27087 ns, lb 8.114121 ns, ub 31.45278 ns, ci 0.950 |

629 | found 19 outliers among 100 samples (19.0%) |

630 | 2 (2.0%) high mild |

631 | 17 (17.0%) high severe |

632 | variance introduced by outliers: 0.999% |

633 | variance is unaffected by outliers |

634 | |

635 | benchmarking v/ghc''' |

636 | collecting 100 samples, 40771 iterations each, in estimated 1.369772 s |

637 | bootstrapping with 100000 resamples |

638 | mean: 333.4159 ns, lb 333.2882 ns, ub 333.6020 ns, ci 0.950 |

639 | std dev: 780.9862 ps, lb 586.9756 ps, ub 1.082490 ns, ci 0.950 |

640 | found 7 outliers among 100 samples (7.0%) |

641 | 3 (3.0%) high mild |

642 | 4 (4.0%) high severe |

643 | variance introduced by outliers: 0.990% |

644 | variance is unaffected by outliers |

645 | |

646 | benchmarking v/ffi' |

647 | collecting 100 samples, 40816 iterations each, in estimated 1.369785 s |

648 | bootstrapping with 100000 resamples |

649 | mean: 334.2612 ns, lb 334.0264 ns, ub 334.5600 ns, ci 0.950 |

650 | std dev: 1.350690 ns, lb 1.114956 ns, ub 1.636520 ns, ci 0.950 |

651 | found 8 outliers among 100 samples (8.0%) |

652 | 8 (8.0%) high mild |

653 | variance introduced by outliers: 0.990% |

654 | variance is unaffected by outliers |

655 | |

656 | benchmarking v/ffi |

657 | collecting 100 samples, 41029 iterations each, in estimated 1.369798 s |

658 | bootstrapping with 100000 resamples |

659 | mean: 334.3927 ns, lb 334.2452 ns, ub 334.6069 ns, ci 0.950 |

660 | std dev: 898.4338 ps, lb 679.2847 ps, ub 1.194989 ns, ci 0.950 |

661 | found 9 outliers among 100 samples (9.0%) |

662 | 5 (5.0%) high mild |

663 | 4 (4.0%) high severe |

664 | variance introduced by outliers: 0.990% |

665 | variance is unaffected by outliers |

666 | |

667 | benchmarking xa0/ghc |

668 | collecting 100 samples, 41055 iterations each, in estimated 1.369800 s |

669 | bootstrapping with 100000 resamples |

670 | mean: 337.2105 ns, lb 335.5540 ns, ub 340.9900 ns, ci 0.950 |

671 | std dev: 12.18136 ns, lb 5.526050 ns, ub 20.72076 ns, ci 0.950 |

672 | found 16 outliers among 100 samples (16.0%) |

673 | 6 (6.0%) high mild |

674 | 10 (10.0%) high severe |

675 | variance introduced by outliers: 0.999% |

676 | variance is unaffected by outliers |

677 | |

678 | benchmarking xa0/ghc' |

679 | collecting 100 samples, 41225 iterations each, in estimated 1.369803 s |

680 | bootstrapping with 100000 resamples |

681 | mean: 333.3973 ns, lb 333.2588 ns, ub 333.6612 ns, ci 0.950 |

682 | std dev: 946.4621 ps, lb 581.3513 ps, ub 1.607080 ns, ci 0.950 |

683 | found 10 outliers among 100 samples (10.0%) |

684 | 6 (6.0%) high mild |

685 | 4 (4.0%) high severe |

686 | variance introduced by outliers: 0.990% |

687 | variance is unaffected by outliers |

688 | |

689 | benchmarking xa0/ghc'' |

690 | collecting 100 samples, 40871 iterations each, in estimated 1.369772 s |

691 | bootstrapping with 100000 resamples |

692 | mean: 334.4555 ns, lb 333.1125 ns, ub 337.9793 ns, ci 0.950 |

693 | std dev: 9.782277 ns, lb 804.0550 ps, ub 19.86414 ns, ci 0.950 |

694 | found 10 outliers among 100 samples (10.0%) |

695 | 5 (5.0%) high mild |

696 | 5 (5.0%) high severe |

697 | variance introduced by outliers: 0.998% |

698 | variance is unaffected by outliers |

699 | |

700 | benchmarking xa0/ghc''' |

701 | collecting 100 samples, 41051 iterations each, in estimated 1.369786 s |

702 | bootstrapping with 100000 resamples |

703 | mean: 332.4284 ns, lb 332.3365 ns, ub 332.5897 ns, ci 0.950 |

704 | std dev: 606.3422 ps, lb 410.3725 ps, ub 1.075444 ns, ci 0.950 |

705 | found 7 outliers among 100 samples (7.0%) |

706 | 4 (4.0%) high mild |

707 | 3 (3.0%) high severe |

708 | variance introduced by outliers: 0.990% |

709 | variance is unaffected by outliers |

710 | |

711 | benchmarking xa0/ffi' |

712 | collecting 100 samples, 40941 iterations each, in estimated 1.369794 s |

713 | bootstrapping with 100000 resamples |

714 | mean: 337.1041 ns, lb 335.7040 ns, ub 339.7735 ns, ci 0.950 |

715 | std dev: 9.568360 ns, lb 5.813967 ns, ub 14.63197 ns, ci 0.950 |

716 | found 16 outliers among 100 samples (16.0%) |

717 | 5 (5.0%) high mild |

718 | 11 (11.0%) high severe |

719 | variance introduced by outliers: 0.998% |

720 | variance is unaffected by outliers |

721 | |

722 | benchmarking xa0/ffi |

723 | collecting 100 samples, 40844 iterations each, in estimated 1.369803 s |

724 | bootstrapping with 100000 resamples |

725 | mean: 336.3716 ns, lb 336.1813 ns, ub 336.6395 ns, ci 0.950 |

726 | std dev: 1.148115 ns, lb 861.7941 ps, ub 1.517364 ns, ci 0.950 |

727 | found 10 outliers among 100 samples (10.0%) |

728 | 3 (3.0%) high mild |

729 | 6 (6.0%) high severe |

730 | variance introduced by outliers: 0.990% |

731 | variance is unaffected by outliers |

732 | |

733 | benchmarking xff/ghc |

734 | collecting 100 samples, 40926 iterations each, in estimated 1.369799 s |

735 | bootstrapping with 100000 resamples |

736 | mean: 339.4825 ns, lb 336.9846 ns, ub 343.7930 ns, ci 0.950 |

737 | std dev: 16.52336 ns, lb 10.80402 ns, ub 23.24877 ns, ci 0.950 |

738 | found 8 outliers among 100 samples (8.0%) |

739 | 8 (8.0%) high severe |

740 | variance introduced by outliers: 0.999% |

741 | variance is unaffected by outliers |

742 | |

743 | benchmarking xff/ghc' |

744 | collecting 100 samples, 40961 iterations each, in estimated 1.369778 s |

745 | bootstrapping with 100000 resamples |

746 | mean: 334.8707 ns, lb 334.7014 ns, ub 335.1143 ns, ci 0.950 |

747 | std dev: 1.029057 ns, lb 766.8710 ps, ub 1.387869 ns, ci 0.950 |

748 | found 8 outliers among 100 samples (8.0%) |

749 | 3 (3.0%) high mild |

750 | 5 (5.0%) high severe |

751 | variance introduced by outliers: 0.990% |

752 | variance is unaffected by outliers |

753 | |

754 | benchmarking xff/ghc'' |

755 | collecting 100 samples, 40771 iterations each, in estimated 1.369787 s |

756 | bootstrapping with 100000 resamples |

757 | mean: 335.9241 ns, lb 334.4623 ns, ub 339.5979 ns, ci 0.950 |

758 | std dev: 10.42524 ns, lb 937.4611 ps, ub 19.11416 ns, ci 0.950 |

759 | found 9 outliers among 100 samples (9.0%) |

760 | 8 (8.0%) high severe |

761 | variance introduced by outliers: 0.998% |

762 | variance is unaffected by outliers |

763 | |

764 | benchmarking xff/ghc''' |

765 | collecting 100 samples, 41025 iterations each, in estimated 1.369784 s |

766 | bootstrapping with 100000 resamples |

767 | mean: 334.5904 ns, lb 334.4362 ns, ub 334.8287 ns, ci 0.950 |

768 | std dev: 964.6287 ps, lb 681.0348 ps, ub 1.319471 ns, ci 0.950 |

769 | found 7 outliers among 100 samples (7.0%) |

770 | 6 (6.0%) high severe |

771 | variance introduced by outliers: 0.990% |

772 | variance is unaffected by outliers |

773 | |

774 | benchmarking xff/ffi' |

775 | collecting 100 samples, 40703 iterations each, in estimated 1.369798 s |

776 | bootstrapping with 100000 resamples |

777 | mean: 338.0728 ns, lb 336.4829 ns, ub 341.8242 ns, ci 0.950 |

778 | std dev: 12.24461 ns, lb 5.463051 ns, ub 20.68281 ns, ci 0.950 |

779 | found 4 outliers among 100 samples (4.0%) |

780 | 3 (3.0%) high severe |

781 | variance introduced by outliers: 0.999% |

782 | variance is unaffected by outliers |

783 | |

784 | benchmarking xff/ffi |

785 | collecting 100 samples, 40974 iterations each, in estimated 1.369780 s |

786 | bootstrapping with 100000 resamples |

787 | mean: 334.7298 ns, lb 334.6585 ns, ub 334.8111 ns, ci 0.950 |

788 | std dev: 389.1930 ps, lb 337.8143 ps, ub 450.1513 ps, ci 0.950 |

789 | found 5 outliers among 100 samples (5.0%) |

790 | 5 (5.0%) high mild |

791 | variance introduced by outliers: 0.990% |

792 | variance is unaffected by outliers |