Changes between Version 20 and Version 21 of Ticket #5793
- Feb 7, 2013 6:52:21 PM (3 years ago)
v20 v21 7 7 1. Think and maybe fix nofib framework design. It has 'ways' which I think correspond to compilation method but more in the sense of 'dynamic' vs 'static', seems it may not suite being able to use ways for 'fasm' vs 'fllvm'. There is also the concept of 'modes' which corresponds to different benchmark input. So 'normal' and 'slow' for getting different run-times. At moment no easy way to select which benchmark groups to run, so may want to change that. I guess we should just decide, what knobs do we want to be able to easily tweak, and see how well the current design allows that. 8 8 9 2. Fixup the runtimes for benchmarks to be significant. (A lot of them run in < 1 or < 0.1 seconds). I think trying to get all of them to run in around 10s is a good target. 9 2. Fixup the runtimes for benchmarks to be significant. This might be best done by changing the way we run benchmarks and collect results to make sure they are meaningful. 10 11 E.g., Lots of great discussion and links to papers on this thread 12 13 http://www.haskell.org/pipermail/ghc-devs/2013-February/000307.html 10 14 11 15 3. Above task is to fix normal but we may want to fixup slow as well and perhaps add a 'fast' mode where benchmarks run in around 1 second.