Changes between Version 21 and Version 24 of Ticket #5793


Ignore:
Timestamp:
Feb 9, 2013 1:09:27 AM (2 years ago)
Author:
dterei
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #5793 – Description

    v21 v24  
    66 
    771. Think and maybe fix nofib framework design. It has 'ways' which I think correspond to compilation method but more in the sense of 'dynamic' vs 'static', seems it may not suite being able to use ways for 'fasm' vs 'fllvm'. There is also the concept of 'modes' which corresponds to different benchmark input. So 'normal' and 'slow' for getting different run-times. At moment no easy way to select which benchmark groups to run, so may want to change that. I guess we should just decide, what knobs do we want to be able to easily tweak, and see how well the current design allows that. 
     8 
     9'''Note''' there is a shake build system attached that does a lot of this (done by Neil Mitchell!). An explanation of it can be found here: http://neilmitchell.blogspot.com/2013/02/a-nofib-build-system-using-shake.html 
     10 
     11The design discussion of it is mostly lost as it was done on private email sorry. 
    812 
    9132. Fixup the runtimes for benchmarks to be significant. This might be best done by changing the way we run benchmarks and collect results to make sure they are meaningful.