Changes between Version 16 and Version 17 of Building/RunningTests/Adding


Ignore:
Timestamp:
Nov 28, 2013 2:20:53 PM (5 months ago)
Author:
nomeata
Comment:

Mention that compiler_stats_num_field skips the test with DEBUG on

Legend:

Unmodified
Added
Removed
Modified
  • Building/RunningTests/Adding

    v16 v17  
    285285The kinds of constraint that can be used are: 
    286286 
    287  * '''compiler_stats_num_field(stat, expecteds)'''  tests the performance of GHC, and should be used with '''compile''' or '''compile_fail''' tests.  '''stat''' is one of the following: `'bytes allocated'`, `'peak_megabytes_allocated'`, or `'max_bytes_used'`; '''expecteds''' is a list of triples. Each triple has the form: `(predicate, baseline, deviation)`. '''predicate''' is a boolean value indicating which triple to use. In the above example, if the machine word size is 32 bits, the first triple's '''baseline''' and '''deviation''' values will be used. If the word size is 64 bits, the second triple's values will be used. '''baseline''' is the baseline value obtained by running the benchmark, and '''deviation''' is the percentage deviation from the baseline that the framework will allow for the test to pass. 
     287 * '''compiler_stats_num_field(stat, expecteds)'''  tests the performance of GHC, and should be used with '''compile''' or '''compile_fail''' tests.  '''stat''' is one of the following: `'bytes allocated'`, `'peak_megabytes_allocated'`, or `'max_bytes_used'`; '''expecteds''' is a list of triples. Each triple has the form: `(predicate, baseline, deviation)`. '''predicate''' is a boolean value indicating which triple to use. In the above example, if the machine word size is 32 bits, the first triple's '''baseline''' and '''deviation''' values will be used. If the word size is 64 bits, the second triple's values will be used. '''baseline''' is the baseline value obtained by running the benchmark, and '''deviation''' is the percentage deviation from the baseline that the framework will allow for the test to pass. Setting this constraint will skip the test if `-DDEBUG` is one (i.e. '''complier_debugged()''' is true), as the numbers are worthless then. 
    288288 
    289289 * '''stats_num_field(stat, expecteds)'''  is the same, but tests the performance of the ''program'', not the compiler.  It should be used in conjunction with a '''compile_and_run''' test.