Testsuite failures when GHC is built with 'quickest' profile
After building GHC HEAD with the quickest setting and running 'make test', here is the testsuite failures (I've included the perf-related tests' for completeness's sake, although they're probably spurious):
Unexpected results from:
TEST="T10083 T8848 linker_unload debug T4930 HyperStrUse integerConstantFolding T9938 T3717 break011 T9938B T7796 break013 T8639_api spec-inline T9220 T4306 T8628 T5623 T7360 T10694 T6056 AmapCoerce T7837 T4018 IntegerConversionRules prog001 T11195 T10482 break024 T9881 EvalTest T4007 UnsatFun T3055 T3234 T4908 T7865 T5327 T8832 dynCompileExpr ghci004 T7116 ghci006 T8598 T2110 tcfail072 ghci025 T10482a T10508_api T3772 T10830 T9872d T4830 T9872a T9872b T9872c T9233 T9020 InlineByteArrayAlloc T5536 T5949 T7954 lazy-bs-alloc T5321Fun T3064 parsing001 T4801 T5030 T5642 T3924 Conversions T5237 T876 T5549 T9848 T7619 T5631 T9203 T8766 T3294 InlineCloneArrayAlloc T4334 MethSharing T7257 InlineArrayAlloc T5205 T3586 T10547 T783 T6048 T4474a T4474c T4474b T9675 T3738 T5113 T5321FD T5837 T4029 T9339 T10359 T7797 T9961 T4978 T1969 T4267 space_leak_001"
OVERALL SUMMARY for test run started at Wed Jun 1 18:03:49 2016 EDT
0:15:57 spent to go through
5174 total tests, which gave rise to
16207 test cases, of which
10987 were skipped
71 had missing libraries
4925 expected passes
116 expected failures
0 caused framework failures
1 unexpected passes
51 unexpected failures
56 unexpected stat failures
Unexpected passes:
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T10083 T10083 (normal)
Unexpected failures:
/tmp/ghctest/_iBKeQ/1/2/3/../../libraries/array/tests/T9220 T9220 [bad stdout] (ghci)
/tmp/ghctest/_iBKeQ/1/2/3/./codeGen/should_compile/debug debug [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./driver/T9938 T9938 [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./driver/T9938B T9938B [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/T10508_api T10508_api [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/T8628 T8628 [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/T8639_api T8639_api [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/dynCompileExpr/dynCompileExpr dynCompileExpr [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci.debugger/scripts/break011 break011 [bad stdout] (ghci)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci.debugger/scripts/break013 break013 [bad stdout] (ghci)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci.debugger/scripts/break024 break024 [bad stdout] (ghci)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci/prog001/prog001 prog001 [bad exit code] (ghci-ext)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/T9881 T9881 [bad stdout] (ghci)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/ghci004 ghci004 [bad exit code] (ghci-ext)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/ghci006 ghci006 [bad exit code] (ghci-ext)
/tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/ghci025 ghci025 [bad stdout] (ghci)
/tmp/ghctest/_iBKeQ/1/2/3/./indexed-types/should_compile/T7837 T7837 [stderr mismatch] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./lib/integer/IntegerConversionRules IntegerConversionRules [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./lib/integer/integerConstantFolding integerConstantFolding [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./numeric/should_compile/T7116 T7116 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T4007 T4007 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/T4018 T4018 [bad exit code] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./pmcheck/should_compile/T11195 T11195 [exit code non-0] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./rts/linker_unload linker_unload [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/EvalTest EvalTest [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3055 T3055 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3234 T3234 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3717 T3717 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3772 T3772 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T4306 T4306 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T4908 T4908 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T4930 T4930 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T5327 T5327 [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T5623 T5623 [bad exit code] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T6056 T6056 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T7360 T7360 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T7796 T7796 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T7865 T7865 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T8832 T8832 [bad stdout] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T8848 T8848 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/spec-inline spec-inline [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_run/AmapCoerce AmapCoerce [bad stdout] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_run/T10830 T10830 [bad exit code] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_run/T2110 T2110 [bad stdout] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./stranal/should_compile/T10482 T10482 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./stranal/should_compile/T10482a T10482a [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./stranal/should_compile/T10694 T10694 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./stranal/sigs/HyperStrUse HyperStrUse [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./stranal/sigs/T8598 T8598 [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./stranal/sigs/UnsatFun UnsatFun [stderr mismatch] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./typecheck/should_fail/tcfail072 tcfail072 [stderr mismatch] (normal)
Unexpected stat failures:
/tmp/ghctest/_iBKeQ/1/2/3/../../libraries/base/tests/T8766 T8766 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/../../libraries/base/tests/T9848 T9848 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./callarity/perf/T3924 T3924 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T10547 T10547 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T1969 T1969 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T3064 T3064 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T3294 T3294 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T4801 T4801 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5030 T5030 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5321FD T5321FD [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5321Fun T5321Fun [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5631 T5631 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5642 T5642 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5837 T5837 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T6048 T6048 [stat not good enough] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T783 T783 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9020 T9020 [stat not good enough] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9233 T9233 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9675 T9675 [stat not good enough] (optasm)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872a T9872a [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872b T9872b [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872c T9872c [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872d T9872d [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9961 T9961 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/parsing001 parsing001 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/Conversions Conversions [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/InlineArrayAlloc InlineArrayAlloc [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/InlineByteArrayAlloc InlineByteArrayAlloc [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/InlineCloneArrayAlloc InlineCloneArrayAlloc [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/MethSharing MethSharing [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T10359 T10359 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T3586 T3586 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T3738 T3738 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4267 T4267 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4474a T4474a [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4474b T4474b [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4474c T4474c [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4830 T4830 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4978 T4978 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5113 T5113 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5205 T5205 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5237 T5237 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5536 T5536 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5549 T5549 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5949 T5949 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7257 T7257 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7619 T7619 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7797 T7797 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7954 T7954 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T876 T876 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T9203 T9203 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T9339 T9339 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/lazy-bs-alloc lazy-bs-alloc [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/T4029 T4029 [stat too good] (ghci)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/T4334 T4334 [stat not good enough] (normal)
/tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/space_leak_001 space_leak_001 [stat not good enough] (normal)I can't reproduce these issues when testing with GHC built with the quick setting.
Trac metadata
| Trac field | Value |
|---|---|
| Version | 8.1 |
| Type | Bug |
| TypeOfFailure | OtherFailure |
| Priority | normal |
| Resolution | Unresolved |
| Component | Test Suite |
| Test case | |
| Differential revisions | |
| BlockedBy | |
| Related | |
| Blocking | |
| CC | thomie |
| Operating system | |
| Architecture |
Activity
added Tbug Trac import testsuite labels
On second thought, this probably isn't a worthwhile endeavor. I forgot that when built with
quickestsetting, GHC compiles code without any optimizations at all, which means that the generated Core is necessarily going to be quite different on most test cases (not to mention the performance implications). Besides, there's a disclaimer on thequickestsetting inmk/build.mkanyway, so if you try running the testsuite after knowingly choosingquickest, you get what you deserve :)Trac metadata
Trac field Value Resolution Unresolved → ResolvedInvalid Could add "and many tests will fail (Trac #12141 (closed))" to that disclaimer.
mentioned in commit 27731f14
added Pnormal label
mentioned in issue #18514
Please register or sign in to reply