ARM is generally a disaster
I'll be recording the state of the testsuite on ARM here as I try to trace down the villains that plague this poor architecture.
Trac metadata
Trac field | Value |
---|---|
Version | 7.10.2 |
Type | Bug |
TypeOfFailure | OtherFailure |
Priority | normal |
Resolution | Unresolved |
Component | Compiler |
Test case | |
Differential revisions | |
BlockedBy | |
Related | |
Blocking | |
CC | |
Operating system | |
Architecture |
- Show closed items
Relates to
- #112058.0.15
- #113408.0.15
Activity
-
Newest first Oldest first
-
Show all activity Show comments only Show history only
- Ben Gamari mentioned in issue #9048 (closed)
mentioned in issue #9048 (closed)
- Ben Gamari mentioned in issue #10864 (closed)
mentioned in issue #10864 (closed)
- Ben Gamari mentioned in issue #10969 (closed)
mentioned in issue #10969 (closed)
- Ben Gamari changed milestone to %8.0.1
changed milestone to %8.0.1
- Ben Gamari changed weight to 5
changed weight to 5
- Ben Gamari added Tbug Trac import labels
added Tbug Trac import labels
- Author Maintainer
As of 688069ca things look like the following,
TEST="T1372 T4891 landmines joao-circular cabal01 debug T2578 T10518 tc263 T7835 cabal06 cabal07 barton-mangler-bug linker_unload T4850 T5423 T7037 T5435_dyn_asm T5435_v_gcc outofmem T5435_v_asm outofmem2 T4059 T5435_dyn_gcc plugins01 mod175 T8628 T6145 T9595 T8639_api T10508_api literals parsed par003 mod179 T7476 T10890_1 T10890 Check04 T1959 recomp008 hs-boot recomp015 safePkg01 T149 T2902 T3736 T10052 recomp004 T9430 sigof01 sigof01m sigof03 sigof02dm sigof02m sigof02d sigof02 dynCompileExpr bug1465 dynamic_flags_001 cabal04 rn.prog006 T5313 T703 T9938B withRtsOpts rtsopts002 rtsopts001 driver081b T9938 driver062a driver062b driver062c driver062d driver062e driver081a T7478 recomp001 integerConstantFolding showsrcspan T3007 Capi_Ctype_001 Capi_Ctype_002 T10955dyn dynamicToo001 hsc2hs004 hsc2hs003 CmmSwitchTest T437 encoding004 T3307 environment001 parseTree T10313 annotations comments listcomps recomp012 recomp007 recomp010 recomp011 gadt23 T8726 T7014 T5243 T10359 T9203 T7257 lazy-bs-alloc haddock.Cabal haddock.compiler haddock.base T5321FD T5030 T4801 T5631 T783 T9872d T9872b T3064 T1969 T5321Fun T5837 T9233 T9961" OVERALL SUMMARY for test run started at Fri Dec 11 22:07:33 2015 CET 1:13:14 spent to go through 4859 total tests, which gave rise to 15400 test cases, of which 10592 were skipped 72 had missing libraries 4506 expected passes 104 expected failures 1 caused framework failures 0 unexpected passes 106 unexpected failures 20 unexpected stat failures
- Author Maintainer
#11205 (closed) is now closed and the world is a much rosier place. As of 353e97a3,
Unexpected results from: TEST="T2431 recomp011 dynCompileExpr joao-circular T5313 T8274 CmmSwitchTest ghci004 ghci006 T7478 Roles4 Roles3 T8958 Roles14 Roles13 Roles2 Roles1 parseTree T10313 annotations comments listcomps TH_Roles2 T10828 T10518 T10052 prog001 outofmem T5435_v_asm linker_unload T5435_v_gcc T8628 T9015 T9595 T10508_api T1094 2 T8639_api T8726 T9430 T10359 T9203 T7257 lazy-bs-alloc haddock.Cabal haddock.compiler haddock.base T5321FD T5030 T4801 T5631 T5837 T9872a T9872d T9872b T3064 T9872c T1969 T5321Fun T783 T9233 T9961" OVERALL SUMMARY for test run started at Thu Dec 24 04:59:15 2015 CET 1:40:31 spent to go through 4945 total tests, which gave rise to 15671 test cases, of which 10775 were skipped 72 had missing libraries 4657 expected passes 105 expected failures 1 caused framework failures 0 unexpected passes 40 unexpected failures 22 unexpected stat failures Unexpected failures: codeGen/should_compile T10518 [exit code non-0] (normal) codeGen/should_run CmmSwitchTest [bad stdout] (normal,g1) deSugar/should_compile T2431 [stderr mismatch] (normal) driver T5313 [bad exit code] (normal) driver/recomp011 recomp011 [bad stdout] (normal) ghc-api T10508_api [exit code non-0] (normal) ghc-api T10942 [exit code non-0] (normal) ghc-api T8628 [bad exit code] (normal) ghc-api T8639_api [bad exit code] (normal) ghc-api T9015 [exit code non-0] (normal) ghc-api T9595 [exit code non-0] (normal) ghc-api/T10052 T10052 [bad exit code] (normal) ghc-api/T7478 T7478 [bad exit code] (normal) ghc-api/annotations T10313 [bad exit code] (normal) ghc-api/annotations annotations [bad exit code] (normal) ghc-api/annotations comments [bad exit code] (normal) ghc-api/annotations listcomps [bad exit code] (normal) ghc-api/annotations parseTree [bad exit code] (normal) ghc-api/dynCompileExpr dynCompileExpr [exit code non-0] (normal) ghci/prog001 prog001 [bad exit code] (ghci-ext) ghci/scripts ghci004 [bad exit code] (ghci-ext) ghci/scripts ghci006 [bad exit code] (ghci-ext) numeric/should_run T8726 [bad exit code] (normal) primops/should_run T9430 [bad exit code] (normal) programs/joao-circular joao-circular [exit code non-0] (normal) roles/should_compile Roles1 [stderr mismatch] (normal) roles/should_compile Roles13 [stderr mismatch] (normal) roles/should_compile Roles14 [stderr mismatch] (normal) roles/should_compile Roles2 [stderr mismatch] (normal) roles/should_compile Roles3 [stderr mismatch] (normal) roles/should_compile Roles4 [stderr mismatch] (normal) roles/should_compile T8958 [stderr mismatch] (normal) rts T5435_v_asm [bad exit code] (normal) rts T5435_v_gcc [bad exit code] (normal) rts linker_unload [bad exit code] (normal) rts outofmem [bad stdout] (normal) simplCore/should_compile T8274 [bad stdout] (normal) th T10828 [stderr mismatch] (normal) th TH_Roles2 [stderr mismatch] (normal) Unexpected stat failures: perf/compiler T1969 [stat not good enough] (normal) perf/compiler T3064 [stat not good enough] (normal) perf/compiler T4801 [stat not good enough] (normal) perf/compiler T5030 [stat not good enough] (normal) perf/compiler T5321FD [stat not good enough] (normal) perf/compiler T5321Fun [stat not good enough] (normal) perf/compiler T5631 [stat not good enough] (normal) perf/compiler T5837 [stat too good] (normal) perf/compiler T783 [stat not good enough] (normal) perf/compiler T9233 [stat not good enough] (normal) perf/compiler T9872a [stat not good enough] (normal) perf/compiler T9872b [stat not good enough] (normal) perf/compiler T9872c [stat not good enough] (normal) perf/compiler T9872d [stat not good enough] (normal) perf/compiler T9961 [stat not good enough] (normal) perf/haddock haddock.Cabal [stat not good enough] (normal) perf/haddock haddock.base [stat too good] (normal) perf/haddock haddock.compiler [stat not good enough] (normal) perf/should_run T10359 [stat too good] (normal) perf/should_run T7257 [stat too good] (normal) perf/should_run T9203 [stat not good enough] (normal) perf/should_run lazy-bs-alloc [stat not good enough] (normal)
- Author Maintainer
As of bc8cac12,
Unexpected results from: TEST="literals parsed landmines dynCompileExpr joao-circular T5313 T8274 CmmSwitchTest ghci004 ghci006 T7478 parseTree T10313 annotations comments listcomps outofmem T5435_v_asm linker_unload T5435_v_gcc T10518 T10052 prog001 recomp011 T8628 T10942 T9595 T10508_api T9015 T6145 T8639_api T8726 T9430 T10359 T9203 T725 7 lazy-bs-alloc haddock.Cabal haddock.compiler haddock.base T5321FD T5030 T4801 T5631 T5837 T9872a T9872d T9872b T3064 T9872c T1969 T5321Fun T783 T9233 T9961" OVERALL SUMMARY for test run started at Sat Dec 26 05:11:08 2015 CET 1:59:58 spent to go through 4951 total tests, which gave rise to 15693 test cases, of which 10791 were skipped 72 had missing libraries 4669 expected passes 105 expected failures 1 caused framework failures 0 unexpected passes 34 unexpected failures 22 unexpected stat failures
- Author Maintainer
Trac metadata
Trac field Value Related - → #11205 (closed), #11289 (closed) - Author Maintainer
Trac metadata
Trac field Value Related #11205 (closed), #11289 (closed) → #11205 (closed), #11289 (closed), #11294 (closed), #11295 - Author Maintainer
Trac metadata
Trac field Value Related #11205 (closed), #11289 (closed), #11294 (closed), #11295 → #11205 (closed), #11289 (closed), #11294 (closed), #11295, #11296 (closed), #11297 (closed) - Author Maintainer
I previously fixed
T10518
in theghc-7.10
branch (in 3b718b7a) but apparently never applied the fix tomaster
. What a pleasant surprise. - Author Maintainer
As of a3b34b64 (with
CmmSwitchTest
marked as broken),Unexpected results from: TEST="T11255 dynamic-paper T8726 outofmem linker_unload T5435_v_gcc recomp011 T10359 T9203 T7257 lazy-bs-alloc T5321FD T5030 T4801 T5631 T5837 T9872a T9872d T9872b T3064 T9872c T1969 T5321Fun T783 T9233 T9961 haddock.Cabal haddock.compiler haddock.base" OVERALL SUMMARY for test run started at Sun Dec 27 12:38:36 2015 CET 1:05:53 spent to go through 4955 total tests, which gave rise to 15703 test cases, of which 10797 were skipped 72 had missing libraries 4697 expected passes 108 expected failures 1 caused framework failures 0 unexpected passes 7 unexpected failures 22 unexpected stat failures Unexpected failures: dependent/should_compile dynamic-paper [exit code non-0] (normal) driver/recomp011 recomp011 [bad stdout] (normal) numeric/should_run T8726 [bad exit code] (normal) polykinds T11255 [exit code non-0] (normal) rts T5435_v_gcc [bad exit code] (normal) rts linker_unload [bad exit code] (normal) rts outofmem [bad stdout] (normal)
Progress! Moreover, I pulled since building the compiler so presumably will be fixed when I rebuild.
Several of these have tickets,
-
T8726
: 32-bitinteger-gmp
issue, #11296 (closed) -
recomp011
: redundant linking, #11260 (closed) -
T11255
: #11255 (closed) (should be fixed; probably failed due to out-of-date compiler) -
T5435_v_gcc
: #11299 (closed) (cache flushing issue) -
linker_unload
: #11299 (closed) -
outofmem
: #11300 (closed) -
dynamic-paper
: Core lint failure, (presumably already fixed)
-
- Author Maintainer
One additional issue that would be of great help to ARM is to speed up the LLVM backend a bit by eliminating redundant passes. See #11295.
- Author Maintainer
As of 78daabc5 the follow tests still fail,
Unexpected results from: TEST="T2552 T2552 TH_spliceE5_prof TH_spliceE5_prof_ext outofmem linker_unload recomp011 T10359 T9203 T7257 lazy-bs-alloc T5321FD T5030 T4801 T5631 T5837 T9872a T9872d T9872b T3064 T9872c T1969 T5321Fun T783 T9233 T9961 haddock.Cabal haddock.compiler haddock.base" OVERALL SUMMARY for test run started at Sat Jan 2 17:03:18 2016 CET 1:34:00 spent to go through 4937 total tests, which gave rise to 16678 test cases, of which 11772 were skipped 66 had missing libraries 4738 expected passes 73 expected failures 1 caused framework failures 1 unexpected passes 6 unexpected failures 22 unexpected stat failures Unexpected passes: profiling/should_run T2552 (prof) Unexpected failures: driver/recomp011 recomp011 [bad stdout] (normal) profiling/should_run T2552 [bad profile] (profasm) rts linker_unload [bad exit code] (normal) rts outofmem [bad stdout] (normal) th TH_spliceE5_prof [bad exit code] (normal) th TH_spliceE5_prof_ext [bad exit code] (normal)
- Author Maintainer
Trac metadata
Trac field Value Related #11205 (closed), #11289 (closed), #11294 (closed), #11295, #11296 (closed), #11297 (closed) → #11205 (closed), #11289 (closed), #11294 (closed), #11295, #11296 (closed), #11297 (closed), #11340 (closed) - Author Maintainer
As of 04f3524f we have,
Unexpected results from: TEST="barton-mangler-bug cabal03 ghci004 ghci006 outofmem recomp011 cabal01 prog001 T10359 T9203 T7257 lazy-bs-alloc T5321FD T5030 T4801 T5631 T5837 T9872a T9872d T9872b T3064 T9872c T1969 T5321Fun T783 T9233 T9961 haddock.Cabal haddock.compiler haddock.base" OVERALL SUMMARY for test run started at Mon Jan 4 02:12:40 2016 CET 4:11:39 spent to go through 4963 total tests, which gave rise to 15727 test cases, of which 10813 were skipped 72 had missing libraries 4704 expected passes 108 expected failures 1 caused framework failures 0 unexpected passes 8 unexpected failures 22 unexpected stat failures Unexpected failures: cabal/cabal01 cabal01 [bad exit code] (normal) cabal/cabal03 cabal03 [bad exit code] (normal) driver/recomp011 recomp011 [bad stdout] (normal) ghci/prog001 prog001 [bad exit code] (ghci-ext) ghci/scripts ghci004 [bad exit code] (ghci-ext) ghci/scripts ghci006 [bad exit code] (ghci-ext) programs/barton-mangler-bug barton-mangler-bug [exit code non-0] (normal) rts outofmem [bad stdout] (normal)
- Author Maintainer
It turns out that the ghci issues were merely due to
iserv
being out of date. Rebuilding seems to fix these, resulting in (running only the subset failing in ticket:11206#comment:112661),Unexpected results from: TEST="outofmem recomp011 T10359 T9203 T7257 lazy-bs-alloc T5321FD T5030 T4801 T5631 T5837 T9872a T9872d T9872b T3064 T9872c T1969 T5321Fun T783 T9233 T9961 haddock.Cabal haddock.compiler haddock.base" OVERALL SUMMARY for test run started at Mon Jan 4 23:43:35 2016 CET 0:09:07 spent to go through 30 total tests, which gave rise to 85 test cases, of which 52 were skipped 0 had missing libraries 9 expected passes 0 expected failures 0 caused framework failures 0 unexpected passes 2 unexpected failures 22 unexpected stat failures Unexpected failures: driver/recomp011 recomp011 [bad stdout] (normal) rts outofmem [bad stdout] (normal)
Check and mate.