Opened 4 years ago

Last modified 13 months ago

#7634 new bug

MD5 collision could lead to SafeHaskell violation

Reported by: shachaf Owned by:
Priority: normal Milestone:
Component: Core Libraries Version: 7.6.1
Keywords: SafeHaskell Cc: core-libraries-committee@…
Operating System: Unknown/Multiple Architecture: Unknown/Multiple
Type of failure: Other Test Case:
Blocked By: Blocking:
Related Tickets: Differential Rev(s):
Wiki Page:


The current scheme for computing TypeRep fingerprints is: md5sum (encodeUTF32BE (unwords [moduleName, packageName, typeName])). SafeHaskell doesn't allow custom-written Typeable instances, but this is more or less the code that deriving Typeable generates.

MD5 is broken and not collision-resistant. If someone can make an MD5 collision, they could use it to derive unsafeCoerce and execute arbitrary code. The constraints (UTF-32, names being alphanumeric, etc.) make it pretty tricky to find a valid collision by the standard methods, but I don't know enough about this to say how feasible it is.

It seems to me that, especially with new-typeable, it might not be necessary to use hashing at all, if GHC can figure out fingerprints statically. Or maybe separate compilation requirements make that unworkable (in which case maybe using a hash of the package/module name along with a separate per-module counter, or something along those lines, might be better, since people are less likely to control those? I'm not sure). Maybe the solution is just switching to another hash function, or something else. At any rate, the issue should be considered -- using MD5 isn't a good idea in cases where collisions could have security implications.

Change History (11)

comment:1 Changed 4 years ago by igloo

difficulty: Unknown
Milestone: 7.8.1

comment:2 Changed 3 years ago by thoughtpolice


Moving to 7.10.1

comment:3 Changed 2 years ago by thoughtpolice

Component: libraries/baseCore Libraries
Owner: set to ekmett

Moving over to new owning component 'Core Libraries'.

comment:4 Changed 2 years ago by thoughtpolice


Moving to 7.12.1 milestone; if you feel this is an error and should be addressed sooner, please move it back to the 7.10.1 milestone.

comment:5 Changed 2 years ago by ekmett

Cc: core-libraries-committee@… added
Milestone: 7.12.1

Acknowledging that this probably won't get addressed in the foreseeable future by pushing it out to _|_.

Given that the two strings would have to be legal UTF-32 encodings of text that can actually be entered you wind up with a huge number of fixed bits in the strings on either side, which very quickly raises the cost of an attempted birthday attack and also forbids a number of birthday attack generation techniques.

That said, saying a cryptographic attack isn't possible for hand-wavy reasons doesn't have a great track record for success. :)

Techniques for finding small single block collisions via random walks, like are probably the most likely source of such a vulnerability. Notice how similar the colliding document pair are. In theory you could prune the walk to keep the paths always within the space of valid inputs. I lack a few weeks (months?) of HPC cluster time to test this hypothesis, however.

comment:6 Changed 2 years ago by bananu7

Maybe the solution is just switching to another hash function

What about that? Doesn't that improve the chances of the collision not being found even more? It looks like an change that's easy enough. Doesn't moving this ticket to _|_ mean that it's effectively being forgotten?

comment:7 Changed 2 years ago by ekmett

The move out from 7.12 was more an acknowledgement that the CLC wasn't planning on tackling this issue in 7.12. If everything is a priority then nothing is a priority, and we have lots of actionable issues with far more immediate impact.

Switching fingerprints to something like SHA-256 could be done. In fact it is probably a pretty good idea, despite doubling the size of fingerprints and having a measurable performance impact -- if a patch was put forth then it would by all means be considered.

comment:8 Changed 2 years ago by bananu7

A quick investigation shows that there are two parts of the problem:

  • Fingerprint is made of two Word64s; would need to change to four, and all the functions that manipulate on it to take four parts into account; that's an easy part
  • MD5 implementation used internally for hashing is written in C. I suppose the SHA-256 implementation that's necessary for the patch could be taken from cryptohash library, which seems pretty mature already. It would need to be integrated as a C source similarly to MD5; It's probably not feasible to drag the whole library as a GHC dependency; maybe I'm wrong here.

Then the functions that have to be altered are fingerprintData and fingerprintString, the latter needing just to take the larger size of the fingerprint into the account, and the former actually being changed to use the SHA-256 context and hashing function.

comment:9 Changed 2 years ago by ekmett

Pretty much.

There are also dozens if not hundreds of SHA-256 implementations out there in C we could take in more or less unmodified.

Heck, I've even written one before, back in my crypto days.

comment:10 Changed 17 months ago by thomie

Owner: ekmett deleted

comment:11 Changed 13 months ago by thomie

Keywords: SafeHaskell added
Note: See TracTickets for help on using tickets.