Upgraded my Gallery. I am now screwing with the layout etc. In Firefox it looks great, Internet Explorer f*cks it up.

[Update] Turns out it is the doctype Gallery inserts. Changed this to the same one MT uses, et voila, sorted.