The main problem with floats in general is they are designed primarily for scientific computing.
We are fortunately starting to see newer (well, not that new now) CPU instructions like FMA that make more accurate decimal representations not take such huge performance hits.