IE is perfectly safe, but to achieve it depends on your knowledge level.
Even knowing that I don't use it directly, since it's a poor excuse for a browser.
FF is somewhat incompatable with the "net". It achieves some safety by not using what IE needs, and thus what many sites use (ActiveX). So some sites won't display properly. Yes i know you can get some replacements for activeX, but not all.
Of course, some anti IE/pro FF sites will return the favour and block IE from viewing them. A blinkered approch that is easily circumvented anyway.
You see, the internet runs according to IE. FF may be compliant with the rules, but IE sets the standard for what is, and isn't.
If you're not compliant with IE, then your not compliant with the net, overall.
I have so far tried Three incarnations of FF. I don't like it. Tab handling is crap. Startup is painfully slow, everything has to be a plugin, plus as i said, it distorts the view of some sites. It isn't completely fault free and still has holes, just like IE.
The holes may be filled quickly, but they are still there, regardless.
Use one of the IE based replacements instead. They are safer "out of the box", much better features than IE, and compatability is assured.
I will blow a trumpet for "Maxthon". A trusted companion.
http://www.maxthon.com/
Ultimately, It's what works for you tho.
__________________
Where there's a will, There's a way.
Pay developers, not Rapidshare!
I know nowt, but at least I'm trying.

Quality, not quantity.
Prevention is better than cure.