Try looking in the BIOS first for the temps, but aside from that, you could use
SpeedFan or
Motherboard Monitor to keep an eye while in Windows.
I saw somewhere that the P3 800 sould burn out at 80 deg C (176 F) but I really wouldn't want to see it at more than 50 or 60 C (about 120 to 140 F).