Thanks for the replies everyone. Here's an update --
I flashed the BIOS with Jess's modified version (10/15). The CPU temperatures were lower with the new BIOS. From reading the forums, it is to my understanding that the shipping BIOS was inaccurate with the temps? If this is the case, should the 10/15 BIOS be more in line with what is actually happening? Now, I get around 36 degrees idle, and around 45-47 under load with no overclock. I bumped it up to 2.4GHz today, and am running 37 degrees idle, and 47-48 under load.
I'm a little happier with these temperatures, if they turn out to be accurate. I think I'm going to upgrade the CPU cooling if I decide to go any higher than 2.4GHz (which I most likely will, haven't run into any stability issues after playing HL2 for over an hour. Yes, I know it's not a true stability test )