We also hiked in to the Ohanapecosh Hot Springs.
The colors are caused by sediment in the water and yes, they were very warm!