Do nuclear fuel rods stay hot after they are used?

after the power plant finishes using them, do the spent fuel rods stay hot and radioactive or just radioactive. i want to know if they actually continue to produce heat all by themselves even after they are discarded