Last night I checked the ganglia dashboard for our Hadoop cluster and found the CPU graph looking like this:
Hrm…right at 00:00 on Sunday the CPUs are pegged, mostly in system calls.
Fortunately, simply setting the system clock fixes it. And nicer than a full reboot.