All the new boxen (srv11-srv30) died mysteriously while Domas and I were trying to restart Apache after installing PHP's CURL library extension so a proper timeout could be used on the Lucene search.
By dead, I mean "Destination Host Unreachable". They're off the network, kaput. That _shouldn't_ happen. :) All the other machines seem just fine; only the spanking new ones exploded, and the reason for it is not too clear. (Freak library incompatibility -> killing machines? That _shouldn't_ happen.)
It may be necessary for somebody to flip the switches and reboot.
-- brion vibber (brion @ pobox.com)