Yes, although for someone to get into that situation, they've probably already made a big mistake themselves (because, e.g. if a recovery key might be necessary to fix that server first, that key definitely shouldn't be stored on that server). But there can be other reasons why fixing that server could be difficult.