Magnitude 3.9 Earthquake 10 miles east of Portsmouth NH.

I'm no geologist but I would suspect that you would have to be fairly close to the epicenter to hear whatever sound waves the earthquake produces - the rest would be sounds made by stuff moving, breaking, etc.
That’s what I would have thought, especially considering it’s underground, but I realized I’ve never actually looked for that answer