Maybe hearing or kinesthetic sensitivity is a factor. I do remember when the big earthquake hit Melbourne recently, I was in a shop with half a dozen other rpeople. I felt/heard it well before anyone else. I was like "what is that??"...everyone looked at me like I was mad. I was amazed no one else could hear or feel it. 10 seconds later they felt it when the intensity increased.
In some locations I have never heard it. It's definitely a physical thing because of the rattling window pane of plaster walls that happens occasionally.