They were "at the door." They had just come back from burying Ananias. It was about three hours later.
The Lord seldom reaches His big hand down and smites anyone directly. Usually, it's some jihadist with the bomb, dagger, sword, etc.