At least by my scare tactics, we don't have to wait for an asteroid.
From http://gsa.confex.com/gsa/2001ESP/finalprogram/abstract_7493.htm: "Erosion of volcanic oceanic islands by large scale landsliding is a well known phenomenon. Many hundred km3 of rock can be removed in a single event, leaving towering headwall scars, amphitheatre shaped depressions (many previously regarded as calderas), and massive dumps of debris offshore. Here we summarise one single event which removed a substantial portion of the Canary Island of El Hierro about 12-17,000 years ago. The initial landslide involved dislocation of about 180 km3 of rock from the north-western flank of the island; about 50% of the material was derived from subaerial sources. Avalanche deposits extend to 4000 m waterdepth, cover an area of 1500 km2, and have a thickness of 250-350 m. Blocks up to 1 km across occur on the seabed up to 65 km away from the island."
An event like this could represent a significantly disruptive situation on the US eastern seaboard.