A 58-story building looks like a massive, monolithic structure, but it's generally built of steel beams and concrete columns and floor slabs (and maybe concrete beams, too). If you were to measure the volume of the building materials used to construct it, you'd find that this volume is dwarfed by the amount of open space inside the building.
A smaller building might topple sideways, especially if it is made of homogenous materials (like poured concrete or concrete blocks) instead of a composite steel/concrete construction. But tall buildings can't be constructed that way because the weight of the upper floors would require huge slabs and columns in the lower floors that would eliminate most of the usable space. When a tall building collapses, you have to keep in mind that every single element of the building is under a vertical force (gravity) that is enormous compared to: (1) any force that would move it sideways very far, and (2) the strength of the joints and structural elements that hold the pieces of the building together.
If you look at the 9/11 clips and see how those buildings collapsed, you'll notice that the first one to fall actually leaned in one direction at the top because the structure failed unevenly. But the downward force of gravity quickly took over, and propelled even the leaning section of the building straight down.
(I hope your not headed toward some truther end.)
The World Trade Center was a fairly unique design, meant to optimize open floor space, much of the weight was carried buy to exterior walls.
This building and 97% of all steel building are braced frames. The World Trade Center was not a braced frame in any classic sense.