Nay, the East was quite prosperous and resilient. It remained a vibrant Empire. The West fell apart politically but trade with the West continued until the Moslems disrupted the Mediterranean trade routes.
Sure it was vibrant, but it was much smaller. That the Roman Empire had withdrawn into itself at Byzantium made it all the easier for the Saracens and Moors to overrun everything in Africa including Spain.