In 2012, I decided to quit my six-figure job in investment banking and retire at 34. I had amassed a net worth of about $3 million that generated roughly $80,000 in investment income per year. For seven years, I lived a charmed life in early retirement with my wife, who also retired from her finance job three years after I did. Together, we earned roughly $250,000 in passive income streams per year — mostly from dividend-paying stocks, interest from savings, municipal bonds, and rental income.