There is no rule saying how many justices there must be. With the senate’s backing, BHO could appoint more, with or without retirements.
You are wrong: http://en.wikipedia.org/wiki/Supreme_Court_of_the_United_States#Size_of_the_Court