Real Men use LFS:
http://www.linuxfromscratch.org/
If you like that kind of control, gentoo is also a good alternative.
Mel