It's hard to tell sometimes. Seacrest fools us by wearing the exact same thing live and in the taped interview so it's almost seemless.
So does Simon, that's why I try to remember what Randy, Kara or Paula are wearing. I guess it doesn't really matter though, since we now know a lot of them lip sync.