Everyone's elite when they are winning. A true test is what happens when the team is losing or underperforming. Is the stadium still full? Are they still pulling in a ranked recruiting class?
So you would consider Michigan not an elite program?
You're making this painful but Michigan is a perfect example. They always have top 25 recruiting classes even in the darkest years of RichRod. The Big House draws a crowd, a big crowd for certain opponents.
EDIT A big exception to my rule is Southern Cal because the Coliseum is empty when they aren't in the title hunt. I give them a pass because fairweather fandom is part of their identity.