Look at Ohio State: They were #5 in '02, #41 in 03, #9 in '04, #12 in '05, and #12 again this past season.
On the other hand look at Florida State: #4 in '02, #21 in '03, #3 in '04, #2 in '05, and #3 this past season.
Judging by those recruiting rankings you would think it was Florida State in the National Championship game this year and not Ohio State. Recruiting is important but as far as ranking go, I think you can compete for a National Championship if you are consistently in the top 20.