Other than each school's current state would it be a step down. Nebraska has a bigger budget, better NIL, fan support and is not in a conference where if things are in order, would be at 8th in the pecking order. That's not even counting OU and Texas. Ole Miss' recruiting hasn't been much better, some years it's been worse. Any location advantage OM has is eliminated by other teams in their conference, with better resources, that take their in state talent.
I too am not saying he's the guy either.