I jumped off the Frost bandwagon about a couple years in, so I feel fair in saying that obviously it would be insane to even consider firing Rhule at this point. I think what a lot of this comes from for you and other fans is justified though in being concerned, because the fact is this:
For the past 20 years, we have watched other programs immediately jump from being garbage to excellent in the span of one or two seasons. Heck, even Pelini took us immediately to 9 wins his first season (his problem being that his floor and his ceiling were one in the same). Every year, we watch a program who has floundered suddenly put it together and succeed again. Look at Tennessee last year. Hell, look at Texas, who fell down and now is back up again.
The simple fact is, of all the blue bloods who had a tumble, outside of maybe Miami (which to me is inexplicable) we are the only one who has continued to struggle for so long. We haven't even gotten the joy of one truly great season. We have had to essentially eat s#!t for 20 years, with only two seasons even approaching what I'd consider great in 2009 and 2010, and even then they did not get there. I was 8 years old when we last even won a conference championship, and I am 32 now. That's absurd to me. Literally no one save a few non-traditional students in UNL's undergraduate program was alive when we were last good. None.
So, this fanbase is right to be absolutely frustrated, because frankly, it does seem like horses#!t that everyone else gets to actually bounce back, even if just for one season, but we don't.