If you want to evaluate a coach's first 2 year performance based on just win-loss record and blowouts then you would have been the guy telling everyone Jim Harbaugh "was never going to get Stanford to a championship" after going 4-8, and 5-7.
Stanford of course has nowhere near the tradition as us, but they recruited with an average recruiting ranking of about 40 the three years prior to Harbaugh. Bo Pelini the 3 years prior to Riley had an average recruiting class of 29. Not much of a gap at all, even without considering the point that of the highest ranked players in those three classes (4*) a third of them never even played meaningful snaps for the Huskers.
All I'm trying to say is we need to give Riley more time, and honestly I think hes done well all things considered to this point. Anyone saying these first two years are evidence he can't get the job done is probably just a worried fan not being objective, which I can be at times as well.
Before Harbaugh was hired for the 2007 season, Stanford had the #59 (2006), #25 (2005), and #60 (2004) classes, or a #48 average. They just came off a 1-11 season, where 9 of those 11 losses were blowouts. He came in and they immediately improved, and then improved again, and then improved again, and finally improved again before he was hired away. The situation Harbaugh inherited at Stanford and improvement he consistently made there is nothing like Riley at Nebraska.
And anyone who says "he's done well all things considered to this point" after a losing season and the curbstompings we've encountered is also not being objective.