For non-conference games the official crew should come from a 3rd conference, like in bowl games. Being a former official, I think most of the calls would be the same (99% of officials are honest, except in the NBA) but it would reduce the appearance of bias.