The referees have always been among the most polarizing aspects of an NFL game.