Simon Cowell has come to Britney Spears’ defense amid reports she has been walking off the set of “The X Factor” midway through auditions, blaming the media for spreading false ru…