Ye told CNBC, Gap brought him on as a leader but wouldn't allow him to lead or make decisions. And, it doesn't sound like he's open to continuing a convo with Gap or its employees, saying ... "I'm not gonna argue with people broker than me about money."