This is the first time I've heard this. I did a search and couldn't find a single mention of this. That doesn't mean it didn't happen.
Do you remember where you saw it reported that Payton said Gayle was a weak owner?
I remember Payton suggesting that the Denver owners had a lot more financial clout, so he felt like the biased refereeing against him would end. That is not the same thing as saying Gayle is a weak owner.