It's not a fair analogy at all. The idea isn't that some threshold amount of people find the name vaguely offensive for some reason. The conclusion of the agency here was that the name was disparaging to a group of people. While "Saints" has a religious connotation, it isn't disparaging or derogatory. It doesn't have a negative connotation or history with respect to those it implicates.
The idea isn't some entirely subjective concept of offensiveness. That could never lead to any applicable standard. Magicians could protest the Orlando Magic. Zookeepers and naturalists could protest any team with an animal name.
That's not what is happening here.