Thanos snapping his neck has its own importance given that knowing he'd wind up dead like that in his own timeline would rule out going back into that timeline as is for Loki, if that was possible. But from the point of view of that Loki, seeing Thor telling him that he wasn't so bad, and Odin saying, "I love you my sons," would also have had its own impact on how he sees himself, and how he might act going forward.
For the infinity stones, I didn't see it as a, "these are really powerful, so the TVA must be really powerful" thing, I saw it as more of a, "these are real, so all of this TVA stuff must also be real," thing. Once you accept the existence of the TVA, the infinity stones aren't the most powerful objects in the universe, they're just the most powerful objects in a universe. The TVA having them doesn't make the TVA powerful in itself, they evidently can't even use them to the point where they're junk, and we've already seen - repeatedly - that beyond having the collars, reset bombs and the... actually, I'm not sure what they're called... prune sticks? Beyond having those, the TVA isn't especially powerful when its agents are in any given timeline. I don't think Loki is so much respecting the TVA as he is just recognising the reality of it.
Although I suspect the TVA must have a nuclear option beyond what we've seen, given that we've already seen them get dangerously close to a Nexus event passing a red line, so it's hard to believe it's never happened, and there's also the question of how they created the one sacred timeline in the first place.