You have to trust that instinct. It's not an issue. Better players will make the team better in the long run and give the Saints more flexibility.
If no other players on the OL or DL has a top 10 grade, they shouldn't be in the conversation. But people who are stuck on the idea of need will be lured into making bad decisions because of it.