Why don't you do your own research and see what the Raiders defense was ranked in each year he was there. I can tell you this, they were never ranked higher than about 22nd in the league and in a few seasons they were 30-32nd. It's a team game.
What was the Saints defense rated during most of Brees career? I believe we had the worst defense in the history of the league but were still competitive.