That would be easy to do if they are operating in the 4th dimension..... it would seem more likely they are doing everything in their power to stop us from eliminating ourselves.
Alien race invents undetectable drone tech and has planetary travel capacity.
Except, for some reason they never noticed human's see a spectrum of light. So they built the fleet with lots of flashing and colors and such which foils their surprise invasion.