Can you do manual labor in business/dress clothes?

Today is saw a guy doing some weedeating in his slacks/button down and it freaked me out a bit - I've seen it before but it always weirds me out

Can you do real work in dressy clothes or do you have specific types of clothes for specific activities (people who work out in jeans also freaks me out)

The most I've done in my work clothes is wash or vacuum out my car. I couldn't do yard work in slacks or a nice shirt. It seems stupid to me, to be honest.

Generally, I'd be in basketball shorts and a t-shirt, unless I need to be in jeans, boots, and a long sleeve t-shirt. Often, in Florida it's more about not over heating.

I work out in shorts and a t-shirt. One time, I did get stuck wearing my work shoes, since I forgot my running shoes. I stuck to the bike that day, and some weights. I felt weird.

When I get home, the first thing I do is change into shorts and a t-shirt.