How much to put aside for taxes

Isn't every expense of the self-employed a business expense?

Yes. Absolutely.