Not if you turn it off. Which can be tricky to do. Or simply leave your phone at home. Which I actually do on occasion. It's actually nice to take a walk or a drive to the store without the phone every now and then.
Shhhh they still have it even if you don’t grant them permission. Google is up front with the fact they will break the law, and pay what minuscule fines to them they have to pay because the data you provide is worth more than the fine. No country is going to fine them enough to hurt and everyone knows it. They will do a public slap on the wrist, but they don’t stop. Besides, one of the bigger users of google data, besides google are governments and political organizations.