I'm the same way. I never put my finger on it but the control issue is probably a good suspect for me. I usually couple restaurant visits with some other thing I need to get out for and call 15 minutes ahead.
Now what pisses me off is the businesses (I am assuming they have been burned by no shows) who wait until you get there to drop your food. We have to get past that shirt.