Cavemen didn't fast, though. They foraged for small plants, grains, and fruits as well as other various living things between hunts/kills.
Look, intermittent fasting is one thing (eating one very large meal per day). Literal fasting for multiple days is crazy.
Calories in, calories out. It's all math.