I would say it is a function of how much it costs you to get to the site, the time it takes you, and the difficulty of the shoot. If it costs $50 in gas to get to a location, you should add that on to their bill.
In the end, it is a deal between you and your customer. You can be flexible.