Hmm, maybe on days I bike I'll count the time from when I wake up, until I get around to the taking a shower after the rideI put in the time I leave the car/house to the time I return/arrive.
If I sit BSing on the trail, that should count against my average speed, IMO.