It depends on your session location. Parks and shaded areas near buildings etc. are more forgiving at different times of the day. Mostly I suggest sunrise and sunset. Here's why...
[Writing this from the car as I wait on my sunrise session client to arrive!]
Now for the...