You are spot on. It is the stress and the fact that these coaches didnt spend time with their children before they were in their 30s and potentially providing grandchildren. The stress is self induced to succeed. Unfortunately families suffer the by product. There comes a time, graduations, marriages, grandchildren and health scares that begin to make coaches realize what they missed. This is when they stop to spend time with the ones they unintentionally due to the stress to succeed. But, coaching is in their blood, almost relatable to an addiction (not trying to minimize actual life threatening addictions), because the coach finds out that they are lost without it. This typically draws them back.
So you are right, stress is the primary reason for getting out, but it is also the reason they need to make up for lost time with family, which in turn makes that excuse valid. Trust me.