I'm at the other end of this since I'm the wife, BUT...it's tough with kids, that's for sure...
Mike used to ride whenever he wanted, I'd be at home, good wife, taking care of the baby...then I bought my Busa and WANTED to ride as much as possible, leave him at home with the kids, etc...it created some friction, but over time we've developed some understanding.
If he wants to go ride with friends, I don't give him grief. I expect the same in return and he's good about it...
The best times are when we get the kids to Grandmas and we head out for a few hours together...it's rare, but it's always a blast...
Gotta have compromise on both sides no matter what the circumstances...