True Tori has followed the marriage troubles of Tori Spelling and Dean McDermott for several months now, but McDermott says he doesn’t feel like he can do it anymore.

The show has given us a behind-the-scenes look at the couple as they try to put their marriage back together following McDermott’s alleged cheating scandal and Spelling’s health issues, and while he says it’s been cathartic for her to share their issues, he wants his privacy back.

“She finds it really helpful. It’s really expedited the conversations that needed to be had in the beginning. And just for me I just think bearing my soul and putting it all out there, I want some of my privacy back. I feel raw,” he said. “I’ve come to the conclusion that for me, yes, it’s too much. I just can’t do it anymore…I’m done.”

As the duo struggle to repair things between them, the question has arisen as to why Tori has chosen to stay.

“When there’s children involved, you look at a relationship differently than you would if there were no children. And I think every woman would agree with that,” she said in an interview.

Spelling was hospitalized last month and was briefly quarantined for Ebola-like symptoms, but was later diagnosed with sinusitis, bronchitis, and pneumonia. Her health issues aside, McDermott has said that they aren’t saying no to expanding their family.

“We’ve kind of joked about it. Barring Tori’s health…the shop’s not closed, as crazy as that may sound. We love our kids, we make beautiful babies and we love a big family so not going to say no, not going to say yes.”