Hugh Jackman has faced rumors for years that he’s gay, and now he’s speaking out about it, saying it’s upsetting his wife, Deborra-Lee Furness.

“Just recently, it bugs her,” he said. “She goes: ‘It’s big. It’s everywhere!”

The rumors may affect Deborra a bit more than they do him, he says, because she frequents the internet more than he does. But he maintains that he is deeply devoted to her and to his family, and says he tries to shrug off the comments. “X-Men” producer Lauren Shuler Donner feels the same way.

“I have seen him with Deborra since the beginning of their trip to Hollywood, and I’ve been on five movie sets with him and have never seen him stray, have never seen him eye anyone. I met him when he did Oklahoma! [at London’s Royal National Theatre in 1999]. He was genuine, hugely talented. He was in love with his wife that day and still is,” she said.

The rumors may have began because Jackman is handsome and unafraid to bust out a show tune now and then, but many believe him when he says he’s a dedicated husband. He and Furness have been married 17 years.