The CEO of Waffle House has been accused of forcing a former employee to perform sexual acts in order to keep her job, and while he admits to a physical relationship with her, he insists it was consensual.

Joe W. Rogers Jr. admits he made a mistake in entering into a physical relationship with his former housekeeper while he was married, but says it began when he was separated from his first wife and that he acknowledges it was stupid…and that he won’t become a victim of her lies.

“Over an almost eight-year period when I was separated, single and re-married, I had a series of infrequent consensual sexual encounters with my housekeeper,” Rogers said of the woman, who was in his employ from 2003 until 2008, when she was let go. He later rehired her, however, but she quit this past summer. The fact that he rehired her may not look good to the judge in the case.

“Shortly thereafter, on July 16, 2012, I received a letter from her attorney containing false allegations and strong threats,” Rogers said. “According to her attorneys, she now wants millions of dollars from me.”

The woman claims that she was a single mother and was too scared to tell Rogers no when he made advances on her; on her part, it may be damning that she waited so long to come forward.

“The police report quotes the woman as saying that [Joseph Rogers Jr.] tried to force her to have sex with him despite her repeated protests. She said that he also touched her breasts, tried to remove her clothes, made lewd comments, and insisted she perform sex acts on him at least once or twice a month,” CBS News reports.