Sometimes, when you’re in the public eye, the things you say can be misconstrued and blown out of proportion. But when you’re a sports figure tied to a beloved team, it pays to choose your words carefully. Reggie Jackson is finding that out the hard way.

After he made some disparaging comments to Sports Illustrated about Alex Rodriguez in regards to his statistics being marred due to possible performance-enhancing drug use, the Yankees higher-ups say they want him to take a break from team-related activities and keep out of the public eye for a while. He also questioned whether or not certain players deserved to be included in the Hall of Fame.

“…I think there are real questions about his numbers,” he said about Rodriguez. “As much as I like him, what he admitted about his usage does cloud some of his records. I didn’t see Kirby Puckett as a Hall of Famer. I didn’t see Gary Carter as a Hall of Famer. I didn’t see Don Sutton as a Hall of Famer. I didn’t see Phil Niekro as a Hall of Famer. As much as I like Jim Rice, I’m not so sure he’s a Hall of Famer.”

While some say Jackson hasn’t been formally disciplined, rumors are spreading that he’s been benched after he was told to stay home rather than accompany the team to Boston last weekend for their four-game series. He has reportedly reached out to the families of those players to apologize, especially Gary Carter’s, since he died earlier this year.