Grimmy will not be returning as a judge on the X Factor this year.
He confirmed the news on his Radio 1 Breakfast Show saying he quit the show and wasn’t fired.
“I did love it and it’s not a diss to the show. It’s a great show and I loved it. But it’s definitely a once in a lifetime style thing,” he said.
He says he decided to leave the show during his time off at Christmas after the 2015 final, won by Louisa Johnson, aired.
Grimmy joked: “You can’t have a curry when you’re on it on a Saturday night because you’re there.
“What’s really good about X Factor is watching it at your house with your friends [and] having a curry.
“When you’re there, there’s no curry. Simon promised me curry.”
During the last series, Grimmy mentored Che Chesterman, Seann Miley Moore and Mason Noise.
ITV recently confirmed The X Factor will continue “into 2017 and beyond”.
It was after speculation the show could be rested following poor ratings and The Voice switching from the BBC.
The Voice is due to begin on ITV next year.
It’s not known whether Rita Ora or Cheryl will return but it is thought Simon will remain on the panel.
There have been rumours Simon is lining up Louis Tomlinson to have a role on the show when it returns.
Last year Louis helped Simon at the judges houses round.