Simon’s big ego resulted in the termination of his favorite co-host Paula. Now the search is on for two new judges and a host.

The X Factor‘s first season ratings didn’t live up to Simon Cowell‘s, 52, high expectations, leaving Paula Abdul and Nicole Scherzinger out in the cold. “It’s only because I opened my big mouth and said we were going to get 20 million [viewers],” Simon told Extra about the changes.

It’s business. It’s not personal. Simon displayed regret for having to ax his former American Idol co-host. “I would’ve liked to have kept [Paula],” Simon said. “She was very gracious, and I said that to her.”

And how is Nicole handling the slight? “I don’t think she’s mad. I think she’s disappointed,” Simon added.

Only Simon and record executive L.A. Reid remain at the judges table. Rumors of new judges include the Queen of Pop, Madonna, and new mother Beyonce. Simon shot down that idea as “complete nonsense.”

Poor Paula. Why didn’t Simon fight for her? Who do YOU think should replace her on the X-Factor?

More Simon Cowell News:

1. Simon Cowell Releases Shocking Statement About ‘X Factor’ Bloodbath
2. ‘X Factor’ Producers Want Mariah Carey, Fergie & Victoria Beckham As Replacements
3. Simon Cowell Is Wrong To Dump Paula Abdul From ‘X Factor,’ But Right To Fire Steve Jones & Nicole Scherzinger