Giuliana Rancic's comment to Zendaya's dreadlocks at the Grammy caused furor online followed by the controversial exit of Kelly Osbourne on the show in late February.
A source told Radar that Osbourne was forced to leave the show as she was given the option to quit or be fired.
E! then announced that the show will resume to air on March 30, but did not announce Osbourne's replacement.
But according to a source of Radar Online, E! might cancel the show due to the humiliating scandal and "Fashion Police" is a "sinking-ship and Giuliana Rancic is the anchor," and Kelly Osbourne and Kathy Griffin left the show because of Giuliana.
"It is not a coincidence that all of the women who work with Giuliana quit," the source told Radar.
On March 13, Kathy Griffin announced on Twitter that she's leaving the show too.
"When I chose to step into the shoes of my beloved Joan Rivers...I was thrilled to continue her legacy as a woman being brash and eccentric on television," she wrote.
"I discovered that my style does not fit with the creative direction of the show and now it's time to move on."
E! later confirmed to HuffPost about Griffin's departure, and reiterated that the show will air as scheduled on March 30 with hosts Giuliana Rancic and Brad Goreski.
"We can confirm that Kathy Griffin is leaving E!'s "Fashion Police." We wish her all the best and are grateful for her time on the show, as well as the many laughs that she gave us all," a representative of E! said in a statement.
"Fashion Police will return, as scheduled, on Monday, March 30 at 9pm with our talented Co-Hosts Giuliana Rancic and Brad Goreski and Executive Producer Melissa Rivers. No further information is available at this time."