MEGA/WENN

Ray J says he will not be silenced after Kim Kardashian and her mom, Kris Jenner, sued him for defamation.

“They will not silence me!” he said in a video livestream. “I cannot be silenced… These MFs think they can silence us?”

“I’m not alright,” he continued. “All I’ve been trying to do is be a good person, bro… We got nothing but love and respect for women… The next couple of days is tainted by accusations from KK and her mom, and all of these things. I just can’t take it no more.”

In a recent podcast with Chrisean Rock, Ray J accused Kim and Kris of human trafficking. He claimed they were under federal investigation and that RICO racketeering charges were coming.

He said he leaked information about the pair to the feds and he was fully cooperating with the government to bring down his ex and her mom.

John Shearer/WireImage

“The federal RICO I’m about to drop on Kim and Kris is about to be crazy,” he claimed. “I’m talking about… I’m on the news every day, I’m gonna say a lot of s–t. Anybody that is cool with Kim, they need to tell her now: The feds is coming. There’s nothing I can do about it.”

Alex Spiro, the New York attorney representing Kim and Kris, tells PEOPLE in a statement that Ray J’s allegations left them “no choice” but to sue him.

Spiro said this is the first time Kim, 44, or Kris, 69, have sued someone for defamation.

“Kris Jenner and Kim Kardashian have never brought a defamation claim before nor have they been distracted by noise – but this false and serious allegation left no choice,” Spiro said.

Spiro added that Ray J is “unable to accept the end of his fleeting relationship with Ms. Kardashian over 20 years ago. Ray J has repeatedly sought to attach himself to Plaintiffs’ names and exploit their prominence for personal gain.”

Even though Sandrarose.com doesn’t have a pony in this race, Alex Spiro threatened this blog with legal action in an email dated Sept. 26.

Read the email below.