Sean "Diddy" Combs is losing one part of his legal team as an attorney in his federal racketeering case steps down.

One of Sean "Diddy" Combs' lawyers filed a motion to withdraw from the mogul's defense team. Anthony Ricco did not provide a reason for his request, in which he wrote, "under no circumstances can I continue to effectively serve as counsel for Sean Combs," according to an affidavit obtained by PEOPLE.