Stop user from Assign record to another user or team, but allow assign to me

Hello,

How can i stop a Dynamics CRM user from Assigning a Case record to another user or team. However he should be allowed to assign that Case to himself (to Me). Please advise how I should tweak the Assign permission/privilege.

Than you.