Filter DELETE REST API calls

I have a custom post type, that can be editable by more than one user.
Each post of that type has a field with the user ids who can edit it (kinda like co-authors).
But since many users have permissions to the post, I am not sure how to prevent deletion by other users (not in the co-authors’ list).