Not currently. Removing a Trusted Contact is on our roadmap.
In the meantime, you can make sure the Trusted Contact(s) you wish to remove do not have access to any of your folders. To double check, simply click on their name and make sure you are not sharing any folders. If any folders appear, click “manage” and remove them from the folder by de-selecting the checkbox.