To delete REST API Credentials, click the action menu control for the credentials you would like to delete to access the action menu:
Click on "Delete" from the action menu, and confirm the delete request or cancel the action: