Yes, you can.
In the Customers or Vendors page, select the customer/vendor you wish to delete. In the details page, click on More on the top right corner and select Delete from the drop-down.
Note: You will not be able to delete a contact if any transactions have been created for it. The transactions for the particular contact have to be deleted first after which you can proceed to delete the contact.
Simplify accounting and