Yes, you can.
In the Contacts module, click on a contact you wish to delete. In the contact details page, click on More on the top right corner and select Delete from the drop-down.
Note: You will not be able to delete a contact if transactions have been created for it. The transactions for the particular contact have to be deleted first after which you can proceed to delete the contact.