Orders can be deleted by clicking Delete in several places:
Orders Details View: In the Tool Bar.
Orders List View: To the right of the order.
The order will be deleted after your confirmation of the action.