You need to select the line items and right click on the selected items to display the delete option: