Go to Orders > Customers >

 

Search/Select Customer > Address

Click on the Address you want to Edit and Save Customer.

Click on the Red Circled X to delete a Recipient address and Save Customer.