Thanks for posting this feedback. There are a couple of ways you can quickly remove a contact from just one list.
1. In the contact's details:
2. By checking the contact off in any list view and using the "Add to Email Lists" button in the header. (Uncheck the list you want to remove them from)