Hello @HoustonPutnamL. Great question! You can find all of your contacts that are not included on any of your lists by doing an Advanced Search in your contacts. I'm including a screenshot of the criteria that you will use for the search
After you find those contacts that are not on a list, you can then select the contacts and remove them.