Your best option in that regard may be to do a specific segmentation with similar criteria to really drill down the contacts that aren't engaging with your material at all:
Contact Activity > Did Not Open > either a date range of emails, or last 5 emails
Contact Activity > Did Not Click > either a date range of emails, or last 5 emails
... View more