Excel 2007 : Finding and Removing Multiple (Not Duplicate) Entries

Hello! Haven't been able to find a solution to this (everything is about duplicate entries) so I'm hoping someone can help. I am in charge of maintaining an email distribution list for a newsletter as part of my job. Currently we are at 22,000 email addresses. The issue is that I get a lot of bounced emails. I've found a macro that lets me filter the bounced email addresses from my Outlook account, but now I'm trying to remove them from the list of 22,000 email addresses.

So basically I have an Excel spreadsheet that has the 22,000 email addresses (List A) and I have another that has the 795 bounced email addresses (List B). I need a way that I can search List A with the data from List B and either highlight the data on List A or just remove it outright. I really do not want to search for 795 emails individually.

Any clues?