How can I use Remove Duplicate Function to remove all the duplicate numbers and the origin

I have an advanced question on how I can use the Remove Duplicate Function.
How can I use the Remove Duplicate Function to remove all the duplicate numbers along with the original numbers that became duplicates too.

So question is. I'm trying to remove duplicates from a list on my excel 10. I need to not just remove the duplicates but remove both duplicates of the same string of files.

For example Lets say I have a list like this.

46
35
20
45
46
20
17
18

So If I remove the duplicates Excel would remove the 46 and the 20
but I want to go much further then that and I want to remove both 46's and both 20's. So I'm left with only 35 45 17 18.
My real list has over 2000 entries. I'm just made this example up to give you an idea what I'm trying to do.

Is there a way I can do this?

thanks zotah