I am trying to find a better way to dedupe records in spreasheet. The dupe records have exact fileds (ID, name, address etc) except the segment code which tells which segment this data is originally extracted from.

What i current do is sort the entire records by IDs and by segment codes. Then go to advanced filter to filter records based on ID field, then Excel will show the very first row of dupe records. Then i copy the visible data to a different worksheet to get the final deduped records. But this is time comsuming - it takes long time for system to filter and you can only copy part of data each time in case data is huge (over 70k).

It'll be much appreciated if there is anyone there who have better idea to do the same job?