Compare Two Tables and Remove Duplicates in Google Sheets

Published on

Comparing two tables and removing duplicates in Google Sheets means identifying rows or data that exist in both tables and eliminating them from one of the tables.

For example, consider the following data in Sheet1, range A1:B:

NameAge
Rose25
Bob30
Mike35
Ben25

And this data in Sheet2, range A1:B:

NameAge
Rose25
David40
Mike35

Let’s compare these two tables and remove duplicates. You can decide from which table you want to remove duplicates.

  • If you consider Table1, you’ll retain rows with “Bob” and “Ben” after removing duplicates.
  • If you consider Table2, you’ll retain the row with “David.”

Below, I’ll provide the formula for Sheet1 and explain the adjustments you should make to apply it to Sheet2 instead.

Step 1: Compare Two Tables and Identify Duplicates

In cell C2 of Sheet1, enter the following formula:

=ArrayFormula(
   LET(
      table1, TRANSPOSE(QUERY(TRANSPOSE(Sheet1!A2:B),,9^9)), 
      table2, TRANSPOSE(QUERY(TRANSPOSE(Sheet2!A2:B),,9^9)), 
      IFNA(IF(XMATCH(table1, table2), "DUPLICATE"), "UNIQUE")
   )
)

This formula will return “DUPLICATE” for duplicate rows and “UNIQUE” for others.

Compare two tables for duplicates and label them in Google Sheets

Formula Breakdown:

  1. TRANSPOSE(QUERY(TRANSPOSE(Sheet1!A2:B), , 9^9))
  2. TRANSPOSE(QUERY(TRANSPOSE(Sheet2!A2:B), , 9^9))
    • Converts multiple columns in Sheet2 (range A2:B) into a single-column format.
  3. LET(table1, ..., table2, ...)
    • Assigns these results to table1 and table2, allowing for cleaner and reusable references in the formula.
  4. XMATCH(table1, table2)
    • Matches table1 values with table2. Returns a number for matches and an error (#N/A) for non-matches.
  5. IFNA(IF(..., "DUPLICATE"), "UNIQUE")
    • Labels matches as “DUPLICATE” and non-matches as “UNIQUE.”

This step identifies duplicates between the two tables. Now let’s proceed to remove them.

Step 2: Filter and Remove Duplicates

  1. Select column C.
  2. Click Data > Create a Filter.
  3. Click the dropdown arrow in cell C1 and uncheck “UNIQUE.”
  4. Click OK to filter out unique rows.
  5. Select the remaining rows (excluding the header).
  6. Click Edit > Delete Rows.
  7. Turn off the filter by clicking Data > Remove Filter.
Filter rows labeled as duplicates in Google Sheets

Modifications to Apply the Formula in Sheet2

If you want to apply the formula in Sheet2 instead of Sheet1, make the following change:

Replace XMATCH(table1, table2) with XMATCH(table2, table1). The updated formula becomes:

=ArrayFormula(
   LET(
      table1, TRANSPOSE(QUERY(TRANSPOSE(Sheet1!A2:B),,9^9)), 
      table2, TRANSPOSE(QUERY(TRANSPOSE(Sheet2!A2:B),,9^9)), 
      IFNA(IF(XMATCH(table2, table1), "DUPLICATE"), "UNIQUE")
   )
)

Enter this formula in cell C2 of Sheet2 and follow the same filtering process described above.

Conclusion

This method provides a flexible approach to compare two tables and remove duplicates. If your data spans multiple columns and you want to compare only specific columns, adjust the formula ranges accordingly.

For example:

  • To compare only columns A:C in both sheets (if the data spans A:Z), use Sheet1!A1:C and Sheet2!A1:C in the formula.
  • For non-adjacent columns like A, D, and F, combine them with HSTACK, e.g., HSTACK(Sheet1!A1:A, Sheet1!D1:D, Sheet1!F1:F).

Resources

Prashanth KV
Prashanth KV
Your Trusted Google Sheets and Excel Expert Prashanth KV is a Diamond Product Expert in Google Sheets, officially recognized by Google for his contributions to the Docs Editors Help Community and featured in the Google Product Experts Directory. Explore his blog to learn advanced formulas, automation tips, and problem-solving techniques to elevate your spreadsheet skills.

Top Discussions

More like this

Pivot Table Formatting, Output & Special Behavior in Google Sheets

Pivot Tables in Google Sheets are powerful—but they can get tricky once you move...

Pivot Table Calculations & Advanced Metrics in Google Sheets

When it comes to built-in tools for data analysis and visualization in Google Sheets,...

Google Sheets Pivot Table Tutorial: Basics, Setup, and Date Grouping

The easiest way to summarize, analyze, and report data in Google Sheets is by...

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.