Compare Two Tables and Remove Duplicates in Google Sheets

Comparing two tables and removing duplicates in Google Sheets means identifying rows or data that exist in both tables and eliminating them from one of the tables.

For example, consider the following data in Sheet1, range A1:B:

NameAge
Rose25
Bob30
Mike35
Ben25

And this data in Sheet2, range A1:B:

NameAge
Rose25
David40
Mike35

Let’s compare these two tables and remove duplicates. You can decide from which table you want to remove duplicates.

  • If you consider Table1, you’ll retain rows with “Bob” and “Ben” after removing duplicates.
  • If you consider Table2, you’ll retain the row with “David.”

Below, I’ll provide the formula for Sheet1 and explain the adjustments you should make to apply it to Sheet2 instead.

Step 1: Compare Two Tables and Identify Duplicates

In cell C2 of Sheet1, enter the following formula:

=ArrayFormula(
   LET(
      table1, TRANSPOSE(QUERY(TRANSPOSE(Sheet1!A2:B),,9^9)), 
      table2, TRANSPOSE(QUERY(TRANSPOSE(Sheet2!A2:B),,9^9)), 
      IFNA(IF(XMATCH(table1, table2), "DUPLICATE"), "UNIQUE")
   )
)

This formula will return “DUPLICATE” for duplicate rows and “UNIQUE” for others.

Compare two tables for duplicates and label them in Google Sheets

Formula Breakdown:

  1. TRANSPOSE(QUERY(TRANSPOSE(Sheet1!A2:B), , 9^9))
  2. TRANSPOSE(QUERY(TRANSPOSE(Sheet2!A2:B), , 9^9))
    • Converts multiple columns in Sheet2 (range A2:B) into a single-column format.
  3. LET(table1, ..., table2, ...)
    • Assigns these results to table1 and table2, allowing for cleaner and reusable references in the formula.
  4. XMATCH(table1, table2)
    • Matches table1 values with table2. Returns a number for matches and an error (#N/A) for non-matches.
  5. IFNA(IF(..., "DUPLICATE"), "UNIQUE")
    • Labels matches as “DUPLICATE” and non-matches as “UNIQUE.”

This step identifies duplicates between the two tables. Now let’s proceed to remove them.

Step 2: Filter and Remove Duplicates

  1. Select column C.
  2. Click Data > Create a Filter.
  3. Click the dropdown arrow in cell C1 and uncheck “UNIQUE.”
  4. Click OK to filter out unique rows.
  5. Select the remaining rows (excluding the header).
  6. Click Edit > Delete Rows.
  7. Turn off the filter by clicking Data > Remove Filter.
Filter rows labeled as duplicates in Google Sheets

Modifications to Apply the Formula in Sheet2

If you want to apply the formula in Sheet2 instead of Sheet1, make the following change:

Replace XMATCH(table1, table2) with XMATCH(table2, table1). The updated formula becomes:

=ArrayFormula(
   LET(
      table1, TRANSPOSE(QUERY(TRANSPOSE(Sheet1!A2:B),,9^9)), 
      table2, TRANSPOSE(QUERY(TRANSPOSE(Sheet2!A2:B),,9^9)), 
      IFNA(IF(XMATCH(table2, table1), "DUPLICATE"), "UNIQUE")
   )
)

Enter this formula in cell C2 of Sheet2 and follow the same filtering process described above.

Conclusion

This method provides a flexible approach to compare two tables and remove duplicates. If your data spans multiple columns and you want to compare only specific columns, adjust the formula ranges accordingly.

For example:

  • To compare only columns A:C in both sheets (if the data spans A:Z), use Sheet1!A1:C and Sheet2!A1:C in the formula.
  • For non-adjacent columns like A, D, and F, combine them with HSTACK, e.g., HSTACK(Sheet1!A1:A, Sheet1!D1:D, Sheet1!F1:F).

Resources

Prashanth KV
Prashanth KV
Your Trusted Google Sheets and Excel Guide Prashanth KV brings a wealth of experience in Google Sheets and Excel, cultivated through years of work with multinational corporations in Mumbai and Dubai. As a recognized Google Product Expert in Docs Editors, Prashanth shares his expertise through insightful blogging since 2012. Explore his blog for practical tips and guidance on maximizing your spreadsheet skills.

Compare Two Tables for Differences in Excel

To compare two tables with similar data for differences, you can use the XLOOKUP...

Calculate Weighted Average in Pivot Table in Google Sheets

You can calculate a weighted average in a Pivot Table using a custom formula...

Summarize Data and Keep the Last Record in Google Sheets

In Google Sheets, we can summarize data (like sum, average, min, max, count) using...

How to Retrieve the Last Record in Each Group in Excel

As part of data analysis, you may need to retrieve the last record from...

More like this

Calculate Weighted Average in Pivot Table in Google Sheets

You can calculate a weighted average in a Pivot Table using a custom formula...

Summarize Data and Keep the Last Record in Google Sheets

In Google Sheets, we can summarize data (like sum, average, min, max, count) using...

Filter Data with Multi-Select Drop-Downs in Google Sheets

If you've started using multi-select drop-downs in Google Sheets, you may encounter challenges when...

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.