HomeGoogle DocsSpreadsheetFind and Eliminate Duplicates Using Query Formula in Google Sheets

Find and Eliminate Duplicates Using Query Formula in Google Sheets

Published on

Learn how to find and eliminate duplicates using Query formula in Google Sheets. I’ve already shared a few awesome tips to find and eliminate duplicates in Google Doc Spreadsheets.

To eliminate duplicates the normal way is using the UNIQUE formula. But it has a shortfall. You can’t use the Unique based duplicate removal formula in all the circumstances.

See the below image. You can clearly understand that the UNIQUE function can’t do a certain type of duplicate elimination in Google Sheets.

Query to Find and Eliminate Duplicates in Google Doc Sheet

Here comes the QUERY function, the killer of many other spreadsheet functions, handy. You can use the Query function for different types of data manipulation techniques.

With Query, you can eliminate duplicates in 2-3 columns while keeping other columns with numbers summed.

Insights into Spreadsheet Duplicate Removal Using UNIQUE, QUERY, or by a Dynamic Formula

Let us see how the UNIQUE function treats duplicates.

Duplicate Removing Using UNIQUE a comparison with QUERY

Here on the left-hand side of the above image contains the source data. From this, it’s clear that one item is repeating multiple times. I’ve marked that above.

On the right-hand side of the screenshot, you can see the unique values that after removing the duplicates. Here the problem is we can’t get the values in Column C and as well as in Column D summed.

See how QUERY handles this. We can find and eliminate duplicates using Query in the following way.

How query formula eliminates duplicates - example

Here the QUERY formula not only eliminates the duplicates but also keeps the values in the adjacent columns summed.

Note: If you don’t want the values to SUM, you can use SORTN. Go to this tutorial to learn more.

So you are not losing any corresponding values with duplicate elimination. Query formula can group and sum the rows containing duplicates.

Before going to our tutorial, find and eliminate duplicates using Query, one more small tip.

You can find and mark duplicates in corresponding rows using a dynamic formula as below. You can pick any one row and match other rows for duplicates.

Mark Rows with “Yes” That Contain Duplicates in Google Sheets

trick to mark rows with duplicates in google sheets

If you find this interesting, below is the link.

You May Like: Find Duplicates in Google Sheets Using Dynamic Formula

How to Find and Eliminate Duplicates Using Query Formula in Google Sheets

Hope you are all ready using Google Sheets Query Function. If not, please follow the below link to master it. Also, a simple search on this site can bring more awesome QUERY tips and tricks.

Must Read: Learn Google Sheets Query.

As I’ve told you above, we can use the Query function to eliminate duplicates while retaining some columns.

The group by clause in Query language is enabling us to do this. Here is the formula based on our sample range above.

=query(A2:D9,"Select A,B, sum(C), sum(D) group by A,B label (A) 'Item Description',(B) 'Area', SUM(C) 'Qty', SUM(D)'Amount'")

This Query formula checks unique values in Column A and B. That means it removes duplicates from Column A and Column B.

How you can you use this Query formula for your use?

A2:D9 – data range. Change this range as per your data set.

Select A,B – We are checking unique values in these two columns.

What is unique rows? tips

In the above screenshot, the first row has a duplicate in the second row. The third one is not a duplicate as the second column value is different.

You can add more columns to the formula like Select A, B, C. But you should make the same changes in the group by part of the formula like group by A, B, C and also label part.

Here is a twist! You can use a combination of UNIQUE, SORT, and QUERY to get the same above query formula result. Here is that formula for your experiment.

={{"Item Description","Area";sort(unique(A2:B9))},query(A2:D9,"Select Sum(C),Sum(D) group by A,B label Sum(C)'Qty.', Sum(D) 'Amount'")}

Thanks for the stay!

Related:

  1. The ultimate duplicate removal tips in Google Spreadsheets.
  2. How to Use Remove Duplicates Menu Command in Google Sheets.
  3. Data Validation – How Not to Allow Duplicates in Google Sheets.
Prashanth KV
Prashanth KV
Your Trusted Google Sheets and Excel Guide Prashanth KV brings a wealth of experience in Google Sheets and Excel, cultivated through years of work with multinational corporations in Mumbai and Dubai. As a recognized Google Product Expert in Docs Editors, Prashanth shares his expertise through insightful blogging since 2012. Explore his blog for practical tips and guidance on maximizing your spreadsheet skills.

SORT and SORTBY – Excel Vs Google Sheets

While Excel offers the SORT and SORTBY functions for sorting a table, Google Sheets...

Get Top N Values Using Excel’s FILTER Function

When using the FILTER function in Excel to extract the top N values, it's...

XLOOKUP in Excel: Working with Visible Rows in a Table

In Excel, the XLOOKUP function isn't inherently designed to exclusively work with visible rows;...

SUMPRODUCT Differences: Excel vs. Google Sheets

The core purpose of the SUMPRODUCT function remains consistent across both Excel and Google...

More like this

Interactive Random Task Assigner in Google Sheets

You have multiple tasks and multiple people. Here's a fun way to randomly assign...

Google Sheets Bar and Column Chart with Target Coloring

To color each data point in the column or bar chart according to the...

Analyzing Column A Between Non-Adjacent Values in Column B: Google Sheets

This tutorial addresses a common scenario encountered in Google Sheets: how to sum, average,...

3 COMMENTS

  1. Hey, from Br,
    thanks for the article.

    Did you try in a big sheet, like 10 thousand rows?
    I did the same thing using INDEX and FREQUENCY, but it’s very low to calculate entire sheet in each access.

    regards

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.