Suppressing duplicates

Options
Hello,


I am running a query with multiple fields and getting a lot of duplicates. I have used the 'suppress duplicate rows' in query options tab, but it still shows duplicates. Is there a way to fix this? Thanks, Kassie

Comments

  • Or use a sub-query aka Merge Query in RE There're some previous posts here about this that you should be able to find with a search.


    Cheers,

    Steve Cinquegrana | CEO and Principal Developer | Protégé Solutions

     
  • JoAnn Strommen:

    If you are including a 'one-to-many' field like phone, constituent code, gift date etc then no. Any field that has more than one entry will cause multiple listings of the same record. What we would consider duplicates are not suppressed.


    Query is considered a grouping tool to pull together the records meeting the criteria. Export using that query to pull only the relevant fields - each record only one time.

    Thanks JoAnn. I am doing one-to-many fields. Normally I used to export it into excel and then delete them manually but now I have 3500+ records and was wondering if there was an easy way out. Thank again. Cheers, Kassie.



     

  • Steven Cinquegrana:

    Or use a sub-query aka Merge Query in RE There're some previous posts here about this that you should be able to find with a search.


    Cheers,

    Steve Cinquegrana | CEO and Principal Developer | Protégé Solutions

     

    Thanks Steve. I have not used sub-query before - will have a look at it. Cheers, Kassie

  • JoAnn Strommen
    JoAnn Strommen ✭✭✭✭✭
    Ancient Membership Facilitator 4 Name Dropper Photogenic

    Kassie Sambaraju:

    JoAnn Strommen:

    If you are including a 'one-to-many' field like phone, constituent code, gift date etc then no. Any field that has more than one entry will cause multiple listings of the same record. What we would consider duplicates are not suppressed.


    Query is considered a grouping tool to pull together the records meeting the criteria. Export using that query to pull only the relevant fields - each record only one time.

    Thanks JoAnn. I am doing one-to-many fields. Normally I used to export it into excel and then delete them manually but now I have 3500+ records and was wondering if there was an easy way out. Thank again. Cheers, Kassie.



     

     

    Just to clarify, Kassie. By Export, I'm not referring to the export to excel function/icon on the query screen. If you use that then yes you will have to do all the clean up manually.  I am referring to the Export function (listed like Query/Batch/Mail on your screen). Just wanted to be sure we were understanding each other as I get impression from your reply that you're exporting your query.

  • JoAnn Strommen:

    Kassie Sambaraju:

    JoAnn Strommen:

    If you are including a 'one-to-many' field like phone, constituent code, gift date etc then no. Any field that has more than one entry will cause multiple listings of the same record. What we would consider duplicates are not suppressed.


    Query is considered a grouping tool to pull together the records meeting the criteria. Export using that query to pull only the relevant fields - each record only one time.

    Thanks JoAnn. I am doing one-to-many fields. Normally I used to export it into excel and then delete them manually but now I have 3500+ records and was wondering if there was an easy way out. Thank again. Cheers, Kassie.



     

     

    Just to clarify, Kassie. By Export, I'm not referring to the export to excel function/icon on the query screen. If you use that then yes you will have to do all the clean up manually.  I am referring to the Export function (listed like Query/Batch/Mail on your screen). Just wanted to be sure we were understanding each other as I get impression from your reply that you're exporting your query.

     

    Hmm, I have not used the Export function (listed like Query/Batch/Mail on my screen). I have to try this one - thanks JoAnn.

  • Kassie Sambaraju:

    Hello,


    I am running a query with multiple fields and getting a lot of duplicates. I have used the 'suppress duplicate rows' in query options tab, but it still shows duplicates. Is there a way to fix this? Thanks, Kassie

    query is a grouping tool not a reporting tool.

    Pull the query through an Export with the fields you want to look at and it will de-dupe.
  • Kassie Sambaraju:

    JoAnn Strommen:

    Kassie Sambaraju:

    JoAnn Strommen:

    If you are including a 'one-to-many' field like phone, constituent code, gift date etc then no. Any field that has more than one entry will cause multiple listings of the same record. What we would consider duplicates are not suppressed.


    Query is considered a grouping tool to pull together the records meeting the criteria. Export using that query to pull only the relevant fields - each record only one time.

    Thanks JoAnn. I am doing one-to-many fields. Normally I used to export it into excel and then delete them manually but now I have 3500+ records and was wondering if there was an easy way out. Thank again. Cheers, Kassie.



     

     

    Just to clarify, Kassie. By Export, I'm not referring to the export to excel function/icon on the query screen. If you use that then yes you will have to do all the clean up manually.  I am referring to the Export function (listed like Query/Batch/Mail on your screen). Just wanted to be sure we were understanding each other as I get impression from your reply that you're exporting your query.

     

    Hmm, I have not used the Export function (listed like Query/Batch/Mail on my screen). I have to try this one - thanks JoAnn.

     

    creating a query "list" also removes duplicates, depending on what  you are creating a query for though, lists are pretty limited

  • I figured an easy way out instead - after exporting the query to Excel, I removed duplicates by selecting Data tab in Excel - highlighted data and clicked on Remove Duplicates icon, selected Constituent ID for unique values. Voila - it worked!! Thanks for the support everyone!! Cheers, K 


     
  • Suzie MacMillan:

    Kassie Sambaraju:

    JoAnn Strommen:

    Kassie Sambaraju:

    JoAnn Strommen:

    If you are including a 'one-to-many' field like phone, constituent code, gift date etc then no. Any field that has more than one entry will cause multiple listings of the same record. What we would consider duplicates are not suppressed.


    Query is considered a grouping tool to pull together the records meeting the criteria. Export using that query to pull only the relevant fields - each record only one time.

    Thanks JoAnn. I am doing one-to-many fields. Normally I used to export it into excel and then delete them manually but now I have 3500+ records and was wondering if there was an easy way out. Thank again. Cheers, Kassie.



     

     

    Just to clarify, Kassie. By Export, I'm not referring to the export to excel function/icon on the query screen. If you use that then yes you will have to do all the clean up manually.  I am referring to the Export function (listed like Query/Batch/Mail on your screen). Just wanted to be sure we were understanding each other as I get impression from your reply that you're exporting your query.

     

    Hmm, I have not used the Export function (listed like Query/Batch/Mail on my screen). I have to try this one - thanks JoAnn.

     

    creating a query "list" also removes duplicates, depending on what  you are creating a query for though, lists are pretty limited

     

    I tried this but it did not give me the fields I wanted - it did remove duplicates though!!

     

Categories