Find and Remove Duplicate Records from Your Data
•Download as PPTX, PDF•
0 likes•1,194 views
Marketing campaigns are often compromised because of poor quality data. Duplicates can be very subtle and difficult to remove. In this presentation you will find the insights to accurately detect and how to remove them. Then you need to ensure that you do not add any more duplicates - find out how best to avoid this problem.
Recommended
Recommended
More Related Content
Similar to Find and Remove Duplicate Records from Your Data
Similar to Find and Remove Duplicate Records from Your Data (20)
Recently uploaded
Recently uploaded (20)
Find and Remove Duplicate Records from Your Data
- 1. When Your Data Has To Be Absolutely, Positively Accurate The Duplicitous Duplicate How To Find Duplicates and How To Find Them Quickly
- 2. When Your Data Has To Be Absolutely, Positively Accurate You may be wondering how a duplicate can be duplicitous. Well, duplicates can be awfully deceiving to find at times, subtle differences fool software engines easily Mr Richard Morrison, 21 1st West Avenue, Greater London, W1 4AB Mr. Dick J. Morrison obe, 21a First Western Avenue, London, w1 E.g .
- 3. When Your Data Has To Be Absolutely, Positively Accurate That innocent looking duplicate can have a devastating affect… Incorrect Reporting: E.g. Number of Customers Reputation Affected: Sending multiple correspondence to the same person Cost Wastage: Mailing and brochure costs Missed Opportunity: Information spread across multiple contacts and accounts
- 4. When Your Data Has To Be Absolutely, Positively Accurate So how do remove them once and for all? Two fold strategy… Batch find all duplicates and merge/purge them Create a process and/or add technology to reduce entering duplicates Garbage-In, Garbage-Out
- 5. When Your Data Has To Be Absolutely, Positively Accurate Step 1: Find and Eliminate Duplicates Two considerations required… What records should I compare? How do I compare them?
- 6. When Your Data Has To Be Absolutely, Positively Accurate Why can’t I compare all records with all others? You can, but if you have lots of records, then the number of comparisons becomes huge…and you could be waiting hours or days for it to process… Record Size Comparisons 1,000 1,000 x 1,000 = 1,000 2,000 2,000 x 2,000 = 4,000 10,000 10,000 x 10,000 = 100,000,000 Very quickly, the number of comparisons becomes impractical
- 7. When Your Data Has To Be Absolutely, Positively Accurate Then how do we decide what to compare? Using a technique called Indexing to categorise similar records… …you are substantially reducing the number of comparisons, and the time taken to find all the duplicates
- 8. When Your Data Has To Be Absolutely, Positively Accurate Here are some ways to match data… Exact Match Mathews Mathews Fuzzy Match Liverpool Livrepol Case Match Oxford OXFORD Sound Match Phone fone Out of Sequence Match Sales and Marketing Director Director of Marketing & sales Acronym Match USA United States of America Abbreviation Match Department Dept
- 9. When Your Data Has To Be Absolutely, Positively Accurate How do I compare two records? Create Duplicate Business Rules Like These: Rule 1: First Name + Last Name + Email all Match Found Duplicate Rule 2: First Name + Last Name + Address all Match Found Duplicate and so on…
- 10. When Your Data Has To Be Absolutely, Positively Accurate What if my data is across multiple files or tables? The same techniques apply, except you have to create rules base on joining the data together… Company Contact Addresses Orders Revenue
- 11. When Your Data Has To Be Absolutely, Positively Accurate How do I choose the master record? This will depend on your business…but here some common criter Most Recently Created Record Most Recent Order Most Contacts Most Information Recently Modified Record Best Fit For Current Target
- 12. When Your Data Has To Be Absolutely, Positively Accurate Step 2: Reduce Entering Duplicates? Create a data entry process for users to search the system for similar records before a new one is created and/or Add special matching codes to the database that automatically presents the user with a list of possible duplicates
- 13. When Your Data Has To Be Absolutely, Positively Accurate Don’t Wait Any Longer…Eliminate Duplicates Now Live Chat Call Us +44 844 800 8837 Email Us info@acuate.com Have Acuate Call You acuate.com Talk To Us Now acuate.com Whether you have a small database or millions of records, you can accurately and quickly find and remove duplicate information. For a no obligation assessment, contact us…