Data Cleanup Routines

Bob Wiebe

I have heard of a large organization using RE which runs a number of routine data cleanups on a regular basis.  I imagine this includes actions such as: checking that preferred abbreviations such as St or St. have been used consistently, looking for missing postal codes, genders, titles, checking that the correct province is associated with the city (we sometimes get Winnipeg, ME instead of Winnipeg, MB). I imagine there are other useful checks to run on a regular basis.  I would be interested to learn about more of same.  Thanks.

Gina Gerhard

I've enclosed a powerpoint presentation I created recently on auditing in RE - might give you some ideas ....



 

Laura Caswell

Great presentation! Thanks for sharing.



laura

 

Paula Alionyte

Thank you for uplaoding the presentation. I have just gone through and it pretty much covers everything that I normally do on a regular basis.

I understand that everyone has a different way of cleaning up RE, but I tend to have a folder with queries that are performed on a daily/weekly/monthly basis and have a code of the tab: Bio 1, Bio 2, Education, Business Relationships, Attributes etc. It does take quite a long while to get all the queries in place, but I guess you should take it as an ongoing process. 

Also, I believe it is very important to run monthly database metrics to keep track of any changes, especially if your organisation tends to run big imports/global changes/adds, as it allows you to track back to make sure that none of the important data is lost in the process.

Bob Wiebe

Gina, this was excellent. I appreciate your generosity in sharing this resource.  I now want to study it more closely and work out the application to our needs.  I would welcome the list of 200+ audit queries you offered.  I will attempt to send you my e mail in a separate note.

Michelle Williams 3

Gina Gerhard:

I've enclosed a powerpoint presentation I created recently on auditing in RE - might give you some ideas ....



 

Thank you Gina, I was looking for some way to make my Data Hygiene (auditing) process make sense to others and your presentation was exactly what I needed. Thank you Thank you.

Daniel Noga 2

Gina Gerhard:

I've enclosed a powerpoint presentation I created recently on auditing in RE - might give you some ideas ....



 

Wow! I set up an audit Query using one of the first suggestions--checking for records with a Title, but no Gender--and got just short of 11,000 records. 



I don't want to know.



Anyway, this presentation is the Bee's Knees! Thanks for sharing it!

Donna Mac Manus

Gina Gerhard:

I've enclosed a powerpoint presentation I created recently on auditing in RE - might give you some ideas ....

Hi Gina

this has come at such an ideal time.  Im doing a complete clean at the moment which is quite complex as everyone knows but this breaks it down into a comprehensive structure for cleaning and future audits.  I would be really interested in the 200+ queries.  I have started and have a good few done. 



Many thanks again

Donna

 

 

Bradley Henry

Daniel Noga:

Gina Gerhard:

I've enclosed a powerpoint presentation I created recently on auditing in RE - might give you some ideas ....



 

Wow! I set up an audit Query using one of the first suggestions--checking for records with a Title, but no Gender--and got just short of 11,000 records. 



I don't want to know.



Anyway, this presentation is the Bee's Knees! Thanks for sharing it!

 

Hi Daniel,



One thing to remember is that Queries and Global changes go hand in hand.



We have the same sort of query but have created seperate queries to look for male specific titles like Mr, Sir, Lord, that don't have a Gender. Then we have a global change that adds the Male gender to all those records. The same applies for the Female specific titles like Ms, Miss, Lady, Her Honour. 



Once you have the easy gender specific ones sorted out with a global change you then are left with the non specific ones like Dr and Professor to look at manually.



Hope this helps, Bradley.