Best practices for data review?
I hope I'm not asking something that's already been answered, but I didn't immediately see a post on this, although I haven't been a consistent user of the forum so I could have been looking in the wrong place.
Our development staff recently expanded, with an additional layer between data entry and the director. I have moved from being primarily responsible for data entry and database administration/ data health to being responsible for database administration and supervising the data entry process. This is a needed change, as our database has expanded drastically over the past couple of years, and having a position that is responsible for data integrity is overdue.
My question is, how do other organizations review their data? Having not had a formal plan in place before, I have been thinking of the ways in which we pull, use and report on our data. Creating a training manual to compliment our database protocols has been valuable in organizing my thoughts on our needs, but I'd love to hear from other organizations tackle database health. Are there any best practices out there?
Comments
-
Nicole Holt:
I hope I'm not asking something that's already been answered, but I didn't immediately see a post on this, although I haven't been a consistent user of the forum so I could have been looking in the wrong place.
Our development staff recently expanded, with an additional layer between data entry and the director. I have moved from being primarily responsible for data entry and database administration/ data health to being responsible for database administration and supervising the data entry process. This is a needed change, as our database has expanded drastically over the past couple of years, and having a position that is responsible for data integrity is overdue.
My question is, how do other organizations review their data? Having not had a formal plan in place before, I have been thinking of the ways in which we pull, use and report on our data. Creating a training manual to compliment our database protocols has been valuable in organizing my thoughts on our needs, but I'd love to hear from other organizations tackle database health. Are there any best practices out there?
Nicole - conratulations on your move.
I am not exactly sure how to answer your post as I am not sure exactly what you mean by "data review". The data in a database gets reviewed in any number of ways - with different goals. Do you mean what I call "data auditing"? Checking to be sure that things are being put in properly, completely, and accurately?
I have presented at BBCON on data auditing before and have some slides on the topic. The basic premise is querying - what can you check by query and how often should you check it? I have query folders for daily, weekly, monthly, quarterly and annual audits. Every day after gift entry is complete - we run the daily audits. These look for common errors made in gift entry which would result in an incorrect receipt or report to the team. Every week we query on other things that should get addressed quickly for reporting purposes but would not have resulted in a problem with a gift receipt. We do most of our constituent audits monthly - errors in addresses that were changed, etc.
There will certainly be things you can not query on. The donor indicated on a reply device they wanted only one solicitation a year - did your gift processor see it and mark the record properly? No query would catch this - these would need to be double checked from the original backup after gift entry, or if not a huge issue, minimally spot check records to be sure there are not issues with these being missed.
0 -
Nicole Holt:
I hope I'm not asking something that's already been answered, but I didn't immediately see a post on this, although I haven't been a consistent user of the forum so I could have been looking in the wrong place.
Our development staff recently expanded, with an additional layer between data entry and the director. I have moved from being primarily responsible for data entry and database administration/ data health to being responsible for database administration and supervising the data entry process. This is a needed change, as our database has expanded drastically over the past couple of years, and having a position that is responsible for data integrity is overdue.
My question is, how do other organizations review their data? Having not had a formal plan in place before, I have been thinking of the ways in which we pull, use and report on our data. Creating a training manual to compliment our database protocols has been valuable in organizing my thoughts on our needs, but I'd love to hear from other organizations tackle database health. Are there any best practices out there?
Nicole, there have been some past discussions on this but, yes, can be hard to find using search - get lots of job postings. Some words to try might be: database cleansing, audit. Most are probably under data or admin sections of forum.
I start with "Where do mistakes happen?" Build a query to check for that. Can be missing data - like no constit code (even though it's a required field)zip code, no title, no gender, coding/notation for invalid addresses/address updates, address blank + 'no valid address' unchecked...etc. To me, you're definitely starting correctly by looking at how you pull, use and report on your data.
I did find this earlier post - wasn't the one I was looking for but might give you some ideas on keeping data integrity: http://forums.blackbaud.com/forums/p/15375/145596.aspx#145596
Just a couple of thoughts
0 -
Melissa Graves:
Nicole - conratulations on your move.
I am not exactly sure how to answer your post as I am not sure exactly what you mean by "data review". The data in a database gets reviewed in any number of ways - with different goals. Do you mean what I call "data auditing"? Checking to be sure that things are being put in properly, completely, and accurately?
I have presented at BBCON on data auditing before and have some slides on the topic. The basic premise is querying - what can you check by query and how often should you check it? I have query folders for daily, weekly, monthly, quarterly and annual audits. Every day after gift entry is complete - we run the daily audits. These look for common errors made in gift entry which would result in an incorrect receipt or report to the team. Every week we query on other things that should get addressed quickly for reporting purposes but would not have resulted in a problem with a gift receipt. We do most of our constituent audits monthly - errors in addresses that were changed, etc.
There will certainly be things you can not query on. The donor indicated on a reply device they wanted only one solicitation a year - did your gift processor see it and mark the record properly? No query would catch this - these would need to be double checked from the original backup after gift entry, or if not a huge issue, minimally spot check records to be sure there are not issues with these being missed.
Thanks so much, Melissa. "Data auditing" would be a more precise term. Your schedule of daily/weekly/monthly queries looks like a great start! And, as you said, the items that are not captured are likely to be the more difficult issues. Since we have new staff, daily reconciliation of data provided vs. data entered will be vital, at least for the near-term.
0 -
JoAnn Strommen:
Nicole, there have been some past discussions on this but, yes, can be hard to find using search - get lots of job postings. Some words to try might be: database cleansing, audit. Most are probably under data or admin sections of forum.
I start with "Where do mistakes happen?" Build a query to check for that. Can be missing data - like no constit code (even though it's a required field)zip code, no title, no gender, coding/notation for invalid addresses/address updates, address blank + 'no valid address' unchecked...etc. To me, you're definitely starting correctly by looking at how you pull, use and report on your data.
I did find this earlier post - wasn't the one I was looking for but might give you some ideas on keeping data integrity: http://forums.blackbaud.com/forums/p/15375/145596.aspx#145596
Just a couple of thoughts
Thanks so much, JoAnn! And thank you for the suggested search terms.
Best,
Nicole
0
Categories
- All Categories
- Shannon parent
- shannon 2
- shannon 1
- 21 Advocacy DC Users Group
- 14 BBCRM PAG Discussions
- 89 High Education Program Advisory Group (HE PAG)
- 28 Luminate CRM DC Users Group
- 8 DC Luminate CRM Users Group
- Luminate PAG
- 5.9K Blackbaud Altru®
- 58 Blackbaud Award Management™ and Blackbaud Stewardship Management™
- 409 bbcon®
- 2.1K Blackbaud CRM™ and Blackbaud Internet Solutions™
- donorCentrics®
- 1.1K Blackbaud eTapestry®
- 2.8K Blackbaud Financial Edge NXT®
- 1.1K Blackbaud Grantmaking™
- 527 Education Management Solutions for Higher Education
- 1 JustGiving® from Blackbaud®
- 4.6K Education Management Solutions for K-12 Schools
- Blackbaud Luminate Online & Blackbaud TeamRaiser
- 16.4K Blackbaud Raiser's Edge NXT®
- 4.1K SKY Developer
- 547 ResearchPoint™
- 151 Blackbaud Tuition Management™
- 1 YourCause® from Blackbaud®
- 61 everydayhero
- 3 Campaign Ideas
- 58 General Discussion
- 115 Blackbaud ID
- 87 K-12 Blackbaud ID
- 6 Admin Console
- 949 Organizational Best Practices
- 353 The Tap (Just for Fun)
- 235 Blackbaud Community Feedback Forum
- 55 Admissions Event Management EAP
- 18 MobilePay Terminal + BBID Canada EAP
- 36 EAP for New Email Campaigns Experience in Blackbaud Luminate Online®
- 109 EAP for 360 Student Profile in Blackbaud Student Information System
- 41 EAP for Assessment Builder in Blackbaud Learning Management System™
- 9 Technical Preview for SKY API for Blackbaud CRM™ and Blackbaud Altru®
- 55 Community Advisory Group
- 46 Blackbaud Community Ideas
- 26 Blackbaud Community Challenges
- 7 Security Testing Forum
- 1.1K ARCHIVED FORUMS | Inactive and/or Completed EAPs
- 3 Blackbaud Staff Discussions
- 7.7K ARCHIVED FORUM CATEGORY [ID 304]
- 1 Blackbaud Partners Discussions
- 1 Blackbaud Giving Search™
- 35 EAP Student Assignment Details and Assignment Center
- 39 EAP Core - Roles and Tasks
- 59 Blackbaud Community All-Stars Discussions
- 20 Blackbaud Raiser's Edge NXT® Online Giving EAP
- Diocesan Blackbaud Raiser’s Edge NXT® User’s Group
- 2 Blackbaud Consultant’s Community
- 43 End of Term Grade Entry EAP
- 92 EAP for Query in Blackbaud Raiser's Edge NXT®
- 38 Standard Reports for Blackbaud Raiser's Edge NXT® EAP
- 12 Payments Assistant for Blackbaud Financial Edge NXT® EAP
- 6 Ask an All Star (Austen Brown)
- 8 Ask an All-Star Alex Wong (Blackbaud Raiser's Edge NXT®)
- 1 Ask an All-Star Alex Wong (Blackbaud Financial Edge NXT®)
- 6 Ask an All-Star (Christine Robertson)
- 21 Ask an Expert (Anthony Gallo)
- Blackbaud Francophone Group
- 22 Ask an Expert (David Springer)
- 4 Raiser's Edge NXT PowerUp Challenge #1 (Query)
- 6 Ask an All-Star Sunshine Reinken Watson and Carlene Johnson
- 4 Raiser's Edge NXT PowerUp Challenge: Events
- 14 Ask an All-Star (Elizabeth Johnson)
- 7 Ask an Expert (Stephen Churchill)
- 2025 ARCHIVED FORUM POSTS
- 322 ARCHIVED | Financial Edge® Tips and Tricks
- 164 ARCHIVED | Raiser's Edge® Blog
- 300 ARCHIVED | Raiser's Edge® Blog
- 441 ARCHIVED | Blackbaud Altru® Tips and Tricks
- 66 ARCHIVED | Blackbaud NetCommunity™ Blog
- 211 ARCHIVED | Blackbaud Target Analytics® Tips and Tricks
- 47 Blackbaud CRM Higher Ed Product Advisory Group (HE PAG)
- Luminate CRM DC Users Group
- 225 ARCHIVED | Blackbaud eTapestry® Tips and Tricks
- 1 Blackbaud eTapestry® Know How Blog
- 19 Blackbaud CRM Product Advisory Group (BBCRM PAG)
- 1 Blackbaud K-12 Education Solutions™ Blog
- 280 ARCHIVED | Mixed Community Announcements
- 3 ARCHIVED | Blackbaud Corporations™ & Blackbaud Foundations™ Hosting Status
- 1 npEngage
- 24 ARCHIVED | K-12 Announcements
- 15 ARCHIVED | FIMS Host*Net Hosting Status
- 23 ARCHIVED | Blackbaud Outcomes & Online Applications (IGAM) Hosting Status
- 22 ARCHIVED | Blackbaud DonorCentral Hosting Status
- 14 ARCHIVED | Blackbaud Grantmaking™ UK Hosting Status
- 117 ARCHIVED | Blackbaud CRM™ and Blackbaud Internet Solutions™ Announcements
- 50 Blackbaud NetCommunity™ Blog
- 169 ARCHIVED | Blackbaud Grantmaking™ Tips and Tricks
- Advocacy DC Users Group
- 718 Community News
- Blackbaud Altru® Hosting Status
- 104 ARCHIVED | Member Spotlight
- 145 ARCHIVED | Hosting Blog
- 149 JustGiving® from Blackbaud® Blog
- 97 ARCHIVED | bbcon® Blogs
- 19 ARCHIVED | Blackbaud Luminate CRM™ Announcements
- 161 Luminate Advocacy News
- 187 Organizational Best Practices Blog
- 67 everydayhero Blog
- 52 Blackbaud SKY® Reporting Announcements
- 17 ARCHIVED | Blackbaud SKY® Reporting for K-12 Announcements
- 3 Luminate Online Product Advisory Group (LO PAG)
- 81 ARCHIVED | JustGiving® from Blackbaud® Tips and Tricks
- 1 ARCHIVED | K-12 Conference Blog
- Blackbaud Church Management™ Announcements
- ARCHIVED | Blackbaud Award Management™ and Blackbaud Stewardship Management™ Announcements
- 1 Blackbaud Peer-to-Peer Fundraising™, Powered by JustGiving® Blogs
- 39 Tips, Tricks, and Timesavers!
- 56 Blackbaud Church Management™ Resources
- 154 Blackbaud Church Management™ Announcements
- 1 ARCHIVED | Blackbaud Church Management™ Tips and Tricks
- 11 ARCHIVED | Blackbaud Higher Education Solutions™ Announcements
- 7 ARCHIVED | Blackbaud Guided Fundraising™ Blog
- 2 Blackbaud Fundraiser Performance Management™ Blog
- 9 Foundations Events and Content
- 14 ARCHIVED | Blog Posts
- 2 ARCHIVED | Blackbaud FIMS™ Announcement and Tips
- 59 Blackbaud Partner Announcements
- 10 ARCHIVED | Blackbaud Impact Edge™ EAP Blogs
- 1 Community Help Blogs
- Diocesan Blackbaud Raiser’s Edge NXT® Users' Group
- Blackbaud Consultant’s Community
- Blackbaud Francophone Group
- 1 BLOG ARCHIVE CATEGORY
- Blackbaud Community™ Discussions
- 8.3K Blackbaud Luminate Online® & Blackbaud TeamRaiser® Discussions
- 5.7K Jobs Board