Reducing database size - tips and tricks
Options
Hello, I'm wondering if people have advice on how to reduce the size of the RE database? Are there common practices/business rules to keep the database size low?
Size was not an issue prior to being hosted by Blackbaud, but now that we are hosted it appears we are just over the threshold of the first billing level. I'd like to see if there's a way to avoid unnecessary billing and Blackbaud support has not been that forthcoming...
Thanks!
Size was not an issue prior to being hosted by Blackbaud, but now that we are hosted it appears we are just over the threshold of the first billing level. I'd like to see if there's a way to avoid unnecessary billing and Blackbaud support has not been that forthcoming...
Thanks!
Tagged:
0
Comments
-
Out of curiosity, what is that threshold?0
-
I think it was 10GB and we ended up purchasing additonal storage for the year..0
-
My favorite one is to have EVERYONE search the database EVERY TIME before adding any new records. My search function works very well when applying the following ideas. Say you have a name like Bryan Smith, where the last name is very common, and the first name more common, but less so. I put into the last name field in search the whole Smith name, but only put Br into the first name, in case we've mis-spelled him as Brian. My name - Heather MacKenzie - I would put only the Mac or %Kenz% into the last name field, and just enough, Heat, into the first name field to find me. With a very uncommon name, such as Zamitly Savoran (real name - an employee at my hospital I work at) - I'd put Savo into the last name, but only need Z for the first name field.
Make sure your data entry people have lots of the check boxes checked when searching too. This brings up results when limiting doesn't. The 2 people who are data entry folks in my office have all the boxes checked except "Exact Match Only."
Hope this is helpful!0 -
(and keep on top of your duplicate constituent search/cleanup/report, whatever it's called - in the Admin area)0
-
First, assess your media file usage. Do you really need to keep the pdf of the donor's letter, or can you store that elsewhere on your own server? Or, simply summarize the letter's contents in a brief Notes entry? In Appeals, do you keep pdf images of your mail pieces, or can your Communications officer keep those in a separate folder on your own server?
Second, consider constituent cleansing. Although it is true that it is easier to re-activate lapsed donors than to acquire new ones, there are also instances when you just have to prune. If you have constituents who have never given a gift, and are 10 years old in your system, (and are not an Alumni), you may want to simply delete these records.
That being said, the goal for all fundraising databases is to keep growing. In an ideal world, as you acquire new donors and since you can't delete donors who have ever donated if yoru organization also uses Financial Edge, your number of constituent records will increase from year to year. If your trimming efforts do not work, you may have to simply strategize a way of increasing revenue to cover the additional costs.0 -
I also have found many records who are simply tributees - they were honored years ago, got their nice recognition card from us, and have had no action since. I say delete!0
-
Thanks all, I will take your great suggestions back and make some changes.
I was wondering if deleting very old queries would have much benefit? It was suggested to delete any that haven't been run in the last two years. Taking a quick look, there are probably around 800 queries which haven't been used for the last 3 years...0 -
Thinking about that one.....
Our batches have a shelf life, and get deleted after a certain length of time, which for us is 3 years. Batch related queries are the same.
We have deleted some of our old queries, but keep what you need to refer to in case you have to track the progression of any process through a length of time. I'm shocked that you have 800 queries! Sounds to me like you might have some duplication? Delete the duplicates, or easy to recreate. I don't even save all my queries that I make.0 -
If I kept my batch queries for 3 years I'd easily have 800+.
Not to hard to create a query batch # equals XXX if needed.
I fairly regularily go through an reveiw list of queries. I will almost always delete any I find that have not been run in past 2 years. Generally they are not that difficult to create and as our use of RE has gotten more saavy maybe even better if created differently.
You may want to check with your account rep or someone from BB to find out what type of data / records / reports / queries etc use the most storage space. I would assume most is constituent records and start with any clean up there.
0 -
F. O.:
I think it was 10GB and we ended up purchasing additonal storage for the year..Interesting - I was told billing was based on number of records, not size of the database... Is that an additional charge for exceeding a certain storage space, or is your billing based solely on the storage size rather than number of records you have?
0 -
Maybe that's for the new RE product? We moved to cloud hosting this spring and the billing was definitely based on database size. The cut-off was 10GB and additional storage was purchased in the event we exceeded it during the year.
0 -
Also when looking for duplicates before adding a new donor - remove all names in the search and then fill in address line 1 only then search. I find many people that way with misspelled names which would not pop up in a name search even with truncated names. (Most of these are from Radiothons where the name is just heard over the phone and often misspelled. - We now check all Radiothon phone donors through LexisNexis in order to get correct information before adding!)
Great ideas to remove old unnecessary queries, exports, etc. Also have moved pdf's from constituent records to a file outside of Raiser's Edge - now RE record juast has a note with "pdf in folder _____"0 -
Hi FO,
Omatic does a lot of data services and very frequently we see RE databases that are incredibly large for the number of constituents/gifts they contain. It's always fun to analyze the tables to see which are the largest, and there is almost always a single "smoking gun" reason for the database bloat. There are many different causes, but one I've seen a few times is a notepad added automatically to many, many records, and the notepad rich-text has a large image in it. If so, it's possible to delete the rich text version of the notes and just keep the plain text, freeing up plenty of space. If you'd like us to analyze your DB to see if there's a smoking gun (just for fun), just let me know.
Jeff
Jeffrey Montgomery
Founder, Omatic Software
We did it again! Omatic Software named to Inc. 500|5000--America’s Fastest-Growing Private Companies list for 4th Consecutive Year.
0
Categories
- All Categories
- Shannon parent
- shannon 2
- shannon 1
- 21 Advocacy DC Users Group
- 14 BBCRM PAG Discussions
- 89 High Education Program Advisory Group (HE PAG)
- 28 Luminate CRM DC Users Group
- 8 DC Luminate CRM Users Group
- Luminate PAG
- 5.9K Blackbaud Altru®
- 58 Blackbaud Award Management™ and Blackbaud Stewardship Management™
- 409 bbcon®
- 2.1K Blackbaud CRM™ and Blackbaud Internet Solutions™
- donorCentrics®
- 1.1K Blackbaud eTapestry®
- 2.8K Blackbaud Financial Edge NXT®
- 1.1K Blackbaud Grantmaking™
- 527 Education Management Solutions for Higher Education
- 1 JustGiving® from Blackbaud®
- 4.6K Education Management Solutions for K-12 Schools
- Blackbaud Luminate Online & Blackbaud TeamRaiser
- 16.4K Blackbaud Raiser's Edge NXT®
- 4.1K SKY Developer
- 547 ResearchPoint™
- 151 Blackbaud Tuition Management™
- 1 YourCause® from Blackbaud®
- 61 everydayhero
- 3 Campaign Ideas
- 58 General Discussion
- 115 Blackbaud ID
- 87 K-12 Blackbaud ID
- 6 Admin Console
- 949 Organizational Best Practices
- 353 The Tap (Just for Fun)
- 235 Blackbaud Community Feedback Forum
- 55 Admissions Event Management EAP
- 18 MobilePay Terminal + BBID Canada EAP
- 36 EAP for New Email Campaigns Experience in Blackbaud Luminate Online®
- 109 EAP for 360 Student Profile in Blackbaud Student Information System
- 41 EAP for Assessment Builder in Blackbaud Learning Management System™
- 9 Technical Preview for SKY API for Blackbaud CRM™ and Blackbaud Altru®
- 55 Community Advisory Group
- 46 Blackbaud Community Ideas
- 26 Blackbaud Community Challenges
- 7 Security Testing Forum
- 1.1K ARCHIVED FORUMS | Inactive and/or Completed EAPs
- 3 Blackbaud Staff Discussions
- 7.7K ARCHIVED FORUM CATEGORY [ID 304]
- 1 Blackbaud Partners Discussions
- 1 Blackbaud Giving Search™
- 35 EAP Student Assignment Details and Assignment Center
- 39 EAP Core - Roles and Tasks
- 59 Blackbaud Community All-Stars Discussions
- 20 Blackbaud Raiser's Edge NXT® Online Giving EAP
- Diocesan Blackbaud Raiser’s Edge NXT® User’s Group
- 2 Blackbaud Consultant’s Community
- 43 End of Term Grade Entry EAP
- 92 EAP for Query in Blackbaud Raiser's Edge NXT®
- 38 Standard Reports for Blackbaud Raiser's Edge NXT® EAP
- 12 Payments Assistant for Blackbaud Financial Edge NXT® EAP
- 6 Ask an All Star (Austen Brown)
- 8 Ask an All-Star Alex Wong (Blackbaud Raiser's Edge NXT®)
- 1 Ask an All-Star Alex Wong (Blackbaud Financial Edge NXT®)
- 6 Ask an All-Star (Christine Robertson)
- 21 Ask an Expert (Anthony Gallo)
- Blackbaud Francophone Group
- 22 Ask an Expert (David Springer)
- 4 Raiser's Edge NXT PowerUp Challenge #1 (Query)
- 6 Ask an All-Star Sunshine Reinken Watson and Carlene Johnson
- 4 Raiser's Edge NXT PowerUp Challenge: Events
- 14 Ask an All-Star (Elizabeth Johnson)
- 7 Ask an Expert (Stephen Churchill)
- 2025 ARCHIVED FORUM POSTS
- 322 ARCHIVED | Financial Edge® Tips and Tricks
- 164 ARCHIVED | Raiser's Edge® Blog
- 300 ARCHIVED | Raiser's Edge® Blog
- 441 ARCHIVED | Blackbaud Altru® Tips and Tricks
- 66 ARCHIVED | Blackbaud NetCommunity™ Blog
- 211 ARCHIVED | Blackbaud Target Analytics® Tips and Tricks
- 47 Blackbaud CRM Higher Ed Product Advisory Group (HE PAG)
- Luminate CRM DC Users Group
- 225 ARCHIVED | Blackbaud eTapestry® Tips and Tricks
- 1 Blackbaud eTapestry® Know How Blog
- 19 Blackbaud CRM Product Advisory Group (BBCRM PAG)
- 1 Blackbaud K-12 Education Solutions™ Blog
- 280 ARCHIVED | Mixed Community Announcements
- 3 ARCHIVED | Blackbaud Corporations™ & Blackbaud Foundations™ Hosting Status
- 1 npEngage
- 24 ARCHIVED | K-12 Announcements
- 15 ARCHIVED | FIMS Host*Net Hosting Status
- 23 ARCHIVED | Blackbaud Outcomes & Online Applications (IGAM) Hosting Status
- 22 ARCHIVED | Blackbaud DonorCentral Hosting Status
- 14 ARCHIVED | Blackbaud Grantmaking™ UK Hosting Status
- 117 ARCHIVED | Blackbaud CRM™ and Blackbaud Internet Solutions™ Announcements
- 50 Blackbaud NetCommunity™ Blog
- 169 ARCHIVED | Blackbaud Grantmaking™ Tips and Tricks
- Advocacy DC Users Group
- 718 Community News
- Blackbaud Altru® Hosting Status
- 104 ARCHIVED | Member Spotlight
- 145 ARCHIVED | Hosting Blog
- 149 JustGiving® from Blackbaud® Blog
- 97 ARCHIVED | bbcon® Blogs
- 19 ARCHIVED | Blackbaud Luminate CRM™ Announcements
- 161 Luminate Advocacy News
- 187 Organizational Best Practices Blog
- 67 everydayhero Blog
- 52 Blackbaud SKY® Reporting Announcements
- 17 ARCHIVED | Blackbaud SKY® Reporting for K-12 Announcements
- 3 Luminate Online Product Advisory Group (LO PAG)
- 81 ARCHIVED | JustGiving® from Blackbaud® Tips and Tricks
- 1 ARCHIVED | K-12 Conference Blog
- Blackbaud Church Management™ Announcements
- ARCHIVED | Blackbaud Award Management™ and Blackbaud Stewardship Management™ Announcements
- 1 Blackbaud Peer-to-Peer Fundraising™, Powered by JustGiving® Blogs
- 39 Tips, Tricks, and Timesavers!
- 56 Blackbaud Church Management™ Resources
- 154 Blackbaud Church Management™ Announcements
- 1 ARCHIVED | Blackbaud Church Management™ Tips and Tricks
- 11 ARCHIVED | Blackbaud Higher Education Solutions™ Announcements
- 7 ARCHIVED | Blackbaud Guided Fundraising™ Blog
- 2 Blackbaud Fundraiser Performance Management™ Blog
- 9 Foundations Events and Content
- 14 ARCHIVED | Blog Posts
- 2 ARCHIVED | Blackbaud FIMS™ Announcement and Tips
- 59 Blackbaud Partner Announcements
- 10 ARCHIVED | Blackbaud Impact Edge™ EAP Blogs
- 1 Community Help Blogs
- Diocesan Blackbaud Raiser’s Edge NXT® Users' Group
- Blackbaud Consultant’s Community
- Blackbaud Francophone Group
- 1 BLOG ARCHIVE CATEGORY
- Blackbaud Community™ Discussions
- 8.3K Blackbaud Luminate Online® & Blackbaud TeamRaiser® Discussions
- 5.7K Jobs Board