Average Time to Export a Custom Report?
Thanks for any input!
Comments
-
That sounds about right. It depends on how many records and what type of fields you use. I have reports that take 2 hours or more, but those containover 20,000 records. I also find that reports where I am exporting attributes take longer.0
-
As Marie mentioned it depends on a lot of factors: number of records, number and type of fields, criteria, and even your hardware. If you are exporting summary fields try having the report do the work instead, if possible (instead of exporting total giving do the calculations in the report). I've never actually tested if that helps but it sure does make me feel better.
Either way 10 minutes seems like a long time to wait for a report.
Give us some info about the fields and we might be able to give more specific advice.
Josh0 -
Josh Bekerman:
As Marie mentioned it depends on a lot of factors: number of records, number and type of fields, criteria, and even your hardware. If you are exporting summary fields try having the report do the work instead, if possible (instead of exporting total giving do the calculations in the report). I've never actually tested if that helps but it sure does make me feel better.Either way 10 minutes seems like a long time to wait for a report.
Give us some info about the fields and we might be able to give more specific advice.
Josh
This is the list of Fields in this particular report. There are maybe 3-4 more for Events under Event participations. Thanks for the replies so far!0 -
How many constituents? Also, are you exporting all notes, events, media, memberships for each constituent? Now that I see the fields 10 minutes doesn't seem that bad.
Do you already have the report built? I'm guessing it's something of a constituent profile, ya?0 -
I believe it is roughly 50 constituents, and I believe you are correct as to it being a constituent profile. Where would I check if I am exporting the notes, events, and such for each constituent? I thought it only exported whatever I select in the Output fields? I am leaving the office now, but I will reply as soon as I can tomorrow. Thanks!0
-
50 constituents shouldn't take 10 minutes, but it would when you add on all of their membership records, media info, notes, and event info.
It is only exporting the fields you selected in the output, but it's also possible that you are exporting all info of that type of record. For example, when you select a membership field for the output a window appears asking how many memberships should be exported per constituent, along with the option to select All membership categories or just specific ones. If you leave the "how many" blank it will export all membership records for all constituents in the export. If you are an org that has had a membership program for the past 20 years that could add up to a lot of information being exported. Same thing for notes, media, events, etc.0 -
Josh Bekerman:
If you are exporting summary fields try having the report do the work instead, if possible (instead of exporting total giving do the calculations in the report). I've never actually tested if that helps but it sure does make me feel better.Josh, it's interesting that you say that -- we were just in a meeting discussing a pretty big report that takes over an hour to export. My theory was that the inclusion of several gift summary fields was slowing the export way down, and if she just dumped all the constituents' gifts into the export, removed the summaries, and summarized in the report, it might go faster.
So I also don't know the answer yet, but we're going to give it a try and I'll report back if I remember to.0 -
I would have thought it would take longer, since you have to export every single gift. Please let us know what you find out!
0 -
I'm wondering if this might also be due to all of the different SQL tables the export is pulling from. (If you've never done it, take a look at the RE7 schema and, for example, figure out how many tables are involved just to pull phone numbers from preferred addresses. It's a great way to spend a weekend afternoon.
) I'm not a SQL guru (and I don't play one on tv) so I have no idea if this has anything to do with it. Even so, there's probably nothing you could do about it, but I'll mention it anyway.
0 -
Marie Stark:
I would have thought it would take longer, since you have to export every single gift. Please let us know what you find out!
Will do!
I'm also not an SQL guru, but the basic concept is when you export everything, you're saying: give me this person, and find the gifts linked to them and export them too.
When you do a summary, you're saying, give me this person, and do another query for gifts that fit these criteria, and then add them up and give me that number. It's a longer process.
And for some reason dealing with membership and events always takes forever, for us. I don't know if that's true for everyone.0 -
For comparative purposes, I have an export that pulls:
Constituent info with primary business and education
Spouse info with primary business and education
Addressees
Constituent codes
Multiple addresses and phones
Several attributes
Prospect Ratings
Proposals and linked actions
Gifts to other orgs
Assigned solicitors
Organization relationships
Individual relationships
All gifts, with Campaign, Fund Appeal, Notes
Current membership
A bunch of actions
Notepads of certain types
Event participations with event info
First gift with Campaign Fund Appeal (I realize I could calculate this in the report; not sure why I didn't)
Volunteer type status and job assignments
EDIT: it's about 135 fields, except that it's exporting into access so it could actually be multiples of each field.
We use it to run a bio, generally for one person at a time. I just ran it for a couple of our donors with the most information, and it took anywhere from 15 to 25 seconds for each export.
0 -
James Andrews:
EDIT: it's about 135 fields, except that it's exporting into access so it could actually be multiples of each field.
We use it to run a bio, generally for one person at a time. I just ran it for a couple of our donors with the most information, and it took anywhere from 15 to 25 seconds for each export.
Hi James, 135 fields seems like a lot! How long does it take if you do not do it one person at a time?
My organization's plan will be to see if we can clean up some static queries (we have over 2500 just in General) and see if that helps at all. Not quite sure if it will help. We do indeed pull all their media info, notes, etc, as the whole point of exporting that particular record is to gather basic constituent data on our donors (I had to verify this with our database administrator).0 -
Thomas Luo:
James Andrews:
EDIT: it's about 135 fields, except that it's exporting into access so it could actually be multiples of each field.
We use it to run a bio, generally for one person at a time. I just ran it for a couple of our donors with the most information, and it took anywhere from 15 to 25 seconds for each export.
Hi James, 135 fields seems like a lot! How long does it take if you do not do it one person at a time?
My organization's plan will be to see if we can clean up some static queries (we have over 2500 just in General) and see if that helps at all. Not quite sure if it will help. We do indeed pull all their media info, notes, etc, as the whole point of exporting that particular record is to gather basic constituent data on our donors (I had to verify this with our database administrator).It is a lot, yeah. But the basic concept is a total data dump about a person from RE, so it can go into a report. So we don't usually do it with big groups of people, and the length of time it takes to export isn't a big issue.0 -
Hi Josh,
I'm new to managing our RE7 database; where can I view the RE7 schema? We are hosted. Thanks!Josh Bekerman:
I'm wondering if this might also be due to all of the different SQL tables the export is pulling from. (If you've never done it, take a look at the RE7 schema and, for example, figure out how many tables are involved just to pull phone numbers from preferred addresses. It's a great way to spend a weekend afternoon.) I'm not a SQL guru (and I don't play one on tv) so I have no idea if this has anything to do with it. Even so, there's probably nothing you could do about it, but I'll mention it anyway.
0 -
I'm keen to know this too, only we host RE ourselves.0
-
According to knowledgebase solution 543924 the schema is not available for hosted clients.
Also in the same KB solution:
"You may also access the database schema outside of Blackbaud application by going toC:\\Program Files\\Blackbaud\\[product name]\\Help
and opening the file [product name]Schema.chm."
-Josh0 -
Thanks Josh0
-
I don't know any more than the previous answers. It does depend on content of export and number of records.
But I have a weird situation that's similar. A custom report I created that pulls approximated 15,800 records takes 2.5-3 hours to pull. The strange thing is that the first 14,000 records pull in about 50 minutes. Then it takes over an hour for the last 1000 or so records. Why would that be? What makes those last 1000 records so slow? They are young alumni so their constituent records have comparatively less info than the other constituent records. It's driving me bonkers trying to determine why. This is a report that our team usesfairly often and I'd love to be able to make its run time more manageable.
Thanks for any tips.0
Categories
- All Categories
- Shannon parent
- shannon 2
- shannon 1
- 21 Advocacy DC Users Group
- 14 BBCRM PAG Discussions
- 89 High Education Program Advisory Group (HE PAG)
- 28 Luminate CRM DC Users Group
- 8 DC Luminate CRM Users Group
- Luminate PAG
- 5.9K Blackbaud Altru®
- 58 Blackbaud Award Management™ and Blackbaud Stewardship Management™
- 409 bbcon®
- 2.1K Blackbaud CRM™ and Blackbaud Internet Solutions™
- donorCentrics®
- 1.1K Blackbaud eTapestry®
- 2.8K Blackbaud Financial Edge NXT®
- 1.1K Blackbaud Grantmaking™
- 527 Education Management Solutions for Higher Education
- 1 JustGiving® from Blackbaud®
- 4.6K Education Management Solutions for K-12 Schools
- Blackbaud Luminate Online & Blackbaud TeamRaiser
- 16.4K Blackbaud Raiser's Edge NXT®
- 4.1K SKY Developer
- 547 ResearchPoint™
- 151 Blackbaud Tuition Management™
- 1 YourCause® from Blackbaud®
- 61 everydayhero
- 3 Campaign Ideas
- 58 General Discussion
- 115 Blackbaud ID
- 87 K-12 Blackbaud ID
- 6 Admin Console
- 949 Organizational Best Practices
- 353 The Tap (Just for Fun)
- 235 Blackbaud Community Feedback Forum
- 55 Admissions Event Management EAP
- 18 MobilePay Terminal + BBID Canada EAP
- 36 EAP for New Email Campaigns Experience in Blackbaud Luminate Online®
- 109 EAP for 360 Student Profile in Blackbaud Student Information System
- 41 EAP for Assessment Builder in Blackbaud Learning Management System™
- 9 Technical Preview for SKY API for Blackbaud CRM™ and Blackbaud Altru®
- 55 Community Advisory Group
- 46 Blackbaud Community Ideas
- 26 Blackbaud Community Challenges
- 7 Security Testing Forum
- 1.1K ARCHIVED FORUMS | Inactive and/or Completed EAPs
- 3 Blackbaud Staff Discussions
- 7.7K ARCHIVED FORUM CATEGORY [ID 304]
- 1 Blackbaud Partners Discussions
- 1 Blackbaud Giving Search™
- 35 EAP Student Assignment Details and Assignment Center
- 39 EAP Core - Roles and Tasks
- 59 Blackbaud Community All-Stars Discussions
- 20 Blackbaud Raiser's Edge NXT® Online Giving EAP
- Diocesan Blackbaud Raiser’s Edge NXT® User’s Group
- 2 Blackbaud Consultant’s Community
- 43 End of Term Grade Entry EAP
- 92 EAP for Query in Blackbaud Raiser's Edge NXT®
- 38 Standard Reports for Blackbaud Raiser's Edge NXT® EAP
- 12 Payments Assistant for Blackbaud Financial Edge NXT® EAP
- 6 Ask an All Star (Austen Brown)
- 8 Ask an All-Star Alex Wong (Blackbaud Raiser's Edge NXT®)
- 1 Ask an All-Star Alex Wong (Blackbaud Financial Edge NXT®)
- 6 Ask an All-Star (Christine Robertson)
- 21 Ask an Expert (Anthony Gallo)
- Blackbaud Francophone Group
- 22 Ask an Expert (David Springer)
- 4 Raiser's Edge NXT PowerUp Challenge #1 (Query)
- 6 Ask an All-Star Sunshine Reinken Watson and Carlene Johnson
- 4 Raiser's Edge NXT PowerUp Challenge: Events
- 14 Ask an All-Star (Elizabeth Johnson)
- 7 Ask an Expert (Stephen Churchill)
- 2025 ARCHIVED FORUM POSTS
- 322 ARCHIVED | Financial Edge® Tips and Tricks
- 164 ARCHIVED | Raiser's Edge® Blog
- 300 ARCHIVED | Raiser's Edge® Blog
- 441 ARCHIVED | Blackbaud Altru® Tips and Tricks
- 66 ARCHIVED | Blackbaud NetCommunity™ Blog
- 211 ARCHIVED | Blackbaud Target Analytics® Tips and Tricks
- 47 Blackbaud CRM Higher Ed Product Advisory Group (HE PAG)
- Luminate CRM DC Users Group
- 225 ARCHIVED | Blackbaud eTapestry® Tips and Tricks
- 1 Blackbaud eTapestry® Know How Blog
- 19 Blackbaud CRM Product Advisory Group (BBCRM PAG)
- 1 Blackbaud K-12 Education Solutions™ Blog
- 280 ARCHIVED | Mixed Community Announcements
- 3 ARCHIVED | Blackbaud Corporations™ & Blackbaud Foundations™ Hosting Status
- 1 npEngage
- 24 ARCHIVED | K-12 Announcements
- 15 ARCHIVED | FIMS Host*Net Hosting Status
- 23 ARCHIVED | Blackbaud Outcomes & Online Applications (IGAM) Hosting Status
- 22 ARCHIVED | Blackbaud DonorCentral Hosting Status
- 14 ARCHIVED | Blackbaud Grantmaking™ UK Hosting Status
- 117 ARCHIVED | Blackbaud CRM™ and Blackbaud Internet Solutions™ Announcements
- 50 Blackbaud NetCommunity™ Blog
- 169 ARCHIVED | Blackbaud Grantmaking™ Tips and Tricks
- Advocacy DC Users Group
- 718 Community News
- Blackbaud Altru® Hosting Status
- 104 ARCHIVED | Member Spotlight
- 145 ARCHIVED | Hosting Blog
- 149 JustGiving® from Blackbaud® Blog
- 97 ARCHIVED | bbcon® Blogs
- 19 ARCHIVED | Blackbaud Luminate CRM™ Announcements
- 161 Luminate Advocacy News
- 187 Organizational Best Practices Blog
- 67 everydayhero Blog
- 52 Blackbaud SKY® Reporting Announcements
- 17 ARCHIVED | Blackbaud SKY® Reporting for K-12 Announcements
- 3 Luminate Online Product Advisory Group (LO PAG)
- 81 ARCHIVED | JustGiving® from Blackbaud® Tips and Tricks
- 1 ARCHIVED | K-12 Conference Blog
- Blackbaud Church Management™ Announcements
- ARCHIVED | Blackbaud Award Management™ and Blackbaud Stewardship Management™ Announcements
- 1 Blackbaud Peer-to-Peer Fundraising™, Powered by JustGiving® Blogs
- 39 Tips, Tricks, and Timesavers!
- 56 Blackbaud Church Management™ Resources
- 154 Blackbaud Church Management™ Announcements
- 1 ARCHIVED | Blackbaud Church Management™ Tips and Tricks
- 11 ARCHIVED | Blackbaud Higher Education Solutions™ Announcements
- 7 ARCHIVED | Blackbaud Guided Fundraising™ Blog
- 2 Blackbaud Fundraiser Performance Management™ Blog
- 9 Foundations Events and Content
- 14 ARCHIVED | Blog Posts
- 2 ARCHIVED | Blackbaud FIMS™ Announcement and Tips
- 59 Blackbaud Partner Announcements
- 10 ARCHIVED | Blackbaud Impact Edge™ EAP Blogs
- 1 Community Help Blogs
- Diocesan Blackbaud Raiser’s Edge NXT® Users' Group
- Blackbaud Consultant’s Community
- Blackbaud Francophone Group
- 1 BLOG ARCHIVE CATEGORY
- Blackbaud Community™ Discussions
- 8.3K Blackbaud Luminate Online® & Blackbaud TeamRaiser® Discussions
- 5.7K Jobs Board