Exporting data

Options
Andrea Egloff
Andrea Egloff ✭
Eighth Anniversary Photogenic First Reply
in Blackbaud Raiser's Edge NXT®: General Discussion
Is it normal to take hours to export 50,000 records to Excel in csv format?  Are there any tricks or tips anyone has to do this any faster?

 
Tagged:

Comments

  • Joanne Felci 2
    Joanne Felci 2 ✭
    Ninth Anniversary Facilitator 4 Name Dropper Photogenic
    Depends what you are exporting - if it is just Con ID, First Name, Last Name, Addressee it should not take that long


    If you are including summary of gift information or event information I've noticed it takes longer


    It also depends upon if you are hosted versus self hosted
  • Karen Stuhlfeier
    Karen Stuhlfeier ✭
    Tenth Anniversary Facilitator 3 Name Dropper Photogenic

     Yes, how much and what kinf of data are you exporting. I'm hosted, but when we were self hosted I didn't notice any time difference. 

     

  • Nicole McMorrow 2
    Nicole McMorrow 2 ✭
    Eighth Anniversary Photogenic First Reply
    I exported a 55k+ record query with 93 columns of info, so MASSIVE. It took about three hours. I created and used a temporary sign in for myself and had it running on another computer so that I could continue to do stuff in RE.
  • Marie Stark
    Marie Stark ✭✭✭✭✭
    Ancient Membership Facilitator 3 Name Dropper Photogenic

    I have found that exporting attributes also increases the time.

     

  • Joshua Bekerman bCLO bCRE
    Joshua Bekerman bCLO bCRE ✭
    Tenth Anniversary Facilitator 3 Name Dropper Photogenic
    As Joanne mentioned it seems to take longer when exporting summary fields.  When possible I usually export the gifts separately and then have Excel or Crystal Reports do the calculations. Not sure if there's any real difference but at least it makes me feel better.  cool
  • Ryan Hyde
    Ryan Hyde ✭
    Tenth Anniversary Facilitator 3 Name Dropper Photogenic
    Yep. I like to make sure I have a bunch of non-RE-related work to do on big export days.
  • Kerry Shippam
    Kerry Shippam ✭
    Ancient Membership Facilitator 1 Photogenic

    ​If self-hosted you might want to check the database maintenace is being done which might help although as others mentioned some things will take a while to export, don't think I've waited hours before though!

    https://kb.blackbaud.com/articles/Article/44806


     

  • Ryan Hyde
    Ryan Hyde ✭
    Tenth Anniversary Facilitator 3 Name Dropper Photogenic
    I used to be able to do that, no problem (hosted environment). But lately that hasn't worked for me so well. I do have a chromebook I sometimes run RE on in a pinch.
  • Andrea Egloff
    Andrea Egloff ✭
    Eighth Anniversary Photogenic First Reply

    Andrea Egloff:

    Is it normal to take hours to export 50,000 records to Excel in csv format?  Are there any tricks or tips anyone has to do this any faster?

     

    We are hosted using the Boston server.  Here's a for instance...yesterday I exported 157,000 records included some basic information and four summary fields.  It took 4 3/4 hours to complete.  I also did an appeal import of 46,000 records which was very basic and it took about 3 hours to complete.  As suggested below, I have a second logon that I use so I can continue to work on other RE items while these import/exports are processing.  It is just frustrating to have to wait so long for them to process.

     
  • Jen Claudy
    Jen Claudy ✭
    Tenth Anniversary Facilitator 4 Name Dropper Photogenic
    You might want to check with BB Support and see if there's something in your database that could be causing a problem.  I regularly run an export of about 347,000 records and it takes just over 2 hours.  It runs every night after close of business, and that could be part of it, that few, if any, other users are logged in when it runs.  At my last org, I did big exports from home in the evenings or on the weekend, when I didn't need to be doing anything else in RE.
  • Anne Herbert
    Anne Herbert ✭
    Tenth Anniversary Facilitator 1 Photogenic

    I’ve also found exports/imports to take a long
    time.  I did an appeal import on 72,000 records that took 5.5
    hours to run, so I share your pain.

  • Michelle Reich 5
    Michelle Reich 5 ✭
    Eighth Anniversary First Reply

    Ryan Hyde:

    I used to be able to do that, no problem (hosted environment). But lately that hasn't worked for me so well. I do have a chromebook I sometimes run RE on in a pinch.

    Totally random, and not related to the original post, but what do you do to run RE on your Chromebook? I am going on vacation and would LOVE just to be able to take my lightweight Chromebook rather than my 9lb (dying) laptop. I too am hosted and have the Citrix receiver extension. Anything else you did? 

  • Ryan Hyde
    Ryan Hyde ✭
    Tenth Anniversary Facilitator 3 Name Dropper Photogenic
    Michelle - there's a Citrix Receiver application for Chrome OS, which you'll have to use because as you've surely found out, using the regular URL from within Chrome just doesn't work on a Chromebook. Just install the app and launch it. In the first page of it, it asks you to put the URL in for your connection, which is https://login2.blackbaudhosting.com (assuming you log in from the Boston data center). If that's not it, I'm sure you already know exactly what the URL should be because you use it every day. 

     

Categories