Import vs Batch Processing for new constituent records

Options
Import should always be the better choice but with an incomplete listing of data variables I do feel forced to manually type in records via the batch. With +100 rows and +40 columns, what a pain!


Opinions aside, if anyone knows what I am talking about and can prove to me I'm wrong (essentailly that the entire data structure that defines a constituent can be imported) then I'd be overjoyed. I'm noticing that the more fringe-y data variables are ignored? Not cool Blackbaud!


Thanks.

Comments

  • Yes, import is the better choice. 


    What sort of "fringe'y" variables are missing for you?  Are they things that you could leave out of the import and use global add to bring them in after importing the records?


    I've run into one thing that couldn't be imported but I'm sure there are more.
  • I am not 100% sure what you are asking but you CAN import constituents - and depending on what data you are imporing it should be able to be imported in a single import. There are some things that are not possible though so can you share what you are having trouble with. I typically use batch for 20 or fewer but definitely import if more than 50. Between 20-50 I decide depening on the complexity of the data and the time I have allotted.
  • JoAnn Strommen:

    Yes, import is the better choice. 


    What sort of "fringe'y" variables are missing for you?  Are they things that you could leave out of the import and use global add to bring them in after importing the records?


    I've run into one thing that couldn't be imported but I'm sure there are more.

    The one facing me down is "Spouse Birth Place", (which I think might be an attribute within an user-defined Category).


    In general I think it's the user-defiend attributes that aren't included. But where's the fun in that?


    By the way, the global add is a good idea. Whereas most of my data have unique values I'll then need to categorize data and global add it via several runs.

  • Melissa Graves:

    I am not 100% sure what you are asking but you CAN import constituents - and depending on what data you are imporing it should be able to be imported in a single import. There are some things that are not possible though so can you share what you are having trouble with. I typically use batch for 20 or fewer but definitely import if more than 50. Between 20-50 I decide depening on the complexity of the data and the time I have allotted.

    How do you deal with an unique user-defined attribute?

  • I think that it depends. I set up batch templates for our new students each fall and after I set up the defaults I have very little data entry. We receive their information as they are enrolled and can just keep adding to the batch and commit it when we know that we have most of them entered.
  • Vincent Meade:

    Melissa Graves:

    I am not 100% sure what you are asking but you CAN import constituents - and depending on what data you are imporing it should be able to be imported in a single import. There are some things that are not possible though so can you share what you are having trouble with. I typically use batch for 20 or fewer but definitely import if more than 50. Between 20-50 I decide depening on the complexity of the data and the time I have allotted.

    How do you deal with an unique user-defined attribute?

     

    You can definitely import attributes with constituents. You just need to add it into your import.

  • Vincent Meade:

    Import should always be the better choice but with an incomplete listing of data variables I do feel forced to manually type in records via the batch. With +100 rows and +40 columns, what a pain!


    Opinions aside, if anyone knows what I am talking about and can prove to me I'm wrong (essentailly that the entire data structure that defines a constituent can be imported) then I'd be overjoyed. I'm noticing that the more fringe-y data variables are ignored? Not cool Blackbaud!


    Thanks.

    I'm definitely keeping an eye on this conversation.  My problem is that every spring I enter in 100 new families to the system. It usually takes me 3-4 days of solid work to enter in all the very detailed and numerous information my boss requires from these applications(Business, Spouse Business, all kids, all kids' educations - current and former, and current and former addresses and phone numbers).  I don't think I can use batch for multiple relationships or multiple education entries, and Import is a pain because all the information is given to me hardcopy only - I'd have to type in the import files manually.  Can anyone help?

  • Lisa Fields:

    Vincent Meade:

    Melissa Graves:

    I am not 100% sure what you are asking but you CAN import constituents - and depending on what data you are imporing it should be able to be imported in a single import. There are some things that are not possible though so can you share what you are having trouble with. I typically use batch for 20 or fewer but definitely import if more than 50. Between 20-50 I decide depening on the complexity of the data and the time I have allotted.

    How do you deal with an unique user-defined attribute?

     

    You can definitely import attributes with constituents. You just need to add it into your import.

     

     

    I agree I have included many different user-defined attributes when importing records. Have you looked into Import-o-matic?

     

  • You don't need import-o-matic for attributes but it is a great tool I agree.
  • You can import both the constituent attribute as well as a relationship attribute (to a non-constituent spouse, for example)
  • Vincent Meade:

     

    Melissa Graves:

    I am not 100% sure what you are asking but you CAN import constituents - and depending on what data you are imporing it should be able to be imported in a single import. There are some things that are not possible though so can you share what you are having trouble with. I typically use batch for 20 or fewer but definitely import if more than 50. Between 20-50 I decide depening on the complexity of the data and the time I have allotted.

    How do you deal with an unique user-defined attribute?

     

    The capability is there, it's just labled strangely in Import.  Look for "Constituent Information Attribute" in the field choices.

  • You can add Attributes to your Constituent Import, it just takes several fields (and it's listed as [Constituent Information Attribute]).  CAttrCat (the Attribute Category), CAttrDesc, CAttrDate, CAttrCom.  If you need a second Constituent Attribute, put the same fields in again, then in the Import screen, make sure the extensions are set properly...two digit number on the far-right which is defaulted to [00].  The extensions for all fields of the second attribute should be [01], etc.


    Use the field names that RE needs (i.e. [ConsID], [CAttrCat]) so you don't have to do any matching, which would need to be done anytime you change anything in your file or you'll get a lot of exceptions.  Pick one record and use it to test until you get everything importing as you want it to be, then save at least one backup copy of your field names so that you don't have to reinvent the wheel.


    Also, when I'm importing a lot of Constituent Records, I often assign an Import ID of my own rather than let RE do it.  This way, I can very easily grab a list of records (i.e. alumni2017-001, alumni2017-002, etc.) or know where these records came from via the Properties window.  Not necessary, but I've found it helpful on occasion.
  • John Heizer:

    Vincent Meade:

     

    Melissa Graves:

    I am not 100% sure what you are asking but you CAN import constituents - and depending on what data you are imporing it should be able to be imported in a single import. There are some things that are not possible though so can you share what you are having trouble with. I typically use batch for 20 or fewer but definitely import if more than 50. Between 20-50 I decide depening on the complexity of the data and the time I have allotted.

    How do you deal with an unique user-defined attribute?

     

    The capability is there, it's just labled strangely in Import.  Look for "Constituent Information Attribute" in the field choices.

     

    I see, this is good news. The Constituent Information Attribute gives category, comment, date, description, attribute import id; and is linked together via the extension #. I am reading that a majority of people have done this so even if I get an error, I think the idea of getting all the information in, is a reality.

     

  • Jen Claudy:

    You can add Attributes to your Constituent Import, it just takes several fields (and it's listed as [Constituent Information Attribute]).  CAttrCat (the Attribute Category), CAttrDesc, CAttrDate, CAttrCom.  If you need a second Constituent Attribute, put the same fields in again, then in the Import screen, make sure the extensions are set properly...two digit number on the far-right which is defaulted to [00].  The extensions for all fields of the second attribute should be [01], etc.


    Use the field names that RE needs (i.e. [ConsID], [CAttrCat]) so you don't have to do any matching, which would need to be done anytime you change anything in your file or you'll get a lot of exceptions.  Pick one record and use it to test until you get everything importing as you want it to be, then save at least one backup copy of your field names so that you don't have to reinvent the wheel.


    Also, when I'm importing a lot of Constituent Records, I often assign an Import ID of my own rather than let RE do it.  This way, I can very easily grab a list of records (i.e. alumni2017-001, alumni2017-002, etc.) or know where these records came from via the Properties window.  Not necessary, but I've found it helpful on occasion.

    Thanks, I'm seeing this all now and it's making sense. While it will take awhile to set up and then test, this process will be less error prone and save time. Not to mention each year when I input students it can be done with no test and very fast.


    Also, I like the ImportID idea. I might do that if it is possible for us ( we might be using a # from another datasystem)


    So that's how databasing is meant to be done, thank blackbaud. (sorry about before! you're still cool! cool)


    Also thanks for everyone's experience and answers, it's nice there is a lively forum here.




  • Vincent Meade:

    Jen Claudy:

    You can add Attributes to your Constituent Import, it just takes several fields (and it's listed as [Constituent Information Attribute]).  CAttrCat (the Attribute Category), CAttrDesc, CAttrDate, CAttrCom.  If you need a second Constituent Attribute, put the same fields in again, then in the Import screen, make sure the extensions are set properly...two digit number on the far-right which is defaulted to [00].  The extensions for all fields of the second attribute should be [01], etc.


    Use the field names that RE needs (i.e. [ConsID], [CAttrCat]) so you don't have to do any matching, which would need to be done anytime you change anything in your file or you'll get a lot of exceptions.  Pick one record and use it to test until you get everything importing as you want it to be, then save at least one backup copy of your field names so that you don't have to reinvent the wheel.


    Also, when I'm importing a lot of Constituent Records, I often assign an Import ID of my own rather than let RE do it.  This way, I can very easily grab a list of records (i.e. alumni2017-001, alumni2017-002, etc.) or know where these records came from via the Properties window.  Not necessary, but I've found it helpful on occasion.

    Thanks, I'm seeing this all now and it's making sense. While it will take awhile to set up and then test, this process will be less error prone and save time. Not to mention each year when I input students it can be done with no test and very fast.


    Also, I like the ImportID idea. I might do that if it is possible for us ( we might be using a # from another datasystem)


    So that's how databasing is meant to be done, thank blackbaud. (sorry about before! you're still cool! cool)


    Also thanks for everyone's experience and answers, it's nice there is a lively forum here.

     

    Thanks for generating this discussion.  I have been using a combination of import and manual data entry to create about 200 new student records each year.  The basic biographical and address data comes over OK by import.  What Blackbaud support and I determined was that relationships cannot be imported.  So parent relationships, spouses, churches, schools, etc. have to be checked and added, record by record.  Or am I missing something? (that might put my student workers out of work!) Also, we update the returning students manually.

     

  • Um - I import the relationships.
  • Sometimes I find it easier to do a series of Imports rather than try to get everything into one.  Last time I did this, I did the Constituent Records and then the Relationships as a separate Import...since I assign the ImportIDs, it makes it relatively easy to add Relationships.
  • Melissa Graves:

    Um - I import the relationships.

    I do too

  • Kristin White:

    Melissa Graves:

    Um - I import the relationships.

    I do too


    As a result of this discusison, I have been experimenting with importing relationships.  Is it possible to do the following:

    import from excel a new student record, including a parent and their address AND assign that parent a constituent id number?

    I have done the first part, e.g. student name, id, address, student ID number, constituent code, etc.  I doubt that the import can create a new constituent ID number for the parent. 

     

     

  • Bob, I don't think RE can create 2 constituent records from one import record/row.  However, you could possibly assign Constituent IDs as part of your Import, and include the student in one row and the parent in another row, then include the appropriate ConstIDs as relationship links.  I'm not sure on this, as I usually do multiple Imports to be sure I don't screw something up...although if I did regular (even annual) Imports, I might find it worthwhile to pick one student/parent pair and test, then save the setup and document it.
  • As has been said I import the student then import the parents - using the import ID I  created for the student, when I create the parents I link them to the child.
  • Karen Stuhlfeier:

    I think that it depends. I set up batch templates for our new students each fall and after I set up the defaults I have very little data entry. We receive their information as they are enrolled and can just keep adding to the batch and commit it when we know that we have most of them entered.

    I am very interested in seeing how the batch works for importing new studnets.  We work on RE but the rest of the campus is on Banner so we run a process in Banner to pull out the new students and its in a excel format then we use that spreadsheet and import them but we still have to enter alot of info on each student.  Could you email me with your process and any help on this process??  mjenner@cbu.edu
  • Karen Stuhlfeier:

    I think that it depends. I set up batch templates for our new students each fall and after I set up the defaults I have very little data entry. We receive their information as they are enrolled and can just keep adding to the batch and commit it when we know that we have most of them entered.

    Is it possible to create new student/parent records from CORE through REConnect or do the new records have to originate from RE?

Categories