Importing Complex Data

Hi all,

I'm starting a contract project helping to convert an automated workflow-based system to BPM Online. Our Database is fully 3rd normal form with over 60 tables. In the grand scheme of things, it's a pretty small database, however for import into BPM Online, it seems to be pushing the limits when it comes to importing data.

BPM Online will be substantially customized with forms and workflow. 

At this point, I'm struggling with two different issues:

1. I've been told that Excel spreadsheets are the only way to import legacy data, and each spreadsheet can only be a maximum of 10 MB. Some of our tables have almost a million rows each and will be 20+ spreadsheets each. That means we'll have more than a hundred separate import runs.

2. A test loading one spreadsheet of one of our tables with 60 columns took an hour. It appears that we're looking at over 100 hours runtime, just to load our data.

This seems burdensome for import into an enterprise class appplication like BPM Online. Is there another approach?

BTW, I'm not sure which product and version we'll be on. I marked Enterprise.

Thanks in advance to all,

Bill

Like 1

Like

1 comments

Dear Bill,

You can create a webservice which will transfer data from your system to BPM'online. It will still impact performance of your system but it will be more flexible for your business task. I have picked a couple of articles from our academy that should help you to implement this functionality:

https://academy.bpmonline.com/documents/technic-sdk/7-13/integration-bp…

https://academy.bpmonline.com/documents/technic-sdk/7-12/web-services-c…

https://academy.bpmonline.com/documents/technic-sdk/7-13/odata

https://academy.bpmonline.com/documents/technic-bpms/7-13/studying-web-…

You may also refer to sub articles in the "See also" section below the main article.



Best regards,

Angela

Show all comments