11/16/12

Welcome, Guest Login Register Getting Started Newsletters Store

SAP Community Network Wiki - Enterprise Information Management - Bulk Loading

Solutions Services & Support About SCN Downloads Industries Training & Education Partnership Developer Center Lines of Business University Alliances Events & Webinars Innovation

Bulk Loading
Added by Brandon Jacobson, last edited by Richard LeBlanc on Jun 28, 2012
For improved performance w hen using change data capture (CDC) or auto correct load, Data Services uses a temporary staging table in HANA to load the target table.

Design
Data Services first loads the data into a staging table and then it applies the operation codes (INSERT, UPDATE, and DELETE) to update the target table. With the Bulk load option selected in the target table editor, any one of the follow ing conditions triggers the staging mechanism The data flow contains a Map_CDC_Operation transform The data flow contains a Map_Operation transform that outputs UPDATE or DELETE row s The data flow contains a Table_Comparison transform The Auto correct load option in the target table editor is set to Yes

If none of these conditions are met, that means the input data contains only INSERT row s. Therefore Data Services does only a bulk insert operation, w hich does not require a staging table or the need to execute any additional SQL.

Settings
Template Tables
For template tables, select the appropriate table type for your SAP HANA target Column Store (default) Row Store

wiki.sdn.sap.com/wiki/display/EIM/Bulk+Loading

1/2

11/16/12
All Tables

SAP Community Network Wiki - Enterprise Information Management - Bulk Loading

When bulk loading is enabled, you have the follow ing options Mode: Specify the mode for loading data to the target table: Append: Adds new records to table (default) Truncate: Deletes all existing records in table then adds new records Commit Size - The maximum number of row s loaded to the staging and target tables before saving the data Column Store (default commit size is 10,000) Row Store (default commit size is 1,000) Update Method Specify how the input row s are applied to the target table UPDATE: Issues an UPDATE to the target table (default for Column Store tables) DELETE-INSERT: Issues a DELETE to the target table for data that matches the old data in the staging table, then issues an INSERT w ith the new data (default for Row Store tables)

Do not use DELETE-INSERT if the update row s do not contain data for all columns in the target table because Data Services w ill replace missing data w ith NULLs.

Follow SCN Contact Us SAP Help Portal Privacy Terms of Use Legal Disclosure Copyright

wiki.sdn.sap.com/wiki/display/EIM/Bulk+Loading

2/2