You are on page 1of 20

Big Data Management in SAP BW on HANA

Project: HANA dynamic tiering


SAP HANA BW Development
September 2014

Disclaimer

This presentation outlines our general product direction and should not be relied on
in making a purchase decision. This presentation is not subject to your license
agreement or any other agreement with SAP. SAP has no obligation to pursue any
course of business outlined in this presentation or to develop or release any
functionality mentioned in this presentation. This presentation and SAP's strategy
and possible future developments are subject to change and may be changed by
SAP at any time for any reason without notice. This document is provided without a
warranty of any kind, either express or implied, including but not limited to, the
implied warranties of merchantability, fitness for a particular purpose, or noninfringement. SAP assumes no responsibility for errors or omissions in this
document, except if such damages were caused by SAP intentionally or grossly
negligent.

2014 SAP AG. All rights reserved.

Customer

Topics

Recall: Data LifeCyle Management in BW-on-HANA


Next step: HANA dynamic tiering for BW

2014 SAP AG. All rights reserved.

Customer

Multi Temperature Data Management for BW on HANA


Data Volume

hot

warm

cold

Performance

Data is read and/or written frequently


In memory
No restrictions, all features available

Non-Active Data Concept


Infrequent access
On disk, only loaded to memory when accessed
No restrictions, all features available

Near-line Storage
Sporadic access
Not stored in HANA DB; stored in Near-line Storage
Restricted to NLS capabilities

Providing lower TCO by optimized data management

2014 SAP AG. All rights reserved.

Multi Temperature Data Management for BW on HANA


Data Volume

hot

warm

cold

Performance

Data is read and/or written frequently


In memory
No restrictions, all features available

HANA dynamic tiering


Infrequent access
On disk, only loaded to memory when accessed
No restrictions, all features available

Near-line Storage
Sporadic access
Not stored in HANA DB; stored in Near-line Storage
Restricted to NLS capabilities

Providing lower TCO by optimized data management

2014 SAP AG. All rights reserved.

Hot-Warm-Cold areas in BW on HANA


BEx Query
Virtual Layer

EDW
Propagation
EDW Transformation

Corporate
Memory

Business Transformation

Archive/NLS

Analytic Mart

Staging Layer
Cold Areas Archive, read-only data, different SLAs
Warm Areas limited reporting, limited HANA-native functions
Hot Areas heavy reporting and/or HANA-native operations (Delta, Transf.,)
2014 SAP AG. All rights reserved.

Hot-Warm-Cold Data Distribution in BW


Focus of HANA
dynamic tiering
Staging

Corporate
Memory

Analytics +
Reporting

Transform &
Harmonize
Data
Archive/NLS

2014 SAP AG. All rights reserved.

HANA dynamic tiering

Primary Storage: RAM


HANA
Table

Extended
Table

Additional table type: Extended


Table

Storage based on SAP IQ


technology
Similar compression rates

Extended Storage: Disk


Remote
Table

2014 SAP AG. All rights reserved.

Optimized data transfer between


Primary and Extended Storage
Data Processing is pushed to
Extended Storage server

HANA dynamic tiering part of the HANA platform


Primary Storage: RAM

Unified Installation&Update
Management
One Backup & Recovery
HANA Studio Integration

Extended Storage: Disk

Monitoring

Tracing

Configuration (.ini file)

Start/Stop

HANA topology includes ES as a


node

Security/User Management by
HANA-only

2014 SAP AG. All rights reserved.

HANA dynamic tiering for BW


BW: Process Management
DSO

DSO

No change to applications,
process required

Primary Storage
HANA
Table

BW Objects can have


property Extended Table

Extended
Table

Conversion to move existing


data to Extended Storage

Move data to ES during DB


migration

Extended Storage
Remote
Table

2014 SAP AG. All rights reserved.

10

Extended Tables in HANA BW


Use Case: Staging and Corporate Memory
Staging Area

DataSource
DataSource
DataSource

BW

Corporate Memory

wo-DSO
wo-DSO
wo-DSO

Generated Tables are of type


Extended

Primary Storage
Active
Table

PSA Table

2014 SAP AG. All rights reserved.

Write and Read operations are


re-directed to ExtendedStore

All BW standard operations


supported no changes

Extended Storage
Remote
Table

DataSources and writeoptimized DSOs can have the


property Extended Table

Remote
Table

Only minor temporary RAM


required in HANA

11

HANA Extended Storage for BW Roadmap


BW: Process Management
DSO

DSO

Primary Storage
HANA
Table

Extended
Table

Extended Storage

Enable ES for additional BW


InfoProviders also on data
slices/partitions
Automated + Modeled data
movements based on HANA
DB & BW statistics
Even tighter integration in
HANA platform
Deployment options by
HANA HW partners

Remote
Table

2014 SAP AG. All rights reserved.

12

HANA dynamic tiering & BW NLS

Extended Storage

BW NLS

Continuous operations data

Archive, read-only

Mission-critical availability

Usually lower SLAs

Optimizing on HANA RAM

Optimizing data footprint in system


landscape

Part of the platform

Separate server

Downward compatibility

Arbitrary (semantic) data slices

Software version dependencies


Complete tables/partitions

Two different types of data require two different types of storages


2014 SAP AG. All rights reserved.

13

HANA dynamic tiering for BW on HANA


Availability
Pilot Shipment ended August 2014 (see note 1983178)

Minimal software versions

SAP HANA SP07


SAP BW7.4 SP05
SAP IQ 16.0 SP03

General Availability planned for Q4 2014

Minimal software versions

SAP HANA SP09


SAP BW7.4 SP08

Sizing guideline adopted sizing report in note 1736976


BW on HANA FAQ - http://spr.ly/bwonhanafaq
TechEd 2013: http://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhana

2014 SAP AG. All rights reserved.

Customer

14

Thank you
Contact information:

Dr. Stefan Hoffmann, SAP HANA BW Product Management


stefan.hoffmann@sap.com
Dr. Klaus Nagel, SAP HANA BW Development
klaus.nagel@sap.com

Appendix

BW NLS Solution for SAP IQ


(DBSL based solution)
BW

BW Porting

InfoProvider

Near Line Adapter (ABAP based )

DBSL for
Sybase ASE (/w IQ ext.)

General
Porting

(Kernel based; Open SQL + Native IQ


SQL via ADBC)

NLS Interface

SAP Sybase ODBC DriverDB Client

HANA DB

2014 SAP AG or an SAP affiliate company. All rights reserved.

Customer 17

Not-Active Data Concept HANA


Tables in HANA can be marked with a high unload priority (not-active). This
property is inherited by all partitions of such tables.
The partitions of the not-active tables are

loaded to RAM in case of read access (column-wise) and processed as usual (same speed
and functionality),

loaded to RAM for merge process (if new data was written and delta reaches limit),

displaced from RAM with highest priority in case of RAM shortage (but only then) or when
actively a cleanup is triggered.

The cautious displacement strategy avoids a


sub-optimal memory strategy, e.g. in case of
subsequent accesses, but it may be altered after
more experience.

RAM
Temporary data
Processing data

Persistent data

2012 SAP AG. All rights reserved.

Filer

18

Extended Tables in BW Deployment option 1


Original sizing config

Sizing config enabling


Extended Storage

HANA Appliance

HANA Appliance

Master

Master

Slave 1

Slave 1

Slave 2

Slave 2

Slave 3

Slave 3

Slave 4

Slave 5

PSA and
CorpMemory
approx. 40%
of data

Extended Storage

Slave 6
2014 SAP AG. All rights reserved.

Customer

19

Extended Tables in BW Deployment option 2


Original sizing config

Sizing config enabling


Extended Storage

HANA Appliance

HANA Appliance

Master

Master

Slave 1

Slave 1

Slave 2

Slave 2

Slave 3

Slave 3
High-speed
connectivity

Slave 4

Slave 5
Slave 6
2014 SAP AG. All rights reserved.

PSA and
CorpMemory
approx. 40%
of data

Commodity HW
Extended Storage

Customer

20

You might also like