Power your Big Data with SAP Lumira & Design Studio

Session-2909

Ravin Angara, Harjeet Judge, Addanki Narasimha Rao

SAP Analytics Product Management
Disclaimer

This presentation outlines our general product direction and should not be relied on in
making a purchase decision. This presentation is not subject to your license
agreement or any other agreement with SAP. SAP has no obligation to pursue any
course of business outlined in this presentation or to develop or release any
functionality mentioned in this presentation. This presentation and SAP's strategy and
possible future developments are subject to change and may be changed by SAP at
any time for any reason without notice. This document is provided without a warranty
of any kind, either express or implied, including but not limited to, the implied
warranties of merchantability, fitness for a particular purpose, or non-infringement.
SAP assumes no responsibility for errors or omissions in this document, except if
such damages were caused by SAP intentionally or grossly negligent.

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 2

Agenda

Ÿ What is Big Data?

Ÿ Consume Big Data within SAP Lumira

Ÿ Consume Big Data within SAP Business Objects Design Studio

Ÿ Conclusion

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 3

What is Big Data?
The world has changed for IT

1980s / 1990s Today

100101
011010
100101

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 5

What is Big Data?
The 3 + 1 V’s

Big Data refers to technologies and initiatives that involve data that is too diverse, fast-
changing or massive for conventional technologies, skills and infra- structure to address
efficiently. Said differently, the volume, velocity or variety of data is too great.

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 6

The Apache Hadoop technology family
logical view*

Non-Relational DB Scripting
Fine-grained data handling

Hive HBase Stinger / Gryphon / Pig

“Data warehouse” that provides
SQL-like interface. Data structure is
projected ad hoc onto unstructured
underlying data
Column oriented, schema-less,
distributed database modeled after
Google’s BigTable. Random real-time
read/write
Impala
Category of projects that
provide faster & more complete
SQL coverage on Hadoop.
Currently many competing
projects
Platform for manipulating
and analyzing large data
sets. Scripting language for
analysts

MapReduce Hadoop Common

Ÿ Parallel programming
Ÿ Large block data HDFS MapReduce
handling (e.g. 64MB) Distributes & replicates data Distributes & monitors tasks,
across machines restarts failed work

* For simplicity, mappings to servers is omitted

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 7

Apache HADOOP Ecosystem

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 8

Big Data Marketplace
The 3 + 1 V’s

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 9

SAP Lumira and Big Data
Lumira and Hadoop

Hive connectivity via Apache JDBC

MongoDB connectivity via OData or JDBC

SAP Lumira 1.27 offers additional connectivity to Hive

13 and Cloudera
Desktop Cloud
Lumira Cloud leverages Hana Cloud Integration
services to connect to Big Data sources on premise or
in the cloud

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 11

BI Big Datasources roadmap

Current Future

• Since BOE 4.1 SP5 (ODBC / • Maintain support of latest

JDBC) versions of Big Datasources
• Hive 0.13 • New datasources considered
• Impala • SparkSQL
• EMR • MongoDB
• Since Lumira 1.21 (JDBC)
• Hive 0.13
• Impala
• EMR

Lumira Datasource extensions can enable access to non-supported

datasources today

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 12

 Lumira 1.27 and available connections

SAP Lumira 1.27 offers a wide

variety of connectivity options
including the Hadoop HDFS
and SQL on Hadoop
connection which enables the
user to write custom SQL
statements to retrieve data

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 13

Data wrangling on any data size in Hadoop

VE
Lumira Server,
4. .lums file Team edition
published to L
Lumira Server o
c
a
l

sample Full Full Lumira

Server for
V
i
e
BI w
platform

1. Sampling of the 3. Full dataset

dataset copied into the
.lums file

5. IT can author
2. Scheduling the views in Hana
operations to using the Smart
Hadoop to Data Access
generate the full
dataset
Original Full Virtual Table

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 14

 Data Wrangling in Lumira 1.27

• Sampling option in data acquisition

when connecting to Hadoop, Hive or
Impala

• Cleanse and gain insights on smaller

samples and replay data
transformations on the full Hadoop
cluster.

• Output the full dataset, Hive table and

an optional .lums file

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 15

 Hadoop Distributed File System(HDFS) Access in SAP
Lumira 1.27

• Transformations pushed down to

Hadoop via Oozie scheduler

• Monitor the HDFS job from SAP

Lumira desktop

• Access the generated Lumira

document with full data once the job
completes successfully.

• Access job logs from SAP Lumira

Desktop

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 16

DEMO

© 2015 SAP SE or an SAP affiliate company. All rights reserved.

SAP Business Objects Design Studio
Current Solutions
SAP HANA as a Big Data Platform
 Current SAP Agnostic Solutions Overview

• SAP BO Data Services

identifies, extracts, structures
and transforms the meaningful
information from Hadoop/Hive
and provisions the data to SAP
HANA.

• Access remote information

from SAP HANA using smart
data access. Load high-value
data (HOT data) from Hadoop
rapidly into HANA for real-time

• Hive is seen as a relational

database. A Universe is built
using HiveQL language

Courtesy: http://ict.swisscom.ch/2015/01/big-data-und-sap-ja-hana-und-hadoop/
http://scn.sap.com/people/angela.harvey/blog

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 20

HANA and Smart Data Access

Access remote information from SAP

HANA using smart data access

Load high-value data (HOT data) from

Hadoop rapidly into HANA for real-time
analysis

Unified data access from an end-user

perspective

Centralize data management to simplify

IT’s role

Combine unstructured and structured data

for insights never seen before

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 21

Data flow design for SAP Design Studio consumption

• Virtual Analytical
View in SAP HANA
Studio with direct access
to Apache Hadoop

• Analytical View can then be

accessed directly within
SAP Design Studio for
creating dashboard
applications.

Courtesy: http://ict.swisscom.ch/2015/01/big-data-und-sap-ja-hana-und-hadoop/
http://scn.sap.com/people/angela.harvey/blog

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 22

Instant results with HANA - infinite storage with Hadoop

Value Proposition
Ÿ One enterprise-class platform for Big Data applications and analytics
Ÿ Real-time
Ÿ Federated: bring all data together under one model
Ÿ Infinite storage with Hadoop

Use Cases
Ÿ Real-time analysis and dashboards on transactional data or event streams (Southern
California Edison)
Ÿ Analyze data from different systems (ex: Optimize genome analysis with HANA, R and
Hadoop at MKI)
Ÿ Compute statistical models on large volumes (ex: Detect critical signals from 100 PBs of
data in eBay EDW)

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 23

Conclusion
SAP and Big Data

Today, companies can already unlock information from a Big Data environment

HANA provides additional out-of-the box capabilities for our BI tools

Tomorrow, SAP plans to provide unmatched E2E solutions on top of Big Data

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 25

SAP Lumira
Enablement

We bring to you all that you need to

learn about SAP Lumira.

On SCN, you can find a Lumira

Overview and other resources at:
http://scn.sap.com/docs/DOC-
55921

Webinars will complement these

published resources:
http://scn.sap.com/docs/DOC-
52806

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 26

 Thank you for attending.
Please provide feedback on this session by
completing a short survey via the event mobile application.

Session Code: 2909

© 2015 SAP SE or an SAP affiliate company. All rights reserved.

© 2015 SAP SE or an SAP affiliate company.
All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG or an
SAP affiliate company.

SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG
(or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional
trademark information and notices.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

National product specifications may vary.

These materials are provided by SAP AG or an SAP affiliate company for informational purposes only, without representation or warranty of any kind,
and SAP AG or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP AG or
SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and
services, if any. Nothing herein should be construed as constituting an additional warranty.

In particular, SAP AG or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related
presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP AG’s or its affiliated
companies’ strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be
changed by SAP AG or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment,
promise, or legal obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties
that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking
statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.

© 2015 SAP SE or an SAP affiliate company. All rights reserved. Public 28