GenAI usage in SAP on AWS deployments

1. Public
April 6th, 2024

2. Public
GEN AI & SAP on AWS
Sourabh Chordiya
Solutions Architect | AWS Ambassador | SAP on AWS SME

3. Public
About Me
Solutions Architect with 15 years of experience and working in
Cloud space for more than 10 years now. Specialized in planning
and executing SAP workloads assessment, migration and
optimization on AWS. AWS Ambassador since 2023 and
interested to share AWS hands-on experiences through blogs
and sessions

4. Public
SAP on AWS
SAP software stacks are commonly deployed on AWS platform in IaaS
Many native AWS services are used including VPC, storage, security
SAP in general is repository of data for any customer, ranging up to
several terabytes
An untapped potential that with the innovation of GenAI can give insights
beyond imagination
Data is protected and, in many cases, have strict compliance
requirements
SAP’s own GenAI introduced recently as Joule that is gradually being
rolled out

5. Public
COMMUNITY DAY
Mumbai
AWS provides several services like SageMaker, BedRock, Trainium
and Inferentia for building GenAI use-cases
In addition, AWS provides applications like Amazon Q, PartyRock and
CodeWhisperer that deliver ready to use functionalities for some of the
use-cases
The GenAI tools from AWS cater to every role, be it a Developer,
Administrator, Analyst, or a Business User
These offerings are supported by best-in-class processing power and
customized CPUs that allows quicker training cycles and inferences
Equipped with additional models from various partners like AI21 Labs,
Claude, Stable Diffusion, the whole suite of available options can cater
to every business need
G E N E R AT I V E A I
AW S O F F E R I N G S

6. Public
COMMUNITY DAY
Mumbai
AW S S D K F O R S A P A B A P
• SAP uses its widely popular native development framework called SAP ABAP
• Primarily a coding language that is used in SAP world
• The SDK helps integrating almost every AWS service directly with ABAP code
and requires minimal coding expertise
• Out-of-the-box integrations including authentication and metadata exchange to
provide seamless SAP and AWS cross-connections and building innovative use-
cases
Image Ref - Software Development Kit for SAP -- AWS SDK for SAP ABAP-- Amazon Web
Services

7. Public
COMMUNITY DAY
Mumbai
• The data available in SAP applications can be used to train and derive inferences
using SageMaker
• There are several ways to extract data based on native SAP and native AWS
solutions, Odata based mechanisms gaining popularity because of wider
acceptance
• Data Staging can be performed in various sources, S3 being most popular one,
however it will be more relevant to utilize ABAP internal tables to avoid data audit
concerns
• SageMaker notebooks or SageMaker Data Wrangler can be used to perform train
and test data split
• SageMaker AutoML can now be used for automatic model determination, note
that this requires data to be in CSV or parquet format and hence direct usage of
ABAP internal tables will not be possible
• The best model can now be used to be served using an Endpoint
• Image Ref - Data insights from SAP with Amazon SageMaker AutoML and
QuickSight | AWS for SAP
• Data Extraction Ref - Architecture Options for Extracting SAP Data with AWS
Services | AWS for SAP (amazon.com)
• Code snippets Ref - SageMaker examples using SDK for SAP ABAP - AWS SDK
for SAP ABAP (amazon.com)
S AG E M A K E R I N S A P L A N D S C A P E S

8. Public
COMMUNITY DAY
Mumbai
ABAP SDK provides native
integration to BedRock for
invoking foundation models
Instead of manually
performing steps for training,
the pre-trained models can be
leveraged using BedRock
In addition, the BedRock
models can be trained with
data extracted from SAP
privately without sharing the
data with Foundation Model
itself
Scenarios like product image
generation and invoice
generation is possible with
Image and Text Generation
models respectively
While BedRock is oriented
towards extending Foundation
Models for GenAI use-cases
with no training efforts, it still
allows customizations and
hence it brings the benefits of
Sagemaker and helps getting
a quicker RoI
B E D RO C K I N S A P L A N D S C A P E S

9. Public
COMMUNITY DAY
Mumbai
C O D E W H I S P E R E R F O R S A P D E V E L O P E R S
• CodeWhisperer supports programming recommendations in Python, Java, JavaScript,
TypeScript, C#, Go, Rust, PHP, Ruby, Kotlin, C, C++, Shell scripting, SQL, Scala, JSON,
YAML, and HCL
• SAP uses ABAP as programming language , hence there is no direct integration currently
available
• With the integrations being cross-platform, CodeWhisperer is still useful when it comes to
scenarios where AWS native services’ integrations are performed with SAP via the ABAP
SDK
• CodeWhisperer can help ABAP developers stop worrying about learning any of the above
languages from a syntax perspective and allows them to focus on logic
• CodeWhisperer supports multiple IDEs , however ABAP Eclipse is not currently supported
• SAP also provides its own “SAP Build Code” as a low-code/no-code platform and SAP Joule
as a co-assistant to program in SAP ABAP Cloud for Java and JavaScripts and yet to be
made available for its most popular ABAP framework

10. Public
COMMUNITY DAY
Mumbai
A M A Z O N Q F O R S A P A D M I N I S T R AT O R S
• The in-line chat assistant by AWS is available in almost every AWS console interface
• SAP on AWS administrators can simplify their regular tasks, for example, extending disks,
provisioning servers, handling load balancers, with a chat-enabled feature
• Typically AWS Administrators and SAP Basis Administrators are different teams, however
Amazon Q bridges this gap and SAP Basis Administrators can perform all L1/L2 tasks
themselves
• The benefits are extended to business users and can be tailored for various business
cases with native integrations, including all operations of Amazon Q being called via ABAP
SDK using the API for Amazon Q Connect
• A typical scenario could be an integration with SAP CRM system where Amazon Q can
assist service agent get summary of previous customer integrations, while the summary
itself being generated using LLMs with no custom development efforts

11. Public
COMMUNITY DAY
Mumbai
PA R T Y R O C K F O R S A P C O N S U LTA N T S
• PartyRock provides a cool way to experiment with AI and build mini-apps
• No coding is required to build apps with PartyRock
• ABAP developers can create code samples in a very easy manner
LIVE DEMO

12. Public
Thank You
Sourabh Chordiya,
Solutions Architect