Integration Options for moving data from SAP into Databricks

Background

This blog delves into the various methods for integrating data from your SAP systems into Databricks. This exploration is particularly relevant given SAP's recent announcement of SAP Datasphere in March 2023. This collaboration aims to provide businesses with the power of federated AI-driven analytics. This will allow them to effortlessly analyze structured and unstructured data from both SAP and non-SAP sources within a single, unified platform.

This blog will explore options for migrating data from SAP to Databricks without relying on Datasphere or BW4HANA, even though licensing for transferring SAP data to non-SAP systems might still be necessary.

Dynamic HTTP or Odata Adapter – SAP Cloud Integration – CI/CPI

In this blog, I aim to simplify the use of dynamic resources/querying in Odata or HTTP.

To make it clearer for you, let's imagine the following scenario:

You need to perform a GET request in Odata on the S4hana Public Cloud, S4hana Private Cloud, or S4hana On-Premise, and you want to use the query options in a very dynamic and simple way.

Examples of queries:

https://myXXXXXX-api.s4hana.cloud.sap/sap/opu/odata/sap/API_BUSINESS_PARTNER/A_BusinessPartner('17300002')

https://myXXXXXX-api.s4hana.cloud.sap/sap/opu/odata/sap/API_BUSINESS_PARTNER/A_BusinessPartner?$filter=BusinessPartnerGrouping eq 'BP03'