SAP's Ina Felsheim and Paul Medailles provided this webcast this past week.
Figure 1: Source: SAP
Figure 1 covers the "3 V’s" of Big Data. Organizations are dealing with larger and larger datasets.
Volume is lots of data.
Variety of data includes structured and unstructured data.
Velocity covers how fast
The 4th V is value, offering challenges and opportunities.
Figure 2: Source: SAP
The majority of businesses deal with less than 100 TB of data today.
Most companies expect data requirements will grow
TDWI expects datasets to be larger than 100 TB by 2015
Figure 3: Source: SAP
Figure 3 shows that rather than running a query, you’re mining data, and not sure what you will find.
You just want tools to find the data to deliver insights
Figure 4: Source: SAP
Figure 4 shows the use case for real time analysis.
On the left, only at end of business process, with latency, take the data and extract it into enterprise data warehouse, and then do analysis
With tools have today, we can do real time analysis (on the right of Figure 4). You can track a process, be in the middle of a process while it is occurring
Figure 5: Source: SAP
Figure 5 shows Data Services, with ETL for data layer, not process layer
It has data quality management capabilities
Third capability is text data processing
Figure 6: Source: SAP
Data Services is not completely SAP-centric, as shown in Figure 6.
Data profiling covers understand the quality of the data
The core data services engine includes jobs for data cleansing, enrichment and validation.
Figure 7: Source: SAP
Figure 7 shows a new format called VCF "Variant Call Format" for gene sequencing
Hadoop is supported as source or target
Data Services 4.2 has new adapter SDK – build connectivity to any back end system as a source or target
Add change data capture
To be continued - slides for the webcast are here: http://public.brighttalk.com/resource/core/28131/navigating-big-data-with-sap-data-services_42469.pdf
Subset of Question & Answer
Q: What skillsets needed for Data Services?
A: It depends on use case
For data migration, a certain set of skills
To develop extract transform load jobs - need a SQL developer
Q: How is it licensed? Is it separate from BI?
A: It is a separate license from BI; licensed by cores
Q: Do you have to be an SAP customer to take advantage of Data Services?
A: No; Data Services – still have a lot of customers use it