Solutions
Overview
Data Virtualization
Data Services for SOA
Business Intelligence and Reporting
CDI-MDM
Virtual Data Marts
Industry Solutions
Home > Solutions > SOA Data Services

 

                                                       

Composite Data Services for SOA

 White Paper: Critical Need for Data Services When Building an SOA       

. .

Break the data bottleneck to achieve SOA objectives

Data Services: The Key to SOA Data Integration
You are not alone if you’ve discovered that a big bottleneck to achieving the SOA promise is how to properly integrate your data. Most new applications, SOA or not, utilize data from an existing systems foundation. This data is complex, diverse and spread across the enterprise in various technology and application silos. Each source has its own access mechanisms, syntax, security, etc., and few are structured properly for consumption, let alone reuse.

Data services overcome these bottlenecks. Data services are a form of Web service, optimized for the real-time data integration demands of SOA. Data services virtualize data to decouple physical and logical locations and therefore avoid unnecessary data replication. Data services abstract complex data structures and syntax. Data services federate disparate data into useful composites. Data services also support data integration across both SOA and non-SOA applications.

Data Services Layer: Critical Architecture Component
Architecturally, data services combine to form a middle layer of reusable services, or a data services layer, decoupled from both the underlying source-data layer as well as the consuming solutions layer. This provides the flexibility required to deal with each layer in the most effective manner, as well as the agility to work quickly across layers such as applications, schemas or underlying data sources change. According to industry analyst firm AMR Research, “No SOA plan is complete without a data services layer.”

<Composite Data Services Demo>

 

Three Tier Data Services Landscape Diagram
Three Tier Data Services Landscape

Wrapping Existing Data and ESBs are Insufficient
If all you need is to access existing data from a single source, then wrapping the data before presenting it within the SOA may be sufficient.  However, if you need to virtualize, abstract and federate disparate data from multiple complex sources, then you will need a robust solution for heavy-duty data integration.

ESBs are sometimes incorrectly associated with queries.  ESBs provide a valuable messaging mediation infrastructure within a SOA.  However, they optimize messaging, not queries, lacking critical data integration capabilities including virtualization, abstraction, and federation.

For optimal SOA data integration, use an ESB to mediate the optimized data services that have been built and run in the Composite Information Server.  This complementary use of technology provides the following benefits:

  • Design Time.  Composite’s easy-to-use data modeling is critical for understanding complex data sets from disparate sources. Automated data service code generators accelerate development by tenfold. As your data sources grow in number and complexity, these tools become even more critical. Data services can be composited with other services authored to run in an ESB.
  • Run Time.  Although ESBs have limited query optimization capabilities that are insufficient for large data sets and/or high performance use cases, information servers are designed to optimize large queries at speed and therefore work in tandem with ESBs in a SOA infrastructure.

Best of Breed Versus Platform
SOA platform vendors such as IBM and BEA Systems provide solutions that include an ESB, an application server and other tools. While a single vendor affords convenience at the time of purchase, a “one size fits all” approach typically comes with functionality compromises. 

Therefore, savvy enterprises find and use the best application server, information server, ESB, governance application, and more from vendors with the highest quality technology available. By buying best-of-breed, you can add to your infrastructure as your business and IT needs dictate. Of course, this requires that your SOA infrastructure components interoperate with multiple vendors’ products.

<SOA Data Services vs Transaction Services Demo>

The Composite Advantage
Composite provides a complete, best-of-breed data integration solution for SOA data services.

  • Web Service Enable Existing Data Assets.  Virtualize, abstract, and federate existing data for use in your SOA. Automatically generate data services directly from data models and metadata.  Leverage pre-built data services for SAP, Oracle EBS, Siebel, Salesforce.com and more.
  • Data Services Layer.  Create a layer for reusable data services within your SOA. Easy to consume directly or composite with other services. Standards-compliant.
  • Integration Ready.  Optimized for data integration across your diverse sources and consumers. Works with any application server, BPM, ESB, and governance middleware. No dependencies.

How Composite Provides Data Services
The Composite Information server is the foundation of Composite’s data services solution. You can start with a single SOA project and extend Composite across your enterprise SOA, flexibly adding reusable data services as your needs grow.

At design time, the Composite Information Server is an easy-to-use data modeler and code generator for creating data services with a few simple clicks.  

At run time, the Composite Information Server is a high-performance query and federation engine that works equally well with tabular (SQL) and hierarchical (XML) data. 

The Composite Information server works directly with multiple vendors’ key SOA components such as application servers, ESBs, BPMs, governance and others.

See Figure – SOA Landscape Model

SOA Landscape Model
Figure: SOA Landscape Model

Composite Data Services In Action
Composite is proven at innovative customers like Wall Street investment banks, large pharmaceuticals, and the US Federal government. 

  • Single View of a “Person of Interest”.  Intelligence data spread across multiple intelligence agencies leverage a shared data services layer enabling analysts to get a complete picture on persons of interest.
  • Financial Research Data Services Layer. Data services form a middle layer between a multi-terabyte financial research database and a variety of Matlabs analytical and custom financial engineering applications. Analysts spend less time on access and more time on analysis resulting in higher investment returns.
  • Reporting Data Services Layer.  Multiple reporting requirements including Prime Brokerage, Reconciliation, Risk Management, etc., share a common set of data services to accelerate new reporting development while improving reporting accuracy.

Go to the following links to better understand where Composite data integration can support your upcoming SOA projects.

The Bottom Line
Data services break the data integration bottleneck that slows down most SOA development projects.  Given today’s complex and multiple source data environments, simple wrapping and ESBs alone cannot support the heavy-duty query requirements.  Only Composite’s best-of-breed solution provides the critical data virtualization, abstraction and federation capabilities you need to provide the robust data services and layer your SOA requires. With Composite data services you can achieve your SOA objectives sooner, for less.