integration design is decoupled from physical environmentmultiple (target-centric) business rules can be defined for each business definitionrules are 100% reusable across projects500,000+ built-in name correlationsintelligent business definition learningrationalization is being done by (data) steward
expressor processor:optimized, parallel processing engine with small footprintbatch and real-time processingthe partitioning is also controllable through configurationschannels can extend across heterogeneous architecturesprocesses terabytes of data per hourprocesses complex / hierarchical data types supports structured & semi-structured data guaranteed message deliveryflexible deployment across Windows, linux, UNIX, and IBM mainframe computersadaptors (motors) to wide range of data sourcesdefinitions:channel - an individual stream of data between tool objects or between an external data source and a motor. Used by expressor processor to specify where data is located and to establish parallelism; when processing in parallel there are multiple channels connecting instances of tool processes.network is a network is an expressor object that serves as a container for channels. A network specifies the type of data source associated with the channels. image - an image is an expressor object that describes the structure of a data record being processed at each operation of the applicationconfiguration – a file containing task configuration details. There is a level hierarchy of configuration files which can be used to flexibly standardize the environment.
no pressure points the connection between specification and execution is linkeddata steward / analyst maintains source / target linkage and rules analyst can test rulesdevelopers reuse tested rulesdesign is decoupled from physical environment by semantic model so it is immediately reusable
expressor IDC Presentation Oct 29 2009 - Presentation Transcript
redefining data integration IDC Business Intelligence Road show 2009 Ljubljana, Slovenia Oct 29, 2009 Mark Talbot, expressor business development manager
company founded in 2003 smart, fast, affordable data integration software led by experienced management team technical founders have very strong data warehousing and DI background received 16 Mill in funding; main investors are Commonwealth Capital Ventures, Globespan Capital Partners and Sigma Partners expressor 2.1 shipped Oct ‘09 headquartered in burlington, ma smart semanticstm breakthrough scalability total lifecycle management 2
expressor - where we fit data consumers web services portals BI tools applications processes databases developer perpetual data analyst semantic metadata services high-performance data integration services data steward collaborative role-based tools manager batch data architect data sources 3 web services databases flat files mainframe messages semi-structured data applications xml
DI products are inefficient and expensive 4 “data integration” solutions on the market are complex, bloated, and service intensive 75% of data warehouse builders still custom-code their DI processes simple and complex data, time-series data, growing number of sources overwhelms tool’s ability to cope data volume growth and complexity continues to explode more data needs to be delivered faster and we have less time to deliver the application time is being compressed hardware costs, obsolete (expensive) software pricing models, and high development staff costs negatively impact ROI current solutions don’t scale
the big switch (Nicolas Carr, IDC) 5
why semantics matter “Only by presenting data together with its definitions in a meaningful context…can organizations fully harness and exploit their data assets. These data semantics, effectively applied, enable smarter query and reporting functionality across the entire IT environment, and they enable the delivery of information, derived from structured data, that is meaningful and actionable for the user.” -- Carl Olofson, Managing Data Strategically, IDC 6
smart semanticstm 7
breakthrough scalability 8 expressor processor image channel channel image network network channel channel channel channel channel-based parallel partitioning data stores / applications data stores / applications expressor engine outperforms leading DI platforms
9 total lifecycle management rationalizes metadata using expressor administrator data architect/ steward (auto) generates project plan based on detailed data and metrics stored in metadata repository creates target-centric semantic rules using expressor constructor business analyst semantic metadata repository project manager (re)uses semantic definitions and analyst rules in expressor drawings expressor integration flow and rules decoupled and abstracted from physical sources and targets by semantic dictionary and available for reuse. Closed loop DI design process developer
business-IT collaboration familiarity through MS Office-based tools common (abstracted) business definitions are much easier to understand than technical metadata simple business rules can be defined directly by an analyst and shared with the ETL developer business rules only need to be defined and tested once and can be reused over and over again 10
expressor application examples 11
case study: healthcare communications company business problem data reaches CSRs in multiple formats, requires intervention by ETL developers at the backend, process requires manual segmentation by analysts results are difficult to analyze need to improve customer interaction
solution
enable CSRs to build “drawings” – merge physical data with abstract layer
segment data as rows in table and leverage repository
use shared libraries to create reusable functions
implement “dynamic where clause” to provide analysts with more reporting granularity
csv csv legacy apps legacy apps analytic apps customer import streams expressor addresses the complete data lifecycle csv csv analytics user
results
CSRs now self-sufficient – no interaction with ETL developers to add or extract data
analysts get faster reporting, with increased granularity and data quality
customer interactions easily iterated based on results
CRMT and expressor – partnering for success CRMT -- leading BI consultancy and SI in former Yugoslavia countries expressor -- creates competitive business advantage by improving the quality of the data supporting strategic, tactical and operational processes CRMT -- exclusive expressor reseller and SI for Austria, Bosnia, Croatia, Hungary, Italy, Macedonia, Montenegro, Serbia and Slovenia 14
15 smart. ultrafast. affordable data integration software
0 comments
Post a comment