Pass Summit 2009 Presentation

Loading...

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

0 comments

Post a comment

    Post a comment
    Embed Video
    Edit your comment Cancel

    Notes on slide 1

    integration design is decoupled from physical environmentmultiple (target-centric) business rules can be defined for each business definitionrules are 100% reusable across projects500,000+ built-in name correlationsintelligent business definition learningrationalization is being done by (data) steward

    expressor processor:optimized, parallel processing engine with small footprintbatch and real-time processingthe partitioning is also controllable through configurationschannels can extend across heterogeneous architecturesprocesses terabytes of data per hourprocesses complex / hierarchical data types supports structured & semi-structured data guaranteed message deliveryflexible deployment across Windows, linux, UNIX, and IBM mainframe computersadaptors (motors) to wide range of data sourcesdefinitions:channel - an individual stream of data between tool objects or between an external data source and a motor.  Used by expressor processor to specify where data is located and to establish parallelism; when processing in parallel there are multiple channels connecting instances of tool processes.network is a network is an expressor object that serves as a container for channels.  A network specifies the type of data source associated with the channels. image - an image is an expressor object that describes the structure of a data record being processed at each operation of the applicationconfiguration – a file containing task configuration details.  There is a level hierarchy of configuration files which can be used to flexibly standardize the environment.

    web-based project management applicationtighly integrated with expressorrepositorused to set up projects, manage personnel assignments, perform semantic rationalization tasks, and create expressor images and network descriptionsused by (data) architects, stewards, and (project) managers

    targeted at (data) steward and analystallows steward to rationalize data field names to common business definitionsconstructor includes 500,000 + pre-built name correlationssuggests names for data field names it can’t rationalize automaticallytool also enables analyst to define and test target-centric business rulesrules expressed in expressordatascript™ language

    MS Visio plug-in using illustrator, a developer (implementer) creates an expressor drawing, which is a graphical representation of a data applicationillustrator provides a complete set of operators incl. join, transform, sort, and partition.processing logic is implemented using expressordatascript ™previously defined business rules can be directly utilized within an expressor drawingdrawing file is stored in expressorrepositor

    Favorites, Groups & Events

    Pass Summit 2009 Presentation - Presentation Transcript

    1. www.expressor-software.com
      PASS Summit
      November 2 – 5, 2009
    2. expressor software
      smart, fast, affordable data integration software
      burlington, ma based DI vendor funded by premier VC investors
      led by experienced management team
      technical founders have very strong data warehousing and DI background
      shipping expressor version 2.1
      smart semanticstm
      breakthrough scalability
      total lifecycle management
      2
    3. smart semantics™
      integration design is decoupled from physical environment
      analyst can define multiple (target-centric) rules for each business definition
      rules are 100% reusable across projects
      ships with over 10,000 business terms
      intelligent business definition learning
      expressordrawing
      if part number begins with “384” then ship type is “Fedex”
      reusable
      businessrules
      semantic integration
      common
      business
      definitions
      semantic (metadata)
      rationalization
      part_#
      part_#
      rdbms
      rdbms
      part_number
      part_number
      semantic
      dictionary
      data warehouse
      part_no
      pnum
      cobol copybook
      expressorrepositor
      xml file
      expressor significantly shortens dev time and effort
      3
    4. expressor software
      expressor named a “2009 cool vendor” by Gartner!
      4
    5. breakthrough scalability
      optimized, parallel processing engine with small footprint
      batch and real-time processing
      processes terabytes of data per hour
      processes complex / hierarchical data types
      supports structured & semi-structured data
      flexible deployment across Windows, Linux and UNIX computers
      connectors to wide range of data sources
      expressor processor
      image
      channel
      channel
      image
      network
      network
      channel
      channel
      channel
      channel
      channel-based parallel partitioning
      data stores /
      applications
      data stores /
      applications
      expressor engine outperforms leading DI platforms
      5
    6. total lifecycle management
      role-based, collaborative environment
      unified, semantic metadata repository with built-in version control
      project staging, deployment and rollback
      simultaneous project development
      common business vocabulary and rules bridge business and IT
      development and runtime reporting
      expressor allows you
      to manage and monitor
      the entire project
      lifecycle
      6
    7. case study: American Tower
      challenge
      solution
      results
      • complex data transformations completed in a single process
      • data loading times cut in half
      • existing development team delivers enterprise-level ETL capabilities
      • data warehouse performance too slow
      • SSIS’ limitations require complex data transformations to be executed as stored procedures in SQL Server
      • several hours to load 200GB
      • leverage expressor’s powerful parallel data processing engine and flexible datascript scripting language to handle complex data transformations
      • use expressor’s familiar, Microsoft-based tools to minimize disruption to technical teams and IT infrastructure
      7
    8. expressor semantic data integration systemtm
      • ftp
      • odbc
      • xml files
      • SAS
      • rdbms incl. SQL Server
      • flat files
      • messaging queues
      • Swift
      • EDI
      • time series
      • WSDL
      • SAP IDOC
      • LDAP
      integrator
      role-based tools suite
      data stores /
      applications
      Windows XP/Vista/7, Linux, Unix
      8
      8
    9. expressor initiator
      import terms and definitions from external sources
      define and edit semantic definitions and terms in bulk
      assign subject areas and meta-types to multiple definitions in a single operation
      save, share, and review work in progress
      synchronize data with expressorrepositor
      initiator - a .NET application
      copyright © 2009 expressor software corporation confidential and proprietary
      9
    10. expressor administrator
      10
      used by data architects, data stewards, and project managers
      used to set up projects, manage personnel assignments, perform semantic rationalization tasks, update reporting database, and create expressor images and network descriptions
      tightly integrated with expressorrepositor
      administrator – an IE-based project setup & management application
      copyright © 2009 expressor software corporation confidential and proprietary
    11. expressor constructor
      11
      targeted at data steward and analyst
      tool enables analyst to define and test target-centric business rules
      all test cases are stored in repository for future use
      rules expressed in expressordatascripttm language
      also allows a data steward to rationalize data field names to common business definitions
      constructor - a Microsoft Excel-based application
      copyright © 2009 expressor software corporation confidential and proprietary
    12. expressor illustrator
      targeted at ETL developers
      provides complete set of operators incl. join, transform, sort, and partition
      data processing logic implemented graphically
      highly complex algorithms can be defined using expressordatascripttm
      allows to define new business rules
      previously defined business rules can be directly utilized within an expressor drawing
      drawings and business rules are stored in expressorrepositor
      provides remote execution of drawings
      illustrator - a Microsoft Visio-based application
      copyright © 2009 expressor software corporation confidential and proprietary
      12
    13. expressor datascripttm
      based on open source Lua scripting language
      powerful, concise, and extensible language
      datascript extends Lua with additional expressor-specific functions
      provides common scripting language across platforms
      developers can use datascript to convert unconventional external metadata into image descriptions
      powerful way to integrate expressor with external scheduling systems
      seamless integration with external scripts written in datascript
      illustrator datascript editor
      copyright © 2009 expressor software corporation confidential and proprietary
      13
    14. why expressor – comparison with SSIS
      copyright © 2009 expressor software corporation confidential and proprietary
      14
    15. try expressor now!
      register for
      expressoreval edition
      www.expressor-software.com/eval-edition.htm
      15
    16. smart. ultrafast. affordable.data integration software
      www.expressor-software.com
      16

    + Michael WaclawiczekMichael Waclawiczek, 3 weeks ago

    custom

    45 views, 0 favs, 0 embeds more stats

    SSIS users: turbocharge your ETL applications with more

    More info about this document

    © All Rights Reserved

    Go to text version

    • Total Views 45
      • 45 on SlideShare
      • 0 from embeds
    • Comments 0
    • Favorites 0
    • Downloads 1
    Most viewed embeds

    more

    All embeds

    less

    Flagged as inappropriate Flag as inappropriate
    Flag as inappropriate

    Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

    Cancel
    File a copyright complaint
    Having problems? Go to our helpdesk?

    Categories