Active Data WarehousingCan you have your cake and eat it too ?Jeff MonicoGeneral Manager Information Systems
AgendaINTRODUCING STAR TRACK EXPRESS
THE ‘REAL TIME ENTERPRISE’
THE TRIGGER FOR CHANGE
ACTIVE DATA WAREHOUSING
THE RESULTS
OPERATIONAL INTELLIGENCE
QUESTIONSCompany OverviewAustralian owned and operated Express Freight Company.
Founded in 1974 by Greg Poche. Greg’s influence and core guiding principles are very much part of the business ethos today.
December 2003 saw Australia Post and Qantas form a joint venture to acquire Star Track Express from its founder.
On the 18th May 2011 the retail division of Australian Air Express was merged into Star Track Express to create Australia’s largest door-to-door express service provider.
4,500+ Employees, 3,750+ Vehicles (Vans, Trucks, Prime Movers, Trailers, Forklifts).
Each day over 400,000 items of freight are picked up and delivered, with an industry leading ~99% success rate.Core Services
How we collect and use dataBusiness activity has a very short life cycle, with data being collected and used at many points during that lifecycle……18:3018:4019:0016:45DATA COLLECTION (SCANS)TIME	EVENT DESCRIPTION16:45	Freight picked up18:30	Freight unloaded at Sortation Depot18:40	Freight sorted at Sortation Depot into Lane 2119:00	Freight loaded onto interstate trailer M20005:00	Freight unloaded at Sortation Depot05:35	Freight sorted at Sortation Depot onto Centre Wishbone07:00	Freight loaded onto delivery truck ABC12309:30	Freight successfully delivered09:30	Consignment Note signed by Bob.09:30DATA USAGE05:0005:3507:00
Problems we faceLarge Volumes of DataProducing millions or records per day which are needed for operational and analytical queries.Fast Response TimesUsers demand sub second response times on operational queries.Near Real Time LoadsReal time business needs real time data from a variety of sources.  Latency of more then a minute or two is an issue.
Large Data SetsExtending the data being collected from financial, to analytical, to transactional created exponentially larger data sets……..
Low LatencyData comes from multiple sources, from inside and outside of local networks and needs to be available with very low latency………OLTP SQL ServerWireless IPDelivery Event??File TransferMainframe (RMS)Sortation EventEDW
Varied Query Response Needs<1s<1s<10s<1m
Data capturedIntelligence deliveredAction takenLow latency, fast response times and effective BI together helps accelerate decisions and create business value…..Business eventValueTimeMissed OpportunitySituationGained OpportunityTwo Trucks are dispatched to same location for delivery
Customer is curious and a bit frustrated as to why 2 trucks are needed…

Real Time Data Warehousing Mastering Business Objects June 11

  • 1.
    Active Data WarehousingCanyou have your cake and eat it too ?Jeff MonicoGeneral Manager Information Systems
  • 2.
  • 3.
    THE ‘REAL TIMEENTERPRISE’
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
    QUESTIONSCompany OverviewAustralian ownedand operated Express Freight Company.
  • 9.
    Founded in 1974by Greg Poche. Greg’s influence and core guiding principles are very much part of the business ethos today.
  • 10.
    December 2003 sawAustralia Post and Qantas form a joint venture to acquire Star Track Express from its founder.
  • 11.
    On the 18thMay 2011 the retail division of Australian Air Express was merged into Star Track Express to create Australia’s largest door-to-door express service provider.
  • 12.
    4,500+ Employees, 3,750+Vehicles (Vans, Trucks, Prime Movers, Trailers, Forklifts).
  • 13.
    Each day over400,000 items of freight are picked up and delivered, with an industry leading ~99% success rate.Core Services
  • 14.
    How we collectand use dataBusiness activity has a very short life cycle, with data being collected and used at many points during that lifecycle……18:3018:4019:0016:45DATA COLLECTION (SCANS)TIME EVENT DESCRIPTION16:45 Freight picked up18:30 Freight unloaded at Sortation Depot18:40 Freight sorted at Sortation Depot into Lane 2119:00 Freight loaded onto interstate trailer M20005:00 Freight unloaded at Sortation Depot05:35 Freight sorted at Sortation Depot onto Centre Wishbone07:00 Freight loaded onto delivery truck ABC12309:30 Freight successfully delivered09:30 Consignment Note signed by Bob.09:30DATA USAGE05:0005:3507:00
  • 15.
    Problems we faceLargeVolumes of DataProducing millions or records per day which are needed for operational and analytical queries.Fast Response TimesUsers demand sub second response times on operational queries.Near Real Time LoadsReal time business needs real time data from a variety of sources. Latency of more then a minute or two is an issue.
  • 16.
    Large Data SetsExtendingthe data being collected from financial, to analytical, to transactional created exponentially larger data sets……..
  • 17.
    Low LatencyData comesfrom multiple sources, from inside and outside of local networks and needs to be available with very low latency………OLTP SQL ServerWireless IPDelivery Event??File TransferMainframe (RMS)Sortation EventEDW
  • 18.
    Varied Query ResponseNeeds<1s<1s<10s<1m
  • 19.
    Data capturedIntelligence deliveredActiontakenLow latency, fast response times and effective BI together helps accelerate decisions and create business value…..Business eventValueTimeMissed OpportunitySituationGained OpportunityTwo Trucks are dispatched to same location for delivery
  • 20.
    Customer is curiousand a bit frustrated as to why 2 trucks are needed…

Editor's Notes

  • #6 On any given day this happens for 300,000 items05:40 – Driver looking for freight09:00 – Customer calling call centre10:00 – Customer using Web
  • #7 Large data – rapid movement to
  • #9 Delivery – anywhere in Australia, messages over wireless IP into OLTP serverSortation – in our facilities, file transfer into mainframe.Traditional Batching Not Appropriate from a timing perspective. Have to be careful about impact on source systems. Different technologies.
  • #10 Web/EMS – tens of htousands of interactions per day – dast response required – SERVICEDashboard – not many interactionsReports – run/schedule, etc
  • #12 Two columns – one for each need. Show implication (extra DB server, hardware, DBA and then ETL)Highlight need for same dataNew WebsiteOld scenario was TEAM basedWanted an ODS (not another transactional system)New EDWSQL2008 but wasn’t going to cut it for the growthWanted an EDWData same as in ODSSeparate or One ?Ideally 1 platform – but can you have your cake and eat it to ??
  • #14 Cards
  • #15 Users – Queues - TASM
  • #16 Tibco ESBAttunity StreamData Integrator