SlideShare a Scribd company logo
RIPping through data
                     Challenges faced in the digital front end




Martin Bailey
CTO, Global Graphics


1   © Copyright 2011 Global Graphics Software Limited
ACKNOWLEDGEMENTS
– This presentation was created with
  assistance from our partners at
  Hewlett Packard.
– Especial thanks are due to Dave Staas,
  Lead Software Architect,
  Indigo Digital Press DFE




2   © Copyright 2011 Global Graphics Software Limited
INTRODUCTION
– A Controller or Digital Front End (DFE) provides a number of functions
  for digital press print jobs:
    •   Workflow definition, control, and management
    •   Job management (submission, status, view, edit, cancel, etc.)
    •   Color, ink, and media management
    •   Imposition and finishing management and control
    •   The conversion of rich document formats like PDF and PPML into “print ready bits” –
        data that is rendered and formatted for the marking engine of the digital press




                                                     HP Indigo W7200 Digital Press

3
CONSTRUCTING A DFE


                                                        Control process



                                                         RIP

                        Pre-                                         Post-       Press
                     processing                          RIP      processing   controller




                            Job
                           cache
                                                         RIP        Raster
                                                                    cache
                                                                                            HP Indigo 7500
                                                                                             Digital Press




4   © Copyright 2011 Global Graphics Software Limited
WORK ALLOCATION
                                                                                  – Interpreting/rendering – 
                                                                                  – Color management – 
                           Control process
                                                                                  – Imposition – ,  or 

                                                                                 – Trapping –  or 
                                 RIP                                              – Screening –  or 
                                                         
                                                           Post-
                                                                       
                                                                       Press      – Font handling – 
        Pre-
     processing                  RIP                    processing   controller

                                                                                  – Variable data –
         Job
                                                        Raster
        cache                    RIP                     cache                    –   + for PPML etc
                                                                                       for PDF with no h/w assist
                                                                                      + for PDF with h/w
                                                                                      (+) or (++) for PDF/VT


5   © Copyright 2011 Global Graphics Software Limited
WHAT’S THE PROBLEM?
– A typical print shop can have many digital presses and DFEs (Consolidated
  Graphics, for example, has more than 50 Indigo digital presses across several sites1)
– A standard mid-range digital press (120 PPM) requires the processing of over
  one hundred million pixels every second, worst-case, with possibly multiple transforms,
  and in 4 (or more) colors
– HP’s high-end presses (like the T400 below) require around three billion pixels every
  second
– The primary performance goal for a DFE is to process any job or workflow at or above
  press speed – strive to always have the DFE outpace the press over a shift
– Maximum efficiency must be exploited in every aspect of the system’s design in order
  to achieve this goal within reasonable cost constraints




    HP Indigo 7500 Digital Press                  HP T400 Color Inkjet Web Press
6
THOSE CALCULATIONS …
Example 1: cut-sheet, 800x800dpi, four color (CMYK), 8 bits per pixel
per colorant, 120ppm (A4), single-sided
  • 800 x 800 = 640,000 pixels per square inch

    •   640,000 x 11.69 x 8.27 = 61,872,832             pixels per A4 page
    •   61,872,832 x 120 / 60 = 123,745,664             pixels per second
    •   123,745,664 x 4 x 8 / 8 = 494,982,656            bytes per second
    •    = 472 MB/s

Example 2: roll-fed, 600x600dpi, four color (CMYK), 8 bits per pixel
per colorant, 41.75” printable width, 600 ft per minute, two-sided
  • 600 x 600 = 360,000 pixels per square inch

    •   360,000 x 41.75 x 600 x 12 = 108,216,000,000            pixels per minute, per side
    •   108,216,000,000 / 60 x 2 = 3,607,200,000            pixels per second, duplexed
    •   3,607,200,000 x 4 x 8 / 8 = 14,428,800,000           bytes per second
    •   = 13.4 GB/s
7   © Copyright 2011 Global Graphics Software Limited
SPEED VS DUTY CYCLE
– Speed: pages per minute (usually A4 or US letter
  equivalent)
    • Definesmax throughput while the press is running
    • Important for office print and light production

– “Duty cycle” has different meanings for different sectors:
  • Office and light production:
       − Simplistic calculation of how many pages a printer could produce in a
         month running flat-out for 1 shift per day
       − Not representative of any realistic throughput
    • High-volume                                production
       − The vendor’s assessment of a realistically achievable page volume per
         month for that press
       − The number of pages a print company expects to be able to produce every
         month from their press

8   © Copyright 2011 Global Graphics Software Limited
IN LIGHT PRODUCTION …
– the monthly duty cycle of a given product is not the “recommended”
  volume at which it should be used on a consistent basis.
       − Paul Albano, Canon USA

– Most vendors of document imaging devices specify a “monthly duty
  cycle” for their products […]. This number represents the maximum
  number of pages a product can produce in a month. It is not the
  volume at which the product should be used on a regular basis. […] In
  the real world, products are being used for much lower volumes,
  ranging from 5 percent to 20 percent of the duty cycle in the case of
  monochrome products.
       − Buyers’ Lab




– This is not true for high-volume production. Print service providers
  expect to achieve the duty cycle every month to ensure that they can
  meet planned return on investment.

9   © Copyright 2011 Global Graphics Software Limited
SPEED & DUTY CYCLE
                       7



                       6
                                                                                                                • Speed plotted against
                                                                                                                  duty cycle for a number
                       5
                                                                                                                  of high-volume digital
Duty cycle (Mpp/mon)




                                                                                                                  presses.
                       4
                                                                                           Duty cycle (Mpp/m)
                                                                                           8/5
                                                                                                                • Diagonal lines show
                       3
                                                                                           16/6                   the page volume
                                                                                           24/7                   achievable in 1, 2 or 3
                       2                                                                                          shifts at that rated
                                                                                                                  speed.
                       1



                       0
                            60                  80                  100        120   140
                                                             Speed (ppm)


      10                   © Copyright 2011 Global Graphics Software Limited
HOURS PER DAY TO REACH DUTY CYCLE
                                                     20                                                                                         • The same data, now
                                                                                                                                                  showing hours per day
                                                     18
                                                                                                                                                  required to achieve duty
Hours per day required to achieve rated duty cycle




                                                                                                                                                  cycle (7 day week).
                                                     16


                                                     14
                                                                                                                                                • High numbers imply an
                                                                                                                                                  expectation that the
                                                     12                                                                                           press can run at rated
                                                                                                                                                  engine speed for most
                                                     10                                                                                           of every shift.

                                                      8                                                                                         • Planned maintenance is
                                                                                                                                                  not taken into account.
                                                      6

                                                                                                                                                • This duty cycle range
                                                      4
                                                                                                                                                  selected to illustrate
                                                      2
                                                                                                                                                  cross-over from light-
                                                                                                                                                  production to high-
                                                      0                                                                                           volume production
                                                          60           70            80             90        100       110   120   130   140     expectations
                                                                                                          Speed (ppm)


                     11                               © Copyright 2011 Global Graphics Software Limited
–Print service providers in high-volume digital
 production print expect to achieve duty
 cycle every month
–This requires that the press run at rated
 engine speed almost 100% of the time,
 regardless of job content or complexity
     • Except              for planned maintenance periods




12   © Copyright 2011 Global Graphics Software Limited
IT’S A SOLVED PROBLEM, ISN’T IT?
All this talk of hugely high performance requirements … do I
 still have to worry?
It’s solved for current jobs and current presses, but:
– New presses need higher data rates
     • Larger           format/wider webs
     • Higher           paper speeds/pages per minute
     • Higher           resolution (2x resolution = 4x raster size)
     • More          colorants (MICR, photoink, HiFi, spot colors etc)
     • Multi-bit           screening

• And …



13   © Copyright 2011 Global Graphics Software Limited
JOBS ARE GETTING MORE COMPLEX
– Larger coverage of variable data in direct marketing, triggered by
     •   Better demographic data
     •   Better data mining techniques
     •   Proven better response rates to well-crafted personalized mail

– More use of live transparency
     •   Driving adoption of PDF for direct marketing
     •   Expanding out of general design practice for books, publication, POD, print-for-pay and
         general commercial print
     •   Many designers don’t even know they’re using transparency!

– In a well-optimized RIP transparency requires more processing than
  an opaque job
     •   Color transforms & read/modify/write cycles




14   © Copyright 2011 Global Graphics Software Limited
THIS IS TRANSPARENCY …




15   © Copyright 2011 Global Graphics Software Limited
AND THIS …




16   © Copyright 2011 Global Graphics Software Limited
AND THIS




17   © Copyright 2011 Global Graphics Software Limited
DOESN’T PDF/VT FIX THE PROBLEM?
– PDF/VT (ISO 16612-2) defines structures in a PDF file to:
     •   Allow easier identification of re-used and single-use graphical elements
     •   Define which sets of pages go together in a hierarchical structure
         − E.g. as components that will be supplied to a single direct mail recipient

     •   Enable pseudo-streaming

• Encourages good practice through PDF/X
     •   All fonts embedded
     •   All colors formally defined etc

– This means that PDF/VT is a useful standard!


– But it does not address the fundamental issues of:
     •   Compute power required to process transparency
     •   Sheer data volume required to drive current and future digital production presses


18   © Copyright 2011 Global Graphics Software Limited
THE REAL GOAL
– With the right architecture and components you can make a DFE drive
  your press at engine speed


– The key metric is the throughput achievable per € total bill of materials
     •   Include hardware and software
     •   Every component makes a difference

– The target is to drive the press at rated speed while minimizing the
  cost of the DFE
     •   If the software is faster or more efficient you can reduce the hardware required

– Reducing hardware reduces power consumption and cooling
     •   Going green can be profitable!




19   © Copyright 2011 Global Graphics Software Limited
ARCHITECTURAL CONSIDERATIONS
– Some of the more relevant architectural considerations for enabling
  maximum efficiency:
     •   Reliability
         − Fast, unreliable systems usually aren’t worth much. Stability first, performance second
     •   Work Avoidance
         − Look for ways to move or eliminate work first rather than scaling an inefficiency
     •   Centralized or Distributed Caching
         − Caching can avoid work and improve performance
         − Watch for centralized caches becoming a bottleneck
     •   Instrumentation and Measurement
         − Establish a way to measure performance in your code and system
     •   Planning
         − An ounce of design effort up-front will save more than a pound in efficiency and cost-savings in development and
           manufacturing
         − If you drive a range of devices you may gain from a common, scalable solution across at least some of that
           range

– No universal right answer on most of these considerations; they’re
  useful topics to think about in the context of efficiency

20
PARALLELISM – WITHIN A MACHINE
             We invest effort to take advantage of all of
             these machine-level parallelisms:



             – Multiple CPUs per machine
             – Multiple cores per CPU
             – Multiple physical disks per machine
             – Multiple physical disks per logical disk
             – Multiple (teamed/bonded) network
               interfaces per logical network connection
             – Multiple RIPs per machine
             – Multiple threads per RIP


21
PARALLELISM – END-TO-END SOLUTION




           Split into page ranges    RIPs deliver data in parallel   Press controllers
            and assign to RIPs           to press controllers        deliver to presses


     Split files into multiple “partitions” or chunks and process in parallel
          Parallelize early, maintain multiple parallel pipelines
          Parallelize in pre-RIP, where the data is much smaller (1/7th the size)
     Process multiple jobs in parallel
     Different variations optimize first-page-out, engine loading or throughput
22
SUMMARY
– Digital printing architectures need careful design
– Many different strategies must be employed in unison for the best
  effect
– Key architectural considerations can help guide your efforts
– Selection of the best components and supplier/partners is an important
  aspect
– The ultimate goal is to reduce cost, power, and cooling for customers




23   © Copyright 2011 Global Graphics Software Limited
Q&A

                           More information at www.globalgraphics.com/imiconf




24   © Copyright 2011 Global Graphics Software Limited

More Related Content

Similar to RIPping through data - Challenges faced in the digital front end

RIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front endRIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front end
Global Graphics Software
 
The unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systemsThe unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systems
Meteor Inkjet Ltd
 
Unified workflow review (gen)
Unified workflow review (gen)Unified workflow review (gen)
Unified workflow review (gen)
Baiju Gujarathi
 
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
Benoit Hudzia
 
Kodak 800 Print Manager Datasheet
Kodak 800 Print Manager DatasheetKodak 800 Print Manager Datasheet
Kodak 800 Print Manager Datasheet
Eyal Benedek
 
Impact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and careerImpact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and career
Vitaliy Rudnytskiy
 
Open Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event ReportOpen Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event Report
Naruhiko Ogasawara
 
IMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon UniversityIMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon University
Alkis Vazacopoulos
 
Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010
HP GSB
 
Sap overview
Sap overviewSap overview
Sap overview
Prashant Wagh
 
Sap overview
Sap overviewSap overview
Sap overview
87sayandas
 
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_dataCon2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
aadamserpcorp
 
Controlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANAControlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANA
John Jordan
 
Streaming print data directly to printhead electronics
Streaming print data directly to printhead electronicsStreaming print data directly to printhead electronics
Streaming print data directly to printhead electronics
Global Graphics Software
 
Revolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet TechnologyRevolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Xennia Technology
 
ITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business modelITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business model
ABC-GROEP.BE
 
Forum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glanceForum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glance
ABC-GROEP.BE
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 Presentation
RGDooley
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 Presentation
John Schaberg
 
Mainframe
MainframeMainframe
Mainframe
shivas
 

Similar to RIPping through data - Challenges faced in the digital front end (20)

RIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front endRIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front end
 
The unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systemsThe unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systems
 
Unified workflow review (gen)
Unified workflow review (gen)Unified workflow review (gen)
Unified workflow review (gen)
 
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
 
Kodak 800 Print Manager Datasheet
Kodak 800 Print Manager DatasheetKodak 800 Print Manager Datasheet
Kodak 800 Print Manager Datasheet
 
Impact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and careerImpact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and career
 
Open Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event ReportOpen Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event Report
 
IMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon UniversityIMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon University
 
Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010
 
Sap overview
Sap overviewSap overview
Sap overview
 
Sap overview
Sap overviewSap overview
Sap overview
 
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_dataCon2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
 
Controlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANAControlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANA
 
Streaming print data directly to printhead electronics
Streaming print data directly to printhead electronicsStreaming print data directly to printhead electronics
Streaming print data directly to printhead electronics
 
Revolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet TechnologyRevolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet Technology
 
ITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business modelITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business model
 
Forum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glanceForum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glance
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 Presentation
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 Presentation
 
Mainframe
MainframeMainframe
Mainframe
 

More from Global Graphics Software

Correct color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enoughCorrect color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enough
Global Graphics Software
 
Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?
Global Graphics Software
 
Global Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peelGlobal Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics Software
 
Avoiding the orange peel - The IJC 2017
Avoiding the orange peel - The IJC 2017Avoiding the orange peel - The IJC 2017
Avoiding the orange peel - The IJC 2017
Global Graphics Software
 
Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...
Global Graphics Software
 
Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016
Global Graphics Software
 

More from Global Graphics Software (6)

Correct color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enoughCorrect color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enough
 
Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?
 
Global Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peelGlobal Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peel
 
Avoiding the orange peel - The IJC 2017
Avoiding the orange peel - The IJC 2017Avoiding the orange peel - The IJC 2017
Avoiding the orange peel - The IJC 2017
 
Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...
 
Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016
 

Recently uploaded

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
TIPNGVN2
 
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Zilliz
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
Pixlogix Infotech
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 

Recently uploaded (20)

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
 
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 

RIPping through data - Challenges faced in the digital front end

  • 1. RIPping through data Challenges faced in the digital front end Martin Bailey CTO, Global Graphics 1 © Copyright 2011 Global Graphics Software Limited
  • 2. ACKNOWLEDGEMENTS – This presentation was created with assistance from our partners at Hewlett Packard. – Especial thanks are due to Dave Staas, Lead Software Architect, Indigo Digital Press DFE 2 © Copyright 2011 Global Graphics Software Limited
  • 3. INTRODUCTION – A Controller or Digital Front End (DFE) provides a number of functions for digital press print jobs: • Workflow definition, control, and management • Job management (submission, status, view, edit, cancel, etc.) • Color, ink, and media management • Imposition and finishing management and control • The conversion of rich document formats like PDF and PPML into “print ready bits” – data that is rendered and formatted for the marking engine of the digital press HP Indigo W7200 Digital Press 3
  • 4. CONSTRUCTING A DFE Control process RIP Pre- Post- Press processing RIP processing controller Job cache RIP Raster cache HP Indigo 7500 Digital Press 4 © Copyright 2011 Global Graphics Software Limited
  • 5. WORK ALLOCATION – Interpreting/rendering –  – Color management –  Control process – Imposition – ,  or   – Trapping –  or  RIP – Screening –  or     Post-  Press – Font handling –  Pre- processing RIP processing controller – Variable data – Job  Raster cache RIP cache – + for PPML etc  for PDF with no h/w assist + for PDF with h/w (+) or (++) for PDF/VT 5 © Copyright 2011 Global Graphics Software Limited
  • 6. WHAT’S THE PROBLEM? – A typical print shop can have many digital presses and DFEs (Consolidated Graphics, for example, has more than 50 Indigo digital presses across several sites1) – A standard mid-range digital press (120 PPM) requires the processing of over one hundred million pixels every second, worst-case, with possibly multiple transforms, and in 4 (or more) colors – HP’s high-end presses (like the T400 below) require around three billion pixels every second – The primary performance goal for a DFE is to process any job or workflow at or above press speed – strive to always have the DFE outpace the press over a shift – Maximum efficiency must be exploited in every aspect of the system’s design in order to achieve this goal within reasonable cost constraints HP Indigo 7500 Digital Press HP T400 Color Inkjet Web Press 6
  • 7. THOSE CALCULATIONS … Example 1: cut-sheet, 800x800dpi, four color (CMYK), 8 bits per pixel per colorant, 120ppm (A4), single-sided • 800 x 800 = 640,000 pixels per square inch • 640,000 x 11.69 x 8.27 = 61,872,832 pixels per A4 page • 61,872,832 x 120 / 60 = 123,745,664 pixels per second • 123,745,664 x 4 x 8 / 8 = 494,982,656 bytes per second • = 472 MB/s Example 2: roll-fed, 600x600dpi, four color (CMYK), 8 bits per pixel per colorant, 41.75” printable width, 600 ft per minute, two-sided • 600 x 600 = 360,000 pixels per square inch • 360,000 x 41.75 x 600 x 12 = 108,216,000,000 pixels per minute, per side • 108,216,000,000 / 60 x 2 = 3,607,200,000 pixels per second, duplexed • 3,607,200,000 x 4 x 8 / 8 = 14,428,800,000 bytes per second • = 13.4 GB/s 7 © Copyright 2011 Global Graphics Software Limited
  • 8. SPEED VS DUTY CYCLE – Speed: pages per minute (usually A4 or US letter equivalent) • Definesmax throughput while the press is running • Important for office print and light production – “Duty cycle” has different meanings for different sectors: • Office and light production: − Simplistic calculation of how many pages a printer could produce in a month running flat-out for 1 shift per day − Not representative of any realistic throughput • High-volume production − The vendor’s assessment of a realistically achievable page volume per month for that press − The number of pages a print company expects to be able to produce every month from their press 8 © Copyright 2011 Global Graphics Software Limited
  • 9. IN LIGHT PRODUCTION … – the monthly duty cycle of a given product is not the “recommended” volume at which it should be used on a consistent basis. − Paul Albano, Canon USA – Most vendors of document imaging devices specify a “monthly duty cycle” for their products […]. This number represents the maximum number of pages a product can produce in a month. It is not the volume at which the product should be used on a regular basis. […] In the real world, products are being used for much lower volumes, ranging from 5 percent to 20 percent of the duty cycle in the case of monochrome products. − Buyers’ Lab – This is not true for high-volume production. Print service providers expect to achieve the duty cycle every month to ensure that they can meet planned return on investment. 9 © Copyright 2011 Global Graphics Software Limited
  • 10. SPEED & DUTY CYCLE 7 6 • Speed plotted against duty cycle for a number 5 of high-volume digital Duty cycle (Mpp/mon) presses. 4 Duty cycle (Mpp/m) 8/5 • Diagonal lines show 3 16/6 the page volume 24/7 achievable in 1, 2 or 3 2 shifts at that rated speed. 1 0 60 80 100 120 140 Speed (ppm) 10 © Copyright 2011 Global Graphics Software Limited
  • 11. HOURS PER DAY TO REACH DUTY CYCLE 20 • The same data, now showing hours per day 18 required to achieve duty Hours per day required to achieve rated duty cycle cycle (7 day week). 16 14 • High numbers imply an expectation that the 12 press can run at rated engine speed for most 10 of every shift. 8 • Planned maintenance is not taken into account. 6 • This duty cycle range 4 selected to illustrate 2 cross-over from light- production to high- 0 volume production 60 70 80 90 100 110 120 130 140 expectations Speed (ppm) 11 © Copyright 2011 Global Graphics Software Limited
  • 12. –Print service providers in high-volume digital production print expect to achieve duty cycle every month –This requires that the press run at rated engine speed almost 100% of the time, regardless of job content or complexity • Except for planned maintenance periods 12 © Copyright 2011 Global Graphics Software Limited
  • 13. IT’S A SOLVED PROBLEM, ISN’T IT? All this talk of hugely high performance requirements … do I still have to worry? It’s solved for current jobs and current presses, but: – New presses need higher data rates • Larger format/wider webs • Higher paper speeds/pages per minute • Higher resolution (2x resolution = 4x raster size) • More colorants (MICR, photoink, HiFi, spot colors etc) • Multi-bit screening • And … 13 © Copyright 2011 Global Graphics Software Limited
  • 14. JOBS ARE GETTING MORE COMPLEX – Larger coverage of variable data in direct marketing, triggered by • Better demographic data • Better data mining techniques • Proven better response rates to well-crafted personalized mail – More use of live transparency • Driving adoption of PDF for direct marketing • Expanding out of general design practice for books, publication, POD, print-for-pay and general commercial print • Many designers don’t even know they’re using transparency! – In a well-optimized RIP transparency requires more processing than an opaque job • Color transforms & read/modify/write cycles 14 © Copyright 2011 Global Graphics Software Limited
  • 15. THIS IS TRANSPARENCY … 15 © Copyright 2011 Global Graphics Software Limited
  • 16. AND THIS … 16 © Copyright 2011 Global Graphics Software Limited
  • 17. AND THIS 17 © Copyright 2011 Global Graphics Software Limited
  • 18. DOESN’T PDF/VT FIX THE PROBLEM? – PDF/VT (ISO 16612-2) defines structures in a PDF file to: • Allow easier identification of re-used and single-use graphical elements • Define which sets of pages go together in a hierarchical structure − E.g. as components that will be supplied to a single direct mail recipient • Enable pseudo-streaming • Encourages good practice through PDF/X • All fonts embedded • All colors formally defined etc – This means that PDF/VT is a useful standard! – But it does not address the fundamental issues of: • Compute power required to process transparency • Sheer data volume required to drive current and future digital production presses 18 © Copyright 2011 Global Graphics Software Limited
  • 19. THE REAL GOAL – With the right architecture and components you can make a DFE drive your press at engine speed – The key metric is the throughput achievable per € total bill of materials • Include hardware and software • Every component makes a difference – The target is to drive the press at rated speed while minimizing the cost of the DFE • If the software is faster or more efficient you can reduce the hardware required – Reducing hardware reduces power consumption and cooling • Going green can be profitable! 19 © Copyright 2011 Global Graphics Software Limited
  • 20. ARCHITECTURAL CONSIDERATIONS – Some of the more relevant architectural considerations for enabling maximum efficiency: • Reliability − Fast, unreliable systems usually aren’t worth much. Stability first, performance second • Work Avoidance − Look for ways to move or eliminate work first rather than scaling an inefficiency • Centralized or Distributed Caching − Caching can avoid work and improve performance − Watch for centralized caches becoming a bottleneck • Instrumentation and Measurement − Establish a way to measure performance in your code and system • Planning − An ounce of design effort up-front will save more than a pound in efficiency and cost-savings in development and manufacturing − If you drive a range of devices you may gain from a common, scalable solution across at least some of that range – No universal right answer on most of these considerations; they’re useful topics to think about in the context of efficiency 20
  • 21. PARALLELISM – WITHIN A MACHINE We invest effort to take advantage of all of these machine-level parallelisms: – Multiple CPUs per machine – Multiple cores per CPU – Multiple physical disks per machine – Multiple physical disks per logical disk – Multiple (teamed/bonded) network interfaces per logical network connection – Multiple RIPs per machine – Multiple threads per RIP 21
  • 22. PARALLELISM – END-TO-END SOLUTION Split into page ranges RIPs deliver data in parallel Press controllers and assign to RIPs to press controllers deliver to presses Split files into multiple “partitions” or chunks and process in parallel Parallelize early, maintain multiple parallel pipelines Parallelize in pre-RIP, where the data is much smaller (1/7th the size) Process multiple jobs in parallel Different variations optimize first-page-out, engine loading or throughput 22
  • 23. SUMMARY – Digital printing architectures need careful design – Many different strategies must be employed in unison for the best effect – Key architectural considerations can help guide your efforts – Selection of the best components and supplier/partners is an important aspect – The ultimate goal is to reduce cost, power, and cooling for customers 23 © Copyright 2011 Global Graphics Software Limited
  • 24. Q&A More information at www.globalgraphics.com/imiconf 24 © Copyright 2011 Global Graphics Software Limited