SlideShare a Scribd company logo
1 of 24
RIPping through data
                     Challenges faced in the digital front end




Martin Bailey
CTO, Global Graphics


1   © Copyright 2011 Global Graphics Software Limited
ACKNOWLEDGEMENTS
– This presentation was created with
  assistance from our partners at
  Hewlett Packard.
– Especial thanks are due to Dave Staas,
  Lead Software Architect,
  Indigo Digital Press DFE




2   © Copyright 2011 Global Graphics Software Limited
INTRODUCTION
– A Controller or Digital Front End (DFE) provides a number of functions
  for digital press print jobs:
    •   Workflow definition, control, and management
    •   Job management (submission, status, view, edit, cancel, etc.)
    •   Color, ink, and media management
    •   Imposition and finishing management and control
    •   The conversion of rich document formats like PDF and PPML into “print ready bits” –
        data that is rendered and formatted for the marking engine of the digital press




                                                     HP Indigo W7200 Digital Press

3
CONSTRUCTING A DFE


                                                        Control process



                                                         RIP

                        Pre-                                         Post-       Press
                     processing                          RIP      processing   controller




                            Job
                           cache
                                                         RIP        Raster
                                                                    cache
                                                                                            HP Indigo 7500
                                                                                             Digital Press




4   © Copyright 2011 Global Graphics Software Limited
WORK ALLOCATION
                                                                                  – Interpreting/rendering – 
                                                                                  – Color management – 
                           Control process
                                                                                  – Imposition – ,  or 

                                                                                 – Trapping –  or 
                                 RIP                                              – Screening –  or 
                                                         
                                                           Post-
                                                                       
                                                                       Press      – Font handling – 
        Pre-
     processing                  RIP                    processing   controller

                                                                                  – Variable data –
         Job
                                                        Raster
        cache                    RIP                     cache                    –   + for PPML etc
                                                                                       for PDF with no h/w assist
                                                                                      + for PDF with h/w
                                                                                      (+) or (++) for PDF/VT


5   © Copyright 2011 Global Graphics Software Limited
WHAT’S THE PROBLEM?
– A typical print shop can have many digital presses and DFEs (Consolidated
  Graphics, for example, has more than 50 Indigo digital presses across several sites1)
– A standard mid-range digital press (120 PPM) requires the processing of over
  one hundred million pixels every second, worst-case, with possibly multiple transforms,
  and in 4 (or more) colors
– HP’s high-end presses (like the T400 below) require around three billion pixels every
  second
– The primary performance goal for a DFE is to process any job or workflow at or above
  press speed – strive to always have the DFE outpace the press over a shift
– Maximum efficiency must be exploited in every aspect of the system’s design in order
  to achieve this goal within reasonable cost constraints




    HP Indigo 7500 Digital Press                  HP T400 Color Inkjet Web Press
6
THOSE CALCULATIONS …
Example 1: cut-sheet, 800x800dpi, four color (CMYK), 8 bits per pixel
per colorant, 120ppm (A4), single-sided
  • 800 x 800 = 640,000 pixels per square inch

    •   640,000 x 11.69 x 8.27 = 61,872,832             pixels per A4 page
    •   61,872,832 x 120 / 60 = 123,745,664             pixels per second
    •   123,745,664 x 4 x 8 / 8 = 494,982,656            bytes per second
    •    = 472 MB/s

Example 2: roll-fed, 600x600dpi, four color (CMYK), 8 bits per pixel
per colorant, 41.75” printable width, 600 ft per minute, two-sided
  • 600 x 600 = 360,000 pixels per square inch

    •   360,000 x 41.75 x 600 x 12 = 108,216,000,000            pixels per minute, per side
    •   108,216,000,000 / 60 x 2 = 3,607,200,000            pixels per second, duplexed
    •   3,607,200,000 x 4 x 8 / 8 = 14,428,800,000           bytes per second
    •   = 13.4 GB/s
7   © Copyright 2011 Global Graphics Software Limited
SPEED VS DUTY CYCLE
– Speed: pages per minute (usually A4 or US letter
  equivalent)
    • Definesmax throughput while the press is running
    • Important for office print and light production

– “Duty cycle” has different meanings for different sectors:
  • Office and light production:
       − Simplistic calculation of how many pages a printer could produce in a
         month running flat-out for 1 shift per day
       − Not representative of any realistic throughput
    • High-volume                                production
       − The vendor’s assessment of a realistically achievable page volume per
         month for that press
       − The number of pages a print company expects to be able to produce every
         month from their press

8   © Copyright 2011 Global Graphics Software Limited
IN LIGHT PRODUCTION …
– the monthly duty cycle of a given product is not the “recommended”
  volume at which it should be used on a consistent basis.
       − Paul Albano, Canon USA

– Most vendors of document imaging devices specify a “monthly duty
  cycle” for their products […]. This number represents the maximum
  number of pages a product can produce in a month. It is not the
  volume at which the product should be used on a regular basis. […] In
  the real world, products are being used for much lower volumes,
  ranging from 5 percent to 20 percent of the duty cycle in the case of
  monochrome products.
       − Buyers’ Lab




– This is not true for high-volume production. Print service providers
  expect to achieve the duty cycle every month to ensure that they can
  meet planned return on investment.

9   © Copyright 2011 Global Graphics Software Limited
SPEED & DUTY CYCLE
                       7



                       6
                                                                                                                • Speed plotted against
                                                                                                                  duty cycle for a number
                       5
                                                                                                                  of high-volume digital
Duty cycle (Mpp/mon)




                                                                                                                  presses.
                       4
                                                                                           Duty cycle (Mpp/m)
                                                                                           8/5
                                                                                                                • Diagonal lines show
                       3
                                                                                           16/6                   the page volume
                                                                                           24/7                   achievable in 1, 2 or 3
                       2                                                                                          shifts at that rated
                                                                                                                  speed.
                       1



                       0
                            60                  80                  100        120   140
                                                             Speed (ppm)


      10                   © Copyright 2011 Global Graphics Software Limited
HOURS PER DAY TO REACH DUTY CYCLE
                                                     20                                                                                         • The same data, now
                                                                                                                                                  showing hours per day
                                                     18
                                                                                                                                                  required to achieve duty
Hours per day required to achieve rated duty cycle




                                                                                                                                                  cycle (7 day week).
                                                     16


                                                     14
                                                                                                                                                • High numbers imply an
                                                                                                                                                  expectation that the
                                                     12                                                                                           press can run at rated
                                                                                                                                                  engine speed for most
                                                     10                                                                                           of every shift.

                                                      8                                                                                         • Planned maintenance is
                                                                                                                                                  not taken into account.
                                                      6

                                                                                                                                                • This duty cycle range
                                                      4
                                                                                                                                                  selected to illustrate
                                                      2
                                                                                                                                                  cross-over from light-
                                                                                                                                                  production to high-
                                                      0                                                                                           volume production
                                                          60           70            80             90        100       110   120   130   140     expectations
                                                                                                          Speed (ppm)


                     11                               © Copyright 2011 Global Graphics Software Limited
–Print service providers in high-volume digital
 production print expect to achieve duty
 cycle every month
–This requires that the press run at rated
 engine speed almost 100% of the time,
 regardless of job content or complexity
     • Except              for planned maintenance periods




12   © Copyright 2011 Global Graphics Software Limited
IT’S A SOLVED PROBLEM, ISN’T IT?
All this talk of hugely high performance requirements … do I
 still have to worry?
It’s solved for current jobs and current presses, but:
– New presses need higher data rates
     • Larger           format/wider webs
     • Higher           paper speeds/pages per minute
     • Higher           resolution (2x resolution = 4x raster size)
     • More          colorants (MICR, photoink, HiFi, spot colors etc)
     • Multi-bit           screening

• And …



13   © Copyright 2011 Global Graphics Software Limited
JOBS ARE GETTING MORE COMPLEX
– Larger coverage of variable data in direct marketing, triggered by
     •   Better demographic data
     •   Better data mining techniques
     •   Proven better response rates to well-crafted personalized mail

– More use of live transparency
     •   Driving adoption of PDF for direct marketing
     •   Expanding out of general design practice for books, publication, POD, print-for-pay and
         general commercial print
     •   Many designers don’t even know they’re using transparency!

– In a well-optimized RIP transparency requires more processing than
  an opaque job
     •   Color transforms & read/modify/write cycles




14   © Copyright 2011 Global Graphics Software Limited
THIS IS TRANSPARENCY …




15   © Copyright 2011 Global Graphics Software Limited
AND THIS …




16   © Copyright 2011 Global Graphics Software Limited
AND THIS




17   © Copyright 2011 Global Graphics Software Limited
DOESN’T PDF/VT FIX THE PROBLEM?
– PDF/VT (ISO 16612-2) defines structures in a PDF file to:
     •   Allow easier identification of re-used and single-use graphical elements
     •   Define which sets of pages go together in a hierarchical structure
         − E.g. as components that will be supplied to a single direct mail recipient

     •   Enable pseudo-streaming

• Encourages good practice through PDF/X
     •   All fonts embedded
     •   All colors formally defined etc

– This means that PDF/VT is a useful standard!


– But it does not address the fundamental issues of:
     •   Compute power required to process transparency
     •   Sheer data volume required to drive current and future digital production presses


18   © Copyright 2011 Global Graphics Software Limited
THE REAL GOAL
– With the right architecture and components you can make a DFE drive
  your press at engine speed


– The key metric is the throughput achievable per € total bill of materials
     •   Include hardware and software
     •   Every component makes a difference

– The target is to drive the press at rated speed while minimizing the
  cost of the DFE
     •   If the software is faster or more efficient you can reduce the hardware required

– Reducing hardware reduces power consumption and cooling
     •   Going green can be profitable!




19   © Copyright 2011 Global Graphics Software Limited
ARCHITECTURAL CONSIDERATIONS
– Some of the more relevant architectural considerations for enabling
  maximum efficiency:
     •   Reliability
         − Fast, unreliable systems usually aren’t worth much. Stability first, performance second
     •   Work Avoidance
         − Look for ways to move or eliminate work first rather than scaling an inefficiency
     •   Centralized or Distributed Caching
         − Caching can avoid work and improve performance
         − Watch for centralized caches becoming a bottleneck
     •   Instrumentation and Measurement
         − Establish a way to measure performance in your code and system
     •   Planning
         − An ounce of design effort up-front will save more than a pound in efficiency and cost-savings in development and
           manufacturing
         − If you drive a range of devices you may gain from a common, scalable solution across at least some of that
           range

– No universal right answer on most of these considerations; they’re
  useful topics to think about in the context of efficiency

20
PARALLELISM – WITHIN A MACHINE
             We invest effort to take advantage of all of
             these machine-level parallelisms:



             – Multiple CPUs per machine
             – Multiple cores per CPU
             – Multiple physical disks per machine
             – Multiple physical disks per logical disk
             – Multiple (teamed/bonded) network
               interfaces per logical network connection
             – Multiple RIPs per machine
             – Multiple threads per RIP


21
PARALLELISM – END-TO-END SOLUTION




           Split into page ranges    RIPs deliver data in parallel   Press controllers
            and assign to RIPs           to press controllers        deliver to presses


     Split files into multiple “partitions” or chunks and process in parallel
          Parallelize early, maintain multiple parallel pipelines
          Parallelize in pre-RIP, where the data is much smaller (1/7th the size)
     Process multiple jobs in parallel
     Different variations optimize first-page-out, engine loading or throughput
22
SUMMARY
– Digital printing architectures need careful design
– Many different strategies must be employed in unison for the best
  effect
– Key architectural considerations can help guide your efforts
– Selection of the best components and supplier/partners is an important
  aspect
– The ultimate goal is to reduce cost, power, and cooling for customers




23   © Copyright 2011 Global Graphics Software Limited
Q&A

                           More information at www.globalgraphics.com/imiconf




24   © Copyright 2011 Global Graphics Software Limited

More Related Content

Similar to RIPping through data - Challenges faced in the digital front end

RIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front endRIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front endGlobal Graphics Software
 
The unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systemsThe unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systemsMeteor Inkjet Ltd
 
Unified workflow review (gen)
Unified workflow review (gen)Unified workflow review (gen)
Unified workflow review (gen)Baiju Gujarathi
 
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...Benoit Hudzia
 
Kodak 800 Print Manager Datasheet
Kodak 800 Print Manager DatasheetKodak 800 Print Manager Datasheet
Kodak 800 Print Manager DatasheetEyal Benedek
 
Impact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and careerImpact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and careerVitaliy Rudnytskiy
 
Open Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event ReportOpen Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event ReportNaruhiko Ogasawara
 
IMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon UniversityIMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon UniversityAlkis Vazacopoulos
 
Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010HP GSB
 
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_dataCon2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_dataaadamserpcorp
 
Controlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANAControlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANAJohn Jordan
 
Streaming print data directly to printhead electronics
Streaming print data directly to printhead electronicsStreaming print data directly to printhead electronics
Streaming print data directly to printhead electronicsGlobal Graphics Software
 
Revolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet TechnologyRevolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet TechnologyXennia Technology
 
Forum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glanceForum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glanceABC-GROEP.BE
 
ITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business modelITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business modelABC-GROEP.BE
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 PresentationJohn Schaberg
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 PresentationRGDooley
 
Mainframe
MainframeMainframe
Mainframeshivas
 

Similar to RIPping through data - Challenges faced in the digital front end (20)

RIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front endRIPping through data - Challenges faced in the digital front end
RIPping through data - Challenges faced in the digital front end
 
The unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systemsThe unique requirements of RIPS for industrial inkjet systems
The unique requirements of RIPS for industrial inkjet systems
 
Unified workflow review (gen)
Unified workflow review (gen)Unified workflow review (gen)
Unified workflow review (gen)
 
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
 
Kodak 800 Print Manager Datasheet
Kodak 800 Print Manager DatasheetKodak 800 Print Manager Datasheet
Kodak 800 Print Manager Datasheet
 
Impact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and careerImpact of in-memory technology and SAP HANA on your business, IT, and career
Impact of in-memory technology and SAP HANA on your business, IT, and career
 
Open Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event ReportOpen Printing Summit / PWG Meeting 2012 Cupertino Event Report
Open Printing Summit / PWG Meeting 2012 Cupertino Event Report
 
IMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon UniversityIMPRESS Presentation Carnegie Mellon University
IMPRESS Presentation Carnegie Mellon University
 
Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010Hp IPEX Keynote, Chris Morgan, May 18 2010
Hp IPEX Keynote, Chris Morgan, May 18 2010
 
Sap overview
Sap overviewSap overview
Sap overview
 
Sap overview
Sap overviewSap overview
Sap overview
 
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_dataCon2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
Con2012 salmon impact_of_sap_hana_revolutionary_changes_for_sap_controlling_data
 
Controlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANAControlling 2012 Impact of SAP HANA
Controlling 2012 Impact of SAP HANA
 
Streaming print data directly to printhead electronics
Streaming print data directly to printhead electronicsStreaming print data directly to printhead electronics
Streaming print data directly to printhead electronics
 
Revolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet TechnologyRevolutionising Textile Decoration & Finishing With Digital Inkjet Technology
Revolutionising Textile Decoration & Finishing With Digital Inkjet Technology
 
Forum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glanceForum Event KA-TI: OpenERP at a glance
Forum Event KA-TI: OpenERP at a glance
 
ITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business modelITmoov 2012 - Het OpenERP business model
ITmoov 2012 - Het OpenERP business model
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 Presentation
 
Canon 750 Presentation
Canon 750  PresentationCanon 750  Presentation
Canon 750 Presentation
 
Mainframe
MainframeMainframe
Mainframe
 

More from Global Graphics Software

Correct color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enoughCorrect color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enoughGlobal Graphics Software
 
Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?Global Graphics Software
 
Global Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peelGlobal Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peelGlobal Graphics Software
 
Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...Global Graphics Software
 
Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016Global Graphics Software
 

More from Global Graphics Software (6)

Correct color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enoughCorrect color on inkjet means uniform color; profiles are not enough
Correct color on inkjet means uniform color; profiles are not enough
 
Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?Has inkjet really achieved offset quality?
Has inkjet really achieved offset quality?
 
Global Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peelGlobal Graphics IJCUSA 2018 - Avoiding the orange peel
Global Graphics IJCUSA 2018 - Avoiding the orange peel
 
Avoiding the orange peel - The IJC 2017
Avoiding the orange peel - The IJC 2017Avoiding the orange peel - The IJC 2017
Avoiding the orange peel - The IJC 2017
 
Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...Intelligent software is as important a component of your digital press as any...
Intelligent software is as important a component of your digital press as any...
 
Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016Fundamentals for Label and Packaging; Labelexpo 2016
Fundamentals for Label and Packaging; Labelexpo 2016
 

Recently uploaded

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 

RIPping through data - Challenges faced in the digital front end

  • 1. RIPping through data Challenges faced in the digital front end Martin Bailey CTO, Global Graphics 1 © Copyright 2011 Global Graphics Software Limited
  • 2. ACKNOWLEDGEMENTS – This presentation was created with assistance from our partners at Hewlett Packard. – Especial thanks are due to Dave Staas, Lead Software Architect, Indigo Digital Press DFE 2 © Copyright 2011 Global Graphics Software Limited
  • 3. INTRODUCTION – A Controller or Digital Front End (DFE) provides a number of functions for digital press print jobs: • Workflow definition, control, and management • Job management (submission, status, view, edit, cancel, etc.) • Color, ink, and media management • Imposition and finishing management and control • The conversion of rich document formats like PDF and PPML into “print ready bits” – data that is rendered and formatted for the marking engine of the digital press HP Indigo W7200 Digital Press 3
  • 4. CONSTRUCTING A DFE Control process RIP Pre- Post- Press processing RIP processing controller Job cache RIP Raster cache HP Indigo 7500 Digital Press 4 © Copyright 2011 Global Graphics Software Limited
  • 5. WORK ALLOCATION – Interpreting/rendering –  – Color management –  Control process – Imposition – ,  or   – Trapping –  or  RIP – Screening –  or     Post-  Press – Font handling –  Pre- processing RIP processing controller – Variable data – Job  Raster cache RIP cache – + for PPML etc  for PDF with no h/w assist + for PDF with h/w (+) or (++) for PDF/VT 5 © Copyright 2011 Global Graphics Software Limited
  • 6. WHAT’S THE PROBLEM? – A typical print shop can have many digital presses and DFEs (Consolidated Graphics, for example, has more than 50 Indigo digital presses across several sites1) – A standard mid-range digital press (120 PPM) requires the processing of over one hundred million pixels every second, worst-case, with possibly multiple transforms, and in 4 (or more) colors – HP’s high-end presses (like the T400 below) require around three billion pixels every second – The primary performance goal for a DFE is to process any job or workflow at or above press speed – strive to always have the DFE outpace the press over a shift – Maximum efficiency must be exploited in every aspect of the system’s design in order to achieve this goal within reasonable cost constraints HP Indigo 7500 Digital Press HP T400 Color Inkjet Web Press 6
  • 7. THOSE CALCULATIONS … Example 1: cut-sheet, 800x800dpi, four color (CMYK), 8 bits per pixel per colorant, 120ppm (A4), single-sided • 800 x 800 = 640,000 pixels per square inch • 640,000 x 11.69 x 8.27 = 61,872,832 pixels per A4 page • 61,872,832 x 120 / 60 = 123,745,664 pixels per second • 123,745,664 x 4 x 8 / 8 = 494,982,656 bytes per second • = 472 MB/s Example 2: roll-fed, 600x600dpi, four color (CMYK), 8 bits per pixel per colorant, 41.75” printable width, 600 ft per minute, two-sided • 600 x 600 = 360,000 pixels per square inch • 360,000 x 41.75 x 600 x 12 = 108,216,000,000 pixels per minute, per side • 108,216,000,000 / 60 x 2 = 3,607,200,000 pixels per second, duplexed • 3,607,200,000 x 4 x 8 / 8 = 14,428,800,000 bytes per second • = 13.4 GB/s 7 © Copyright 2011 Global Graphics Software Limited
  • 8. SPEED VS DUTY CYCLE – Speed: pages per minute (usually A4 or US letter equivalent) • Definesmax throughput while the press is running • Important for office print and light production – “Duty cycle” has different meanings for different sectors: • Office and light production: − Simplistic calculation of how many pages a printer could produce in a month running flat-out for 1 shift per day − Not representative of any realistic throughput • High-volume production − The vendor’s assessment of a realistically achievable page volume per month for that press − The number of pages a print company expects to be able to produce every month from their press 8 © Copyright 2011 Global Graphics Software Limited
  • 9. IN LIGHT PRODUCTION … – the monthly duty cycle of a given product is not the “recommended” volume at which it should be used on a consistent basis. − Paul Albano, Canon USA – Most vendors of document imaging devices specify a “monthly duty cycle” for their products […]. This number represents the maximum number of pages a product can produce in a month. It is not the volume at which the product should be used on a regular basis. […] In the real world, products are being used for much lower volumes, ranging from 5 percent to 20 percent of the duty cycle in the case of monochrome products. − Buyers’ Lab – This is not true for high-volume production. Print service providers expect to achieve the duty cycle every month to ensure that they can meet planned return on investment. 9 © Copyright 2011 Global Graphics Software Limited
  • 10. SPEED & DUTY CYCLE 7 6 • Speed plotted against duty cycle for a number 5 of high-volume digital Duty cycle (Mpp/mon) presses. 4 Duty cycle (Mpp/m) 8/5 • Diagonal lines show 3 16/6 the page volume 24/7 achievable in 1, 2 or 3 2 shifts at that rated speed. 1 0 60 80 100 120 140 Speed (ppm) 10 © Copyright 2011 Global Graphics Software Limited
  • 11. HOURS PER DAY TO REACH DUTY CYCLE 20 • The same data, now showing hours per day 18 required to achieve duty Hours per day required to achieve rated duty cycle cycle (7 day week). 16 14 • High numbers imply an expectation that the 12 press can run at rated engine speed for most 10 of every shift. 8 • Planned maintenance is not taken into account. 6 • This duty cycle range 4 selected to illustrate 2 cross-over from light- production to high- 0 volume production 60 70 80 90 100 110 120 130 140 expectations Speed (ppm) 11 © Copyright 2011 Global Graphics Software Limited
  • 12. –Print service providers in high-volume digital production print expect to achieve duty cycle every month –This requires that the press run at rated engine speed almost 100% of the time, regardless of job content or complexity • Except for planned maintenance periods 12 © Copyright 2011 Global Graphics Software Limited
  • 13. IT’S A SOLVED PROBLEM, ISN’T IT? All this talk of hugely high performance requirements … do I still have to worry? It’s solved for current jobs and current presses, but: – New presses need higher data rates • Larger format/wider webs • Higher paper speeds/pages per minute • Higher resolution (2x resolution = 4x raster size) • More colorants (MICR, photoink, HiFi, spot colors etc) • Multi-bit screening • And … 13 © Copyright 2011 Global Graphics Software Limited
  • 14. JOBS ARE GETTING MORE COMPLEX – Larger coverage of variable data in direct marketing, triggered by • Better demographic data • Better data mining techniques • Proven better response rates to well-crafted personalized mail – More use of live transparency • Driving adoption of PDF for direct marketing • Expanding out of general design practice for books, publication, POD, print-for-pay and general commercial print • Many designers don’t even know they’re using transparency! – In a well-optimized RIP transparency requires more processing than an opaque job • Color transforms & read/modify/write cycles 14 © Copyright 2011 Global Graphics Software Limited
  • 15. THIS IS TRANSPARENCY … 15 © Copyright 2011 Global Graphics Software Limited
  • 16. AND THIS … 16 © Copyright 2011 Global Graphics Software Limited
  • 17. AND THIS 17 © Copyright 2011 Global Graphics Software Limited
  • 18. DOESN’T PDF/VT FIX THE PROBLEM? – PDF/VT (ISO 16612-2) defines structures in a PDF file to: • Allow easier identification of re-used and single-use graphical elements • Define which sets of pages go together in a hierarchical structure − E.g. as components that will be supplied to a single direct mail recipient • Enable pseudo-streaming • Encourages good practice through PDF/X • All fonts embedded • All colors formally defined etc – This means that PDF/VT is a useful standard! – But it does not address the fundamental issues of: • Compute power required to process transparency • Sheer data volume required to drive current and future digital production presses 18 © Copyright 2011 Global Graphics Software Limited
  • 19. THE REAL GOAL – With the right architecture and components you can make a DFE drive your press at engine speed – The key metric is the throughput achievable per € total bill of materials • Include hardware and software • Every component makes a difference – The target is to drive the press at rated speed while minimizing the cost of the DFE • If the software is faster or more efficient you can reduce the hardware required – Reducing hardware reduces power consumption and cooling • Going green can be profitable! 19 © Copyright 2011 Global Graphics Software Limited
  • 20. ARCHITECTURAL CONSIDERATIONS – Some of the more relevant architectural considerations for enabling maximum efficiency: • Reliability − Fast, unreliable systems usually aren’t worth much. Stability first, performance second • Work Avoidance − Look for ways to move or eliminate work first rather than scaling an inefficiency • Centralized or Distributed Caching − Caching can avoid work and improve performance − Watch for centralized caches becoming a bottleneck • Instrumentation and Measurement − Establish a way to measure performance in your code and system • Planning − An ounce of design effort up-front will save more than a pound in efficiency and cost-savings in development and manufacturing − If you drive a range of devices you may gain from a common, scalable solution across at least some of that range – No universal right answer on most of these considerations; they’re useful topics to think about in the context of efficiency 20
  • 21. PARALLELISM – WITHIN A MACHINE We invest effort to take advantage of all of these machine-level parallelisms: – Multiple CPUs per machine – Multiple cores per CPU – Multiple physical disks per machine – Multiple physical disks per logical disk – Multiple (teamed/bonded) network interfaces per logical network connection – Multiple RIPs per machine – Multiple threads per RIP 21
  • 22. PARALLELISM – END-TO-END SOLUTION Split into page ranges RIPs deliver data in parallel Press controllers and assign to RIPs to press controllers deliver to presses Split files into multiple “partitions” or chunks and process in parallel Parallelize early, maintain multiple parallel pipelines Parallelize in pre-RIP, where the data is much smaller (1/7th the size) Process multiple jobs in parallel Different variations optimize first-page-out, engine loading or throughput 22
  • 23. SUMMARY – Digital printing architectures need careful design – Many different strategies must be employed in unison for the best effect – Key architectural considerations can help guide your efforts – Selection of the best components and supplier/partners is an important aspect – The ultimate goal is to reduce cost, power, and cooling for customers 23 © Copyright 2011 Global Graphics Software Limited
  • 24. Q&A More information at www.globalgraphics.com/imiconf 24 © Copyright 2011 Global Graphics Software Limited