Re-speaking and localization

  • 792 views
Uploaded on

Presentation for the first international seminar on New Technologies in Real Time Subtitling Intralingual, held at the Department of Interdisciplinary Studies in Translation, Languages ​​and Cultures …

Presentation for the first international seminar on New Technologies in Real Time Subtitling Intralingual, held at the Department of Interdisciplinary Studies in Translation, Languages ​​and Cultures (Dipartimento di Studi Interdisciplinari su Traduzione, Lingue e Culture) of the University of Bologna on November 17, 2006 in Forlì.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
792
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
0
Comments
0
Likes
3

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Re-speaking and Localization Luigi Muzii
  • 2. Evolution of the Language Market
    • Conference interpreting is shrinking
    • Audiovisual market is in an upward trend
      • Emerging Translation Practices
        • Web localization
          • Media-rich content
            • Entertainment prevails, edutainment is rising
            • Consumable short-term editorial projects
        • Multimedia localization
        • Video game localization
          • Interactive media with non-linear text structure
            • Written text and spoken dialogues of both technical and creative nature
            • Gameplay
            • Interface
          • Story
            • Game culture and related media
  • 3. Translation Strategies Foreignising Localization Non-translation Transfer Subtitling Voice-over Dubbing New text
  • 4. Localization
    • A complex process
      • Not exclusively pertaining to software
        • All media
          • “Artistic” manipulation of content
  • 5. Media Convergence
    • New challenges
      • Media-rich content are changing localization
        • Resources, skills, processes
          • Minimizing costs
            • Streamline and optimization
  • 6. Integration
    • Audio and video
      • Infrastructure and data
    • Sports and newsroom
      • Radio, television, teletext
    • Off-line and online post production
      • Audio and video
    • Graphics
      • 2D and 3D
    • Virtual sets
    • Contribution network feeds
      • Media recording
    • Archiving
      • Automated online/near-online
  • 7. Non-linear Processes
    • The audio component is only one
      • Five main components
        • Each one influencing the others
          • The order of localization is driven by time, functional and production constraints
            • Localization processes run parallel to each other
  • 8. Subtitling Media-rich Content for the Web
    • Still rare
      • Made on a shoestring budget
        • High cost vs. investment shrinkage
          • Skilled staff and special hardware resources
  • 9. Making Multimedia Accessible
    • Video and multimedia products are required to be captioned and audio-described
      • Real-Time Captioning
        • Closed captions
          • Separate from the video image
        • Open captions
          • Added to the video image and broadcasted as part of it
            • Visible to all viewers
      • Audio Descriptions
        • Narrative tracks describing the current scene or setting
  • 10. Closed vs. Open Captioning
    • Closed captions
      • Separate from the video image
        • Optionally displayed
          • Decoder needed
            • For hearing impaired
    • Open captions added to the video image and broadcasted as part of it
      • Visible to all viewers
        • For translated dialog
  • 11. Technology
    • Any sufficiently advanced technology is indistinguishable from magic.
  • 12. Collaborative Subtitling
    • Quality requirements, pricing structures, and business practices limit the industry to 1% of assets
      • Shifting approach
        • Technology can open up another niche for language workers
          • Networked (translation) projects
            • Sharing the process
  • 13. Real-time Captioning for the Web
    • Few real-time multimedia technologies have native support for captioning
      • Real-time captions delivered through different technology
        • Parallel to multimedia software/hardware
          • Dedicated applications
      • In streaming video a delay occurs between when the media is captured and when it displays to the end user
    • (Remote) CART (Communication Access Real-time Translation)
      • Make the web as searchable for multimedia content as it is searchable for text
        • MPEG-7
          • Multimedia Content Description Interface
            • Standard for describing multimedia content data
        • SMIL ( Synchronized Multimedia Integration Language)
          • MAGpie (Media Access Generator)
    • Broadcast/Electronic News Room (ENR) captioning
  • 14. Caption Template Generation Systems
    • Audio and video analysis to identify caption end-points
      • Empty time-coded captions
        • Caption time-codes identified by audio-breaks
          • Acoustic segmentation techniques
  • 15. Progress
    • A technology is a real progress when it is available to anyone.
  • 16. dotSUB.com http://stage.dotsub.com/films/commonsense/index.php?autostart=true&language_setting=none_
  • 17. dotSUB.com
    • Web-based, point-and-shoot-camera technology
      • Great potential
        • A video testimonial transcribed, translated into English and posted on the web in less than 20 minutes
          • Time-coding of subtitles with a few keyboard commands
  • 18. Space, the final frontier
    • Voxonic proprietary software to replicate a specific voice in any language
      • Ten minute sample
        • The voice is broken into phonemes
          • A second speaker mimics the first speaker’s vocal patterns
            • The two voices are then aligned
  • 19. Low-cost Speech Recognition
    • Medical Dictation and Transcription
      • StructuRad StudyManager
        • HL7* interfaces
          • “ All-in-one” technology
            • Speech recognition-assisted transcription
            • Dictation playback
            • Macro-enriched reporting
    * Health Level Seven, Inc., an all-volunteer, not-for-profit organization involved in development of international healthcare standards
  • 20. Tower of Babel
    • Created at Carnegie Mellon University, Pittsburgh
      • Detailed in New Scientist
        • Users can silently mouth a word in their own language for it to be translated and read out in another
          • Electrodes attached to the neck and face detect movements
            • A computer works out the sounds and builds them up into words
            • Like watching a television program that has been dubbed
        • Two prototypes
          • Chinese into English
          • English into Spanish/German
  • 21. Automation of (On-line) Closed Captioning
    • Small and well-defined domains (news, sports and politics)
      • Contents with limited lead-time
        • Segmentation of soundtrack for speech location
        • Text organized into individual captions for display and reading rate adjustment
        • Analysis of video image for caption synchronization
  • 22. Automatic Subtitle Generation
    • Integration of speech and language technologies
      • ASR for the transcription of audio streams into text
      • Subtitling production from audio transcriptions
      • Machine translation and translation memory
  • 23. Corpora Support
    • Large vocabulary continuous speech recognition (LVCSR)
      • Automatic speech recognition in off-line closed-captioning
        • At least a one-million-word text corpus
          • Segmented and transcribed speech utterances for each typical genre
            • Acoustic complexity requires acoustic models
            • Noise-tolerance
          • Very concentrated core set of frequently used words
  • 24. Subtitle Workflow
    • Automatic addition to task list of events requiring subtitling
    • Tracking each and every subtitling task
      • Live and pre-prepared subtitle events
        • Allocation to subtitlers and dates assignment
          • Status of all tasks
          • Feature set to each user
    • Subtitle file asset management
      • In a database
        • File re-use and subtitle search
  • 25. Re-speaking for Real-time Subtitling
    • Steadily increasing demand
      • Especially for the hard of hearing
        • Voice recognition for live subtitling
          • Far from 100% efficiency
            • Performance can degrade markedly as the complexity of acoustic data increases
            • A “re-speaker” is necessary to process information
          • Major events and news reports
            • A new niche for specialized interpreters
  • 26. Training of Interpreters
    • Still focusing on language acquisition
      • Proficiency
      • Terminology
    • Communication abilities
      • Clear speaking
      • Audible speaking
      • Speaking with a minimum of hesitation
  • 27. Conclusions
    • Hearing-impaired supporting technologies can help
      • A systematic solution to the multiple constraints of multimedia localization
        • Multidimensional approach
  • 28. Re-speak This! Ka mate, Ka mate! Ka ora, Ka ora! Ka mate, Ka mate! Ka ora, Ka ora! Tenei te tangata puhuruhuru Nana i tiki mai whakawhiti te ra! A hupane, kaupane A hupane, kaupane whiti te ra!