This document describes PISA, a system for production, indexing, and search of audiovisual material. PISA includes tools for script editing, 3D modeling of scenes and characters, intelligent analysis of video content, and computer-assisted manufacturing. It allows for timecode-based indexing, geo-temporal referencing, taxonomy-based search, and faceted search. PISA also features a multi-touch 3D modeler for creating and manipulating shot descriptions, cameras, microphones, lights, and character animations on a timeline.

1. PISA
Production, Indexing and Search
of Audio-visual Material
Multi-touch 3D-set modeler
Philippe Bekaert, IBBT – EDM – UHasselt

2. PISA - Overview
Computer Assisted Design Search Engine
Concept
Indexing
Script Editing
Retrieval
• Parse scenario Script Editing • Timecode based indexing
• Shooting script editor
• Geo-temporal reference
• Storyboard
• Taxonomy based indexing and search
Abstract • Facetted search
Information
Virtual Intelligent Analysis and
Model Driven Development: Modelling Analysis Quantization
• Setting (Stage properties, light) Interpretation
• Character • Character identification
• Synthetic Speech • Background categorisation
• Sound effects Virtual and identification
• Character animation Model • Topic and eventdetection
• Virtual camera
Quantization
Computer Assisted Manufacturing
Automated Reverse Engineering
Realisation Production • Shot segmentation
• Ingest Footage • Video footprint and reuse detection
• Editing • Biometric face detection
• Mastering • Background analysis
• Reproduction to alternative distribution channels • Speech-to-text
28

3. Multi-Touch 3D Modeler
• Create and Manipulate
3D Shot descriptions:
• Setting, actors, props
• Cameras
• Microphones
• Lights
Animated
• Time-line
• MoCap character anim.
EyeTronics
• Text-to-Speech
Nuance
Export EDL/snapshots

4. Antics
AutoDesk 3DStudio Max MovieSoft FrameForge3D
PowerProduction StoryBoard Artist

5. Unique Feature #1
SCOOP = Integrated System

6. Unique Feature #2
Multi-Touch Table Interaction

7. VIDEO