Uploaded byBrett Renfer
SALT Proposal for Google DevArt Project
The salt project is an interactive sculpture that gradually dissolves due to human interaction, aiming to address ecological concerns through a physical and digital art experience. It features a salt object controlled by visitor presence and online data, with accompanying audiovisual elements that degrade as the sculpture dissolves. The proposal outlines a detailed plan for the project's system architecture, including prototypes, timelines, and phases for development and installation.
SALT Proposal for Google DevArt Project
- 1. Salt Shobun Baile andBrett Renfer Salt Project Proposal - Shobun Baile + Brett Renfer 1 !
- 2. Salt Salt is aphysical, digital, and sonic sculpture that is gradually destroyed by direct and indirect human interaction, with the goal of making global-scale ecological concerns compelling and accessible to a wide audience. The sculpture is centered around a single salt object that slowly dissolves at a rate controlled by the physical presence of visitors at the installation, as well as virtual influences coming from a range of data harvested from online activity. ! Video will be directly mapped onto the salt object and will be accompanied by multi-channel audio output. The video and audio elements will degrade as a direct result of the salt dissolving, creating a visceral connection between the physical and the digital. Salt Project Proposal - Shobun Baile + Brett Renfer 2 !
- 3. System: Overview Water output2: virtual input Water output 1: physical input Salt block Pedestal Salt Project Proposal - Shobun Baile + Brett Renfer 3 !
- 4. System: Water Output Thewater armature is comprised of 8 individually controllable outputs driven by peristaltic pumps. Salt Project Proposal - Shobun Baile + Brett Renfer 4 !
- 5. System: Depth cameracone The water armature is designed to allow an unobstructed view from a PrimeSense-type depth camera Salt Project Proposal - Shobun Baile + Brett Renfer 5 !
- 6. System: Projector locations Projectorfrustums based on Optoma TH1060P Salt Project Proposal - Shobun Baile + Brett Renfer 6 !
- 7. System: Software Architecture LocalInput: Camera Sensing • Multi- or single-camera input (space dependent) to computer vision algorithms • Outputs location, motion data of on-site audience • Based off of TSPS* Remote Input: Web Activity • Aggregates Google API activity • Social: Google+, YouTube • Personal: Drive, Calendar, custom Chrome extension(s) for BR + SB • Outputs activity levels of each individual input Routing, Sensing, and Display • Digests incoming data from Local and Remote inputs, maps to Water and Sound Outputs • Renders projected imagery based on depth camera input • openFrameworks-based Audio Routing • Multi-channel routing software processes input from Routing application, outputs real-time processed audio • Ableton Live To projection, Arduino To sound output *TSPS: open-source computer vision toolkit developed + maintained by Brett Salt Project Proposal - Shobun Baile + Brett Renfer 7 !
- 8. System: Hardware Web Camera Camera Client* Projection Speakers (x4)** Depthcamera Mac Pro Peristaltic Pump (x8) Arduino *Camera Client: Mac Mini, possibly Raspberry Pi (depending on prototyping results) ** Speakers: May require additional mixing hardware depending on Mac Pro sound card Salt Project Proposal - Shobun Baile + Brett Renfer 8 !
- 9. Proposed Timeline Phase 1:Prototyping • Material studies: test appropriate makeup of salt-based sculpture for optimum dissolution durations • Technical studies: • Refine projector-depth camera calibration and live projection mapping • Test proposed water armature: distance, spread, number of pumps ! Phase 2: Content Creation • Visual: produce film-based content for projection • Sonic: develop process-based sound degradation • Software development: produce input + output applications ! Phase 3: Installation Phase 4: Expansion • Further explorations of platform • Outreach: workshops, talks, open-source tools Salt Project Proposal - Shobun Baile + Brett Renfer 9 !
- 10. Process Current/ongoing prototypes Salt ProjectProposal - Shobun Baile + Brett Renfer 1 !0
- 11. Prototype: Water Test1 Prototype: Live Projection Mapping Camera-controlled pressurized solenoid Experiments with projector to depth camera calibration and layered video Salt Project Proposal - Shobun Baile + Brett Renfer 1 !1
- 12. Prototype: System Test1 Camera sensing, peristaltic pump, salt sculpture, calibrated projector/depth camera, test video content Salt Project Proposal - Shobun Baile + Brett Renfer 1 !2
- 13. Prototype: System Test1 (con’t) Sequence of salt sculpture dissolution Salt Project Proposal - Shobun Baile + Brett Renfer 1 !3
- 14. Thank you Salt ProjectProposal - Shobun Baile + Brett Renfer 1 !4