Slides from my ARE2011 talk on creating and using ClayAR as a mobile 3d mesh creation and fabbing app. The app is available as a private beta @ http://blog.clayar.com
1. ClayAR
Virtual Clay in the Real World
Sunday, May 22, 2011
2. Intro - Of Clay and ClayAR...
• Clay - infinitely malleable, can be shaped to visually represent
anything. Historically, the most intuitive creation tool.
• ClayAR is a mixed reality productivity platform that lets you
create anything, anywhere your mobile device goes -- but, with
the power of a truly infinitely malleable and infinitely replicable
virtual clay.
• It’s “Augmented Reality Clay” - or...
• “virtual clay in the real world” - an intuitive creation tool
of the mobile era
Sunday, May 22, 2011
3. The ClayAR Project
• Software Component - intuitive touchscreen-accelerometer-
camera* driven “clay” modeling toolset with cloud-based data
storage that enables seamless creation across devices, and a
virtual marketplace
• natural interface motif for mobile manipulation of 3d mesh
• Hardware Component - the next generation mobile device
that lets you 3d holographically project your mesh on the spot
or fab / 3d print your creation when you leave your phone to
charge. (Think: early Holodecks or Replicators)
• the ability to take that virtual mesh and make it real
Sunday, May 22, 2011
4. CREATION
Design Considerations...
• Key Objective - Avoid Complexity. “Don’t turn into Maya”
• Minimal, intuitive, adaptive interface - for ubiquitous creation, anytime,
anywhere
• Multitouch motifs for more “onscreen” degrees of freedom
• View Mode - global manipulations, i.e., physical rotation/movement of
clay, add/remove additional clay balls
• Edit Mode - sculpting
• Embraces mobile device capabilities for extended input points - device
accelerometer for rotating and moving your virtual object - and GPS for
tying your virtual mesh to a real location
• Fundamentally, based on a clay motif. You can sculpt clay, and connect it
to other balls of clays with sticks! (Demo coming up!)
Sunday, May 22, 2011
5. INFRASTRUCTURE...
Infinitely Replicable, but so what?
• Data stored in the ClayAR cloud - safe, and accessible
anywhere
• even from the middle of the Congo!
• Creations can be instantly shared in the ClayAR Marketplace -
others can modify and extend existing creations - accessible
both in-app and on the web
• Extendable -
• ClayAR content available in universal 3d file formats (.obj and others)
• Easily take into your existing pipeline, or dropship to Shapeways!
• (Or 3d print or 3d project it with ClayAR hardware)
Sunday, May 22, 2011
7. The ClayAR Phone...
A 3D HOLOGRAPHIC PROJECTOR PHONE + 3D PRINTER
Sunday, May 22, 2011
8. PLATFORM EXTENSIONS...
• Pipeline integration
• Exports to standard 3d file formats accessible via a UUID on the
ClayAR server - direct download to your desktop workstation for
integration in your own projects
• ClayAR Mobile Game Creation Engine - Touch and drag simple
behaviors to your ClayAR-created mesh, to instantly create mobile
games with them!
• “Plant your clay in the real world!”
• Location-tying ClayAR to POI’s
• mShakespeare Virtual Theatre
Sunday, May 22, 2011
9. http://blog.ClayAR.com
Private Beta available for
iOS and Android
Help determine an intuitive universal set of tools to avoid complexity of onscreen buttons
Sunday, May 22, 2011
for mobile 3d mesh manipulation and creation