ClayAR @ ARE2011 Art Tools session


Published on

Slides from my ARE2011 talk on creating and using ClayAR as a mobile 3d mesh creation and fabbing app. The app is available as a private beta @

1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

ClayAR @ ARE2011 Art Tools session

  1. 1. ClayAR Virtual Clay in the Real WorldSunday, May 22, 2011
  2. 2. Intro - Of Clay and ClayAR... • Clay - infinitely malleable, can be shaped to visually represent anything. Historically, the most intuitive creation tool. • ClayAR is a mixed reality productivity platform that lets you create anything, anywhere your mobile device goes -- but, with the power of a truly infinitely malleable and infinitely replicable virtual clay. • It’s “Augmented Reality Clay” - or... • “virtual clay in the real world” - an intuitive creation tool of the mobile eraSunday, May 22, 2011
  3. 3. The ClayAR Project • Software Component - intuitive touchscreen-accelerometer- camera* driven “clay” modeling toolset with cloud-based data storage that enables seamless creation across devices, and a virtual marketplace • natural interface motif for mobile manipulation of 3d mesh • Hardware Component - the next generation mobile device that lets you 3d holographically project your mesh on the spot or fab / 3d print your creation when you leave your phone to charge. (Think: early Holodecks or Replicators) • the ability to take that virtual mesh and make it realSunday, May 22, 2011
  4. 4. CREATION Design Considerations... • Key Objective - Avoid Complexity. “Don’t turn into Maya” • Minimal, intuitive, adaptive interface - for ubiquitous creation, anytime, anywhere • Multitouch motifs for more “onscreen” degrees of freedom • View Mode - global manipulations, i.e., physical rotation/movement of clay, add/remove additional clay balls • Edit Mode - sculpting • Embraces mobile device capabilities for extended input points - device accelerometer for rotating and moving your virtual object - and GPS for tying your virtual mesh to a real location • Fundamentally, based on a clay motif. You can sculpt clay, and connect it to other balls of clays with sticks! (Demo coming up!)Sunday, May 22, 2011
  5. 5. INFRASTRUCTURE... Infinitely Replicable, but so what? • Data stored in the ClayAR cloud - safe, and accessible anywhere • even from the middle of the Congo! • Creations can be instantly shared in the ClayAR Marketplace - others can modify and extend existing creations - accessible both in-app and on the web • Extendable - • ClayAR content available in universal 3d file formats (.obj and others) • Easily take into your existing pipeline, or dropship to Shapeways! • (Or 3d print or 3d project it with ClayAR hardware)Sunday, May 22, 2011
  6. 6. DEMO!Sunday, May 22, 2011
  7. 7. The ClayAR Phone... A 3D HOLOGRAPHIC PROJECTOR PHONE + 3D PRINTERSunday, May 22, 2011
  8. 8. PLATFORM EXTENSIONS... • Pipeline integration • Exports to standard 3d file formats accessible via a UUID on the ClayAR server - direct download to your desktop workstation for integration in your own projects • ClayAR Mobile Game Creation Engine - Touch and drag simple behaviors to your ClayAR-created mesh, to instantly create mobile games with them! • “Plant your clay in the real world!” • Location-tying ClayAR to POI’s • mShakespeare Virtual TheatreSunday, May 22, 2011
  9. 9. Private Beta available for iOS and Android Help determine an intuitive universal set of tools to avoid complexity of onscreen buttonsSunday, May 22, 2011 for mobile 3d mesh manipulation and creation