Augmented Reality on iPhone Applications

AUGMENTED REALITY Paolo Quadrani MitAPP www.MitAPP.com

DEFINITION • Isa term for a live direct or indirect view of a physical real- world environment whose elements are augmented by virtual computer-generated imagery. (Wikipedia) www.MitAPP.com

HISTORY • 1966: was invented the head mounted display. • 1992: The term Augmented Reality has been coined by Thomas Caudell. • 1999: Hirokazu Kato develops ARToolKit and is demonstrated at Siggraph in the same year. • 2008: Wikitude AR Travel Guide is launched with the G1 Android Phone. • 2010: acrossair, AR Browser brings AR to the mobile user on the iPhone 3Gs. www.MitAPP.com

TECHNOLOGY - TRACKING • Mobile devices use • Digital camera. • Accelerometers. • GPS. • Gyroscopes, Solid state compasses. • RFID. • Wireless sensors. www.MitAPP.com

PROCEDURE • ImageRegistration: this deﬁne the way of retrieving the real world reference system on which over-impose computer generated images. • Toachieve the point above are used computer vision techniques. www.MitAPP.com

LIGHTWEIGHT AUGMENTED REALITY es: Wikitude • Use GPS tracking to retrieve the device position. • Usesolid state compass to manage the device orientation. www.MitAPP.com

Ristoranti - Google Maps GEO-REFERENCED DATA • Datacontent has to be associated to a GPS position • Data access through • web service • local to a database www.MitAPP.com © Google

WORKFLOW Accelerom Compass Camera eter Acquire the GPS Position

WORKFLOW GPS Accelerom Compass Camera Position eter Acquire the GPS Position

RETRIEVING GPS POSITION • Classes • CLLocationManager • CLLocation • Protocol • CLLocationManagerDelegate www.MitAPP.com

RETRIEVING GPS POSITION Delegates Methods - (void)locationManager:(CLLocationManager*)manager didUpdateToLocation:(CLLocation*)newLocation fromLocation:(CLLocation*)oldLocation; - (void)locationManager: (CLLocationManager*)manager didFailWithError:(NSError*)error; www.MitAPP.com

RETRIEVING GPS POSITION Delegates Methods - (void)locationManager:(CLLocationManager*)manager didUpdateToLocation:(CLLocation*)newLocation fromLocation:(CLLocation*)oldLocation; - (void)locationManager:(CLLocationManager*)manager didFailWithError:(NSError*)error; www.MitAPP.com

RETRIEVING GPS POSITION CLLocationManager* manager = [[CLLocationManager alloc] init]; [manager setDelegate:self]; [manager setDesiredAccuracy:kCLLocationAccuracyBest]; [manager setDistanceFilter:10]; [manager startUpdatingLocation]; www.MitAPP.com

RETRIEVING GPS POSITION CLLocationManager* manager = [[CLLocationManager alloc] init]; [manager setDelegate:self]; [manager setDesiredAccuracy:kCLLocationAccuracyBest]; [manager setDistanceFilter:10]; // Distance expressed in meters [manager startUpdatingLocation]; www.MitAPP.com

RETRIEVING GPS POSITION CLLocationManager* manager = [[CLLocationManager alloc] init]; [manager setDelegate:self]; [manager setDesiredAccuracy:kCLLocationAccuracyBest]; [manager setDistanceFilter:10]; [manager startUpdatingLocation]; www.MitAPP.com

RETRIEVING GPS POSITION - (void)locationManager:(CLLocationManager*)manager didUpdateToLocation:(CLLocation*)newLocation fromLocation: (CLLocation*)oldLocation { // Use the coordinate data double lat = newLocation.coordinate.latitude; double lon = newLocation.coordinate.longitude; } www.MitAPP.com

RETRIEVING GPS POSITION - (void)locationManager:(CLLocationManager*)manager didUpdateToLocation:(CLLocation*)newLocation fromLocation: (CLLocation*)oldLocation { NSTimeInterval howRecent = [newLocation.timestamp timeIntervalSinceNow]; if (howRecent < -10) return; if (newLocation.horizontalAccuracy > 100) return; // Use the coordinate data double lat = newLocation.coordinate.latitude; double lon = newLocation.coordinate.longitude; } www.MitAPP.com

WORKFLOW GPS Accelerom Camera Position eter Get the orientation through the Compass

WORKFLOW GPS Accelerom Compass Camera Position eter Get the orientation through the Compass

USING THE COMPASS • Classes • CLLocationManager • CLHeading • Protocol • CLLocationManagerDelegate www.MitAPP.com

USING THE COMPASS Delegates Methods - (void)locationManager:(CLLocationManager*)manager didUpdateHeading:(CLHeading*)newHeading; - (void)locationManagerShouldDisplayHeadingCalibration: (CLLocationManager*)manager; www.MitAPP.com

USING THE COMPASS CLLocationManager* manager = [[CLLocationManager alloc] init]; [manager setDelegate:self]; [manager setDesiredAccuracy:kCLLocationAccuracyBest]; [manager setDistanceFilter:10]; [manager startUpdatingLocation]; if ([manager headingAvailable]) { [manager setHeadingFilter:2]; [manager startUpdatingHeading]; } else { // Show a message to notify the user that compass is required in AR apps. } www.MitAPP.com

USING THE COMPASS CLLocationManager* manager = [[CLLocationManager alloc] init]; [manager setDelegate:self]; [manager setDesiredAccuracy:kCLLocationAccuracyBest]; [manager setDistanceFilter:10]; [manager startUpdatingLocation]; if ([manager headingAvailable]) { [manager setHeadingFilter:2]; // ﬁlter value is in degrees. [manager startUpdatingHeading]; } else { // Show a message to notify the user that compass is required in AR apps. } www.MitAPP.com

RETRIEVING GPS POSITION - (void)locationManager: (CLLocationManager*)manager didUpdateHeading: (CLHeading*)newHeading { // Use the compass data // angle in degree with respect to the magnetic north double heading = newHeading.magneticHeading; } www.MitAPP.com

WORKFLOW GPS Compass Camera Position Catch the Acceleration for detecting device orientation and virtual item ﬁne positioning

WORKFLOW GPS Compass Accelerometer Camera Position Catch the Acceleration for detecting device orientation and virtual item ﬁne positioning

ACCELEROMETERS • Classes • UIAccelerometer • UIAcceleration • Protocol • UIAccelerometerDelegate www.MitAPP.com

USING THE COMPASS Delegate Method - (void)accelerometer: (UIAccelerometer*)accelerometer didAccelerate:(UIAcceleration*)acceleration; www.MitAPP.com

ACCELEROMETERS UIAccelerometer* accelerometer = [UIAccelerometer sharedAccelerometer]; [accelerometer setUpdateInterval: 1/25]; [accelerometer setDelegate:self]; www.MitAPP.com

ACCELEROMETERS - (void)accelerometer: (UIAccelerometer*)accelerometer didAccelerate:(UIAcceleration*)acceleration { // Use the accelerometer data double accel_x = acceleration.x; double accel_y = acceleration.y; double accel_z = acceleration.z; } www.MitAPP.com

WORKFLOW GPS Accelerom Compass Position eter Get the real world from the device camera

WORKFLOW GPS Accelerom Compass Camera Position eter Get the real world from the device camera

GETTING THE IMAGE FROM THE CAMERA • UIImagePickerController class • UIImagePickerControllerDelegate protocol www.MitAPP.com

GETTING THE IMAGE FROM THE CAMERA if([UIImagePickerController isSourceTypeAvailable: UIImagePickerControllerSourceTypeCamera]) { UIImagePickerController *picker = [[UIImagePickerController alloc] init]; [picker setSourceType:UIImagePickerControllerSourceTypeCamera]; [picker setDelegate:self]; [picker setShowCameraControls:NO]; [picker setNavigationBarHidden:YES]; [picker setCameraOverlayView:[self view]]; [self presentModalViewController:picker animated:NO]; } www.MitAPP.com

PUTTING ALL TOGETHER • Existing libraries to use as starting point: • NyARToolKit (free) - http://nyatla.jp/nyartoolkit/wiki/ index.php?FrontPage.en • ARKit (free) - http://www.iphonear.org/ • metaio (free and commercial) - http://www.metaio.com/ www.MitAPP.com

AR APPLICATIONS ON APPLE STORE • Layar • Wikitude • Around Me www.MitAPP.com

VIDEO www.MitAPP.com

MITAPP http://www.mitapp.com/ paolo.quadrani@gmail.com caﬁniomar@gmail.com www.MitAPP.com

http://www.slideshare.net	110
http://translate.googleusercontent.com	2
http://192.168.1.199	2
http://facebook.slideshare.com	1
http://bbs.motionblue.com	1

Augmented Reality on iPhone Applications

by Omar Cafini

Accessibility

Categories

Upload Details

Usage Rights

5 Embeds 116

Statistics

Augmented Reality on iPhone Applications Presentation Transcript