This document discusses several Apple technologies for augmented reality (ARKit) and machine learning (CoreML, MLKit). It provides tips on face detection using ARKit and MLKit, converting coordinates between systems, preventing overheating, managing memory budgets, and anchoring 3D objects in augmented reality scenes using SceneKit and ARAnchor.

1. ARKit
CoreML
Turi Create
삼형제
노수진, GW Tech
김희재, NSML

3. Overview
ARKit AVFoundation
Core ML
SceneKit
MLKit

4. Image Tracking
ARKit

5. Realtime detection for Better User Experience
Face Detection
AVMetadataFaceObject

6. Realtime detection for Better User Experience
Face Detection
AVMetadataFaceObject

7. Face Detection
MLKit
MLKit Vision Framework

8. Convert Coordinate
Tip

9. Convert Coordinate
func UIKitRectForCoreImageRect(_ rect: CGRect, _ height: CGFloat) -> CGRect {
let ciCoordToUICoord = CGAffineTransform(scaleX: 1, y: -1).translatedBy(x: 0, y: -height)
return rect.applying(ciCoordToUICoord)
}
Tip

10. Overheating
private var captureDevice: AVCaptureDevice?
captureDevice?.addObserver(self, forKeyPath: "systemPressureState",
options: NSKeyValueObservingOptions.new, context: nil)
var frameRate: Int32
try captureDevice?.lockForConfiguration()
captureDevice?.activeVideoMinFrameDuration = CMTime(value: 1, timescale: frameRate)
captureDevice?.activeVideoMaxFrameDuration = CMTime(value: 1, timescale: frameRate)
captureDevice?.unlockForConfiguration()
Tip

11. Overheating
NotificationCenter.default.addObserver(self,
selector: #selector(thermalStateDidChange),
name: ProcessInfo.thermalStateDidChangeNotification,
object: nil)
Tip

12. Memory Budget
https://stackoverflow.com/questions/5887248/ios-app-maximum-memory-budget
Tip

13. Anchoring
with SceneKit

14. ARAnchor

15. SCNNode
private func makeOutlineNode(from bill: Bill) -> SCNNode {
let geometry = SCNPlane(size: bill.outlineSize)
geometry.firstMaterial?.diffuse.contents = bill.outlineImage
let node = SCNNode(geometry: geometry)
node.name = PortraitNode.PortraitOutlineNodeName
node.eulerAngles.x = -.pi / 2
return node
}

16. 성장

17. 성장