New trends on research and software development techniques for wearable devices
•
1 like•915 views
This document discusses software design considerations for wearable devices. It begins with an overview of wearable technologies and common components found in wearables. Key aspects of wearable software design are then outlined, including always-on/connected functionality, context awareness, and short/glanceable interactions. Examples are provided of existing and prototype wearable devices. Software design patterns for Google Glass and Android Wear are also reviewed.
More Related Content
What's hot
What's hot (20)
Similar to New trends on research and software development techniques for wearable devices
Similar to New trends on research and software development techniques for wearable devices (20)
More from Everyware Technologies
Recently uploaded
Recently uploaded (20)
New trends on research and software development techniques for wearable devices
- 1. Tomás Ruiz-López Software Design Manager @tomasruizlopez @everywaretech /everywaretech http://www.everywaretech.es Carlos Rodríguez Domínguez Chief Technology Officer @carlosrodrigdom New trends on research and ! software development techniques ! for wearable devices Ph.D. Program on Information and Communication Technologies! University of Granada
- 5. Everyware Technologies Spinoff UGR 3 Development Android iOS BlackBerry Web Android Wear Chromecast Google Glass Android TV Apple Watch
- 8. Darcy Norman Performance Data Analyst Adidas Micoach Speed Cell Measure speed, distance, heart! rate… during training
- 10. A little bit of! History
- 11. 1961! MIT “The Gambling! Shoe” 1810! Naples Queen First wristwatch 1600! Qing Dinasty Abacus integrated! on a ring
- 12. Edward Thorp Claude Shannon
- 16. Global interest in! Wearable Technology
- 17. 70% 15% 48% People aware of the existence of wearable devices People already using wearable devices Owners of wearable devices are 18-34 years old
- 18. 300$ Average price of a wearable device By ! market 957$ Industrial! 134$ Pets Animals By body! location 1117$ Legs! 92$ Hands
- 19. 57% Self-monitoring and health concerns 35%Supplement their smartphone addiction Reasons to buy
- 20. 72% Wearable devices are too expensive 62%Wearable devices are not too fashionable Reasons NOT to buy 53% Would like wearable devices to look more like jewelry
- 21. Is it compatible with ! my smartphone? Is it easy to! set up? Is it easy to put on?! Is it accurate? Will the battery last?! How long? Is it comfortable! to wear? Is it cool?! Do I look dumb?! Is it fashionable?
- 22. Users’ Preferences to wear devices
- 23. Device distribution by price
- 24. OS compatibility
- 25. Battery duration
- 26. Most Funded Kickstarter Projects! > 1.000.000$ each Pebble Smartwatch Dash Headphones Emotive Insight Omate TrueSmart Agent Smartwatch Oculus Rift
- 27. Key features! of wearable devices
- 28. Hands-free! Voice / gesture control. Avoid distractions. Context-aware! Use sensors to proactively infer the user’s needs Always-on! Low power consumption. Fast wake up. Background processing Always connected! Use wireless technologies to communicate with other devices. Market! Manufacturing by both big and small companies Enhancing! Augment knowledge, facilitate learning or enhance experience Development platform! Software makes wearable devices meaningful
- 29. Accelerometer Components Touch Interface Respiratory Monitor Pressure Sensor Muscle Contraction Sensor FM Tuner Buzzer Blood Pressure Meter Audio Jack Barometer Magnetometer Textile Strain Sensor Pedometer DLP Display Depth Camera E-Paper Display Microphone Vibrator Thermometer Backlight LED Display Altimeter Bone Conduction Speaker/Mic ECG Sensor Clock Photo/Video Camera Perspiration SensorInfrared Sensor UV Light Sensor Galvanometer Skin Impedance Sensor Oximeter GPS Gyroscope
- 30. Some of what you can find on the! Market! (or about to be released)
- 31. Smart Cap! EDAN SAFE PTY LTD - Fatigue monitoring system (EdenSafe! Universal Fatigue Algorithm)! - Keep truck drivers safe! - EEG sensors on the brim! - Sends information to an operator! - Audio alarm when the user starts ! falling asleep
- 32. SensoGlove! SENSOGLOVE - Smart glove designed for golfers! - Detects intensity of the grip when! holding the club or driver! - Data analysis in real-time! - Audio and visual feedback to the user! to know if they are holding the club! correctly
- 33. Voyce Dog Monitor! VOYCE - Measures key vital signs and overall! health in dogs! - Heart rate, respiratory rate, calories…! - iOS and Android apps to check data
- 34. Fit Guard! FORCE IMPACT TECHNOLOGIES - Detection of head injuries in athletes! - Accelerometer to detect head movement! and compute the force of the head impact! - Analyze severity of head injuries! - Sends data to companion app
- 35. June! NENATMO - Monitor the user’s UV exposure during th day and alert when it has exceeded the! recommended limit! - Can be worn on the wrist, neck or chest! - Companion app shows data about sun! exposure and advices for skin protection
- 36. Shine! MISFIT - Motion-tracking wearable device! - Records activity levels and sleep! - Can be worn or embedded in some piece of clothing the company sells! - Sends data to a companion app and ! shares results with friends
- 37. Achillex! XYBERMIND - Ankle wrap (around running shoes) and! vest! - Measures impact forces, degree of ! pronation and orientation of the foot! - Used in retail environments! - Shows information to help customers! decide which shoes to purchase
- 38. Lechal Shoe! LECHAL - User navigation through vibration! - Bluetooth enabled insole! - Additional fitness functions! - Control from smartphone! - Alert if the smartphone is missing
- 39. Nex Band! MIGHTYCAST - Band with pluggable modules with LEDs! for user feedback! - Mainly for gaming and entertainment! purposes! - User customizable
- 40. PequeAlarma! INTERACTIVE TOYS + EVERYWARE TECHNOLOGIES - Monitor children proximity! - Trigger an alarm if child is going further! from a predefined distance! - Additionally checks temperature and! falls to water
- 41. Inivisibility Glasses! AVG - Glasses with infrared LEDs! - Not visible to human eye but visible to! cameras! - Make face recognition algorithms not! work properly! - Focus on guaranteeing privacy
- 42. Swarm! MICROSOFT - Scarf to help people with autism or! visual and hearing impairments! - Modules with biometric sensors that are! able to heat up or vibrate! - Connect via Bluetooth to the smartphone
- 43. Software Design! for mainstream wearable devices
- 46. Real life Notification Use device Micro-interactions
- 48. Glanceable
- 51. Short copy Keep text short and focused
- 52. Notify sparingly and discreetly
- 53. Building Glassware for! Google Glass! with the GDK
- 57. Live Cards Currently cooking for 1683 peopleOk Glass, find a Breaking! Service Service <service android:name="es.everywaretech.breakingglass.BreakingService" android:label="@string/app_name" android:enabled="true" android:exported="true"> <intent-filter> <action android:name=“com.google.android.glass.action. VOICE_TRIGGER" /> </intent-filter> <meta-data android:name="com.google.android.glass.VoiceTrigger" android:resource="@xml/voice_trigger_start" /> </service> Android Manifest <trigger command="FIND_A_RECIPE" /> xml/voice_trigger_start.xml High-frequency rendering
- 58. Currently cooking for 1683 people Breaking! Service Service Breaking! Drawer Direct Rendering ! Callback Breaking! View View Breaking! Activity Activity action Live! Card Live Card Live Cards Ok Glass, find a High-frequency rendering
- 59. Currently cooking for 1683 people Live CardsHigh-frequency rendering liveCard = new LiveCard(this, LIVE_CARD_TAG); ! callback = new BreakingDrawer(this); liveCard.setDirectRenderingEnabled(true).getSurfaceHolder().addCallback(callback); ! Intent menuIntent = new Intent(this, BreakingActivity.class); menuIntent.addFlags(Intent.FLAG_ACTIVITY_NEW_TASK | Intent.FLAG_ACTIVITY_CLEAR_TASK); liveCard.setAction(PendingIntent.getActivity(this, 0, menuIntent, 0)); liveCard.attach(this); ! liveCard.publish(PublishMode.REVEAL); BreakingService
- 62. Static Cards adapter = new RecipeAdapter(createCards(this)); scrollView = new CardScrollView(this); scrollView.setAdapter(adapter); scrollView.activate(); setContentView(scrollView); setCardScrollerListener(); RecipeActivity.onCreate() Card c = new Card(context); c.setImageLayout(Card.ImageLayout.FULL); c.setText("Your blue meth-candy is ready"); c.setFootnote("Tap to start selling it"); c.addImage(R.drawable.background_01); RecipeActivity.createCards()
- 63. Notifications Recipe! Activity Activity Alarm! Manager Selling! Service Service Intent intent = new Intent(this, SellingBroadcastReceiver.class); PendingIntent pending = PendingIntent.getBroadcast(this, (int) System.currentTimeMillis(), intent, PendingIntent.FLAG_CANCEL_CURRENT); AlarmManager am = (AlarmManager) this.getSystemService( Context.ALARM_SERVICE); am.set(AlarmManager.RTC_WAKEUP, System.currentTimeMillis() + 20*1000, pending); Selling! Broadcast! Receiver Broadcast Receiver time goes by…
- 64. Live Cards Selling! Service Service Low-frequency rendering Live! Card Live Card View RemoteViews
- 65. Live CardsLow-frequency rendering // Get an instance of a live card liveCard = new LiveCard(this, LIVE_CARD_TAG); ! // Inflate a layout into a remote view liveCardView = new RemoteViews(getPackageName(), R.layout.selling_view); ! // Publish the live card liveCard.publish(PublishMode.REVEAL); ! // Queue the update text runnable handler.post(mUpdateLiveCardRunnable);
- 67. Developing with the SDK for! Android Wear
- 68. Suggest The context stream Demand The cue card Notifications Actions Images Voice
- 69. Google! Play Store App installation Handheld App Wearable App
- 72. Google! Play Services Communication between devices
- 74. NotificationCompat.Builder notificationBuilder = new NotificationCompat.Builder(this) .setSmallIcon(R.drawable.event) .setContentTitle(eventTitle) .setContentText(eventLocation) .setContentIntent(viewPendingIntent); ! // Get an instance of the NotificationManager service NotificationManagerCompat notificationManager = NotificationManagerCompat.from(this); ! // Build the notification and issues it with notification manager. notificationManager.notify(notificationId, notificationBuilder.build()); Send Notifications as usual
- 78. Adding background icon NotificationCompat.Builder notificationBuilder = new NotificationCompat.Builder(this) .setSmallIcon(R.drawable.event) .setContentTitle(eventTitle) .setContentText(eventLocation) .setContentIntent(viewPendingIntent) .setBigIcon(R.drawable.background);
- 79. #gandroid
- 80. Adding actions NotificationCompat.Builder notificationBuilder = new NotificationCompat.Builder(this) .setSmallIcon(R.drawable.event) .setContentTitle(eventTitle) .setContentText(eventLocation) .setContentIntent(viewPendingIntent) .setBigIcon(R.drawable.background); .addAction(R.drawable.maps, context.getResources().getString(R.string.maps), mapPendingIntent);
- 81. #gandroid
- 82. Receiving Voice Input <?xml version="1.0" encoding="utf-8"?> <resources> <string-array name="reply_choices"> <item>Yes</item> <item>No</item> <item>Maybe</item> </string-array> </resources>
- 83. Receiving Voice Input String replyLabel = getResources() .getString(R.string.reply_label); String[] replyChoices = getResources().getStringArray(R.array.reply_choices); ! RemoteInput remoteInput = new RemoteInput.Builder(EXTRA_VOICE_REPLY) .setLabel(replyLabel) .setChoices(replyChoices) .build();
- 84. Adding pages BigTextStyle secondPageStyle = new NotificationCompat.BigTextStyle(); secondPageStyle.setBigContentTitle("Title") .bigText("Long text content"); ! // Create second page notification Notification secondPageNotification = new NotificationCompat.Builder(context) .setStyle(secondPageStyle) .build(); ! // Create main notification and add the second page Notification twoPageNotification = notificationBuilder .extend(new NotificationCompat.WearableExtender() .addPage(secondPageNotification)) .build();
- 85. #gandroid
- 86. Stacking notifications final String GROUP_KEY = "group_key"; ! NotificationCompat.Builder builder = new NotificationCompat.Builder(this) .setContentTitle("Title") .setContentText("Text") .setSmallIcon(R.drawable.event) .setGroup(GROUP_KEY);
- 87. Summary notification Notification summaryNotification = new NotificationCompat.Builder(context) .setContentTitle("2 new messages") .setSmallIcon(R.drawable.ic_small_icon) .setLargeIcon(largeIcon) .setStyle(new NotificationCompat.InboxStyle() .addLine("Alex Faaborg Check this out") .addLine("Jeff Chang Launch Party") .setBigContentTitle("2 new messages") .setSummaryText("johndoe@gmail.com")) .setGroup(GROUP_KEY_EMAILS) .setGroupSummary(true) .build();
- 90. Wearable! UI Library BoxInsetLayout CardFragment CircledImageView ConfirmationActivity CrossFadeDrawable DelayedConfirmationView DismissOverlayView DotsPageIndicator GridViewPager GridPagerAdapter FragmentGridPagerAdapter WatchViewStub WearableListView
- 91. System-provided Voice Actions <activity android:name="MyNoteActivity"> <intent-filter> <action android:name="android.intent.action.SEND" /> <category android:name="com.google.android.voicesearch.SELF_NOTE" /> </intent-filter> </activity>
- 92. Node API Discovery of the nodes in the network Message API Exchange messages between devices Data API Sync data between devices
- 93. Packaging dependencies{ ... wearApp project(“:wearable”) }
- 95. iPhone accessory Relies on iPhone hardware No standalone apps (yet) Quick information consumption
- 96. Inputs Voice! (no keyboard!) Touch Pressure! (Force Touch) Digital Crown Sensors! (also from iPhone)
- 97. UI Elements Text input! (again, no keyboard!) Labels Switches Buttons Menu! (Force Touch) Sliders Images! (tint + animation) Maps Pin or image Timers
- 98. Layout Groups of controls No absolute positioning!!!! Groups of groups Horizontal or vertical groups Dynamic or static sizes Tables Custom cells (with groups inside)
- 99. Development XCode Storyboards (Design time) WatchKit! (ObjC+Swift) >=iOS 8.2! (all frameworks! except UIKit)
- 101. 1Actionable! Notifications (Automatic Basic Development!!) (Local + Remote Notifications!!)
- 102. Short-Look Long-look
- 103. Short-Look
- 104. Long-Look KVELLING!!
- 105. Development of custom long-looks Static Dynamic Different notifications for the same app!
- 106. Development of custom long-looks Static long-looks One dynamic label + unlimited! static labels Defined at the design-time (no code!!) No interactive controls (apart from dismissal button) All images must be known at compilation time
- 107. Development of custom long-looks Dynamic long-looks The interface can change at runtime Custom actions and interactive controls Remotely downloaded resources (including images)
- 108. 2Glances
- 109. Read only!! (tap anywhere to open app) No scroll Pre-designed templates Optional for apps Really difficult to design!! Context-aware (!!)
- 110. Glance Development Top and bottom groups! (all templates) Customizable app launch
- 111. Eventbox Glance Top group! (Event Date +Time) Bottom group! (Conference + event info) Upcoming event information from latest conference! that we accessed from the iPhone app
- 112. 3Watch Apps
- 113. iPhone app extension!! (for now) Can share data with iPhone (app groups) Handoff: start on the Watch and finish on the iPhone! (or viceversa) May not work without paired iPhone
- 114. UI Navigation Hierarchy Page-based Modal! (page-based or hierarchy) can’t be combined
- 115. Eventbox Watch App Page based Modal Sheet Modal Sheet
- 116. Eventbox Watch App
- 117. App Store App installation iOS App Watch App
- 120. BlueTooth LE! (no internet required!) Communication between devices
- 121. Demo