Download to read offline
Uploaded byyoshiharu sato
Interactions of human, machines, and atoms
The document discusses different types of interactions between humans, machines, and atoms. It notes that while humans interact with machines primarily through fingers and hands, interactions with other humans and the real world are often multimodal in nature. It also observes that machines currently provide information to humans in mostly one-directional and primitive ways, but that interactions could be improved, such as through nursing care robots. The document envisions opportunities for more amazing multimodal interactions if human effectors like voice, gaze, or brain state could be linked to machines to act on atoms.
![Coded Agents – with UiPath SDK + LangGraph [Virtual Hands-on Workshop]](https://cdn.slidesharecdn.com/ss_thumbnails/codedagentsdeck-251215155422-5497c599-thumbnail.jpg?width=640&height=640&fit=bounds)
Interactions of human, machines, and atoms
- 1. Interactions of Humans, Machines,and Atoms Yoshiharu Sato http://yo-sato.com/
- 2.
- 3. Human acts onMachine • Interaction examples • GUI of PC, Smart Phone • Commanding • Discrete: start/stop, select, confirm • Analog: quantity setting • Texting • Pointing (position, movement) • Handle, Pedal in a car • Button, Knob on consumer electronics • … • Observation • Fingers/hands are dominant organs to play, while human actions to human/atoms in real-world are multi-modal in nature.
- 4. Machine receives information fromHuman • Interaction examples • Health-care monitor • Security camera • Lock/unlock of car door • Wind direction of air-conditioner • … • Observation • They are one direction and not interactions. There is a much space to help human through interactions.
- 5. Machine acts onHuman • Interaction examples • Game story • Alarm • GUI - popup window • sound, lighting, vibration • Traffic signal • … • Observation • Besides visuals, multiple modalities are used but in primitive forms. Robots, for example, nursing care robot, may change situation radically.
- 6. Human receives informationfrom Machine • Interaction examples • GUI of PC, Smart Phone • Display • Augmented reality with Google Glass • Rumba position • … • Visuals are dominant.
- 7. Human vs Human •Interaction channels • language • text • voice • visuals • sounds • body gesture • Observation • They are multimodal interactions.
- 8. Human vs Atom •Interaction channels • Human-to-atom: trigger by human mechanical actions • Atom-to-human: human 5 senses • Observation • It is uni-modal from human to atom, while it is multi- modal in opposite direction. • If human multi-modal effectors such as voice, gaze, or brain state is linked with machines to act on atoms, human power on atoms would be amazing.
- 9.