Natural Language in Human-Robot InteractionSeokhwan Kim
Tutorial @ The 4th International Conference on Human-Agent Interaction (HAI 2016), 04 Oct 2016
Speakers: Rafael E. Banchs, Seokhwan Kim, Luis Fernando D’Haro, Andreea I. Niculescu
Guest lecture for TCSS 452 (Human-Computer Interaction) at University of Washington, Tacoma, on Sherry Turkle's book, Alone Together, and the broader theme of human-robot interaction
In this presentation, I address two major questions:
1. What is Intelligent Agent Perception?
2. How do Intelligent Agents Perceive?
In addressing the meaning of agent perception, I highlight impediments to the perceptual process and the process of situation assessment.
In addressing how agents perceive, I highlight traditional approaches to robotic perception and then the next step after sensor input, which is how sensor data (vision sensor, tactile, olfactory, haptic, etc.) is interpreted. Methods for interpretation include solutions based on Bayes' Theorem, the underpinning of many robotics algorithms; Probabilistic Algorithms; and Artificial Neural Networks.
I also discuss a current system for robotic perception, designed to accommodate more robust and complex robotic needs: using sensors in tandem with machine learning. This method is closer to mimicking the human perceptual process than previous methods. I discuss some examples of this: 1) a study in which researchers used visual sensors and an artificial neural network (ANN) for robotic perception; 2) a study in which researchers used haptic sensors and a classification algorithm, called a boosting algorithm for robotic perception; and 3) a study in which researchers used pressure sensors, an ANN, and intended to add pre-programmed models in order to facilitate robotic perception.
Natural Language in Human-Robot InteractionSeokhwan Kim
Tutorial @ The 4th International Conference on Human-Agent Interaction (HAI 2016), 04 Oct 2016
Speakers: Rafael E. Banchs, Seokhwan Kim, Luis Fernando D’Haro, Andreea I. Niculescu
Guest lecture for TCSS 452 (Human-Computer Interaction) at University of Washington, Tacoma, on Sherry Turkle's book, Alone Together, and the broader theme of human-robot interaction
In this presentation, I address two major questions:
1. What is Intelligent Agent Perception?
2. How do Intelligent Agents Perceive?
In addressing the meaning of agent perception, I highlight impediments to the perceptual process and the process of situation assessment.
In addressing how agents perceive, I highlight traditional approaches to robotic perception and then the next step after sensor input, which is how sensor data (vision sensor, tactile, olfactory, haptic, etc.) is interpreted. Methods for interpretation include solutions based on Bayes' Theorem, the underpinning of many robotics algorithms; Probabilistic Algorithms; and Artificial Neural Networks.
I also discuss a current system for robotic perception, designed to accommodate more robust and complex robotic needs: using sensors in tandem with machine learning. This method is closer to mimicking the human perceptual process than previous methods. I discuss some examples of this: 1) a study in which researchers used visual sensors and an artificial neural network (ANN) for robotic perception; 2) a study in which researchers used haptic sensors and a classification algorithm, called a boosting algorithm for robotic perception; and 3) a study in which researchers used pressure sensors, an ANN, and intended to add pre-programmed models in order to facilitate robotic perception.
Natural Interaction for Augmented Reality ApplicationsMark Billinghurst
Keynote talk giving by Mark Billinghurst from the HIT Lab NZ at the IVCNZ 2013 conference, November 28th 2013. The talk focuses on Natural Interaction with Augmented Reality applications using speech and gesture and demonstrates some of the projects in this area developed by the HIT Lab NZ.
Gestures are expressive, meaningful body motions, i.e., physical movements of the fingers, hands, arms, head, face, or body with the intent to convey information or interact with the environment.
Learning Social Affordances and Using Them for PlanningKadir Uyanik
This study extends the learning and use of affordances on robots on two fronts. First, we use the very same affordance
learning framework that was used for learning the affordances of inanimate things to learn social affordances, that is affordances whose existence requires the presence of humans. Second, we use the learned affordances for making multistep
plans.
Specifically, an iCub humanoid platform is equipped with a perceptual system to sense objects placed on a table, as well as the presence and state of humans in the environment, and a behavioral repertoire that consisted of simple object manipulations as well as voice behaviors that are uttered simple verbs. After interacting with objects and humans, the robot learns a set of affordances with which it can make multi-step plans towards achieving a demonstrated goal.
COMP lecture 4 given by Bruce Thomas on August 16th 2017 at the University of South Australia about 3D User Interfaces for VR. Slides prepared by Mark Billinghurst.
The Reality of Augmented Reality: Are we there yet?Mark Billinghurst
3DUI 2015 Keynote talk given by Mark Billinghurst on March 24th 2015, as part of the 3DUI 2015 conference. The talk is a survery of Augmented Reality and Empathic Computing
Abstract: This PDSG workship introduces basic concepts on Reinforcement Learning. Concepts covered are reflex and intelligent agents, states, actions, and rewards, with examples.
Level: Fundamental
Requirements: No prior programming knowledge is required.
In this talk I discuss to foundations of spatial interaction design by exploring how we’ve used our environment all through the centuries to help us with cognitive tasks.
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityMark Billinghurst
Lecture 7 of the COMP 4010 course in Virtural Reality. This lecture was about 3D User Interfaces for Virtual Reality. The lecture was taught by Mark Billinghurst on September 13th 2016 at the University of South Australia.
Lecture 9 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture describes principles for effective Interface Design for Mobile AR applications. Look for the other 9 lectures in the course.
The app “It Feels Like” provides users a means of viewing their current weather conditions in an adventurous fashion. It takes current local weather information aggregated from Data Canvas nodes and compares this to a database of typical weather conditions from various international cities and finds the match with most similar weather. Once the match is found, “It Feels Like” presents to the user further visual information of the city and the season which it feels like. This could help recollect feelings from an old vacation spot, serve as a guide to possibly the next destination or introduce people to somewhere completely new.
Natural Interaction for Augmented Reality ApplicationsMark Billinghurst
Keynote talk giving by Mark Billinghurst from the HIT Lab NZ at the IVCNZ 2013 conference, November 28th 2013. The talk focuses on Natural Interaction with Augmented Reality applications using speech and gesture and demonstrates some of the projects in this area developed by the HIT Lab NZ.
Gestures are expressive, meaningful body motions, i.e., physical movements of the fingers, hands, arms, head, face, or body with the intent to convey information or interact with the environment.
Learning Social Affordances and Using Them for PlanningKadir Uyanik
This study extends the learning and use of affordances on robots on two fronts. First, we use the very same affordance
learning framework that was used for learning the affordances of inanimate things to learn social affordances, that is affordances whose existence requires the presence of humans. Second, we use the learned affordances for making multistep
plans.
Specifically, an iCub humanoid platform is equipped with a perceptual system to sense objects placed on a table, as well as the presence and state of humans in the environment, and a behavioral repertoire that consisted of simple object manipulations as well as voice behaviors that are uttered simple verbs. After interacting with objects and humans, the robot learns a set of affordances with which it can make multi-step plans towards achieving a demonstrated goal.
COMP lecture 4 given by Bruce Thomas on August 16th 2017 at the University of South Australia about 3D User Interfaces for VR. Slides prepared by Mark Billinghurst.
The Reality of Augmented Reality: Are we there yet?Mark Billinghurst
3DUI 2015 Keynote talk given by Mark Billinghurst on March 24th 2015, as part of the 3DUI 2015 conference. The talk is a survery of Augmented Reality and Empathic Computing
Abstract: This PDSG workship introduces basic concepts on Reinforcement Learning. Concepts covered are reflex and intelligent agents, states, actions, and rewards, with examples.
Level: Fundamental
Requirements: No prior programming knowledge is required.
In this talk I discuss to foundations of spatial interaction design by exploring how we’ve used our environment all through the centuries to help us with cognitive tasks.
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityMark Billinghurst
Lecture 7 of the COMP 4010 course in Virtural Reality. This lecture was about 3D User Interfaces for Virtual Reality. The lecture was taught by Mark Billinghurst on September 13th 2016 at the University of South Australia.
Lecture 9 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture describes principles for effective Interface Design for Mobile AR applications. Look for the other 9 lectures in the course.
Similar to Robots and Humans - Oussama Khatib (20)
The app “It Feels Like” provides users a means of viewing their current weather conditions in an adventurous fashion. It takes current local weather information aggregated from Data Canvas nodes and compares this to a database of typical weather conditions from various international cities and finds the match with most similar weather. Once the match is found, “It Feels Like” presents to the user further visual information of the city and the season which it feels like. This could help recollect feelings from an old vacation spot, serve as a guide to possibly the next destination or introduce people to somewhere completely new.
How Swiss schools are using social media, what kind of accounts they have, how many followers, and highlights of the best use of social media in Switzerland.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
19. s2 : Stanford Human-Safe Robot
Impact-reducing
proximity and
pressure sensing
Skin using SDM
20. .. not only walk, but also interact with the world!
a unified mobility & manipulation framework!
21. Sensing and Perception
Multiple Sensing Modalities
Combining visual, range, force,
and tactile sensing feedback.
Probabilistic framework for global
state estimation
22.
23. The Challenge
Sensing and Perception
real-time, unstructured world
Planning, Control, Skills
many degrees of freedom
mobility and manipulation
human-like skills, learning
Human-Robot Interaction
cognitive and physical
Mechanisms and Actuation
safety & performance
Interactivity & Human-Friendly
35. Human Motion Characteristics
Humans grow to learn the
efficiency of the body’s
physio-mechanical advantage
In learned tasks, humans
minimize muscular effort,
under physical and “social”
constraints
52. Unified Whole Body Control Framework
Task, Posture, Constraints, Multiple Contacts, and Balance
53. Unified Framework
posture
consistent with {
task
consistent with {
contact
consistent with {
internal constraints
self collision
local obstacles
consistent with {
interact with the world,
balance cooperate, and manipulate
} }
} }
