A proesentation og the Horizon Europe CORESENSE Project.

1. CoreSense

2. The CORESENSE project has received funding from
the European Union’s Horizon Europe research and
innovation programme under grant agreement No.
CoreSense: A Hybrid Cognitive Architecture for Deep
Understanding
www.coresens
e.eu
CORESENSE
RICARDO SANZ
UPM Autonomous Systems
A HORIZON EUROPE PROJECT

3. CORESENSE 20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 3
Machines that “understand”
Robots reflecting on the sense of their life

4. Inspection Drones
Understanding Themselves
4
Social Robots
Understanding Humans
Manufacturing Robots
Understanding the Mission

5. CORESENSE
What’s in a name?
CoreSense
Common Sense
20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 5

6. What is this all about?
Machines that deeply know
about systems (as engineers
do) and can use this
knowledge to improve
resilience by deep knowledge-
based control and adaptation.

7. CORESENSE
CoreSense Strands
• AI and Cognition
• Robotics
• Control
• Systems and Software Engineering
• Philosophy
20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 7

8. CORESENSE 20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 8
Some Core Threads
• Model-based cognition
• The perceptual awareness pipeline
• Formalization using abstract concepts
• Reusable architecture and components
• Digital engineering up to runtime

9. CORESENSE 20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 9
Model-based cognition
• Model-based cognitive systems create models of their
world and use them in the performance of action.
• World and model
are systems
• World and model
stay in a formal relation

10. CORESENSE 20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 10
Representation and World

11. Robots can understand systems

12. Engine Model
Models are created, updated,
exerted, shared, forgotten, …
Engin
e
Engin
e

13. Modelet
Models are aggregates …
Modelet
Modelet
Modelet
Modelet
… of heterogeneous modelets.

14. The perceptual pipeline

15. The (self-aware) system lifecycle
Deployment
System
Design
Requiremen
ts
User needs
System
Realization
needs requirements patterns system system-of-systems
Operation
The system operation shall delivered value

16. Robots become engineers
16

17. CORESENSE
WP NO WORK PACKAGE NAME CONTENT
WP1 Understanding and Awareness Theory A formal theory of understanding to generate world
and self-awareness for autonomous systems.
WP2 Awareness Architecture A system software-intensive cognitive architecture
based on the theory
WP3 Cognitive Modules and Structures Reusable architectural and functional components
WP4 System Lifecycle and Toolchain Engineering processes and tools supporting a
methodology of autonomous systems development
WP5 ROSification of Software Assets Deployment of assets in the ROS Ecosystem
WP6 Testbed: Manufacturing robots Manufacturing robots that show flexibility in dealing
with changing missions
WP7 Testbed: Inspection drones Industrial drones that show team-level resilience
WP8 Testbed: Social robots Robots that interact with humans and are able to show
human alignment and explainability.
20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 17
WorkPackages

18. System Release
Testbed
Use Case
Concepts
Theory
SW Assets
ROS
Packages
Refined Theory
Refined SW
Handbook
Architecture
THEORY
TECHNOLOGY
APPLICATIONS
Life-cycle Methodology
Tooling
Use Case
Concepts
Use Case
Concepts Testbed
Testbed
System Release
System Release

19. Year 1 Year 2 Year 3 Year 4
WP1: Theory
WP3: Cognitive Modules
WP5: ROSification
WP4: Lifecycle and Toolchain
WP9: Dissemination, Exploitation and Communication
WP2: Architecture
THEORY
TECHNOLOGY
APPLICATIONS
WP6: Manufacturing Testbed
WP7: Drone Inspection Testbed
WP8 Social Robot Testbed
PROJECT
WP10: Project Management and Coordination
Milestone
1
Milestone
2
Milestone
3
Milestone
4

20. CORESENSE
In summary
• This project is about the use of
heterogeneous active
representations of the world and
the system supporting model-
based action for autonomous
robots.
• The establishment of active
mappings to user needs puts
delivered value at the forefront.
• Heterogeneity is handled by using
abstract categories.
• Universality is addressed by
different use cases.
20221005 / CORESENSE KoM / Sanz / CORESENSE Vision 20

21. CoreSense