Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
WILLIAM LOUTH
AUTOLETICS.COM
UNDERSTANDING
UNDERSTANDING
understanding
a relation between the knower and an
object of knowledge
the totality of one’s knowledge of an
object…to sup...
awareness
to perceive, to feel, or to be conscious of
events, objects, or sensory patterns
sense data can be confirmed by ...
situational
awareness
The perception of elements in the
environment within a volume of time and
space…the comprehension of...
situational
awareness
knowing what is going on so you can
figure out what to do
directed consciousness within a dynamic
ta...
perception
the processing of sensory data in order to
represent and understand the environment
the key to survival is the ...
perception
the application of distinction
shaped by learning, memory, expectation,
and attention
perception is paying atte...
change
blindness
the failure to detect changes in a visual
scene, resulting from the conditions under
which the change occ...
Language
A means to communicate the contents of
perception of one individual to another
developed to serve perception and ...
DRAMATISM
Life is drama (in the sense of fiction)
we discover the motives of actors by
looking for their particular type o...
DRAMATISM
PENTAD
Act
agent
agency
scenepurpose
attitude
DRAMATISM
PENTAD
Act - What was done?
Scene - Where was it done?
Agent - Who did it?
Agency - how was it done?
Purpose - W...
CRIME SCENE
PROFILING
WHAT - THE CRIME (ACT) COMMITTED
WHERE - THE SCENE WHERE IT HAPPENED
WHEN - THE TIME WHEN THE ACT TO...
CRIME SCENE
PROFILING
THE NATURE OF ACTS AND AGENTS WILL BE
CONSISTENT WITH THE SCENE
MOTIVES ARE SHORTHAND TERMS FOR SITU...
structurational
theory
structure is produced and reproduced in
what people do
actions reinforce and reproduce a set of
exp...
observational
learning
attention - Observers cannot learn unless
they pay attention to what's happening
memory - Observers...
experiential
learning
For the things we have to learn before we
can do them, we learn by doing them
when a person involved...
experiential
learning
Did I notice what happened?
Why did it happen?
Does that happen often?
Why does that happen?
How can...
activity
theory
activity
system
Subject
(actor)
object
(context)
Instrument
(agency)
activity
theory
subject - an actor engaged in activities
instruments - tools used by an actor
community - all actors invol...
activity
hierarchy
Activity Motive PRESCRIBED
action goal planned
operation conditioN provisional
Embodied
cognition
Cognitive activity takes place in the context
of a real-world environment, and
inherently involves perc...
good regulator
theorem
every good regulator of a system must be a
model of that system
All doing is knowing and all knowin...
human-centered
Computing
computers must share a conceptual system
with humans
sensory lets us perceive and understand
acti...
Cognizant
Computing
Cognizant
machines
simulation
the imitation of the operation of a system
requires a model be developed representing
key system characteristic...
replication
involves sharing information so as to
ensure consistency between redundant
resources, such as software or hard...
simulation Theory
(of the Mind)
humans anticipate and make sense of the
behavior of others by activating mental
processes ...
mirror
neurons
Mirroring is formed by activations within a
neural cortical system when a person
experiences an event endog...
mirror
system
is used to retrodict as well as predict
mental states, allowing us to work
backwards and draw an inference f...
threat
simulation theory
dreams evolved as an offline simulation to
repeatedly experience life threatening events
as a mea...
episodic
memories
memory of experiences and specific events in
time in a serial form, from which we can
reconstruct the ac...
simulated
reality
reality could be simulated to a degree
indistinguishable from "true" reality
conscious minds may not be ...
control
theory
Evidence
Relevance
Consequence
Action Feedback Loop
Observation
JudgementReaction
Regulation
measured
observations
Collect Measure Instrument
metric monitoring
vs
activity metering
monitoring focuses on
detecting pixel changes
each pixel
is a metric
identification...
metering
is motion
environment
context
actors
activities
motion
spatial
temporal
Consciousness is only possible through ch...
activity
metering
Model Activity Resource
Device Probe Meter
Develop Code Counter
Design Behavior Usage
Data Group Metering
activity
metering
Context
+
Thread
Probe
=
Code
Metering
Measurement
Meter
+
Resource
actoractivity
begin event
end event
...
activity
metering
Actor Activity
Context
Coordinate
Event
Environment
Resource
simulation
demonstrations
software activity
the motion picture
software memories
& simulated dreams
!!!!☻☺☻ ☻
☻☺ ☺ ☻☻
☻ ☻☺
☺
☻ ☻☻
☻ ☻
✂
revised
recording
original
recording
"metering
pl...
software mirrored
simulated realities
Application
Instance #1
The view the service provider has of the
infrastructure and ...
software mirrored
simulated realities
Infrastructure
Application
Instance #1
Customer
Dev(Ops) & Test
Teams
Mirroring
& Si...
software mirrored
simulated realities
Infrastructure
Application
Instance #1
Security &
Auditing
Mirroring
& Simulation
Si...
Ping
JVM
metering
engine
simz
playback
satoris
agent
metering
engine
simz
client
Precept
game
Precept
set
state
metered
ac...
Mirrored
simulation
mechanical
sympathy
algorithms
& structurescode
optimization
execution
heuristics
software
adaptation
...
Upcoming SlideShare
Loading in …5
×

Understanding Understanding - /dev/07 DevPro Meetup - 3rd Nov 2014

724 views

Published on

In this talk a vision is presented for the future of large scale distributed software development that is based on mirrored simulation of software execution behaviour (motion) and its environment (state) for reinterpretation and augmentation across space and time. When fully realized across multiple languages and platforms this vision has the potential to be one of the most significant advances in the engineering of software systems. Its impact will be as big as that of distributed computing, if not even greater. The talk will touch on the following topics which have inspired this approach:

-activity theory
-activity metering
-self-adaptive software
-experiential learning
-situational awareness
-mirror neurons and simulated embodiment
-simulation theory (and the matrix)
-episodic memories and dreams

as well as indirectly:

-discrete event simulation
-actor programming model
-event sourcing
-supervision and control
-signals and boundaries
-machine learning

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Understanding Understanding - /dev/07 DevPro Meetup - 3rd Nov 2014

  1. 1. WILLIAM LOUTH AUTOLETICS.COM UNDERSTANDING UNDERSTANDING
  2. 2. understanding a relation between the knower and an object of knowledge the totality of one’s knowledge of an object…to support intelligent action
  3. 3. awareness to perceive, to feel, or to be conscious of events, objects, or sensory patterns sense data can be confirmed by an observer without necessarily implying understanding
  4. 4. situational awareness The perception of elements in the environment within a volume of time and space…the comprehension of their meaning, and the projection of their status in the near future
  5. 5. situational awareness knowing what is going on so you can figure out what to do directed consciousness within a dynamic task environment to keep the operator tightly coupled to the dynamics of the environment
  6. 6. perception the processing of sensory data in order to represent and understand the environment the key to survival is the effective organization of action appropriate to the environment Perception developed from action to serve action
  7. 7. perception the application of distinction shaped by learning, memory, expectation, and attention perception is paying attention
  8. 8. change blindness the failure to detect changes in a visual scene, resulting from the conditions under which the change occurs
  9. 9. Language A means to communicate the contents of perception of one individual to another developed to serve perception and in turn to serve effective action a flexible instrument designed to match human experience (perception and action)
  10. 10. DRAMATISM Life is drama (in the sense of fiction) we discover the motives of actors by looking for their particular type of motivation in action and discourse
  11. 11. DRAMATISM PENTAD Act agent agency scenepurpose attitude
  12. 12. DRAMATISM PENTAD Act - What was done? Scene - Where was it done? Agent - Who did it? Agency - how was it done? Purpose - Why did it happen?
  13. 13. CRIME SCENE PROFILING WHAT - THE CRIME (ACT) COMMITTED WHERE - THE SCENE WHERE IT HAPPENED WHEN - THE TIME WHEN THE ACT TOOK PLACE HOW - THE PERFORMANCE (ACTION) WHY - THE MOTIVE (INTENT) WHO - THE AGENT (ACTOR)
  14. 14. CRIME SCENE PROFILING THE NATURE OF ACTS AND AGENTS WILL BE CONSISTENT WITH THE SCENE MOTIVES ARE SHORTHAND TERMS FOR SITUATIONS IT IS THE SCENE THAT CONNECTS AGENT AND ACT ATTITUDE INCLINES THE AGENT TOWARD CERTAIN PATTERNS OF ACTS..THE SCENE PRECIPITATES THEM
  15. 15. structurational theory structure is produced and reproduced in what people do actions reinforce and reproduce a set of expectationS which make up the 'social forces' and 'social structures’
  16. 16. observational learning attention - Observers cannot learn unless they pay attention to what's happening memory - Observers must not only recognize behavior but also remember it motor - Observers must be physically and/ intellectually capable of producing the act
  17. 17. experiential learning For the things we have to learn before we can do them, we learn by doing them when a person involved in an activity looks back and evaluates it, determines what was useful or important to remember, and uses this information to perform another activity
  18. 18. experiential learning Did I notice what happened? Why did it happen? Does that happen often? Why does that happen? How can I use that?
  19. 19. activity theory activity system Subject (actor) object (context) Instrument (agency)
  20. 20. activity theory subject - an actor engaged in activities instruments - tools used by an actor community - all actors involved object - transformed into outcome by actor rules - regulation of activity system division of labor - hierarchical structure
  21. 21. activity hierarchy Activity Motive PRESCRIBED action goal planned operation conditioN provisional
  22. 22. Embodied cognition Cognitive activity takes place in the context of a real-world environment, and inherently involves perception and action The function of the mind is to guide action Even when decoupled from the environment, the activity of the mind is grounded in mechanisms that evolved for interaction with the environment
  23. 23. good regulator theorem every good regulator of a system must be a model of that system All doing is knowing and all knowing is doing
  24. 24. human-centered Computing computers must share a conceptual system with humans sensory lets us perceive and understand actions motor lets us produce actions language lets us communicate actions
  25. 25. Cognizant Computing
  26. 26. Cognizant machines
  27. 27. simulation the imitation of the operation of a system requires a model be developed representing key system characteristics and behaviors a model represents the system a simulation represents the system over time
  28. 28. replication involves sharing information so as to ensure consistency between redundant resources, such as software or hardware components, to improve reliability, fault- tolerance, or accessibility
  29. 29. simulation Theory (of the Mind) humans anticipate and make sense of the behavior of others by activating mental processes that, if carried into action, would produce similar behavior We form predictions and explanations of someone by putting ourselves in the shoes of another person and simulating them
  30. 30. mirror neurons Mirroring is formed by activations within a neural cortical system when a person experiences an event endogenously or when the person perceives an action by another person that correlates to the event
  31. 31. mirror system is used to retrodict as well as predict mental states, allowing us to work backwards and draw an inference from the observed action to a hypothesized goal state as well as generate explanations of the target’s behavior
  32. 32. threat simulation theory dreams evolved as an offline simulation to repeatedly experience life threatening events as a means to increase survival rates in priming response behavior
  33. 33. episodic memories memory of experiences and specific events in time in a serial form, from which we can reconstruct the actual moment or act Individuals tend to see themselves as actors the context surrounding an event is usually part of the memory
  34. 34. simulated reality reality could be simulated to a degree indistinguishable from "true" reality conscious minds may not be fully aware that they are living inside a simulation unprovable as any "evidence" that is directly observed could be another simulation itself
  35. 35. control theory Evidence Relevance Consequence Action Feedback Loop Observation JudgementReaction Regulation
  36. 36. measured observations Collect Measure Instrument
  37. 37. metric monitoring vs activity metering monitoring focuses on detecting pixel changes each pixel is a metric identification of actor & env the begin and end events of an activity are measured perception of actor & action is near impossible movement through space is trackable
  38. 38. metering is motion environment context actors activities motion spatial temporal Consciousness is only possible through change; change is only possible through movement
  39. 39. activity metering Model Activity Resource Device Probe Meter Develop Code Counter Design Behavior Usage Data Group Metering
  40. 40. activity metering Context + Thread Probe = Code Metering Measurement Meter + Resource actoractivity begin event end event call act(ion)
  41. 41. activity metering Actor Activity Context Coordinate Event Environment Resource
  42. 42. simulation demonstrations
  43. 43. software activity the motion picture
  44. 44. software memories & simulated dreams !!!!☻☺☻ ☻ ☻☺ ☺ ☻☻ ☻ ☻☺ ☺ ☻ ☻☻ ☻ ☻ ✂ revised recording original recording "metering playback "metering playback ⇣ ⇣ ⇣ ⇣ ⇣ ⇣ ⇣ ⇣⇣ ⇣ ⇣ ⇣ ⇣ ⇣ ⇣ ⇣ JVM Runtime Application metered threads metering recorder Disk 1010101010 metering recorder Disk 1010101010 filtered playback
  45. 45. software mirrored simulated realities Application Instance #1 The view the service provider has of the infrastructure and applications. Application The view a PaaS vendor or managed service provider offers to customers. Application The view a customer needs of applications deployed to PaaS. Infrastructure Infrastructure Application Instance #2 Application Instance #3
  46. 46. software mirrored simulated realities Infrastructure Application Instance #1 Customer Dev(Ops) & Test Teams Mirroring & Simulation Simz Service Single Application Monitoring Plane Metering Feed Unidirectional Application Instance #2 Application Instance #3
  47. 47. software mirrored simulated realities Infrastructure Application Instance #1 Security & Auditing Mirroring & Simulation Simz Service Simulated Application Metering Feed Unidirectional Application Instance #2 Application Instance #3 Business Analytics Service Level Management API API
  48. 48. Ping JVM metering engine simz playback satoris agent metering engine simz client Precept game Precept set state metered activity replicate action ping event(s) simz server pong JVM metering engine satoris agent simz playback metering engine simz server Precept game Precept set statemetered activity pong event(s) simz client simulate action simulate action replicate action ! ! ! ! ping actor pong actor mind sim mind sim action > ping pong < action precept < pong ping > precept metering feed ping Pong
  49. 49. Mirrored simulation mechanical sympathy algorithms & structurescode optimization execution heuristics software adaptation system dynamics execution caches the underworld Elysium software memorization execution parallelism dataset training online learning embodiment & augmentation emergent behavior pipelining & prediction software performance improvement techniques software execution model system execution model corruptive influence collective intelligence

×