2014 Spring NuPIC Hackathon Kickoff

•Download as PPTX, PDF•

1 like•1,490 views

This document summarizes the NuPIC 2014 Spring Hackathon event. It provides the schedule and logistics for the hackathon, which includes sessions on getting started with NuPIC, the Cortical Learning Algorithm, temporal pooling, and demos on the last day. Staff supporting the event are listed, as well as resources for the hackathon including the code of conduct. The document also provides information on communications during the event and encourages participants to share photos and videos from the hackathon.

NuPIC 2014
Spring Hackathon
Welcome and Kickoff

Recordings & Live Streams
• Live Stream: http://ustream.tv/channel/nupic-
events
• Recordings will also be available on UStream
• You might be caught on tape!
• Please take photos and videos if you wish
(#NupicHack)

Hackathon Staffers
Engineers
• Jeff Hawkins
• Subutai Ahmad
• Scott Purdy
• Matt Taylor
• Austin Marshall
• Chetan Surpur
• Ian Danforth
• Brev Patterson
• Jared Casner
Support
• Teri Fry
• Casey Stone
• Zofia
• Maggie
• Tira

Hackathon Resources
• numenta.org/hack/
• Code of Conduct
• Hack registration
• Schedule
• Announcements
• Live Stream

Today’s
Schedule
• 10:00 Kickoff
• 10:30 Install-athon
• 01:00 Beginner’s Guide to
NuPIC (Scott Purdy)
• 02:30 Anomaly Detection
Using The Cortical Learning
Algorithm (Subutai Ahmad)
• 04:00 Temporal Pooling
(Jeff Hawkins)

Tomorrow’s
Schedule
• 10:00 Cortical Learning
Algorithm as Implemented
in NuPIC (Chetan Surpur)
• 01:00 The State of NuPIC
(Matt Taylor)
• 04:00 Hackathon Demos!

bigprojectorwall
storage
fooseball
room
3rd Floor Expansion 30 stations, 1 storage, 1 conf. room, 3 offices, co. mtg area
jocelyn
bryan
companymtgarea
currently rented but have rofr
santhosh
nadia
matt
jon
kalpesh
ankur
patrick
brie
kari vijay
mamta
jervey
natasha
summit omideric
pat
fish bowl scrumroom
don
walid
aziz
men’s
women’s
open
open
openopen
open
open
open
Upstairs
youare
here

mini kitchen
conf. room
server room
lobby
mother’s
room
oliviergregjoeopen
kitchen?
lunchroom
mini-scrum
office 7chris terrence
2nd Floor Existing 30 42 desks, 3 conf. rooms, 8 offices
ceiling opening
landing
carlos
anjini
ayla
elita
tyler
andre
jamison
ashley
cathy
michelle
ian
albert
juan
nick
larry
open
open open
open open
open
open
open
open
open
open
open
open
margi
open
puja
derek
tara
sree
andy
men’s
women’s
open
open
open
maggie
chris
clayton
jon
omar
jennifer
Downstairs
food

Pinger Facility
• Coming and going
• Sleep
• Wifi

Protocol
• Badges
• Food and drink
• Cleanliness
• Respect
• Code of Conduct

Communications
• IRC: #nupic on freenode
• Use the mailing lists
• Report bugs
• Spread the word: #NupicHack
– Please take pictures, videos, whatever and share
them

Audience Questions
• Ever been to a hackathon?
• Ever built NuPIC?
• Ever run any examples?
• Ever passed own data into NuPIC?

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ Neuromodulators are signalling chemicals in the brain, which control the emergence of adaptive learning and behaviour. Neuromodulators including dopamine, acetylcholine, serotonin and noradrenaline operate on a spectrum of spatio-temporal scales in tandem and opposition to reconfigure functions of biological neural networks and to regulate global cognition and state transition. Although neuromodulators are important in shaping cognition, their phenomenology is yet to be fully realized in deep neural networks (DNNs). In this talk, we will give an overview of the biological organizing principles of neuromodulators in adaptive cognition and highlight the competition and cooperation across neuromodulators.

Brains@Bay Meetup: How to Evolve Your Own Lab Rat - Thomas Miconi

Numenta

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ A hallmark of intelligence is the ability to learn new flexible, cognitive behaviors - that is, behaviors that require discovering, storing and exploiting novel information for each new instance of the task. In meta-learning, agents are trained with external algorithms to learn one specific cognitive task. However, animals are able to pick up such cognitive tasks automatically, as a result of their evolved neural architecture and synaptic plasticity mechanisms, including neuromodulation. Here we evolve neural networks, endowed with plastic connections and reward-based neuromodulation, over a sizable set of simple meta-learning tasks based on a framework from computational neuroscience. The resulting evolved networks can automatically acquire a novel simple cognitive task, never seen during evolution, through the spontaneous operation of their evolved neural organization and plasticity system. We suggest that attending to the multiplicity of loops involved in natural learning may provide useful insight into the emergence of intelligent behavior.

Brains@Bay Meetup: The Increasing Role of Sensorimotor Experience in Artifici...

Numenta

We receive information about the world through our sensors and influence the world through our effectors. Such low-level data has gradually come to play a greater role in AI during its 70-year history. I see this as occurring in four steps, two of which are mostly past and two of which are in progress or yet to come. The first step was to view AI as the design of agents which interact with the world and thereby have sensorimotor experience; this viewpoint became prominent in the 1980s and 1990s. The second step was to view the goal of intelligence in terms of experience, as in the reward signal of optimal control and reinforcement learning. The reward formulation of goals is now widely used but rarely loved. Many would prefer to express goals in non-experiential terms, such as reaching a destination or benefiting humanity, but settle for reward because, as an experiential signal, reward is directly available to the agent without human assistance or interpretation. This is the pattern that we see in all four steps. Initially a non-experiential approach seems more intuitive, is preferred and tried, but ultimately proves a limitation on scaling; the experiential approach is more suited to learning and scaling with computational resources. The third step in the increasing role of experience in AI concerns the agent’s representation of the world’s state. Classically, the state of the world is represented in objective terms external to the agent, such as “the grass is wet” and “the car is ten meters in front of me”, or with probability distributions over world states such as in POMDPs and other Bayesian approaches. Alternatively, the state of the world can be represented experientially in terms of summaries of past experience (e.g., the last four Atari video frames input to DQN) or predictions of future experience (e.g., successor representations). The fourth step is potentially the biggest: world knowledge. Classically, world knowledge has always been expressed in terms far from experience, and this has limited its ability to be learned and maintained. Today we are seeing more calls for knowledge to be predictive and grounded in experience. After reviewing the history and prospects of the four steps, I propose a minimal architecture for an intelligent agent that is entirely grounded in experience.

Brains@Bay Meetup: Open-ended Skill Acquisition in Humans and Machines: An Ev...

Numenta

In this talk, I will propose a conceptual framework sketching a path toward open-ended skill acquisition through the coupling of environmental, morphological, sensorimotor, cognitive, developmental, social, cultural and evolutionary mechanisms. I will illustrate parts of this framework through computational experiments highlighting the key role of intrinsically motivated exploration in the generation of behavioral regularity and diversity. Firstly, I will show how some forms of language can self-organize out of generic exploration mechanisms without any functional pressure to communicate. Secondly, we will see how language — once invented — can be recruited as a cognitive tool that enables compositional imagination and bootstraps open-ended cultural innovation. For more:

Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...

Numenta

Most current deep neural networks learn from a static data set without active interaction with the world. We take a look at how learning through a closed loop between action and perception affects the representations learned in a DNN. We demonstrate how these representations are significantly different from DNNs that learn supervised or unsupervised from a static dataset without interaction. These representations are much sparser and encode meaningful content in an efficient way. Even an agent who learned without any external supervision, purely through curious interaction with the world, acquires encodings of the high dimensional visual input that enable the agent to recognize objects using only a handful of labeled examples. Our results highlight the capabilities that emerge from letting DNNs learn more similar to biological brains, though sensorimotor interaction with the world. For more:

SBMT 2021: Can Neuroscience Insights Transform AI? - Lawrence Spracklen

Numenta

Viewers also liked

Beginner's Guide to NuPICNumenta

Brains, Data, and Machine Intelligence (2014 04 14 London Meetup)

Numenta

Principles of Hierarchical Temporal Memory - Foundations of Machine Intelligence

Numenta

Anomaly Detection Using the CLANumenta

Getting Started with Numenta Technology

Numenta

Sparse Distributed Representations: Our Brain's Data Structure

Numenta

What the Brain says about Machine Intelligence

Numenta

Why Neurons have thousands of synapses? A model of sequence memory in the brain

Numenta

Real-Time Streaming Data Analysis with HTM

Numenta

Science of Anomaly Detection

Numenta

Evaluating Real-Time Anomaly Detection: The Numenta Anomaly Benchmark

Numenta

Predictive Analytics with Numenta Machine Intelligence

Numenta

Numenta Anomaly Benchmark - SF Data Science Meetup

Numenta

Streaming Analytics: It's Not the Same Game

Numenta

Detecting Anomalies in Streaming Data

Numenta

Viewers also liked (15)

Beginner's Guide to NuPIC

Brains, Data, and Machine Intelligence (2014 04 14 London Meetup)

Principles of Hierarchical Temporal Memory - Foundations of Machine Intelligence

Anomaly Detection Using the CLA

Getting Started with Numenta Technology

Sparse Distributed Representations: Our Brain's Data Structure

What the Brain says about Machine Intelligence

Why Neurons have thousands of synapses? A model of sequence memory in the brain

Real-Time Streaming Data Analysis with HTM

Science of Anomaly Detection

Evaluating Real-Time Anomaly Detection: The Numenta Anomaly Benchmark

Predictive Analytics with Numenta Machine Intelligence

Numenta Anomaly Benchmark - SF Data Science Meetup

Streaming Analytics: It's Not the Same Game

Detecting Anomalies in Streaming Data

More from Numenta

Deep learning at the edge: 100x Inference improvement on edge devices

Numenta

Brains@Bay Meetup: A Primer on Neuromodulatory Systems - Srikanth Ramaswamy

Numenta

Brains@Bay Meetup: How to Evolve Your Own Lab Rat - Thomas Miconi

Numenta

Brains@Bay Meetup: The Increasing Role of Sensorimotor Experience in Artifici...

Numenta

Brains@Bay Meetup: Open-ended Skill Acquisition in Humans and Machines: An Ev...

Numenta

Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...

Numenta

SBMT 2021: Can Neuroscience Insights Transform AI? - Lawrence Spracklen

Numenta

FPGA Conference 2021: Breaking the TOPS ceiling with sparse neural networks -...

Numenta

Nick Ni (Xilinx) and Lawrence Spracklen (Numenta) presented a talk at the FGPA Conference Europe on July 8th, 2021. In this talk, they presented a neuroscience approach to optimize state-of-the-art deep learning networks into sparse topology and how it can unlock significant performance gains on FPGAs without major loss of accuracy. They then walked through the FPGA implementation where they exploited the advantage of sparse networks with a unique Domain Specific Architecture (DSA).

BAAI Conference 2021: The Thousand Brains Theory - A Roadmap for Creating Mac...

Numenta

Jeff Hawkins NAISys 2020: How the Brain Uses Reference Frames, Why AI Needs t...

Numenta

Jeff Hawkins presents a talk on "How the Brain Uses Reference Frames to Model the World, Why AI Needs to do the Same." In this talk, he gives an overview of The Thousand Brains Theory and discusses how machine intelligence can benefit from working on the same principles as the neocortex. This talk was first presented at the NAISys conference on November 10, 2020. You can find a re-recording of the talk here: https://youtu.be/mGSG7I9VKDU

OpenAI’s GPT 3 Language Model - guest Steve Omohundro

Numenta

In this research meeting, guest Stephen Omohundro gave a fascinating talk on GPT-3, the new massive OpenAI Natural Language Processing model. He reviewed the network architecture, training process, and results in the context of past work. There was extensive discussion on the implications for NLP and for Machine Intelligence / AGI. Link to GPT-3 paper: https://arxiv.org/abs/2005.14165 Link to YouTube recording of Steve's talk: https://youtu.be/0ZVOmBp29E0

CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...

Numenta

Sparsity In The Neocortex, And Its Implications For Machine Learning

Numenta

The Thousand Brains Theory: A Framework for Understanding the Neocortex and B...

Numenta

Recent advances in reverse engineering the neocortex reveal that it is a highly-distributed sensory-motor modeling system. Each cortical column learns complete models of observed objects through movement and sensation. The columns use long-range connections to vote on what objects are currently being observed. In this talk, we introduce the key elements of this theory and describe how these elements can be introduced into current machine learning techniques to improve their capabilities, robustness, and power requirements.

Jeff Hawkins Human Brain Project Summit Keynote: "Location, Location, Locatio...

Numenta

Location, Location, Location - A Framework for Intelligence and Cortical Comp...

Numenta

Have We Missed Half of What the Neocortex Does? A New Predictive Framework ...

Numenta

Locations in the Neocortex: A Theory of Sensorimotor Prediction Using Cortica...

Numenta

The Predictive Neuron: How Active Dendrites Enable Spatiotemporal Computation...

Numenta

The Biological Path Toward Strong AI by Matt Taylor (05/17/18)

Numenta

These are Matt Taylor's slides from the AI Singapore Meetup on May 17, 2018. Abstract: Today’s wave of AI technology is still being driven by the ANN neuron pioneered decades ago. Hierarchical Temporal Memory (HTM) is a realistic biologically-constrained model of the pyramidal neuron reflecting today’s most recent neocortical research. This talk will describe and visualize core HTM concepts like sparse distributed representations, spatial pooling and temporal memory. Strong AI is a common goal of many computer scientists. So far, machine learning techniques have created amazing results in narrow fields, but haven’t produced something we could all call “intelligent”. Given recent advances in neuroscience research, we know a lot more about how neurons work together now than we did when ANNs were created. We believe systems with a more realistic neuronal model will be more likely to produce Strong AI. Hierarchical Temporal Memory is a theory of intelligence based upon neuroscience research. The neocortex is the seat of intelligence in the brain, and it is structurally homogeneous throughout. This means a common algorithm is processing all your sensory input, no matter which sense. We believe we have discovered some of the foundational algorithms of the neocortex, and we’ve implemented them in software. I’ll show you how they work with detailed dynamic visualizations of Sparse Distributed Representations, Spatial Pooling, and Temporal Memory.

More from Numenta (20)