2014 Fall NuPIC Hackathon Kickoff

•Download as PPTX, PDF•

1 like•1,332 views

Numenta

The kickoff presentation.

Software

Recordings, Videos, Pictures
• Sessions and demos are being recorded
• No live streaming this time
• You might be caught on tape!
• Please take photos and videos if you wish
(#NupicHack)
• Testimonials?

Hackathon Staffers
Engineers
• Jeff Hawkins
• Subutai Ahmad
• Scott Purdy
• Matt Taylor
• Austin Marshall
• Chetan Surpur
Support
• Teri Fry
• Taylor Wirfs
• Trinity Taylor
• Kyle Quackenbush

Hackathon Resources
• numenta.org/hack/
• Code of Conduct
• Hack registration
• Schedule
• Announcements
• Live Stream

Today’s
Schedule
• 10:00 Kickoff
• 10:30 Install-athon
• 01:00 On the Way to
Language Intelligence
(Francisco Webber –
cortical.io)
• 02:30 Applications of HTM
(Chetan Surpur)

Tomorrow’s
Schedule • 02:00 Whiteboard Learning
Session (Jeff Hawkins)
• 04:00 Hackathon Demos!

Upstairs
3rd Floor Expansion 30 stations, 1 storage, 1 conf. room, 3 offices, co. mtg area
big projector wall
women’s
storage
you are
here
eric summit omid
fooseball
room
bryan
jocelyn
company mtg area
currently rented but have rofr
santhosh
nadia
matt
jon
kalpesh
ankur
patrick
brie
kari vijay
mamta
jervey
natasha
pat
fish bowl scrumroom
don
walid
aziz
men’s
open
open
open open
open
open
open

2nd Floor Existing 30 42 desks, 3 conf. rooms, 8 offices
conf. room
mini kitchen
lobby
server room
derek
puja
open open
open
mother’s
room
lunchroom
kitchen?
open joe greg olivier
mini-scrum
women’s
clayton
chris otfefircree n7ce
ceiling opening
landing
sree
andre
anjini
ayla
elita
tyler
carlos
jamison
ashley
cathy
michelle
ian
albert
juan
nick
larry
open
open open
open
open
open
open
open
open
open
open
margi
tara
andy
men’s
open
open
open
maggie
chris
jon
omar
jennifer
Downstairs
food

Pinger Facility
• Coming and going
• Sleep
• Wifi

Protocol
• Badges
• Food and drink
• Cleanliness
• Respect
• Code of Conduct

Communications
• IRC: #nupic on freenode
• Gitter: https://gitter.im/numenta/public
• Use the mailing lists
• Report bugs
• Spread the word: #NupicHack
– Please take pictures, videos, whatever and share
them

Community Announcements
• “nupic.community” GitHub organization
– clortex
– nupic.studio
– nupic.vision
https://github.com/nupic-community
https://github.com/numenta/nupic/wiki/Other-HTM-CLA-projects

NuPIC Studio, by David Ragazzi
https://github.com/nupic-community/nupic.studio
“create a HTM neural network from scratch, train it, collect statistics, and
share it among the members of the community”

HTM Java Port
• https://github.com/numenta/htm.java
• Author: David Ray (cogmission)
• donated to Numenta for management
• full implementation of
– spatial pooling
– temporal memory
1-to-1 correlation between the methods and functions implementing
each algorithm in the Java and Python versions. To this end, it is
estimated that 98% of the Python tests in each module have the exact
same output produced within the Java unit tests and integration tests.

Audience Questions
• Ever been to a hackathon?
• Ever built NuPIC?
• Ever run any examples?
• Ever passed own data into NuPIC?

Your Ideas
https://github.com/numenta/nupic/wiki/2014-Fall-Hackathon

Viewers also liked

A Whole New World [DEMO #4] (2014 Fall NuPIC Hackathon)

Numenta

We'll Always Have Paris

Numenta

Brains, Data, and Machine Intelligence (2014 04 14 London Meetup)

Numenta

Principles of Hierarchical Temporal Memory - Foundations of Machine Intelligence

Numenta

Applications of Hierarchical Temporal Memory (HTM)

Numenta

Sparse Distributed Representations: Our Brain's Data Structure

Numenta

Why Neurons have thousands of synapses? A model of sequence memory in the brain

Numenta

What the Brain says about Machine Intelligence

Numenta

Real-Time Streaming Data Analysis with HTM

Numenta

Science of Anomaly Detection

Numenta

Evaluating Real-Time Anomaly Detection: The Numenta Anomaly Benchmark

Numenta

Detecting Anomalies in Streaming Data

Numenta

Numenta Anomaly Benchmark - SF Data Science Meetup

Numenta

Streaming Analytics: It's Not the Same Game

Numenta

Viewers also liked (14)

A Whole New World [DEMO #4] (2014 Fall NuPIC Hackathon)

We'll Always Have Paris

Brains, Data, and Machine Intelligence (2014 04 14 London Meetup)

Principles of Hierarchical Temporal Memory - Foundations of Machine Intelligence

Applications of Hierarchical Temporal Memory (HTM)

Sparse Distributed Representations: Our Brain's Data Structure

Why Neurons have thousands of synapses? A model of sequence memory in the brain

What the Brain says about Machine Intelligence

Real-Time Streaming Data Analysis with HTM

Science of Anomaly Detection

Evaluating Real-Time Anomaly Detection: The Numenta Anomaly Benchmark

Detecting Anomalies in Streaming Data

Numenta Anomaly Benchmark - SF Data Science Meetup

Streaming Analytics: It's Not the Same Game

Similar to 2014 Fall NuPIC Hackathon Kickoff

Open hackeu introductionb

Murray Rowan

The Well Connected Facility

Ryan Duggan

S1 intro

ruyalarcon

Core Hack Day 2

Kavita Kapoor

Interested in delivering webinars, but don't know where to start? This PowerPoint is from a one hour TechSoup webinar by program manager Kyla Hunt and independent library consultant, author, and trainer Stephanie Gerding on the basics of providing effective webinars. Discover: How is online training different from ace-to-face or in-person training? What planning is involved in designing and delivering a webinar? How do you encourage audience participation and interaction? What are the differences between webinar platforms? Archive available at: http://techsoupforlibraries.org/events/training-an-invisible-audience-delivering-effective-webinars

Training an Invisible Audience

TechSoup for Libraries

Many modern day citizen science projects are powered by mobile and web technologies, which enable ordinary citizens around the globe to take part in science research, and open up many fields of science to the participation of volunteers for the first time. These same underlying technologies also provide a unique opportunity for the co-creation of new tools, and the creative application of existing citizen science platforms. One way to harness this is through 'creative collaboration' events such as Hack Days, Code Sprints and ThinkCamps. Ever since the Hackathon and Hack Day event formats were first invented in the early 2000's the number and range of these 'un-conference' events have continued to grow in popularity as a creative outlet for developers and 'makers', and a way to enhance software & platform development while engaging with a wider community of participants externally. These events have long since expanded beyond their initial software developer orientation and for the past decade have alsobeen applied to an increasingly wide range of subjects -such as Science. In this talk I will outline the unique properties of a range of creative collaboration event formats and describe how can they be used as a tool to achieve outcomes such as increased engagement and innovation. I will also share lessons learned in running the first Citizen Science Hack Days at the London Citizen Cyberscience Summits and ECSA2016, and make recommendations for future event organisers, Citizen Science project owners, and policy makers.

CitSci Association Conference 2017 - Hack Days & ThinkCamps for Citizen Science

Margaret Gold

Introduction to Open Source, Apache and Apache Way

Srinath Perera

JupyterHub - A "Thing Explainer" Overview

Carol Willing

CC Salon Seoul

Brian Herbert

Matriux is the first full-fledged Debian-based security distribution designed for penetration testing and forensic investigations. Although it is primarily designed for security enthusiasts and professionals, it can also be used by any Linux user as a desktop system for day-to-day computing. Besides standard Debian software the Matriux Arsenal contains a huge collection of more than 350 most powerful and versatile security and penetration testing tools with around 20-50 more tools being added every release cycle of 6 months. Matriux comes with a custom-built Linux kernel to provide better performance and higher support for hardware to work even with a Pentium IV and 512 MB RAM comfortably. Matriux was first released in 2009 under code name “lithium” and then followed by versions like “xenon” based on Ubuntu. Matriux “Krypton” then followed in 2011 where we moved our system to Debian. Other versions followed for Matriux “Krypton” with v1.2 and then Ec-Centric in 2012. This year we are working releasing Matriux “Leandros” which is currently in beta testing and a major revamp over the existing system. Matriux arsenal is divided into sections with a broader classification of tools for Reconnaissance, Scanning, Attack Tools, Frameworks, Radio (Wireless), Digital Forensics, Debuggers, Tracers, Fuzzers and other miscellaneous tool providing a wider approach over the steps followed for a complete penetration testing and forensic scenario. Although there are were many questions raised regarding why there is a need for another security distribution while there is already one. We believed and followed the free spirit of Linux in making one. We always tried to stay updated with the tool and hardware support and so include the latest tools and compile a custom kernel to stay abreast with the latest technologies in the field of information security. Matriux is also designed to run from a Live environment like a CD/ DVD or USB stick which can be helpful in computer forensics and data recovery for forensic analysis, investigations and retrievals not only from Physical Hard drives but also from Solid state drives and NAND flashes used in smart phones like Android and iPhone. With Matriux we also support and work with the projects and tools that have been discontinued over time and also keep track with the latest tools and applications that have been developed and presented in the recent conferences.

Matriux Leandros - BSidesLV 2013

Prajwal Panchmahalkar

Python-data-science.pptx

KabileshCm

Python Meetup: The Origins

Nicola Costantino

Fablabs – Innovation by Doing

Peter Troxler

Edge Talks 4 December - Hacked off? Get hacking

NHS Improving Quality

OpenAerialMap: A Distributed Commons for Searching and Hosting Free Imagery

Kate Chapman

How Build Infrastructure Powers the Node.js Foundation

Gibson Fahnestock

The Case of the Ouch! Demoing Inaccessible User Experiences to Bring Organiza...

Angela M. Hooker

Penn State is taking a serious look at the educational possibilities of games, virtual worlds, and simulations. This session presented the trials and tribulations of building the Educational Gaming Commons (EGC) at Penn State, from the initial need expressed by faculty to the construction of a state-of-the-art research lab. Now in its second year, the EGC is building “open” games for faculty, sponsoring research in virtual worlds, and assisting departments in simulation construction. How did we do it? Examples of current work, infrastructure of the EGC and EGC Lab, ongoing initiatives, and future directions were shared. Brett Bixler, Pennsylvania State University

EGC Presentation at NMC 2010 Symposium

Brett Bixler

Dark Web and Privacy

Brian Pichman

Jupyter: A Gateway for Scientific Collaboration and Education

Carol Willing

Similar to 2014 Fall NuPIC Hackathon Kickoff (20)

Open hackeu introductionb

The Well Connected Facility

S1 intro

Core Hack Day 2

Training an Invisible Audience

CitSci Association Conference 2017 - Hack Days & ThinkCamps for Citizen Science

Introduction to Open Source, Apache and Apache Way

JupyterHub - A "Thing Explainer" Overview

CC Salon Seoul

Matriux Leandros - BSidesLV 2013

Python-data-science.pptx

Python Meetup: The Origins

Fablabs – Innovation by Doing

Edge Talks 4 December - Hacked off? Get hacking

OpenAerialMap: A Distributed Commons for Searching and Hosting Free Imagery

How Build Infrastructure Powers the Node.js Foundation

The Case of the Ouch! Demoing Inaccessible User Experiences to Bring Organiza...

EGC Presentation at NMC 2010 Symposium

Dark Web and Privacy

Jupyter: A Gateway for Scientific Collaboration and Education

More from Numenta

Deep learning at the edge: 100x Inference improvement on edge devices

Numenta

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ Neuromodulators are signalling chemicals in the brain, which control the emergence of adaptive learning and behaviour. Neuromodulators including dopamine, acetylcholine, serotonin and noradrenaline operate on a spectrum of spatio-temporal scales in tandem and opposition to reconfigure functions of biological neural networks and to regulate global cognition and state transition. Although neuromodulators are important in shaping cognition, their phenomenology is yet to be fully realized in deep neural networks (DNNs). In this talk, we will give an overview of the biological organizing principles of neuromodulators in adaptive cognition and highlight the competition and cooperation across neuromodulators.

Brains@Bay Meetup: A Primer on Neuromodulatory Systems - Srikanth Ramaswamy

Numenta

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ A hallmark of intelligence is the ability to learn new flexible, cognitive behaviors - that is, behaviors that require discovering, storing and exploiting novel information for each new instance of the task. In meta-learning, agents are trained with external algorithms to learn one specific cognitive task. However, animals are able to pick up such cognitive tasks automatically, as a result of their evolved neural architecture and synaptic plasticity mechanisms, including neuromodulation. Here we evolve neural networks, endowed with plastic connections and reward-based neuromodulation, over a sizable set of simple meta-learning tasks based on a framework from computational neuroscience. The resulting evolved networks can automatically acquire a novel simple cognitive task, never seen during evolution, through the spontaneous operation of their evolved neural organization and plasticity system. We suggest that attending to the multiplicity of loops involved in natural learning may provide useful insight into the emergence of intelligent behavior.

Brains@Bay Meetup: How to Evolve Your Own Lab Rat - Thomas Miconi

Numenta

We receive information about the world through our sensors and influence the world through our effectors. Such low-level data has gradually come to play a greater role in AI during its 70-year history. I see this as occurring in four steps, two of which are mostly past and two of which are in progress or yet to come. The first step was to view AI as the design of agents which interact with the world and thereby have sensorimotor experience; this viewpoint became prominent in the 1980s and 1990s. The second step was to view the goal of intelligence in terms of experience, as in the reward signal of optimal control and reinforcement learning. The reward formulation of goals is now widely used but rarely loved. Many would prefer to express goals in non-experiential terms, such as reaching a destination or benefiting humanity, but settle for reward because, as an experiential signal, reward is directly available to the agent without human assistance or interpretation. This is the pattern that we see in all four steps. Initially a non-experiential approach seems more intuitive, is preferred and tried, but ultimately proves a limitation on scaling; the experiential approach is more suited to learning and scaling with computational resources. The third step in the increasing role of experience in AI concerns the agent’s representation of the world’s state. Classically, the state of the world is represented in objective terms external to the agent, such as “the grass is wet” and “the car is ten meters in front of me”, or with probability distributions over world states such as in POMDPs and other Bayesian approaches. Alternatively, the state of the world can be represented experientially in terms of summaries of past experience (e.g., the last four Atari video frames input to DQN) or predictions of future experience (e.g., successor representations). The fourth step is potentially the biggest: world knowledge. Classically, world knowledge has always been expressed in terms far from experience, and this has limited its ability to be learned and maintained. Today we are seeing more calls for knowledge to be predictive and grounded in experience. After reviewing the history and prospects of the four steps, I propose a minimal architecture for an intelligent agent that is entirely grounded in experience.

Brains@Bay Meetup: The Increasing Role of Sensorimotor Experience in Artifici...

Numenta

In this talk, I will propose a conceptual framework sketching a path toward open-ended skill acquisition through the coupling of environmental, morphological, sensorimotor, cognitive, developmental, social, cultural and evolutionary mechanisms. I will illustrate parts of this framework through computational experiments highlighting the key role of intrinsically motivated exploration in the generation of behavioral regularity and diversity. Firstly, I will show how some forms of language can self-organize out of generic exploration mechanisms without any functional pressure to communicate. Secondly, we will see how language — once invented — can be recruited as a cognitive tool that enables compositional imagination and bootstraps open-ended cultural innovation. For more:

Brains@Bay Meetup: Open-ended Skill Acquisition in Humans and Machines: An Ev...

Numenta

Most current deep neural networks learn from a static data set without active interaction with the world. We take a look at how learning through a closed loop between action and perception affects the representations learned in a DNN. We demonstrate how these representations are significantly different from DNNs that learn supervised or unsupervised from a static dataset without interaction. These representations are much sparser and encode meaningful content in an efficient way. Even an agent who learned without any external supervision, purely through curious interaction with the world, acquires encodings of the high dimensional visual input that enable the agent to recognize objects using only a handful of labeled examples. Our results highlight the capabilities that emerge from letting DNNs learn more similar to biological brains, though sensorimotor interaction with the world. For more:

Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...

Numenta

SBMT 2021: Can Neuroscience Insights Transform AI? - Lawrence Spracklen

Numenta

Nick Ni (Xilinx) and Lawrence Spracklen (Numenta) presented a talk at the FGPA Conference Europe on July 8th, 2021. In this talk, they presented a neuroscience approach to optimize state-of-the-art deep learning networks into sparse topology and how it can unlock significant performance gains on FPGAs without major loss of accuracy. They then walked through the FPGA implementation where they exploited the advantage of sparse networks with a unique Domain Specific Architecture (DSA).

FPGA Conference 2021: Breaking the TOPS ceiling with sparse neural networks -...

Numenta

BAAI Conference 2021: The Thousand Brains Theory - A Roadmap for Creating Mac...

Numenta

Jeff Hawkins presents a talk on "How the Brain Uses Reference Frames to Model the World, Why AI Needs to do the Same." In this talk, he gives an overview of The Thousand Brains Theory and discusses how machine intelligence can benefit from working on the same principles as the neocortex. This talk was first presented at the NAISys conference on November 10, 2020. You can find a re-recording of the talk here: https://youtu.be/mGSG7I9VKDU

Jeff Hawkins NAISys 2020: How the Brain Uses Reference Frames, Why AI Needs t...

Numenta

In this research meeting, guest Stephen Omohundro gave a fascinating talk on GPT-3, the new massive OpenAI Natural Language Processing model. He reviewed the network architecture, training process, and results in the context of past work. There was extensive discussion on the implications for NLP and for Machine Intelligence / AGI. Link to GPT-3 paper: https://arxiv.org/abs/2005.14165 Link to YouTube recording of Steve's talk: https://youtu.be/0ZVOmBp29E0

OpenAI’s GPT 3 Language Model - guest Steve Omohundro

Numenta

CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...

Numenta

Sparsity In The Neocortex, And Its Implications For Machine Learning

Numenta

Recent advances in reverse engineering the neocortex reveal that it is a highly-distributed sensory-motor modeling system. Each cortical column learns complete models of observed objects through movement and sensation. The columns use long-range connections to vote on what objects are currently being observed. In this talk, we introduce the key elements of this theory and describe how these elements can be introduced into current machine learning techniques to improve their capabilities, robustness, and power requirements.

The Thousand Brains Theory: A Framework for Understanding the Neocortex and B...

Numenta

Jeff Hawkins Human Brain Project Summit Keynote: "Location, Location, Locatio...

Numenta

Location, Location, Location - A Framework for Intelligence and Cortical Comp...

Numenta

Have We Missed Half of What the Neocortex Does? A New Predictive Framework ...

Numenta

Locations in the Neocortex: A Theory of Sensorimotor Prediction Using Cortica...

Numenta

The Predictive Neuron: How Active Dendrites Enable Spatiotemporal Computation...

Numenta

These are Matt Taylor's slides from the AI Singapore Meetup on May 17, 2018. Abstract: Today’s wave of AI technology is still being driven by the ANN neuron pioneered decades ago. Hierarchical Temporal Memory (HTM) is a realistic biologically-constrained model of the pyramidal neuron reflecting today’s most recent neocortical research. This talk will describe and visualize core HTM concepts like sparse distributed representations, spatial pooling and temporal memory. Strong AI is a common goal of many computer scientists. So far, machine learning techniques have created amazing results in narrow fields, but haven’t produced something we could all call “intelligent”. Given recent advances in neuroscience research, we know a lot more about how neurons work together now than we did when ANNs were created. We believe systems with a more realistic neuronal model will be more likely to produce Strong AI. Hierarchical Temporal Memory is a theory of intelligence based upon neuroscience research. The neocortex is the seat of intelligence in the brain, and it is structurally homogeneous throughout. This means a common algorithm is processing all your sensory input, no matter which sense. We believe we have discovered some of the foundational algorithms of the neocortex, and we’ve implemented them in software. I’ll show you how they work with detailed dynamic visualizations of Sparse Distributed Representations, Spatial Pooling, and Temporal Memory.

The Biological Path Toward Strong AI by Matt Taylor (05/17/18)

Numenta

More from Numenta (20)