SlideShare a Scribd company logo
1 of 47
Download to read offline
neuroscience +
machine intelligence
@thefreemanlab |
NYAI
about me:
neuroscientist
open source + open science
@thefreemanlab
janelia.org
star fleet academy
there’s a lot we
don’t know
(2016)
loudon county
public library
hubel and
wiesel
(1959)
V1
V3d
V2d
V3v
V2v
TH
TF
CITv
AITv
PITv
PITd
M
T
CITd
AITd
STPa
FST
STPp
M
STl
MSTd
V4d
V4t
V3A 7aDP
LIP
PIP
VIP
PO
MDP
MIP
Somato-
sensory
Orbito-
frontal
Lateral
prefrontal
Auditory
Olfactory
Motor
46
36
FEF
Dorsal prefrontal
Medial prefrontal
Cingulate
V4v
VOT
ER
ER
HC
LGN
Retina
SC
M
L
I
1 cm
Pulvinar
rosenblatt
PERCEPTRON
(1957)
(1980)fukushima
NEOCOGNITRON
(1985)lecun
HIERARCHICAL LEARNING MACHINE
(1986)rumelhart et al.
BACK PROPAGATION
but humans are
way better than
neural nets, right??
(2007)
V1
V3d
V2d
V3v
V2v
TH
TF
CITv
AITv
PITv
PITd
M
T
CITd
AITd
STPa
FST
STPp
M
STl
MSTd
V4d
V4t
V3A 7aDP
LIP
PIP
VIP
PO
MDP
MIP
Somato-
sensory
Orbito-
frontal
Lateral
prefrontal
Auditory
Olfactory
Motor
46
36
FEF
Dorsal prefrontal
Medial prefrontal
Cingulate
V4v
VOT
ER
ER
HC
LGN
Retina
SC
M
L
I
1 cm
Pulvinar
V1
V3d
V2d
V3v
V2v
TH
TF
CITv
AITv
PITv
PITd
M
T
CITd
AITd
STPa
FST
STPp
M
STl
MSTd
V4d
V4t
V3A 7aDP
LIP
PIP
VIP
PO
MDP
MIP
Somato-
sensory
Orbito-
frontal
Lateral
prefrontal
Auditory
Olfactory
Motor
46
36
FEF
Dorsal prefrontal
Medial prefrontal
Cingulate
V4v
VOT
ER
ER
HC
LGN
Retina
SC
M
L
I
1 cm
Pulvinar
?
?
?
?
corey ziemba
david heeger
eero simoncelli
tony movshon
@nyu
ProportionofcellsProportionofcells
V1
n = 102
V2
n = 103
Modulation index
−0.5 0 0.5
0
0.4
−0.5 0 0.5
0
0.4
while we were
in the lab…
(2012)
science
/
engineering
(2015)
(2015)
matthias bethge
leon gatys
(2000)
javiar portilla
eero simoncelli
(2011)
open source has
enabled and
democratized
machine intelligence
… and science
needs to catch up!
what’s next?
(2016-?)
@sofroniewn
two photon
mesoscope
nicholas sofroniew
dan flicking
karel svoboda
tactile
virtual
reality
nicholas
sofroniew
crowdsourcing
human
intelligence
HEXAWORLD!
labyrinth / cool
deep mind papers
labyrinth / cool
deep mind papers
science
/
engineering
science
+
engineering
thanks!

More Related Content

Viewers also liked

NYAI - Understanding Music Through Machine Learning by Brian McFee
NYAI - Understanding Music Through Machine Learning by Brian McFeeNYAI - Understanding Music Through Machine Learning by Brian McFee
NYAI - Understanding Music Through Machine Learning by Brian McFeeRizwan Habib
 
Virtual Madness @ Etsy
Virtual Madness @ EtsyVirtual Madness @ Etsy
Virtual Madness @ EtsyNishan Subedi
 
NYAI - Commodity Machine Learning & Beyond by Andreas Mueller
NYAI - Commodity Machine Learning & Beyond by Andreas MuellerNYAI - Commodity Machine Learning & Beyond by Andreas Mueller
NYAI - Commodity Machine Learning & Beyond by Andreas MuellerRizwan Habib
 
Machine Learning with scikit-learn
Machine Learning with scikit-learnMachine Learning with scikit-learn
Machine Learning with scikit-learnodsc
 
Mining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started GuideMining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started GuideMatthew Russell
 
Privacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social WebPrivacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social WebMatthew Russell
 
Adaptive Input — Breaking Development Conference, San Diego
Adaptive Input — Breaking Development Conference, San DiegoAdaptive Input — Breaking Development Conference, San Diego
Adaptive Input — Breaking Development Conference, San DiegoJason Grigsby
 
Lessons Learned from Running Hundreds of Kaggle Competitions
Lessons Learned from Running Hundreds of Kaggle CompetitionsLessons Learned from Running Hundreds of Kaggle Competitions
Lessons Learned from Running Hundreds of Kaggle CompetitionsBen Hamner
 
What's coming in 2016? Cognitive Analytics
What's coming in 2016? Cognitive AnalyticsWhat's coming in 2016? Cognitive Analytics
What's coming in 2016? Cognitive AnalyticsSonia Baratas Alves
 
Cognitive Load Theory
Cognitive Load TheoryCognitive Load Theory
Cognitive Load Theorycarolid
 
Web navigation design with respect to cognitive science
Web navigation design with respect to cognitive scienceWeb navigation design with respect to cognitive science
Web navigation design with respect to cognitive scienceAimee Maree Forsstrom
 
Renner Talk Cognitive Load Theory
Renner Talk Cognitive Load TheoryRenner Talk Cognitive Load Theory
Renner Talk Cognitive Load Theoryadamrenner
 
What convnets look at when they look at nudity
What convnets look at when they look at nudityWhat convnets look at when they look at nudity
What convnets look at when they look at nudityRyan Compton
 
What is cognitive load theory and why should you care?
What is cognitive load theory and why should you care?What is cognitive load theory and why should you care?
What is cognitive load theory and why should you care?Jo Hanna Pearce
 
Personalized Intelligence in KOL engagement and why it's all about you.
Personalized Intelligence in KOL engagement and why it's all about you. Personalized Intelligence in KOL engagement and why it's all about you.
Personalized Intelligence in KOL engagement and why it's all about you. Jason Smith
 
Accessible Web Content & Intellectual Disabilities
Accessible Web Content & Intellectual DisabilitiesAccessible Web Content & Intellectual Disabilities
Accessible Web Content & Intellectual DisabilitiesInteractive Accessibility
 
Neuroscience and machine learning
Neuroscience and  machine learningNeuroscience and  machine learning
Neuroscience and machine learningChris Hausler
 
CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni...
 CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni... CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni...
CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni...Charity Learning Consortium
 
Navigation design with respect to cognitive load
Navigation design with respect to cognitive loadNavigation design with respect to cognitive load
Navigation design with respect to cognitive loadAimee Maree Forsstrom
 
The Conversation Gets Interesting: Creating the Adaptive Interface
The Conversation Gets Interesting: Creating the Adaptive InterfaceThe Conversation Gets Interesting: Creating the Adaptive Interface
The Conversation Gets Interesting: Creating the Adaptive InterfaceStephen Anderson
 

Viewers also liked (20)

NYAI - Understanding Music Through Machine Learning by Brian McFee
NYAI - Understanding Music Through Machine Learning by Brian McFeeNYAI - Understanding Music Through Machine Learning by Brian McFee
NYAI - Understanding Music Through Machine Learning by Brian McFee
 
Virtual Madness @ Etsy
Virtual Madness @ EtsyVirtual Madness @ Etsy
Virtual Madness @ Etsy
 
NYAI - Commodity Machine Learning & Beyond by Andreas Mueller
NYAI - Commodity Machine Learning & Beyond by Andreas MuellerNYAI - Commodity Machine Learning & Beyond by Andreas Mueller
NYAI - Commodity Machine Learning & Beyond by Andreas Mueller
 
Machine Learning with scikit-learn
Machine Learning with scikit-learnMachine Learning with scikit-learn
Machine Learning with scikit-learn
 
Mining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started GuideMining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started Guide
 
Privacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social WebPrivacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social Web
 
Adaptive Input — Breaking Development Conference, San Diego
Adaptive Input — Breaking Development Conference, San DiegoAdaptive Input — Breaking Development Conference, San Diego
Adaptive Input — Breaking Development Conference, San Diego
 
Lessons Learned from Running Hundreds of Kaggle Competitions
Lessons Learned from Running Hundreds of Kaggle CompetitionsLessons Learned from Running Hundreds of Kaggle Competitions
Lessons Learned from Running Hundreds of Kaggle Competitions
 
What's coming in 2016? Cognitive Analytics
What's coming in 2016? Cognitive AnalyticsWhat's coming in 2016? Cognitive Analytics
What's coming in 2016? Cognitive Analytics
 
Cognitive Load Theory
Cognitive Load TheoryCognitive Load Theory
Cognitive Load Theory
 
Web navigation design with respect to cognitive science
Web navigation design with respect to cognitive scienceWeb navigation design with respect to cognitive science
Web navigation design with respect to cognitive science
 
Renner Talk Cognitive Load Theory
Renner Talk Cognitive Load TheoryRenner Talk Cognitive Load Theory
Renner Talk Cognitive Load Theory
 
What convnets look at when they look at nudity
What convnets look at when they look at nudityWhat convnets look at when they look at nudity
What convnets look at when they look at nudity
 
What is cognitive load theory and why should you care?
What is cognitive load theory and why should you care?What is cognitive load theory and why should you care?
What is cognitive load theory and why should you care?
 
Personalized Intelligence in KOL engagement and why it's all about you.
Personalized Intelligence in KOL engagement and why it's all about you. Personalized Intelligence in KOL engagement and why it's all about you.
Personalized Intelligence in KOL engagement and why it's all about you.
 
Accessible Web Content & Intellectual Disabilities
Accessible Web Content & Intellectual DisabilitiesAccessible Web Content & Intellectual Disabilities
Accessible Web Content & Intellectual Disabilities
 
Neuroscience and machine learning
Neuroscience and  machine learningNeuroscience and  machine learning
Neuroscience and machine learning
 
CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni...
 CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni... CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni...
CLC Members' Seminar 5th March 2015 - Neuroscience and brain-friendly learni...
 
Navigation design with respect to cognitive load
Navigation design with respect to cognitive loadNavigation design with respect to cognitive load
Navigation design with respect to cognitive load
 
The Conversation Gets Interesting: Creating the Adaptive Interface
The Conversation Gets Interesting: Creating the Adaptive InterfaceThe Conversation Gets Interesting: Creating the Adaptive Interface
The Conversation Gets Interesting: Creating the Adaptive Interface
 

Recently uploaded

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfOverkill Security
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 

Recently uploaded (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 

NYAI - State of Modern Neuroscience + Machine Learning by Jeremy Freeman