MACHINE LEARNING MICHAEL SHILMAN [email protected] 1 How to detect porn and decide where to live using
Oct 21, 2014
MACHINE LEARNINGMICHAEL SHILMAN
1
How to detect porn and decide where to live using
SCI-FI INSPIRES, TECHNOLOGY DELIVERS...
2001: A Space Odyssey (1968) Infinity Blade for iPhone (2011)
Sci-Fi Technology
TECHNOLOGY DELIVERS... most of the time
Teleportation
Time Travel
Telekinesis
Artificial Intelligence (AI)
Hardware
Software
AI is the last big software problem left
...and has been largely a failure so far.
1960-70’s: CONCEPTS
Basic Theory Demos
Viterbi Decoding (1967) Sutherland’s Sketchpad (1968)
1980’s: MODELING THE BRAINNeuron
Neural Network
Expert
Expert System
ENTER MACHINE LEARNING
Machine Learning is the study of
computer algorithms that improve
automatically through experience.
Tom Mitchell, Machine Learning (1997)
BASIC MACHINE LEARNING
Observations
Labels
X
Yf(x) = yLearn
Male
X = height
Female
Y = gender
REAL-WORLD MACHINE LEARNING
Y - 100’s of labels
X - 1000’s of features
N - Millions of examples
? - Not all data is labeled
? - Some data is mis-labeled
Model spatial context
Model temporal context
Observations
Labels
X
Y
f(x) = y
1990’s: MACHINE LEARNING BASICS
Speech Handwriting OCR
2000’s: BIG DATA
Web Search Collaborative Filtering Porn Detection
2011: PUTTING IT ALL TOGETHER
Apple’s Siri (2011)
=
Modeling the Brain (1980’s)
+
Machine Learning Basics (1990’s)
+
Big Data (2000’s)
SIRI TEARDOWN
SIRI TEARDOWN
Waveform Input Broken into Little Chunks
X(t)
Each Chunk is a phoneme
Y(t)
Find the most likely paths through the
phonemes that match a words from the
dictionary
a
e
i
o
u
f u u d
“food”
SIRI TEARDOWN
Find the most likely paths through the words that make
grammatical sense
Find the most likely sentences that match the
context
Execute a query based on the most
likely sentence
Speak the result to the user
“bet me food” “get me food”dialog
“what would
you like to eat?”
SCI-FI INSPIRES, TECHNOLOGY DELIVERS?
2001: A Space Odyssey (1968) Apple’s Siri (2011)
Sci-Fi Technology
TECHNOLOGY DELIVERS? TIME WILL TELL
Good Bad Ugly
http://siriouslyweird.tumblr.com/
WHAT’S NEXT?
Modeling the Brain (1980’s)
+
Machine Learning Basics (1990’s)
+
Big Data (2000’s)
?????? ???
??? ??????
WHAT’S NEXT ... BIG DECISIONS
What to Buy? Where to Live? Who to Marry?
WHAT’S NEXT ... HUMAN STEERING
WHAT’S NEXT? NEED MORE SCI-FI!
Sci-Fi Technology
?????? ???
??? ??????