Hierarchical Voting Experts: An Unsupervised Algorithm for Hierarchical Sequence Segmentation Matt Miller and Alex Stoytchev, Developmental Robotics Lab, Iowa State University Our Work •Extend Voting Experts to more general domains •Use VE for unsupervised segmentation of hierarchically structured sequences •Improve accuracy of segmentation by using “top down” Miller and Stoytchev, ICDL 2008 Baby’s task: tupirogolabubedakupadoditupirotupirogolabutupiro… tupiro*golabu*bedaku*padoti*tupiro*tupiro*golabu*tupiro… [Saffran, Aslin et. al. 1996] [Cohen and Adams, 2001] Voting Experts’ task: itwasabrightcolddayinaprilandthecl ockswere… itwas*a*bright*cold*day*in*april*andthe *clockswere… i t w a s a b r i g h t … 1 1 3 4 1 7 6 1 Votes : i t w a s * a * b r i g h t … Interesting because: 1. Entropy metrics very similar to “Statistical cues” of Saffran, Aslin et. al. 2. General model – useful for more than text 3. Surprisingly effective, given Low Internal Entropy High Boundary Entropy
Our Work
Jan 25, 2016
Hierarchical Voting Experts: An Unsupervised Algorithm for Hierarchical Sequence Segmentation Matt Miller and Alex Stoytchev, Developmental Robotics Lab, Iowa State University. [ Saffran , Aslin et. al. 1996]. Baby’s task: tupirogolabubedakupadoditupirotupirogolabutupiro …. - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Hierarchical Voting Experts: An Unsupervised Algorithm for Hierarchical Sequence Segmentation
Matt Miller and Alex Stoytchev, Developmental Robotics Lab, Iowa State University
Our Work•Extend Voting Experts to more general domains•Use VE for unsupervised segmentation of hierarchically structured sequences•Improve accuracy of segmentation by using“top down” information
Miller and Stoytchev, ICDL 2008
Baby’s task: tupirogolabubedakupadoditupirotupirogolabutupiro… tupiro*golabu*bedaku*padoti*tupiro*tupiro*golabu*tupiro…
[Saffran, Aslin et. al. 1996]
[Cohen and Adams, 2001]Voting Experts’ task: itwasabrightcolddayinaprilandtheclockswere…
itwas*a*bright*cold*day*in*april*andthe*clockswere…
i t w a s a b r i g h t …
1 134 17 6 1Votes:
i t w a s * a * b r i g h t …
Interesting because:1. Entropy metrics very similar to “Statistical cues”
of Saffran, Aslin et. al.2. General model – useful for more than text3. Surprisingly effective, given its simplicity
Low Internal EntropyHigh Boundary Entropy
Experiments•Demonstrate that HVE works•Explore the domain of applicability
“Future” Work•Tokenize an audio stream and apply HVE to find breaks•Use artificially generated and spoken audio•Results on “baby talk” and audio CD data are promising
Miller and Stoytchev, ICDL 2008
Hierarchical Voting Experts: An Unsupervised Algorithm for Hierarchical Sequence Segmentation
Other codes:•Morse code•ASCII Octal•Random Code
3rd Voting Expert:•Improves Accuracy•Top-Down Information
Other Experiments:•No Time
Related Documents
