Prof. Wei-Guang Teng ( 鄧維光 ) Dept. of Engineering Science National Cheng Kung University 2013/3/18 Data Knowledge Learning & Mining Crowd
Prof. Wei-Guang Teng (鄧維光 )Dept. of Engineering Science
National Cheng Kung University
2013/3/18
DataKnowledge
Learning&
MiningCrowd
2
Let’s Start with “Data”
• Data– Known facts that can be recorded and have an
implicit meaning
• Database– A collection of related data
Data
BigData
What Are
?
4
Big Data
Data
• Exabyte (EB or 1018 bytes)– 1 EB = 1,000 PB = 1,000,000 TB
• See Big Data - Big Opportunity– http://www.youtube.com/watch?v=e6K0VHz6FVc
5
Problem of Data Overloading
• We are drowning in data, but starving for knowledge!
Data
How to Solve this Problem?
7
Possible Solutions!
Data
Learning&
Mining
8
Machine Learning (機器學習 )
• Machine learning, a branch of artificial intelligence, is about the construction and study of systems that can learn from data
• Example 1: OCR (optical character recognition)– Printed characters are recognized automatically based on
previous examples
• Example 2: Spam Detection– A machine learning system could be trained on email messages
to learn to distinguish between spam and non-spam messages. After learning, it can then be used to classify new email messages into spam and non-spam foldersData
Learning&
Mining
9
Data Mining (資料探勘 )
• To extract interesting patterns from large databases– Interesting: non-trivial, implicit, previously unknown & potentially useful– Patterns: association rules, classification, clustering, ...
Data
Learning&
Mining
10
ML vs. DM
• Machine learning focuses on prediction, based on known properties learned from the training data
• Data mining focuses on the discovery of (previously) unknown properties on the data
Data
Learning&
Mining
11
To Work Together
• See What is Predictive Analytics / Data Mining?– http://www.youtube.com/watch?v=BjznLJcgSFI
Data
Learning&
Mining
Why Collective Intelligence,
not Personalized ?
13
Social Network
• A social structure made up of a set of actors and the dyadic ties between these actors– Social network analysis is to identify local and global patterns,
locate influential entities, and examine network dynamics
Data
Learning&
MiningCrowd
14
Media, Management & Marketing ...
• See A Day in the Life of Social Media– http://www.youtube.com/watch?v=iReY3W9ZkLU
• See The Social Media Revolution 2012-13– http://www.youtube.com/watch?v=0eUeL3n7fDs
Data
Learning&
MiningCrowd
What’s Next?
16
Crowdsourcing (群 外包眾 )
• See Crowdsourcing Evolution– http://www.youtube.com/watch?v=OKMOI9PSQwo
DataKnowledge
Learning&
MiningCrowd
17
Amazon Mechanical Turk
DataKnowledge
Learning&
MiningCrowd
18
Types of Tasks
DataKnowledge
Learning&
MiningCrowd
Questions?