Top Banner
Access to Modern Multivariate Data Analysis Pengchao Si (司鹏超) Shandong University 08-09-2011
34

Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Jul 13, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Access to Modern Multivariate Data Analysis

Pengchao Si (司鹏超)Shandong University

08-09-2011

Page 2: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

The world is multivariate……

From www.theblessednaturalist.com

Page 3: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Woman With Weather ?

dreamstime.com

Healthy conditionsSocial environmentLove indexFood & drinkShopping requirements鸭梨很大

(and so on……)

Page 4: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Health status also depends on several factors:genes,social position,eating habits,stress……

Page 5: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Age

Energy

Page 6: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Why to learn Multivariate Data Analysis?

• Explanation of a social or physical phenomenon must be tested by gathering and analyzing data

• Complexities of most phenomena require an investigator to collect observations on many different variables

Page 7: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Why to learn Multivariate Data Analysis?(MVDA)

We are Materials Men! (M_M)

Page 8: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Access to Modern Multivariate Data Analysis

OverviewOverview

Course Objective...Introduce fundamental concepts and methods in

multivariate data analysisYou will learn about:

• methodology to analyze data• how to do multivariate data analysis• processing multivariate data via professional software

This course will help you to:• train methodology properly• use multivariate data analysis in practice• improve you English and team spirit

Page 9: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Associ. Prof.: Pengchao Si88399858 (office)[email protected]

Course outline

Time: The 1st Semester Annual (Fall semster)L7-8, Thursday (16:00 - 18:00)

Location: South-Loop Campus 5-202

Activities:• to present methods for data analysis• to announce reading and group work• to take quizzes and final oral defence

Page 10: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Course outline

Teaching purposes:This course aims to acquaint students with

fundamental concepts and methods of multivariate data analysis via an English teaching model.

Through online experimental work, well-known professional software, Unscrambler will be introduced to the students.

At the same time, English capability of students will be improved and strengthened.

In the end, students would understand the basic concepts and methods of multivariate data analysis.

Page 11: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Course outlineScheduleI Overview for Multivariate data Analysis(6 hrs)

1 Overview2. An Introduction of Multivariate Methods 3. A Review of Statistical Concepts and Methods

II Preparing For a MV Analysis (6 hrs)4. Examining Your Data5. Principal Components Analysis6. Factor Analysis

III Dependence Techniques (12 hrs)7. Multiple Regression Analysis8. Principle Component Regression (PCR) 9. Partial Least Squares Regression (PLS)

IV Introduction for Data Analysis Software (8 hrs)11. Brief for statistic software 12. Introduction for Unstrambler13. Experimental work

Page 12: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Course outline

• Theoretical part 28 hrsPractical part 4 hrs

• Software: Unscrambler X

• Fully English teaching with group work

• Fully English oral defence (Pass / No pass)

Page 13: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Course outline

• Course website (building……)

• References: 1.《多元统计分析与应用》

余锦华、杨维权

2.《数据分析》(第二版)范金城、梅长林

More on

Page 14: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

References:

Analyzing Multivariate DataJames Lattin, Douglas Carroll, Paul Green

Multivariate Data Analysis (7th Edition) Joseph F. Hair, William C. Black (Author), Barry J. Babin, Rolph E. Anderson

Page 15: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

References:

Multivariate Data Analysis - in practice Kim H. Esbensen (Author), Dominique Guyot(Editor), Frank Westad(Editor), Lars P. HoumÃller (Editor)

Page 16: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Several variables

—— Multivariate

Only one variable

—— Univariate

Page 17: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Direct and Indirect Observations

http://wi17.com/view.php?id=179

Long distance and high temperature IR thermometer (-10~1450℃)

Page 18: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Data must carry useful information!

Page 19: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Some basic concepts

1. Objects are the entities on which the measurements are taken. Eg. person, items……

2. Variables are the aspects of the objects that are measure. Eg. size, weight……

Page 20: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Some basic concepts

Measurement Scales1. Nonmetric Measurement Scales1) Nominal Scales Data are data described

categorically (根据类别).Eg. lady is 1; man is 2.

2) Ordinal Scales Data are ranked data.Eg. which fruits do you prefer, orange, apple, pear,

banana, or Durian? Banana > Orange > Pear > Apple > Durian

Page 21: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Some basic concepts2. Metric Measurement Scales

1) Interval Scales Data allow us to say how much more of the measured characteristic is possessed by one object over another.

Eg. Preference Level Scale Value

Very high preference 5

High preference 4

Moderate preference 3

Low preference 2

Very low preference 1

Page 22: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Some basic concepts

2) Ratio Scales Data have the same properties as interval scale data but also possesses a meaningful origin.

Page 23: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

X / Y relationship

X —— measured variables Object vector

Y —— desired property

Y is the function of X.

Multivariate Data Analysis - in practice Kim H. Esbensen et.al.

Page 24: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Multivariate Data Analysis - in practice Kim H. Esbensen et.al.

Page 25: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

What Is Multivariate Analysis?Statistical methodology to analyze data with measurements on many variables

L

L

L

controllable factors

uncontrollable factors

input output

Process

Page 26: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Types of Multivariate Techniques

Generally, multivariate data analysis includes: principle components analysis (PCA)factor analysiscluster analysis discriminant analysisand so on…

Which method you choose depends on the type of answer you want to get out of data analysis.

Page 27: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Purposes of using multivariate data analysis

Here in this course:

1. Data description (explorative data structure modeling)

2. Discrimination and classification3. Regression and prediction

Page 28: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Data description (explorative data structure modeling)

A large part of multivariate data analysis is concerned with revealing the intrinsic data structures visually by suitable graphs. Eg. Yields (产率) in organic synthesis.

Principal component Analysis (PCA) is a promising method that frequently used for data description and explorative data structure modeling.

Page 29: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Principal component Analysis(主成分分析)

= +Love LierLovelier

Information metrix = Structure + Noise

Page 30: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Discrimination and classification

Discrimination deals with the separation of groups of data.

Classification is used to say which groups are relevant to models.

Page 31: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Regression and prediction

Regression is an approach for relating two sets of variables to each other.This often happens to Indirect Observations.

This course will mainly introduce regression methods Principle Component Regression (PCR) and Partial Least Squares Regression (PLS).

Page 32: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Regression and predictionPrediction means determine Y-values for new X-objects, based on a previously estimated or calibrated X-Y model.

Page 33: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Summery

1. World is multivariate. Why to learn multivariate data analysis?

2. Overview of this course3. Basic concepts and brief methods

of multivariate data analysis

Page 34: Access to Modern Multivariate Data Analysiscourse.sdu.edu.cn/Download/59993e9b-579e-4ef3-8747-5a07... · 2012-12-16 · Course outline Teaching purposes: This course aims to acquaint

Thanks for your attention!