This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
January 17, 2001 Data Mining: Concepts and Techniques 1
http://www.cs.sfu.caJanuary 17, 2001 Data Mining: Concepts and Techniques 2
Chapter 4: Data Mining Primitives, Languages, and System Architectures
n Data mining primitives: What defines a data
mining task?
n A data mining query language
n Design graphical user interfaces based on a
data mining query language
n Architecture of data mining systems
n Summary
January 17, 2001 Data Mining: Concepts and Techniques 3
Why Data Mining Primitives and Languages?
n Finding all the patterns autonomously in a database? — unrealistic because the patterns could be too many but uninteresting
n Data mining should be an interactive process n User directs what to be mined
n Users must be provided with a set of primitives to be used to communicate with the data mining system
n Incorporating these primitives in a data mining query languagen More flexible user interaction n Foundation for design of graphical user interfacen Standardization of data mining industry and practice
January 17, 2001 Data Mining: Concepts and Techniques 4
What Defines a Data Mining Task ?
n Task-relevant data
n Type of knowledge to be mined
n Background knowledge
n Pattern interestingness measurements
n Visualization of discovered patterns
January 17, 2001 Data Mining: Concepts and Techniques 5
Task-Relevant Data (Minable View)
n Database or data warehouse name
n Database tables or data warehouse cubes
n Condition for data selection
n Relevant attributes or dimensions
n Data grouping criteria
January 17, 2001 Data Mining: Concepts and Techniques 6
Types of knowledge to be mined
n Characterization
n Discrimination
n Association
n Classification/prediction
n Clustering
n Outlier analysis
n Other data mining tasks
2
January 17, 2001 Data Mining: Concepts and Techniques 7
Background Knowledge: Concept Hierarchies
n Schema hierarchyn E.g., street < city < province_or_state <
countryn Set-grouping hierarchy
n E.g., {20-39} = young, {40-59} = middle_aged
n Operation-derived hierarchyn email address: login-name < department <
university < countryn Rule-based hierarchy
n low_profit_margin (X) <= price(X, P1) and cost (X, P2) and (P1 - P2) < $50
January 17, 2001 Data Mining: Concepts and Techniques 8
Measurements of Pattern Interestingness
n Simplicitye.g., (association) rule length, (decision) tree size
n Certaintye.g., confidence, P(A|B) = n(A and B)/ n (B), classification reliability or accuracy, certainty factor, rule strength, rule quality, discriminating weight, etc.
n Utilitypotential usefulness, e.g., support (association), noise threshold (description)
n Noveltynot previously known, surprising (used to remove redundant rules, e.g., Canada vs. Vancouver rule implication support ratio
January 17, 2001 Data Mining: Concepts and Techniques 9
Visualization of Discovered Patterns
n Different backgrounds/usages may require different forms of representation
n E.g., rules, tables, crosstabs, pie/bar chart etc.
n Concept hierarchy is also important
n Discovered knowledge might be more understandable
when represented at high level of abstraction
n Interactive drill up/down, pivoting, slicing and dicingprovide different perspective to data
n Different kinds of knowledge require different representation: association, classification, clustering, etc.
January 17, 2001 Data Mining: Concepts and Techniques 10
Chapter 4: Data Mining Primitives, Languages, and System Architectures
n Data mining primitives: What defines a data
mining task?
n A data mining query language
n Design graphical user interfaces based on a
data mining query language
n Architecture of data mining systems
n Summary
January 17, 2001 Data Mining: Concepts and Techniques 11
A Data Mining Query Language (DMQL)
n Motivation
n A DMQL can provide the ability to support ad-hoc and interactive data mining
n By providing a standardized language like SQLn Hope to achieve a similar effect like that SQL has on relational
database
n Foundation for system development and evolution
n Facilitate information exchange, technology transfer,
commercialization and wide acceptance
n Design
n DMQL is designed with the primitives described earlier
January 17, 2001 Data Mining: Concepts and Techniques 12
Syntax for DMQL
n Syntax for specification of
n task-relevant data
n the kind of knowledge to be mined
n concept hierarchy specification
n interestingness measure
n pattern presentation and visualization
n Putting it all together — a DMQL query
3
January 17, 2001 Data Mining: Concepts and Techniques 13
Syntax for task-relevant data specification
n use database database_name, or use data
warehouse data_warehouse_name
n from relation(s)/cube(s) [where condition]
n in relevance to att_or_dim_list
n order by order_list
n group by grouping_list
n having condition
January 17, 2001 Data Mining: Concepts and Techniques 14
Specification of task-relevant data
January 17, 2001 Data Mining: Concepts and Techniques 15
Syntax for specifying the kind of knowledge to be mined
n CharacterizationMine_Knowledge_Specification ::=
n DiscriminationMine_Knowledge_Specification ::= mine comparison [as pattern_name] for target_class where target_condition{versus contrast_class_i where contrast_condition_ i}analyze measure(s)
n AssociationMine_Knowledge_Specification ::=
mine associations [as pattern_name]
January 17, 2001 Data Mining: Concepts and Techniques 16
Syntax for specifying the kind of knowledge to be mined (cont.)
v ClassificationMine_Knowledge_Specification ::= mine classification [as pattern_name] analyze classifying_attribute_or_dimension
January 17, 2001 Data Mining: Concepts and Techniques 18
Syntax for concept hierarchy specification (Cont.)
n operation-derived hierarchiesdefine hierarchy age_hierarchy for age on customer as {age_category(1), ..., age_category(5)} := cluster(default, age, 5) < all(age)
n rule-based hierarchiesdefine hierarchy profit_margin_hierarchy on item as level_1: low_profit_margin < level_0: all
if (price - cost)< $50level_1: medium-profit_margin < level_0: all
if ((price - cost) > $50) and ((price - cost) <= $250))
January 17, 2001 Data Mining: Concepts and Techniques 19
Syntax for interestingness measure specification
n Interestingness measures and thresholds can be specified by the user with the statement:
with <interest_measure_name> threshold = threshold_value
n Example:
with support threshold = 0.05with confidence threshold = 0.7
January 17, 2001 Data Mining: Concepts and Techniques 20
Syntax for pattern presentation and visualization specification
n We have syntax which allows users to specify the display of discovered patterns in one or more forms
display as <result_form>n To facilitate interactive viewing at different concept
level, the following syntax is defined:
Multilevel_Manipulation ::= roll up onattribute_or_dimension
¦ drill down onattribute_or_dimension
¦ add attribute_or_dimension ¦ drop
attribute_or_dimension
January 17, 2001 Data Mining: Concepts and Techniques 21
Putting it all together: the full specification of a DMQL query
use databaseAllElectronics_db use hierarchy location_hierarchy for B.addressmine characteristics as customerPurchasing analyze count% in relevance toC.age, I.type, I.place_made from customer C, item I, purchases P, items_sold S,
works_at W, branchwhere I.item_ID = S.item_ID and S.trans_ID = P.trans_ID
and P.cust_ID = C.cust_ID and P.method_paid = ``AmEx'' and P.empl_ID = W.empl_ID and W.branch_ID = B.branch_ID and B.address = ``Canada" and I.price >= 100
with noise threshold= 0.05 display as table
January 17, 2001 Data Mining: Concepts and Techniques 22
Other Data Mining Languages & Standardization Efforts
n Association rule language specificationsn MSQL (Imielinski & Virmani’99)n MineRule (Meo Psaila and Ceri’96)
n Query flocks based on Datalog syntax (Tsur et al’98)n OLEDB for DM (Microsoft’2000)
n Based on OLE, OLE DB, OLE DB for OLAPn Integrating DBMS, data warehouse and data mining
n CRISP-DM (CRoss-Industry Standard Process for Data Mining)n Providing a platform and process structure for effective data
mining
n Emphasizing on deploying data mining technology to solve business problems
January 17, 2001 Data Mining: Concepts and Techniques 23
Chapter 4: Data Mining Primitives, Languages, and System Architectures
n Data mining primitives: What defines a data
mining task?
n A data mining query language
n Design graphical user interfaces based on a
data mining query language
n Architecture of data mining systems
n Summary
January 17, 2001 Data Mining: Concepts and Techniques 24
Designing Graphical User Interfaces based on a data mining query language
n What tasks should be considered in the design GUIs
based on a data mining query language?
n Data collection and data mining query composition
n Presentation of discovered patterns
n Hierarchy specification and manipulation
n Manipulation of data mining primitives
n Interactive multilevel mining
n Other miscellaneous information
5
January 17, 2001 Data Mining: Concepts and Techniques 25
Chapter 4: Data Mining Primitives, Languages, and System Architectures
n Data mining primitives: What defines a data
mining task?
n A data mining query language
n Design graphical user interfaces based on a
data mining query language
n Architecture of data mining systems
n Summary
January 17, 2001 Data Mining: Concepts and Techniques 26
Data Mining System Architectures
n Coupling data mining system with DB/DW systemn No coupling—flat file processing, not recommended
n Loose couplingn Fetching data from DB/DW
n Semi-tight coupling—enhanced DM performancen Provide efficient implement a few data mining primitives in a
DB/DW system, e.g., sorting, indexing, aggregation, histogram analysis, multiway join, precomputation of some stat functions
n Tight coupling—A uniform information processing environmentn DM is smoothly integrated into a DB/DW system, mining query
is optimized based on mining query, indexing, query processing methods, etc.
January 17, 2001 Data Mining: Concepts and Techniques 27
Chapter 4: Data Mining Primitives, Languages, and System Architectures
n Data mining primitives: What defines a data
mining task?
n A data mining query language
n Design graphical user interfaces based on a
data mining query language
n Architecture of data mining systems
n Summary
January 17, 2001 Data Mining: Concepts and Techniques 28
Summary
n Five primitives for specification of a data mining taskn task-relevant datan kind of knowledge to be minedn background knowledgen interestingness measuresn knowledge presentation and visualization techniques
to be used for displaying the discovered patternsn Data mining query languages
n DMQL, MS/OLEDB for DM, etc.n Data mining system architecture
n No coupling, loose coupling, semi-tight coupling, tight coupling
January 17, 2001 Data Mining: Concepts and Techniques 29
References
n E. Baralis and G. Psaila . Designing templates for mining association rules. Journal of Intelligent Information Systems, 9:7-32, 1997.
n Microsoft Corp., OLEDB for Data Mining, version 1.0, http://www.microsoft.com/data/oledb/dm, Aug. 2000.
n J. Han, Y. Fu, W. Wang, K. Koperski, and O. R. Zaiane, “DMQL: A Data Mining Query Language for Relational Databases”, DMKD'96, Montreal, Canada, June 1996.
n T. Imielinski and A. Virmani. MSQL: A query language for database mining. Data Mining and Knowledge Discovery, 3:373-408, 1999.
n M. Klemettinen, H. Mannila , P. Ronkainen, H. Toivonen, and A.I. Verkamo. Finding interesting rules from large sets of discovered association rules. CIKM’94, Gaithersburg, Maryland, Nov. 1994.
n R. Meo, G. Psaila , and S. Ceri. A new SQL-like operator for mining association rules. VLDB'96, pages 122-133, Bombay, India, Sept. 1996.
n A. Silberschatz and A. Tuzhilin. What makes patterns interesting in knowledge discovery systems. IEEE Trans. on Knowledge and Data Engineering, 8:970-974, Dec. 1996.
n S. Sarawagi, S. Thomas, and R. Agrawal. Integrating association rule mining with relational database systems: Alternatives and implications. SIGMOD'98, Seattle, Washington, June 1998.
n D. Tsur, J. D. Ullman, S. Abitboul, C. Clifton, R. Motwani, and S. Nestorov. Query flocks: A generalization of association-rule mining. SIGMOD'98, Seattle, Washington, June 1998.
January 17, 2001 Data Mining: Concepts and Techniques 30