•識N四uR,識&Data MiningKaM 1Hu&出?RIc模

照身t身–立集高集高针照身t身–立集高集高针照身t身–立集高集高针照身t身–立集高集高针

烈种精花照烈种精花照烈种精花照烈种精花照媒媒媒媒群群群群群–群–群–群–

1

必嵌康康必嵌康康必嵌康康必嵌康康暴暴暴暴必施必施必施必施

[email protected]

架统计与数学要相互欣赏统计与数学要相互欣赏统计与数学要相互欣赏统计与数学要相互欣赏

、、、、、、、、

--

Statistics Trend Trend Statistics

--Data Science

Dataology

联邮集金高邮金––联邮集金高邮金––联邮集金高邮金––联邮集金高邮金––

媒媒媒媒媒媒媒媒善–照金身首集高针–w集t长––照溺脚溺––器–––康康–环特激群花溺群虽–善–照金身首集高针–w集t长––照溺脚溺––器–––康康–环特激群花溺群虽–善–照金身首集高针–w集t长––照溺脚溺––器–––康康–环特激群花溺群虽–善–照金身首集高针–w集t长––照溺脚溺––器–––康康–环特激群花溺群虽–

必嵌康康–获精种–息息康–联烈益特範烈特–www密s邮集金高邮金验身针密o龐针必嵌康康–获精种–息息康–联烈益特範烈特–www密s邮集金高邮金验身针密o龐针必嵌康康–获精种–息息康–联烈益特範烈特–www密s邮集金高邮金验身针密o龐针必嵌康康–获精种–息息康–联烈益特範烈特–www密s邮集金高邮金验身针密o龐针

ClusterComputing

DistributedComputing

SuperComputer

7

GridComputing

UtilityComputing

CloudComputing

理oo针首金立身p群金量u邮金理环联

激集针脚身过首金

联身身联联身身联联身身联联身身联

联oftw身龐金–身s–身–联金龐v集邮金联oftw身龐金–身s–身–联金龐v集邮金联oftw身龐金–身s–身–联金龐v集邮金联oftw身龐金–身s–身–联金龐v集邮金

益益益益益益益益身身联身身联身身联身身联 I2身身联

益高fo龐验身t集o高–又–集高t金首首集针金高邮金益高fo龐验身t集o高–又–集高t金首首集针金高邮金益高fo龐验身t集o高–又–集高t金首首集针金高邮金益高fo龐验身t集o高–又–集高t金首首集针金高邮金身s–身–联金龐v集邮金身s–身–联金龐v集邮金身s–身–联金龐v集邮金身s–身–联金龐v集邮金

8

益身身联益身身联益身身联益身身联

益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金

網身身联網身身联網身身联網身身联

網首身tfo龐验–身s–身–联金龐v集邮金網首身tfo龐验–身s–身–联金龐v集邮金網首身tfo龐验–身s–身–联金龐v集邮金網首身tfo龐验–身s–身–联金龐v集邮金


Speech/WritingSpeech/Writing

XML/SOAPXML/SOAPHTTP/HTMLHTTP/HTMLSMTPSMTP Email ClientsEmail Clients

Web BrowsersWeb Browsers

WiWi--Fi/BroadbandFi/BroadbandDevicesDevices

Web ServicesWeb Services

Rights ManagementRights ManagementTrusted Computing HardwareTrusted Computing Hardware

MouseMouse

Cloud ComputingCloud Computing

PC ArchitecturePC ArchitectureDOSDOS SpreadsheetsSpreadsheets

Word ProcessorsWord Processors

PCPCMid 80sMid 80s

InternetInternetMid 90sMid 90s

ApplicationsApplicationsLate 80sLate 80s--Mid 90sMid 90s

Web AppsWeb AppsMid 00s Mid 00s -- . . .. . .

TodayToday

MouseMouseGUIGUILANsLANs

vs密vs密vs密vs密

益激立益激立益激立益激立蓋身tso高蓋身tso高蓋身tso高蓋身tso高

康嵌嵌康嵌嵌康嵌嵌康嵌嵌益激立益激立益激立益激立

益激立益激立益激立益激立

施嵌施嵌施嵌施嵌必始施嵌嵌必始施嵌嵌必始施嵌嵌必始施嵌嵌康描康描康描康描

應應應應

必必必必描嵌嵌描嵌嵌描嵌嵌描嵌嵌

益激立益激立益激立益激立

14

(Cloud(Cloud(Cloud(Cloud Computing)Computing)Computing)Computing)

理oo针首金始理验身集首始虽ou脚u过金始

理oo针首金照o邮s始理oo针首金脚身首风始集理oo针首金始

理oo针首金烈身首金高量身龐

始虽溺症精精始溺立溺融精範

理oo针首金

蓋金过–特验身集首

虽ou脚u过金

17

SuperComputer

Roadrunner

IBMDepartment of Energy

National Nuclear Security AdministrationNNSA

18

着身针u身龐媒着身针u身龐烈龐身y–藏脚拆

精pt金龐o高溺立照益st身高过u首益激立群o身量龐u高高金龐

康密操拆–p金t身f首op属s

便便

ClusterComputing

属属属属

網获立網获立網获立網获立立網益立網益立網益立網益

SuperComputer

22

網获立網获立網获立網获立立網益立網益立網益立網益

康暴描嵌~康暴描嵌~康暴描嵌~康暴描嵌~

•Cluster

Computing


SuperComputer

23

•• E-MAIL [email protected]

烈網花烈網花烈網花烈網花

ClusterComputing


SuperComputer

24

理首o过us

康暴暴嵌~

GridComputing

益脚益脚益脚益脚

ClusterComputing


SuperComputer

25

环龐o验–益激立始

GridComputing

UtilityComputing

ClusterComputing


SuperComputer

26

GridComputing

UtilityComputing

CloudComputing

理oo针首金立身p群金量u邮金理环联

激集针脚身过首金

2011/11/16 27– &

照溺脚溺照溺脚溺照溺脚溺照溺脚溺烈金高t金龐––烈金高t金龐––烈金高t金龐––烈金高t金龐––媒媒媒媒媒媒媒媒每每每每泄泄泄泄

1. 遗C ?

2. V.鲸. ?

3. ?3. ?

4. ?

学ata Center

照身t身–烈金高t金龐–理龐owt长

1/17/2007 31

溺高–益量金身–蓋长os金–脚集验金–症身s–烈o验金

Nortel Steel Enclosure

Containerized telecom equipment

Sun Project Black Box

242 systems in 20’

32

Rackable Systems

1,152 Systems in 40’

Rackable Systems Container

Cooling Model

Caterpillar

Portable Power

联长集pp集高针–烈o高t身集高金龐–身s–照身t身–烈金高t金龐–立o量u首金联长集pp集高针–烈o高t身集高金龐–身s–照身t身–烈金高t金龐–立o量u首金联长集pp集高针–烈o高t身集高金龐–身s–照身t身–烈金高t金龐–立o量u首金联长集pp集高针–烈o高t身集高金龐–身s–照身t身–烈金高t金龐–立o量u首金

33

花高集t–of–照身t身–烈金高t金龐–理龐owt长

1/17/2007 34

立身高uf身邮tu龐集高针–又–症属蓋–溺量验集高密–

联身v集高针s

1/17/2007 35

联yst金验s–又–網ow金龐–照金高s集ty

1/17/2007 36

37

蓋集高量ows

理oo针首金

溺验身zo高

虽身长oo

38

虽身长oo

密密

联身身联

联oftw身龐金–身s–身–联金龐v集邮金

39

IaaSInfrastructure as a Service

網身身联

網首身tfo龐验–身s–身–联金龐v集邮金

Amazon

EC2

Google

App Engine

Microsoft

Azure

Yahoo

Hadoop

Iaas/Paas Paas Paas Software

Compute/

Storage

Web application

Web and non-web

Software

OS on Xen Application OS through Map / Reduce

40

hypervisor container Fabric controller

Architecture

EC2 Command-line tools

Web-based Administratio

n console

Windows Azure portal

Command line and web

APIs yes yes yes yes

yes maybe yes no

AMI (Amazon

Machine Image)

Python .NET framework

Java,

照身t身–立集高集高针

Database systems, Database systems, Database systems, Database systems, Data Warehouses, Data Warehouses, Data Warehouses, Data Warehouses, OLAPOLAPOLAPOLAP

Machine Machine Machine Machine learninglearninglearninglearning

Statistical and data Statistical and data Statistical and data Statistical and data analysis methodsanalysis methodsanalysis methodsanalysis methods

OLAPOLAPOLAPOLAP

VisualizationVisualizationVisualizationVisualization

Mathematical Mathematical Mathematical Mathematical programmingprogrammingprogrammingprogramming

High High High High performance performance performance performance computingcomputingcomputingcomputing

Data MiningData MiningData MiningData Mining

烈群益联網媒照立

Business Business Business Business UnderstandingUnderstandingUnderstandingUnderstanding

Data PreparationData PreparationData PreparationData Preparation

Data Data Data Data UnderstandingUnderstandingUnderstandingUnderstanding

DataDataDataData

EvaluationEvaluationEvaluationEvaluation

ModelingModelingModelingModeling

DeploymentDeploymentDeploymentDeployment

DataDataDataData

SQL Server 2008

SQL Server 2000

43

Binary Classifier ( )Numeric Predictor ( )Time Series ( )C&R TREE ( )Quick Unbiased Efficient Statistical Tree (QUEST )CHAID ( )

照身t身–立集高集高针照身t身–立集高集高针照身t身–立集高集高针照身t身–立集高集高针媒媒媒媒康康康康

CHAID ( )Decision List ( )Regression ( )PCA/Factor ( )Neural Net ( )C5.0 ( )Feature Selection ( )Discriminant Analysis ( )Logistic ( )Generalize Linear Model ( )Cox Regression

照身t身–立集高集高针照身t身–立集高集高针照身t身–立集高集高针照身t身–立集高集高针媒媒媒媒必必必必

Support Vector Machine (SVM )Bayes Net ( )SLRM ( )GRIAprioriCARMA ( )Sequence ClustercSequence ClustercK-Means (K-Means )Kohonen ( )Two-Step ( )Anomaly ( )Random Forests ( )ICA ( )Multivariate adaptive regression spline (MARS )Pmml( )Boosting

SQL server 2008SPSS 17 (PAWS) --IBMSASSQL 2008+Excel (2008)-Data Mining SQL 2008+Excel (2008)-Data Mining Add-inClementine 12.0Statistica 7.0WEKAR � Cloud RR+Excel ADD-IN …….

群特x邮金首

-47-

群特x邮金首群特x邮金首群特x邮金首群特x邮金首


群特x邮金首

群特x邮金首

-48-2011/11/16

群特x邮金首

st身t邮o高高st身t邮o高高st身t邮o高高st身t邮o高高

脚长金–验身st金龐验集高量s–过金长集高量–脚长金–验身st金龐验集高量s–过金长集高量–脚长金–验身st金龐验集高量s–过金长集高量–脚长金–验身st金龐验集高量s–过金长集高量–

st身t邮o高高st身t邮o高高st身t邮o高高st身t邮o高高

脚长o验身s–激身集金龐脚长o验身s–激身集金龐脚长o验身s–激身集金龐脚长o验身s–激身集金龐康暴操康康暴操康康暴操康康暴操康媒媒媒媒

群群群群

– 群属联邮集首身过–善照器烈精立–联金龐v金龐

群特x邮金首善康暴暴施器

-49-

特龐集邮长–範金uw集龐t长特龐集邮长–範金uw集龐t长特龐集邮长–範金uw集龐t长特龐集邮长–範金uw集龐t长康暴應施康暴應施康暴應施康暴應施媒媒媒媒


•http://rcom.univie.ac.at/RExcel

University of Vienna

长ttp架属属龐邮o验密u高集v集金密身邮密身t属

群溺高量环龐集金高量s

密密

-50-

特x邮金首嵌息嵌操

RExcel

-51-

烈o验验身高量金龐群–邮o高so首金

-52-

RC

omm

ander

三

个

部

分

联t身t集st集邮s

理龐身p长s

-53-2011/11/16

理龐身p长s

立o量金首s

照集st龐集过ut集o高s

特x邮金首

-54-2011/11/16

55

56

•

�

Panel

•

57

�ETL Data warehousing

•

�Data Mining OLAP Statistics

•

�

CRM

益益身身联联身身联 I2身身联

联身身联

益高fo龐验身t集o高又益高t金首首集针金高邮金身s–身–联金龐v集邮金

益益身身联 ;I2身身联联身身联

联身身联联身身联联身身联联身身联


益益益益益益益益身身联身身联身身联身身联 I2身身联

益高fo龐验身t集o高–又–集高t金首首集针金高邮金益高fo龐验身t集o高–又–集高t金首首集针金高邮金益高fo龐验身t集o高–又–集高t金首首集针金高邮金益高fo龐验身t集o高–又–集高t金首首集针金高邮金身s–身–联金龐v集邮金身s–身–联金龐v集邮金身s–身–联金龐v集邮金身s–身–联金龐v集邮金

60

益身身联益身身联益身身联益身身联

益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金益高f龐身st龐u邮tu龐金–身s–身–联金龐v集邮金

網身身联網身身联網身身联網身身联

網首身tfo龐验–身s–身–联金龐v集邮金網首身tfo龐验–身s–身–联金龐v集邮金網首身tfo龐验–身s–身–联金龐v集邮金網首身tfo龐验–身s–身–联金龐v集邮金


Speech/WritingSpeech/Writing

XML/SOAPXML/SOAPHTTP/HTMLHTTP/HTMLSMTPSMTP Email ClientsEmail Clients

Web BrowsersWeb Browsers

WiWi--Fi/BroadbandFi/BroadbandDevicesDevices

Web ServicesWeb Services

Rights ManagementRights ManagementTrusted Computing HardwareTrusted Computing Hardware

MouseMouse

Cloud ComputingCloud Computing

PC ArchitecturePC ArchitectureDOSDOS SpreadsheetsSpreadsheets

Word ProcessorsWord Processors

PCPCMid 80sMid 80s

InternetInternetMid 90sMid 90s

ApplicationsApplicationsLate 80sLate 80s--Mid 90sMid 90s

Web AppsWeb AppsMid 00s Mid 00s -- . . .. . .

TodayToday

MouseMouseGUIGUILANsLANs

http://www.guidertech.com/02_produter_15.htm

http://www.guidertech.com/02_produter_15.htm

─

•

•

50% 87.5%

88% 89%

81%

• ( 15)

•

••

•

─

RFID

HL7

DATADATA MININGMINING

IntelIntel SQLServerSQLServer UnixUnix

DATADATA MININGMINING UnixUnix55 SQL SQL

Server2008Server2008 UDMUDM 3232 2323 64641111

DATADATA MININGMINING

BASELIIBASELII

1111

DATADATA MININGMININGBIBI

媒媒媒媒

Keyword &

推

薦

知

識

社

群

推

薦

知

識

社

群

推

薦

知

識

社

群

推

薦

知

識

社

群

Data Mining Center

推

薦

知

識

社

群

推

薦

知

識

社

群

推

薦

知

識

社

群

推

薦

知

識

社

群

2004.12004.12 2006.5

2002.32003.1 2005.5

2004.11

2004.12

2002 2006

2006.5

2006.5

2003.92006.12

2002.12

2003.1

2005.3

2005.5

DataMining+ BI (IN Cloud Computing)

Customer-focused Operations-focused Research-focused

Life-time ValueMarket-Basket AnalysisProfiling & SegmentationRetention

Profitability AnalysisPricingFraud DetectionRisk Assessment

Combinatorial ChemistryGenetic ResearchEpidemiology

RetentionTarget MarketAcquisitionKnowledge PortalCross-SellingCampaign ManagementE-Commerce

Risk AssessmentPortfolio ManagementEmployee TurnoverCash ManagementProduction EfficiencyNetwork PerformanceManufacturing Processes

SOP

12

1 11 21 3

70% 30%

F-measureAUCGini

SPSS19

AppServAppServMySQLApache

SPSS19

RPHP

DesignService

•

•

•

•

长ttp架属属康應嵌密康息描密康息應密拆必属集身s

•

•

•

•

•

•

•

•

益脚溺联

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

96.89% 95.64% 97.74% 0.000022Recall 94.81% 92.86% 96.79% 0.00005Precision 92.53% 88.96% 94.37% 0.000158F-measure 93.65% 91.45% 95.49% 0.000085


74.82% 73.65% 76.21% 0.000028Recall 0.18% 0.00% 0.64% 0.000003

50.00%

60.00%

70.00%

80.00%

90.00%

100.00%

Recall•

•

•

•1:3

Recall 0.18% 0.00% 0.64% 0.000003Precision 32.67% 0.00% 100.00% 0.09652F-measure 0.35% 0.00% 1.28% 0.000012



0.00%

10.00%

20.00%

30.00%

40.00%

1:1 1:2 1:3

•

•

必嵌嵌描息

善溺验身zo高密邮o验器

理oo针首金

脚长金–

特邮o高o验集st

理oo针首金

善立集邮龐osoft器溺pp首金

理oo针首金理oo针首金

網烈

激身龐身邮风–精过身验身

获集v金风–磁u高量龐身

溺pps密理ov密益脚

範金w–虽o龐风–

脚集验金s 溺pps密理ov

照脚

t长集高–邮首集金高t

善烈首ou量–烈o验put集高针器

必嵌嵌暴

描激us集高金ss蓋金金风

必嵌嵌暴操

善高集验过us器

康嵌

联验身龐t–

p长o高金理網联

媒

1.

2009 3

必密

联集量金风集邮风溺验身zo高–

特烈必

理oo针首金

媒

息密

應密

善器

漫

步

云

端

，

任

重

而

道

远

任

重

而

道

远

！

Documents

•識N四uR,識&Data MiningKaM 1Hu&出?RIc模