Top Banner
WINDOWS AZURE MARKETPLACE DATAMARKET OVERVIEW [email protected]
17

WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Aug 02, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

WINDOWS AZURE MARKETPLACE

DATAMARKET OVERVIEW

[email protected]

Page 3: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Why DataMarket?

Information

marketplace

Simple

distribution

Easy

discovery

and sign up

Data

providers

Developers

IWs

ISVs

Page 4: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Exploring DataMarket

Page 5: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

DataMarket APIs

• OData-based APIs for access to the service

• Query language over HTTP

• Standardized metadata

• Server-based filtering and sorting

• Pagination for large result sets

• Open standard (www.odata.org)

• Support for a lot of languages, including C#, VB.NET, PHP, Objective C, etc.

• ATOM feed as response

• Authentication using DataMarket account key

• HTTP basic authentication

• Secured through SSL

Page 6: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Consuming a DataMarket Dataset

Page 7: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

DataMarket Architecture

Page 8: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Processing user requests

Page 9: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Reaching out to content provider’s data

Page 10: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Scaling out user databases

Page 11: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Monitoring

• Discover issues before customer!

• Build monitoring as Windows Azure web role

• Deployed to multiple data centers (leverage Azure infrastructure)

• Executes sample queries on regular base

• Stores result in Windows Azure Table

• Logs transferred on a regular basis to SQL Azure

• Reporting services to create reports

• Alerting on condition matching

Page 12: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Securing high value data

• Problem: how to secure 3rd party

connection information?

• Solution: Certificates!

• Windows Azure has dedicated certificate

pipeline

• Only small number of people need access to

them

• Connection information encrypted with

final key during publication process

• Certificates to decrypt connection

information on the fly

• Connecting to data sources through SSL

Page 13: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

So why did we do this?

Page 14: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

How do I buy it?

• Free and commercial datasets

• Content provider sets the price

• Two supported subscription models

• Unlimited number of queries per month

• Limited number of queries per month and minute

• Credit card payment

Page 15: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Publishing data in DataMarket

• You are in control of the

• data

• price

• terms of use

• Easy publishing - we create the consumer facing APIs

• Connect to SQL Azure

• Wrap existing web services

• Receive periodic reports and payouts

Page 16: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Discover DataMarket datasets from Office

Page 17: WINDOWS AZURE MARKETPLACE DATAMARKET ...nwds.cs.washington.edu/files/nwds/pdf/Presentation.pdf•Windows Azure has dedicated certificate pipeline •Only small number of people need

Questions?