Principles of microservices ndc oslo

PRINCIPLES OF MICROSERVICESSam Newman NDC Oslo 2015

@samnewman#ndcoslo

@samnewman#ndcoslo

Sam Newman

Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS

@samnewman#ndcoslo

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

@samnewman#ndcoslo

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Small Autonomous services that work together, modelled

around a business domain

@samnewman#ndcoslo

@samnewman#ndcoslo http://www.12factor.net/

http://www.12factor.net/

@samnewman#ndcoslo

Strategic Goals Architectural

Principles Design and Delivery

Practices

Enable scalable business More customers/transactions Self-service for customers

Support entry into new markets Flexible operational processes New products and operational processes

Support innovation in existing markets Flexible operational processes New products and operational processes

Reduce inertia Make choices that favour rapid feedback and change, with reduced dependencies across teams.

Eliminate accidental complexity Aggressively retire and replace unnecessarily complex processes, systems, and integrations so that we can focus on the essential complexity.

Consistent interfaces and data flows Eliminate duplication of data and create clear systems of record, with consistent integration interfaces.

No silver bullets Off the shelf solutions deliver early value but create inertia and accidental complexity.

Standard REST/HTTP

Encapsulate legacy

Eliminate integration databases

Consolidate and cleanse data

Published integration model

Small independent Services

Continuous deployment

Minimal customisation of COTS/SAAS

@samnewman#ndcoslo

Small Autonomous services that work together

@samnewman#ndcoslo

Principles Of Microservices

@samnewman#ndcoslo


Modelled Around Business Domain

@samnewman#ndcoslo



Culture Of Automation

@samnewman#ndcoslo



Culture Of Automation Hide Implementation

Details

@samnewman#ndcoslo




Details

Decentralise All The Things

@samnewman#ndcoslo




Details


Deploy Independently

@samnewman#ndcoslo




Details



Consumer First

@samnewman#ndcoslo




Details


Isolate Failure Deploy Independently

Consumer First

@samnewman#ndcoslo




Details



Highly Observable

Consumer First

@samnewman#ndcoslo

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

@samnewman#ndcoslo

@samnewman#ndcoslo




Details



Highly Observable

✔

Consumer First

@samnewman#ndcoslo




Details



Highly Observable

✔

Consumer First

@samnewman#ndcoslo

@samnewman#ndcoslo

3 Months

2 Microservices

@samnewman#ndcoslo

3 Months

2 Microservices

12 Months

10 Microservices

@samnewman#ndcoslo

3 Months

2 Microservices

12 Months

10 Microservices

18 Months

60 Microservices

@samnewman#ndcoslo

Infrastructure Automation

@samnewman#ndcoslo


Automated Testing

@samnewman#ndcoslo


Continuous Delivery

Automated Testing

@samnewman#ndcoslo




Details



Highly Observable

✔ ✔

Consumer First

@samnewman#ndcoslo




Hide Implementation Details



Highly Observable

✔ ✔

Consumer First

@samnewman#ndcoslo

DB

@samnewman#ndcoslo

DB

@samnewman#ndcoslo

DB

@samnewman#ndcoslo

DB

@samnewman#ndcoslo

DB

HIDE YOUR DATABASE

@samnewman#ndcoslo http://martinfowler.com/bliki/images/boundedContext/sketch.png

@samnewman#ndcoslo 18




Details



Highly Observable

✔ ✔ ✔

Consumer First





Details



Highly Observable

✔ ✔ ✔

Consumer First

@samnewman#ndcoslo

What is autonomy?

@samnewman#ndcoslo

What is autonomy?

Giving people as much freedom as possible to do the job at hand

@samnewman#ndcoslo

What is autonomy?

Giving people as much freedom as possible to do the job at hand

@samnewman#ndcoslo

SELF-SERVICE

https://www.flickr.com/photos/katsrcool/15184711908/

@samnewman#ndcoslo

http://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice

SHARED GOVERNANCE

@samnewman#ndcoslo

DUMB-PIPES, SMART ENDPOINTS

Magical Mystery Bus

@samnewman#ndcoslo

Magical Mystery Bus

@samnewman#ndcoslo

@samnewman#ndcoslo




Details


Highly Observable

✔ ✔ ✔

Decentralise All The Things ✔

Consumer First

@samnewman#ndcoslo




Details


Highly Observable

✔ ✔ ✔


Consumer First

@samnewman#ndcoslo

ONE SERVICE PER-HOST

Host

Service

@samnewman#ndcoslo

ONE SERVICE PER-HOST

Host

Service

Host

Service Service

Service Service

VS

@samnewman#ndcoslo

CONSUMER-DRIVEN CONTRACTS

Shipping Inventory

@samnewman#ndcoslo


Expectations

Shipping Inventory

@samnewman#ndcoslo


Expectations

Shipping Inventory

@samnewman#ndcoslo


Expectations

Prod

Shipping Inventory

@samnewman#ndcoslo


Expectations

Prod

Shipping Inventory

@samnewman#ndcoslo

https://github.com/realestate-com-au/pact

https://github.com/realestate-com-au/pact

@samnewman#ndcoslo

CO-EXIST ENDPOINTS

Customer Service

Shipping

@samnewman#ndcoslo

CO-EXIST ENDPOINTS

Customer Service

Shipping

V2V1

@samnewman#ndcoslo

CO-EXIST ENDPOINTS

Customer Service

Shipping

V2V1

@samnewman#ndcoslo

CO-EXIST ENDPOINTS

Customer Service

Shipping

V2





Details

Isolate Failure

Highly Observable

✔ ✔ ✔


Deploy Independently✔




Details

Isolate Failure

Highly Observable

✔ ✔ ✔


Deploy Independently✔Consumer First





Details

Isolate Failure

Highly Observable

✔ ✔ ✔






Details

Isolate Failure

Highly Observable

✔ ✔ ✔







Details

Isolate Failure

Highly Observable

✔ ✔ ✔






Details

Isolate Failure

Highly Observable

✔ ✔ ✔



@samnewman

DOCUMENTATION

@samnewman

@samnewman

SERVICE DISCOVERY

@samnewman

SERVICE DISCOVERY

@samnewman

SERVICE DISCOVERY

@samnewman

HUMANE REGISTRIES

@samnewman#ndcoslo




Details

Isolate Failure

Highly Observable

✔ ✔ ✔


Deploy Independently✔Consumer First✔

@samnewman#ndcoslo




Details

Isolate Failure

Highly Observable

✔ ✔ ✔


Deploy Independently✔Consumer First✔

@samnewman#ndcoslo

Strangler App

@samnewman#ndcoslo

Strangler App

Legacy App

Legacy AppLegacy App

@samnewman#ndcoslo

Strangler App

Legacy App

Legacy App

Requests

Legacy App

@samnewman#ndcoslo

Strangler App

Legacy App

Legacy App

Requests

Legacy App

@samnewman#ndcoslo

Strangler App

Legacy App

Legacy App

Requests

Legacy App

@samnewman#ndcoslo

Strangler App

Legacy App

Legacy App

Requests

Legacy App

30 - 60 Concurrent Requests

@samnewman#ndcoslo

Strangler App

Legacy App

Legacy App

Requests

Legacy App


> 800 Concurrent Requests

@samnewman#ndcoslo

Strangler App

Legacy App

Legacy App

Requests

Legacy App


> 800 Concurrent Requests

@samnewman#ndcoslo

Strangler App

Legacy App Legacy App Legacy App

Thread Pool

@samnewman#ndcoslo

Strangler App


Thread Pool

Failing…slowly!

@samnewman#ndcoslo

Strangler App


Thread Pool

Failing…slowly!

@samnewman#ndcoslo

Strangler App


Thread Pool

Failing…slowly!

Thread-pool exhausted

@samnewman#ndcoslo

Strangler App


Thread Pool

Failing…slowly!


No requests to other downstream apps

@samnewman#ndcoslo

Strangler App


Thread Pool

Failing…slowly!



@samnewman#ndcoslo

Strangler App


Thread Pool

Failing…slowly!


Requests Building Up


@samnewman#ndcoslo

Strangler App


Thread Pool

@samnewman#ndcoslo

Strangler App


Fix Timeouts

Thread Pool

@samnewman#ndcoslo

Strangler App


Fix Timeouts

Thread Pool

@samnewman#ndcoslo

Strangler App


Fix Timeouts

Thread Pool Thread PoolThread Pool

@samnewman#ndcoslo

Strangler App


Fix Timeouts

Thread Pool Thread PoolThread PoolBulkhead

Downstream Connections

@samnewman#ndcoslo

Strangler App


Fix Timeouts



@samnewman#ndcoslo

Strangler App


Fix Timeouts



Circuit Breakers





Details

Highly Observable

✔ ✔ ✔


Deploy Independently✔Isolate Failure✔ Consumer First✔





Details

Highly Observable

✔ ✔ ✔


Deploy Independently✔Isolate Failure✔ Consumer First✔

@samnewman#ndcoslo

@samnewman#ndcoslo

AGGREGATION

@samnewman#ndcoslo

LOGS

AGGREGATION

@samnewman#ndcoslo

LOGSSTATS

AGGREGATION

@samnewman#ndcoslo

CORRELATION IDS

@samnewman#ndcoslo

CORRELATION IDS

ID 8964

@samnewman#ndcoslo

CORRELATION IDS

ID 8964

ID 8964

ID 8964

ID 8964

ID 8964

@samnewman#ndcoslo


@samnewman#ndcoslo



@samnewman#ndcoslo




@samnewman#ndcoslo




Details

@samnewman#ndcoslo




Details


@samnewman#ndcoslo




Details



@samnewman#ndcoslo




Details



Consumer First

@samnewman#ndcoslo




Details



Consumer First

@samnewman#ndcoslo




Details



Highly Observable

Consumer First

@samnewman#ndcoslo

Sam Newman

Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS

http://buildingmicroservices.com/

AUTHD

http://buildingmicroservices.com/

Sam Newman @samnewman

THANKS!

Principles of microservices ndc oslo

Services

ndcoslo accounts

ndcoslo http

implementation details

scalable business

complex processes

things isolate failure

accidental complexity

cleanse data