Using Docker, Neo4j, and Spring Cloud for Developing Microservices

Unless otherwise indicated, these slides are © 2016 Pivotal Software, Inc. and licensed under aCreative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/

Using Docker, Neo4j, and Spring Cloud for Developing Microservices

Kenny Bastani, Spring Developer Advocate, Pivotal @kennybastani

http://creativecommons.org/licenses/by-nc/3.0/

http://creativecommons.org/licenses/by-nc/3.0/

https://github.com/kbastani/spring-boot-graph-processing-example

Speaker Intro - Kenny Bastani

2


Ranking Twitter ProfilesUsing PageRank

3 https://github.com/kbastani/spring-boot-graph-processing-example



PageRank algorithm

4



PageRank algorithm

5


https://github.com/kbastani/spring-boot-graph-processing-example6







Tools we’ll be using

! Spring Boot

! Neo4j

! Apache Spark

! Docker

! RabbitMQ

9



Containerize all the things!

10










Connecting Neo4j and Apache Spark…to submit PageRank jobs




Request new Apache Spark job

16

Algorithm TypeRelationship Type



Export Neo4j graph to HDFS

17

New Job Request

HDFS Path: /../../graph.csv

Job Type: pagerank



Encoding a graph as an edge list

18

edge list

G B

H B

I B

K B

E B

F B

J B

D B

G E

H E

I E

K E …



Import edge list to Apache Spark

19

Process Job Request

HDFS Path: /../../graph.csv

Job Type: pagerank

graph.csv

0 1

1 2

2 3

0 3

2 1 …



Apply results back to Neo4j

20

Completed Job

HDFS Path: /../../results.csv

Job Type: pagerank

results.csv

0 .56

1 .42

2 .14

3 .25 …



Graph processing platform

21

Algorithm TypeRelationship Type



docker-compose.yml

! Demo

22


Building Microservices





24





26

Creating Spring Data Neo4j Repositories




What our application needs

! Repositories

• User repository (to manage and import users)

• Follows repository (to manage and import following relationships)

• Custom Cypher queries mapped to repository methods

! Domain model

• User — (our node entity)

• Follows — (our relationship entity)

! REST API

• Expose the resources of the domain as a REST API

27




















Exposing repository APIs using Spring Data REST









Connecting to the Twitter API











We can override these properties as environment variables at runtime








Scheduling new PageRank jobs




Scheduling PageRank jobs from Neo4j

44


Scheduling new PageRank jobs



Ranking Dashboard





Ranking dashboard




Ranking dashboard


Adding static web content



Ranking dashboard




Ranking dashboard

52



Add seed profiles

53



Choose 3 seed profiles

54






Discover new users and update rankings

56



Learn More. Stay Connected.

! Twitter: @kennybastani

! Spring: spring.io/team/kbastani

! Blog: kennybastani.com

! GitHub: github.com/kbastani

Twitter: twitter.com/springcentral

YouTube: spring.io/video

LinkedIn: spring.io/linkedin

Google Plus: spring.io/gplus


Using Docker, Neo4j, and Spring Cloud for Developing Microservices

Technology