Top Banner
STREAM IS THE NEW BATCH
35

Stream is the new Batch

Apr 11, 2017

Download

Software

Donovan Muller
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Stream is the new Batch

STREAMIS THE

NEW BATCH

Page 2: Stream is the new Batch

A BIT ABOUT MEDONOVAN MULLER

LEAD TECHNICAL PARTNER AT ABSA

DONOVANCMULLER

Page 3: Stream is the new Batch

WHAT THIS TALK IS ABOUTNOT

STREAMING ANALYTICS, BIG DATAAPACHE SPARK, SAMSA

HADOOP

Page 4: Stream is the new Batch

THAT'S ONE BIG BATCHCURRENT STATE OF AFFAIRS

SCHEDULED / FILE DRIVEN

Page 5: Stream is the new Batch

MONOLITHIC APPLICATIONSTRIGGERED BY CONTROL PROGRAMS

HARD TO SCALESUITED TO BIG TIN / MAINFRAME

Page 6: Stream is the new Batch

LETS BUILD LEGACYMONOLITH

SPRING BATCH

Page 7: Stream is the new Batch

SPRING BATCHJOBS

READERS, ... AND WRITERSREADERS

Page 8: Stream is the new Batch

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-LEGACY-BATCH

Page 9: Stream is the new Batch

IT WORKS, BUTIT'S A BATCH TO WORK ON

Page 10: Stream is the new Batch

WHAT DO WE NEED?SINGLE, FOCUSED MODULES (FUNCTIONAL)

EASILY COMPOSABLEAUTONOMOUSEASY TO TEST

Page 11: Stream is the new Batch

WHEN DO WE NEED IT?EASILY DEPLOYABLE

EASILY SCALABLEEASILY DISTRIBUTABLE

Page 12: Stream is the new Batch

MICROSERVICES, MICROSERVICES,MICROSERVICES

Page 13: Stream is the new Batch

MICROSERVICESSOA FOR HIPSTERS

Page 14: Stream is the new Batch

SPRING BOOTSELF CONTAINED / SELF EXECUTING

AUTO CONFIGURATION FTW

Page 15: Stream is the new Batch

SPRING BOOTCHKICKING THE KITTY

Page 16: Stream is the new Batch

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH

Page 17: Stream is the new Batch

ONE STEP AT A TIMEBREAKING APART THE MONOLITH

Page 18: Stream is the new Batch

SPRING CLOUD STREAMI/O, I/O, OFF TO WORK WE GO

FRAMEWORK FOR BUILDING MESSAGE-DRIVEN MICROSERVICESOPINIONATED CONFIGURATION OF MESSAGE BROKERS

SOURCE, PROCESSOR, SINK

Page 19: Stream is the new Batch

... AND IN THE DARKNESS BIND THEMRABBIT MQ

KAFKAJMS (COMING SOON)

ROLL YOUR OWN

Page 20: Stream is the new Batch

OOTBOUT OF THE BOX APPS FOR SIMPLE USE CASES

Page 21: Stream is the new Batch

ORCHESTRATING THE GREMLINSSPRING CLOUD DATA FLOW

Page 22: Stream is the new Batch

SPRING | CLOUD | DATA | FLOW

UNIX SYNTAXTASKS AND STREAMS

CLOUD NATIVE PROGRAMMING AND OPERATINGMODEL FOR COMPOSABLE DATA MICROSERVICES

Page 23: Stream is the new Batch

TASKSON DEMAND EXECUTION

SHORT LIVED, PROCESS AND DIEGREAT FOR BATCH

Page 24: Stream is the new Batch

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH-SCDF-TASK

Page 25: Stream is the new Batch

STREAMSALWAYS ON

DIRECTED GRAPH OF APPLICATIONSSOURCES, PROCESSES, SINKS

Page 26: Stream is the new Batch

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH-SCDF-STREAM

Page 27: Stream is the new Batch

LOCAL IS LEKKER...... BUT WE NEED MORE

Page 28: Stream is the new Batch

SPRING CLOUD DEPLOYERABSTRACTION FOR DEPLOYING BOOT APPS

DEPLOYER SPIDEPLOYS APPS AND TASKS

Page 29: Stream is the new Batch

MESOS

YARN

CLOUD FOUNDRY

CURRENT DEPLOYER IMPLS

KUBERNETES

OPENSHIFT 😎

Page 30: Stream is the new Batch

OPENSHIFTREDHAT - ORIGIN & CONTAINER

PLATFORM

EXTENDS KUBERNETES

SCHEDULES DOCKER CONTAINERS

package i.code.java;

public interface OpenShift extends Kubernetes {

// Build the Dockers BuildConfig buildConfig();

// Deploy the Dockers, // more smarter than ReplicationController DeploymentConfig deploymentConfig();

// Expose the Dockers Route route();

...}

Page 31: Stream is the new Batch

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH-SCDF-

STREAM/TREE/OPENSHIFT

Page 32: Stream is the new Batch

HELM, WARP ONE ENGAGE! SCALE INDEPENDANT APPLICATIONS IN STREAMS

SMARTER APP DISTRIBUTION

Page 33: Stream is the new Batch

THESE ARE THE VOYAGES OF THEENTERPRISE BATCH

... TO EXPLORE STRANGE NEW WORLDS

Page 34: Stream is the new Batch

YEAH BUT NO, BUT YEAH BUT NO, BUTCULTURE - DEVOPSAFFORDS AGILITY

BEGINNINGS OF REACTIVE

Page 35: Stream is the new Batch

QUESTIONS?