CF Korea Meetup - Gemfire on PCF

2© 2015 Pivotal Software, Inc. All rights reserved. 2

Gemfire and PCF

이창재 ([email protected]) | Pivotal | Advanced Platform ArchitectsMarch, 2016

3© 2015 Pivotal Software, Inc. All rights reserved.

4© 2015 Pivotal Software, Inc. All rights reserved.

5© 2015 Pivotal Software, Inc. All rights reserved. 5

12factor App Manifesto - VI. Processes

Twelve-factor processes are stateless and share-nothing.

Some web systems rely on “sticky sessions” – that is, caching user session data in memory of the app’s process and expecting future requests from the same visitor to be routed to the same process. Sticky sessions are a violation of twelve-factor and should never be used or relied upon.

6© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire 는 ?

수평적으로 자유롭게 확장이 가능한 고가용성 및 Low latency 메모리 저장소 Key/Value (Map) Store (+ ααααααααα) Open Source

– 2015 년 4 월에 ASF 에 기증 – Project Geode

Pivotal Cloud Foundry 에 Marketplace 로 Service 제공

7© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire vs Geode

Open Source 기능상의 차이

– WAN 상의 클러스터 복제 (Geode 차기 버전에 포함 예정 )– Continuous Query (Geode 차기 버전에 포함 예정 )– C++, C# 지원

상용 Support Spring Data Gemfire 는 Pivotal Gemfire 를 이용하여 개발

8© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire Data 복제 – PARTITION_REDUNDANT

9© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire Scale-out 구조

10© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire Topology - PARTITION

REDUNDANT 를 가지는 것과 안가지는 것 (PARTITION, PARTITION_REDUNDANT)

LRU(Least Recently Used) 기반 Eviction

PERSISTENT – Disk 에 저장

OVERFLOW– Heap 에 region size 를 지정하고 LRU 기반으로 data 를 disk 로 옮김

PERSISTENT_OVERFLOW– 자주 사용되는 data 만 메모리에 저장

11© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire Topology - REPLICATE

REPLICATE_HEAP_LRU

REPLICATE_OVERFLOW

REPLICATE_PERSISTENT

REPLICATE_PERSISTENT_OVERFLOW

REPLICATE_PROXY

12© 2015 Pivotal Software, Inc. All rights reserved.

고가용성을 위한 Data 복제 Copy 갯수 지정 ( 기본 1) 복제 Zone 지정 다른 호스트에 복제본 저장

13© 2015 Pivotal Software, Inc. All rights reserved.

Pivotal GemFire High Availability and Fault Tolerance in 6 acts

Failing data copies are replaced transparently

Data is replicated to other clusters and sites

(WAN)

Network segmentations are identified and fixed

automatically

Client and cluster disconnections are handled

gracefully

Data is persisted on local disk for ultimate

durability

“split brain”

Failed function executions are restarted

automatically

restart

14© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire (+ ααααααααα) – FunctionService

15© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire (+ ααααααααα) – Cache Writer, Listener

16© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire (+ ααααααααα) – Off Heap

17© 2015 Pivotal Software, Inc. All rights reserved. 17

Gemfire On PCF

18© 2015 Pivotal Software, Inc. All rights reserved.

19© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire on PCF

PCF 에 Tile 로 서비스 제공 Gemfire 8.2, Java8 Spring Cloud GemFire Connector cf gfsh 플러그인 제공 Session State Caching

– Session Offloaing– Service binding

20© 2015 Pivotal Software, Inc. All rights reserved.

Gemfire on PCF RoadMap

Buildpack Auto Reconfiguration WAN Replication Auto-Scaling PWS

21© 2015 Pivotal Software, Inc. All rights reserved.

Demo of Basic Admin and Dev Features (~4 min)

http://youtube.com/v/_yyrEiHObbk