Wichert Akkerman - Plone.Org Infrastructure

Post on 18-May-2015

1134 Views

Category:

Business

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

The plone.org and plone.net websites are the first confrontation with Plone for most users. It is important that they perform well and are stable. With almost 4 million page views per day and thousands of LDAP users plone.org and plone.net are examples of a complex deployment setup requiring LDAP, caching and load balancing - all on a single machine. I will describe how the Plone websites are build and how those practices can be applied to other sites, making it possible to scale upwards to bigger sites or make smaller sites more efficient.

Transcript

Plone.organ overview of the plone infrastructure

Who ?

• Former lifetime: Debian

• Plone developer

• Plone 3 release manager

• Plone infrastructure team lead

• Simplon

What ?

• Issue trackers

• Mailing lists

• Source control systems

• Web sites

How?

• 90% existing software

• 2% custom changes

• 2% custom software

• 6% cursing and frustration

• equals 100% love (we hope)

For who?

• 681 commiters

• over 1 million downloads

• over 200 Plone companies

• the whole world uses Plone!

24 hours per day

0

1,000

2,000

3,000

4,000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

Plone Collective

7 days per week

0

2,250

4,500

6,750

9,000

Monda

y

Tues

day

Wed

nesd

ay

Thursd

ayFr

iday

Satu

rday

Sund

ay

Plone Collective

Internet

Web server

proxy cache

Load Balancer

Zopeinstance

Zopeinstance

ZEOserver

LDAP

Zopeinstance

ZEOserver

Zope hosting

Debian GNU/Linux

PloneHelpCenter

PloneSoftwareCenter

Poi

PloneOrg

Bluffing

• ~ 150k page views per day

• Plone is not nearly fast enough

• Fake it!

Varnish vs Squid

• Squid help enormously

• Varnish helped even more

• ~80% cache hit rate

• CacheSetup makes it possible

Source Control

• Subversion

• Synchronised to svn-mirror.plone.org

• Access control via LDAP

• Reporting to CIA and mailing lists

Who are you ?

• Authentication required for services

• Duplication is evil

• Single account database

LDAPserver

LDAPserver

plone.org

plone.net

dev.plone.org

svn.plone.org

LDAPrepllication

svn commitmails

LDAP everywhere

LDAP Statistics

• 28971 accounts

• ~ 1000 new accounts per month

0

7,500

15,000

22,500

30,000

Dec

embe

r 20

05

Febr

uary

200

6

Apr

il 20

06

June

200

6

Aug

ust

2006

Oct

ober

200

6

Dec

embe

r 20

06

Febr

uary

200

7

Apr

il 20

07

June

200

7

Aug

ust

2007

LDAP accounts

LDAP setup

• OpenLDAP everywhere

• PloneLDAP is your friend

• Apache is your fiend

No Worries Mate

• Spam on dev.plone.org

• Spam on lists.plone.org

• Spam on paste.plone.org

• Postgres and Varnish stability

• Robots are coming to get us

Pain pill

Dreams ...

• Plone 3.0 for plone.org and plone.net

• Redundancy

• Single sign-on

top related