Plone.org an overview of the plone infrastructure
Wichert Akkerman - Plone.Org Infrastructure
May 18, 2015
The plone.org and plone.net websites are the first confrontation with Plone for most users. It is important that they perform well and are stable. With almost 4 million page views per day and thousands of LDAP users plone.org and plone.net are examples of a complex deployment setup requiring LDAP, caching and load balancing - all on a single machine. I will describe how the Plone websites are build and how those practices can be applied to other sites, making it possible to scale upwards to bigger sites or make smaller sites more efficient.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Plone.organ overview of the plone infrastructure
Who ?
• Former lifetime: Debian
• Plone developer
• Plone 3 release manager
• Plone infrastructure team lead
• Simplon
What ?
• Issue trackers
• Mailing lists
• Source control systems
• Web sites
How?
• 90% existing software
• 2% custom changes
• 2% custom software
• 6% cursing and frustration
• equals 100% love (we hope)
For who?
• 681 commiters
• over 1 million downloads
• over 200 Plone companies
• the whole world uses Plone!
24 hours per day
0
1,000
2,000
3,000
4,000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
Plone Collective
7 days per week
0
2,250
4,500
6,750
9,000
Monda
y
Tues
day
Wed
nesd
ay
Thursd
ayFr
iday
Satu
rday
Sund
ay
Plone Collective
Internet
Web server
proxy cache
Load Balancer
Zopeinstance
Zopeinstance
ZEOserver
LDAP
Zopeinstance
ZEOserver
Zope hosting
Debian GNU/Linux
PloneHelpCenter
PloneSoftwareCenter
Poi
PloneOrg
Bluffing
• ~ 150k page views per day
• Plone is not nearly fast enough
• Fake it!
Varnish vs Squid
• Squid help enormously
• Varnish helped even more
• ~80% cache hit rate
• CacheSetup makes it possible
Source Control
• Subversion
• Synchronised to svn-mirror.plone.org
• Access control via LDAP
• Reporting to CIA and mailing lists
Who are you ?
• Authentication required for services
• Duplication is evil
• Single account database
LDAPserver
LDAPserver
plone.org
plone.net
dev.plone.org
svn.plone.org
LDAPrepllication
svn commitmails
LDAP everywhere
LDAP Statistics
• 28971 accounts
• ~ 1000 new accounts per month
0
7,500
15,000
22,500
30,000
Dec
embe
r 20
05
Febr
uary
200
6
Apr
il 20
06
June
200
6
Aug
ust
2006
Oct
ober
200
6
Dec
embe
r 20
06
Febr
uary
200
7
Apr
il 20
07
June
200
7
Aug
ust
2007
LDAP accounts
LDAP setup
• OpenLDAP everywhere
• PloneLDAP is your friend
• Apache is your fiend
No Worries Mate
• Spam on dev.plone.org
• Spam on lists.plone.org
• Spam on paste.plone.org
• Postgres and Varnish stability
• Robots are coming to get us
Pain pill
Dreams ...
• Plone 3.0 for plone.org and plone.net
• Redundancy
• Single sign-on
Related Documents
