Performance measurement and tuning

High performance websites An introduction into xDebug profiling, Kcachegrind and JMeter

About Us

Axel Jung Software Developer

AOE media GmbH

Timo Schmidt Software Developer

AOE media GmbH

Preparation

Install Virtualbox and import the t3dd2012 appliance (User & Password: t3dd2012)

You will find: • Apache with xdebug and apc • Jmeter • Kcachegrind • PHPStorm

There are two vhost: • typo3.t3dd2012 and playground.t3dd2012

Can you build a new

website for me?

Yes, we can!

But I expect a lot of

visitors. Can you handle them?

Yes, we can!

Really?

Yes, we can!

...after inventing the next, cutting edge, enterprise

architecture...

...and some* days of development...

The servers are not fast enough for your application ;)

INSTALL AND CONFIGURE xDebug

Install XDebug & KCachegrind

● Install xdebug (eg. apt-get install php5-xdebug) ● Install kcachegrind (eg. apt-get install kcachegrind)

● Configuration in (/etc/php5/conf.d/xdebug.ini on Ubuntu)

● xdebug.profiler_enable_trigger = 1 ● xdebug.profiler_output_dir = /..

Configure xDebug

● By request: ?XDEBUG_PROFILE ● All requests by htaccess: php_value xdebug.profiler_enable 1

Profiling

Open with KCachegrind

OPTIMIZE WITH IDE AND MIND KCachegrind

Analyzing Cachegrinds ● High self / medium self and many calls => High potential for optimization ● Early in call graph & not needed => High potential for optimization

Hands on

● There is an extension „slowstock“ in the VM. ● Open: „http://typo3.t3dd2012/index.php?id=2“ and analyze it with kcachegrind.

Total Time Cost 12769352

This code is very time consuming

SoapClient is instantiated everytime => move to constructor

Change 1 (SoapConversionRateProvider)

Before: /** * @param string $fromCurrency * @param string $toCurrency * @return float */ public function getConversionRate($fromCurrency, $toCurrency) { $converter = new SoapClient($this->wsdl); $in = new stdClass(); $in->FromCurrency = $fromCurrency; $in->ToCurrency = $toCurrency; $out = $converter->ConversionRate($in); $result = $out->ConversionRateResult; return $result; }

Change 1 (SoapConversionRateProvider)

After: /** @var SoapClient */ protected $converter; /** @return void */ public function __construct() { $this->converter = new SoapClient($this->wsdl); } /** * @param string $fromCurrency * @param string $toCurrency * @return float */ public function getConversionRate($fromCurrency, $toCurrency) { $in = new stdClass(); $in->FromCurrency = $fromCurrency; $in->ToCurrency = $toCurrency; $out = $this->converter->ConversionRate($in); $result = $out->ConversionRateResult; return $result; }

Change 1 (SoapConversionRateProvider)

Total Time Cost 10910560 ( ~ -15%)

11,99 % is still much time :(

Change 2 (SoapConversionRateProvider)

● Conversion rates can be cached in APC cache to reduce webservice calls. – Inject „ConversionRateCache“ into

SoapConversionRateProvider.

–Use the cache in the convert method.

Change 2 (SoapConversionRateProvider) Before: /** @var SoapClient */ protected $converter; /** @return void */ public function __construct() { $this->converter = new SoapClient($this->wsdl); } /** * @param string $fromCurrency * @param string $toCurrency * @return float */ public function getConversionRate($fromCurrency, $toCurrency) { $in = new stdClass(); $in->FromCurrency = $fromCurrency; $in->ToCurrency = $toCurrency; $out = $this->converter->ConversionRate($in); $result = $out->ConversionRateResult; return $result; }

Change 2 (SoapConversionRateProvider) After: /** @var Tx_Slowstock_System_Cache_ConversionRateCache */ protected $cache; ... /** @param Tx_Slowstock_System_Cache_ConversionRateCache $cache */ public function injectRateCache(Tx_Slowstock_System_Cache_ConversionRateCache $cache) { $this->cache = $cache; } … public function getConversionRate($fromCurrency, $toCurrency) { $cacheKey = $fromCurrency.'-'.$toCurrency; if(!$this->cache->has($cacheKey)) { $in = new stdClass(); $in->FromCurrency = $fromCurrency; $in->ToCurrency = $toCurrency; $out = $this->converter->ConversionRate($in); $result = $out->ConversionRateResult; $this->cache->set($cacheKey, $result); } return $this->cache->get($cacheKey); }

Change 2 (SoapConversionRateProvider) After: /** @var Tx_Slowstock_System_Cache_ConversionRateCache */ protected $cache; ... /** @param Tx_Slowstock_System_Cache_ConversionRateCache $cache */ public function injectRateCache(Tx_Slowstock_System_Cache_ConversionRateCache $cache) { $this->cache = $cache; } … public function getConversionRate($fromCurrency, $toCurrency) { $cacheKey = $fromCurrency.'-'.$toCurrency; if(!$this->cache->has($cacheKey)) { $in = new stdClass(); $in->FromCurrency = $fromCurrency; $in->ToCurrency = $toCurrency; $out = $this->converter->ConversionRate($in); $result = $out->ConversionRateResult; $this->cache->set($cacheKey, $result); } return $this->cache->get($cacheKey); }

Total Time Cost 5187627 ( ~ -50%)

Much better, but let's look on the call graph... do we need all that stuff?

The kcachegrind call graph

The kcachegrind call graph

Do we need any TCA in Eid? No

Change 3 – Remove unneeded code: (Resources/Private/Eid/rates.php):

Before: tslib_eidtools::connectDB(); tslib_eidtools::initTCA(); $TSFE = t3lib_div::makeInstance('tslib_fe', $GLOBALS['TYPO3_CONF_VARS'], ...); After: tslib_eidtools::connectDB(); $TSFE = t3lib_div::makeInstance('tslib_fe', $GLOBALS['TYPO3_CONF_VARS'], ...);

Total Time Cost 2877900 ( ~ -45%)

Summary

● From 12769352 => 2877900 (-77%) with three changes ● Additional Ideas:

● Reduce created fluid objects by implementing static fluid view helpers

(examples in fluid core)

● Cache reverse conversion rate (1/rate)

● Use APC Cache Backend for TYPO3 and Extbase caches

JMeter

http://jmeter.apache.org/

Why Jmeter?

BUILD A SIMPLE WEB TESTPLAN JMeter

JMeter Gui

Add Thread Group

Name Group

Add HTTP Defaults

Set Server

Add HTTP Sampler

Set Path

Add Listener

Start Tests

View Results

RECORD WITH PROXY JMeter

Add Recording Controller

Add Proxy Server

Exclude Assets

Start

Configure Browser

Browse

View results

ADVANCED JMeter

Add Asserts

Match Text

Constant Timer

Set the Base

Summary Report

Graph Report

Define Variables

Use Variables

CSV Files

CSV Settings

Use CSV Vars

Command Line

• /…/jmeter -n -t plan.jmx -l build/logs/testplan.jtl -j build/logs/testplan.log

Jenkins and JMeter

Detail Report

Use Properties

-p ${properties}

DISTRIBUTED TESTING

JMeter + Cloud

Start Server

jmeter.properties

remote_hosts=127.0.0.1

Run Slaves

AMAZON CLOUD http://aws.amazon.com/

Create User

EC2

Create Key

Name Key

Download Key

Create Security Groups

Launch

Select AMI ami-3586be41

Minimum Small

Configure Firewall

Wait 15 Min

Get Adress

Connect

Start Cloud Tool

Start Instances

Wait for Slaves

Slave Log

Close JMeter

All Slave will be terminated

Slave AMI

• ami-963e0ce2 • Autostart JMeter im Server Mode

Costs

Want to know more?

European HQ: AOE media GmbH Borsigstraße 3 65205 Wiesbaden Tel.: +49 (0)6122 70 70 7 - 0 Fax: +49 (0)6122 70 70 7 - 199 E-Mail: [email protected] Web: http://www.aoemedia.de