AEM (CQ) Maintenance Webinar 2013

Tags:

Post on 11-Nov-2014

1565 Views

Category:

Technology

5 Downloads

Preview:

Click to see full reader

DESCRIPTION

Sample code: https://github.com/cqsupport/webinar-aem-monitoring-maintenance Webinar Recording: https://my.adobeconnect.com/p9du34yji38 Monitor and maintain your AEM optimally. Eliminate performance slowdowns To manage and deliver content swiftly, you need a steady CQ environment. You can maximize the performance using the built-in monitoring and maintenance tools.

Transcript

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

ADOBE CUSTOMER BROWN BAG SERIES

Andrew Khoury amp Sham Hassan ChikkegowdaCustomer Support Engineers Adobe

For the best listening experience we recommend using a headset

TODAYrsquoS TOPIC AEM Monitoring and Maintenance

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Whatrsquos Covered

1 Best practices for maintaining AEM instances

2 Tips and tricks for proactive things to monitor

3 Tips and tricks for reducing downtime when instances are corrupted

4 Common pitfalls to avoid

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Topics covered

Replication

DataStore Garbage Collection

Tar PM Optimization

Workflow

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 4

Optimizing replication

Replication Tuning and Monitoring

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Monitoring Replication

bull Replication can be monitored using JMX

bull Each agent exposes an object

bull The objects expose

- If the agent is enabled

- If the queue is blocked paused or invalid

- The number of entries in the queue

- Timing information

5

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Configure a replicationlog

6

Why

bull Keeps errorlog from getting bloated

bull Isolates replication errors and warnings

How

bull Add an Apache Sling Logging Logger

- Log File logsreplicationlog

- Log Level Info

- Logger comdaycqreplication

bull Add an Apache Sling Logging Writer (for log rotation)

- Log File logsreplicationlog

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 7

Replication monitoring via JMX And Log Configuration

DEMONSTRATION

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Replication Initializing and Queuing

8

User activatescontentgeometrixx-outdoorsensupport

Durbo package

varreplicationdata

Content is packaged

OSGievent is fired

ReplicationAgentManager

handles the event

Sling Job Handlerqueuesstores the job

slingeventJob

vareventingjobs

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Replication Processing Jobs

9

SlingJob Handler

Process the job through thecorrect TransportHandler

ERROR Queue stuck

SUCCESS Process

next job in queue

slingeventJob node

vareventingjobs

Read job from queue

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Replication Troubleshooting

The queue can get stuck ifbull The Job Handler fails

bull Error while sending the data- Failure to create Durbo package from

varreplicationdata

- Issue in class loading network malfunction etc

bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

unstable

bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

- Failure to saveimport the content

10

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Optimizing Replication

Optimizations

bull Enable ldquoFile Storagerdquo of replication durbo packages

- Go to httphostportsystemconsoleconfigMgr and login as admin

- Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

- Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

- socketConnect can be 30 seconds = 30000

- socketRead timeout can be 10 minutes = 600000

11

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Optimizing Replication

12

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Optimizing Replication

Optimizations

bull In the ldquoTriggersrdquo tab of the replication agent

- ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

- ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

13

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Optimizing Replication

14

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

Reducing disk space usageDataStore Garbage Collection

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

What is the DataStore

The DataStore (default implementation)

bull Stores binary JCR properties gt 4KB (default)

bull Only allows files to be added

bull Stores files under crx-quickstartrepositoryrepositorydatastore

bull Files are referenced by the JCR internal node record (persistence manager bundles)

16

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

How does the DataStore work

1 A unique id is generated from contents of the file

2 The id is used for the filename

3 The datastore directory structure is built like this

bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

4 Due to this files are stored uniquely so the same file will only be stored once

17

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

DataStore Example

User uploads the same image to two different locations

18

AEMpng

Upload

Upload

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

a2b98676377b947244bb954769def9b4fd625daa

repositoryrepositorydatastore

86

b9

a2

DataStore Example

19

JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

property

JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

originaljcrcontentdata property

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

How does DataStore GC work

DataStore GC (Garbage Collection) is the only way to delete DataStore files

How does it work

bull ldquoScanrdquo Phase

- Read all nodes in the JCR

- Update the timestamp of each of the referenced datastore files

bull ldquoDeleterdquo Phase

- Find all files with timestamp older than when it started the scan phase and deletes them

20

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

DataStore GC Avoiding common Pitfalls

Before running DataStore GC make sure

bull You have a backup of the datastore directory

bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

bull Date and time is in sync between network storage and CQ server

bull CQ53 or 54 with CRX22 - at least hotfix 22070

bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

21

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

How to run DataStore GCDEMONSTRATION

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

DataStore GC

This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

If you see that error then do not run datastore gc until you have restored the missing files

To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

bull Browse to Repository Configuration =gt Check Repositoryrdquo

bull Check the Data store consistency check box

bull Click ldquoRunrdquo

bull This will output a list of nodes referencing the missing files along with the path of the missing file

bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

23

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

How to run DataStore Consistency Check

DEMONSTRATION

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

Tar Persistence Manager Optimization

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Part 2 Topics Covered

TarPM Optimization

- What is the TarPM amp TarPM optimization

- Best practices for maintaining AEM Instances

- Tips and tricks for proactive things to monitor

- Tips and tricks for reducing downtime amp Speed up the process

Workflow Monitoring

- Supported Features

- Best practices for maintaining AEM Instances

- Tips and tricks for proactive things to monitor

26

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

What is TarPM

27

data_00000tar

ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

data_00001tar

Bundle 01Bundle 02

Bundle 03

Bundle 04

Adding New page

Modifying

page

Del

etin

g

page

bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

bull Tar PM model is append only

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

What is TarPM Optimization

bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

28

bundle03

bundle04

bundle11

bundle14

data_00003tar

TAR OPTIMIZATI

ON

bundle01

bundle02

bundle03

bundle04

data_00001tar

bundle11

bundle12

bundle13

bundle14

data_00002tar

Unused

data

Deletes old data tar file

Deletes old data tar file

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Data Tar file location

bull Default storage location of data tar files are

29

ltcq_homegtcrx-quickstartrepository

data_00000tardata_00001tar

workspaces

crxdefault

version

data_00004tardata_00005tar

data_00010tardata_00011tar

tarJournal

data_00012tardata_00013tar

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Best practices for maintaining AEM Instances

Regularly run tar optimization during the low usage hours of your system

bull Automatic Schedule-

- By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

- To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

30

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Best practices for maintaining AEM Instances

Manually execute TarPM optimization from JMX console

31

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Best practices for maintaining AEM Instances

Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

32

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Tips and tricks for proactive things to monitor

bull From JMX console monitor

- TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

- TarOptimizationWork- The remaining optimization work in KiloBytes

- TarOptimizationRate- TarPM optimization rate in KBsec

33

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

How to monitor Tar Optimization via JMX client

DEMONSTRATION

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Tips and tricks for reducing downtime amp Speed up the process

bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

- cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

- cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

35

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Common Pitfalls to Avoid

bull Scheduling tar optimization to run during the heavy usage hours of your system

bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

bull Do not run tar optimization while you are backing up instance

bull Do not run tar optimization when datastore garbage collection is running

bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

36

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

Workflow maintenance and Purge Obsolete Workflow Data

Workflow Monitoring

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Workflow Purge

bull Workflows enable you to automate Experience Manager activities

bull Workflows events generate archived data

bull This data can quickly grow over time as workflows are processed

bull Purging this data on a regular schedule improves system performance

bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

38

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Best practices for maintaining AEM Instances

Regularly run workflow purge to avoid the problems associated with a large volume of data

bull Using user interface through Felix console

bull Using CURL

bull Creating a JMX client that uses Workflow Mbean

httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

39

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

Tips and tricks for proactive things to monitor

40

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

How to monitor workflow via JMX client

DEMONSTRATION

copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

  • ADOBE CUSTOMER BROWN BAG SERIES
  • Whatrsquos Covered
  • Topics covered
  • Slide 4
  • Monitoring Replication
  • Configure a replicationlog
  • Slide 7
  • Replication Initializing and Queuing
  • Replication Processing Jobs
  • Replication Troubleshooting
  • Optimizing Replication
  • Optimizing Replication (2)
  • Optimizing Replication (3)
  • Optimizing Replication (4)
  • Slide 15
  • What is the DataStore
  • How does the DataStore work
  • DataStore Example
  • DataStore Example (2)
  • How does DataStore GC work
  • DataStore GC Avoiding common Pitfalls
  • Slide 22
  • DataStore GC
  • Slide 24
  • Slide 25
  • Part 2 Topics Covered
  • What is TarPM
  • What is TarPM Optimization
  • Data Tar file location
  • Best practices for maintaining AEM Instances
  • Best practices for maintaining AEM Instances (2)
  • Best practices for maintaining AEM Instances (3)
  • Tips and tricks for proactive things to monitor
  • Slide 34
  • Tips and tricks for reducing downtime amp Speed up the process
  • Common Pitfalls to Avoid
  • Slide 37
  • Workflow Purge
  • Best practices for maintaining AEM Instances (4)
  • Tips and tricks for proactive things to monitor (2)
  • Slide 41
  • Slide 42

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Whatrsquos Covered

    1 Best practices for maintaining AEM instances

    2 Tips and tricks for proactive things to monitor

    3 Tips and tricks for reducing downtime when instances are corrupted

    4 Common pitfalls to avoid

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Topics covered

    Replication

    DataStore Garbage Collection

    Tar PM Optimization

    Workflow

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 4

    Optimizing replication

    Replication Tuning and Monitoring

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Monitoring Replication

    bull Replication can be monitored using JMX

    bull Each agent exposes an object

    bull The objects expose

    - If the agent is enabled

    - If the queue is blocked paused or invalid

    - The number of entries in the queue

    - Timing information

    5

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Configure a replicationlog

    6

    Why

    bull Keeps errorlog from getting bloated

    bull Isolates replication errors and warnings

    How

    bull Add an Apache Sling Logging Logger

    - Log File logsreplicationlog

    - Log Level Info

    - Logger comdaycqreplication

    bull Add an Apache Sling Logging Writer (for log rotation)

    - Log File logsreplicationlog

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 7

    Replication monitoring via JMX And Log Configuration

    DEMONSTRATION

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Replication Initializing and Queuing

    8

    User activatescontentgeometrixx-outdoorsensupport

    Durbo package

    varreplicationdata

    Content is packaged

    OSGievent is fired

    ReplicationAgentManager

    handles the event

    Sling Job Handlerqueuesstores the job

    slingeventJob

    vareventingjobs

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Replication Processing Jobs

    9

    SlingJob Handler

    Process the job through thecorrect TransportHandler

    ERROR Queue stuck

    SUCCESS Process

    next job in queue

    slingeventJob node

    vareventingjobs

    Read job from queue

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Replication Troubleshooting

    The queue can get stuck ifbull The Job Handler fails

    bull Error while sending the data- Failure to create Durbo package from

    varreplicationdata

    - Issue in class loading network malfunction etc

    bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

    unstable

    bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

    - Failure to saveimport the content

    10

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Optimizing Replication

    Optimizations

    bull Enable ldquoFile Storagerdquo of replication durbo packages

    - Go to httphostportsystemconsoleconfigMgr and login as admin

    - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

    - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

    bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

    - socketConnect can be 30 seconds = 30000

    - socketRead timeout can be 10 minutes = 600000

    11

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Optimizing Replication

    12

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Optimizing Replication

    Optimizations

    bull In the ldquoTriggersrdquo tab of the replication agent

    - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

    - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

    13

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Optimizing Replication

    14

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

    Reducing disk space usageDataStore Garbage Collection

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    What is the DataStore

    The DataStore (default implementation)

    bull Stores binary JCR properties gt 4KB (default)

    bull Only allows files to be added

    bull Stores files under crx-quickstartrepositoryrepositorydatastore

    bull Files are referenced by the JCR internal node record (persistence manager bundles)

    16

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    How does the DataStore work

    1 A unique id is generated from contents of the file

    2 The id is used for the filename

    3 The datastore directory structure is built like this

    bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

    bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

    4 Due to this files are stored uniquely so the same file will only be stored once

    17

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    DataStore Example

    User uploads the same image to two different locations

    18

    AEMpng

    Upload

    Upload

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    a2b98676377b947244bb954769def9b4fd625daa

    repositoryrepositorydatastore

    86

    b9

    a2

    DataStore Example

    19

    JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

    property

    JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

    originaljcrcontentdata property

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    How does DataStore GC work

    DataStore GC (Garbage Collection) is the only way to delete DataStore files

    How does it work

    bull ldquoScanrdquo Phase

    - Read all nodes in the JCR

    - Update the timestamp of each of the referenced datastore files

    bull ldquoDeleterdquo Phase

    - Find all files with timestamp older than when it started the scan phase and deletes them

    20

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    DataStore GC Avoiding common Pitfalls

    Before running DataStore GC make sure

    bull You have a backup of the datastore directory

    bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

    bull Date and time is in sync between network storage and CQ server

    bull CQ53 or 54 with CRX22 - at least hotfix 22070

    bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

    21

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

    How to run DataStore GCDEMONSTRATION

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    DataStore GC

    This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

    If you see that error then do not run datastore gc until you have restored the missing files

    To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

    bull Browse to Repository Configuration =gt Check Repositoryrdquo

    bull Check the Data store consistency check box

    bull Click ldquoRunrdquo

    bull This will output a list of nodes referencing the missing files along with the path of the missing file

    bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

    See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

    23

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

    How to run DataStore Consistency Check

    DEMONSTRATION

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

    Tar Persistence Manager Optimization

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Part 2 Topics Covered

    TarPM Optimization

    - What is the TarPM amp TarPM optimization

    - Best practices for maintaining AEM Instances

    - Tips and tricks for proactive things to monitor

    - Tips and tricks for reducing downtime amp Speed up the process

    Workflow Monitoring

    - Supported Features

    - Best practices for maintaining AEM Instances

    - Tips and tricks for proactive things to monitor

    26

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    What is TarPM

    27

    data_00000tar

    ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

    data_00001tar

    Bundle 01Bundle 02

    Bundle 03

    Bundle 04

    Adding New page

    Modifying

    page

    Del

    etin

    g

    page

    bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

    bull Tar PM model is append only

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    What is TarPM Optimization

    bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

    28

    bundle03

    bundle04

    bundle11

    bundle14

    data_00003tar

    TAR OPTIMIZATI

    ON

    bundle01

    bundle02

    bundle03

    bundle04

    data_00001tar

    bundle11

    bundle12

    bundle13

    bundle14

    data_00002tar

    Unused

    data

    Deletes old data tar file

    Deletes old data tar file

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Data Tar file location

    bull Default storage location of data tar files are

    29

    ltcq_homegtcrx-quickstartrepository

    data_00000tardata_00001tar

    workspaces

    crxdefault

    version

    data_00004tardata_00005tar

    data_00010tardata_00011tar

    tarJournal

    data_00012tardata_00013tar

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Best practices for maintaining AEM Instances

    Regularly run tar optimization during the low usage hours of your system

    bull Automatic Schedule-

    - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

    - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

    bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

    30

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Best practices for maintaining AEM Instances

    Manually execute TarPM optimization from JMX console

    31

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Best practices for maintaining AEM Instances

    Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

    32

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Tips and tricks for proactive things to monitor

    bull From JMX console monitor

    - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

    - TarOptimizationWork- The remaining optimization work in KiloBytes

    - TarOptimizationRate- TarPM optimization rate in KBsec

    33

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

    How to monitor Tar Optimization via JMX client

    DEMONSTRATION

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Tips and tricks for reducing downtime amp Speed up the process

    bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

    bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

    - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

    - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

    bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

    35

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Common Pitfalls to Avoid

    bull Scheduling tar optimization to run during the heavy usage hours of your system

    bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

    bull Do not run tar optimization while you are backing up instance

    bull Do not run tar optimization when datastore garbage collection is running

    bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

    36

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

    Workflow maintenance and Purge Obsolete Workflow Data

    Workflow Monitoring

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Workflow Purge

    bull Workflows enable you to automate Experience Manager activities

    bull Workflows events generate archived data

    bull This data can quickly grow over time as workflows are processed

    bull Purging this data on a regular schedule improves system performance

    bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

    38

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Best practices for maintaining AEM Instances

    Regularly run workflow purge to avoid the problems associated with a large volume of data

    bull Using user interface through Felix console

    bull Using CURL

    bull Creating a JMX client that uses Workflow Mbean

    httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

    39

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    Tips and tricks for proactive things to monitor

    40

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

    How to monitor workflow via JMX client

    DEMONSTRATION

    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

    • ADOBE CUSTOMER BROWN BAG SERIES
    • Whatrsquos Covered
    • Topics covered
    • Slide 4
    • Monitoring Replication
    • Configure a replicationlog
    • Slide 7
    • Replication Initializing and Queuing
    • Replication Processing Jobs
    • Replication Troubleshooting
    • Optimizing Replication
    • Optimizing Replication (2)
    • Optimizing Replication (3)
    • Optimizing Replication (4)
    • Slide 15
    • What is the DataStore
    • How does the DataStore work
    • DataStore Example
    • DataStore Example (2)
    • How does DataStore GC work
    • DataStore GC Avoiding common Pitfalls
    • Slide 22
    • DataStore GC
    • Slide 24
    • Slide 25
    • Part 2 Topics Covered
    • What is TarPM
    • What is TarPM Optimization
    • Data Tar file location
    • Best practices for maintaining AEM Instances
    • Best practices for maintaining AEM Instances (2)
    • Best practices for maintaining AEM Instances (3)
    • Tips and tricks for proactive things to monitor
    • Slide 34
    • Tips and tricks for reducing downtime amp Speed up the process
    • Common Pitfalls to Avoid
    • Slide 37
    • Workflow Purge
    • Best practices for maintaining AEM Instances (4)
    • Tips and tricks for proactive things to monitor (2)
    • Slide 41
    • Slide 42

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Topics covered

      Replication

      DataStore Garbage Collection

      Tar PM Optimization

      Workflow

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 4

      Optimizing replication

      Replication Tuning and Monitoring

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Monitoring Replication

      bull Replication can be monitored using JMX

      bull Each agent exposes an object

      bull The objects expose

      - If the agent is enabled

      - If the queue is blocked paused or invalid

      - The number of entries in the queue

      - Timing information

      5

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Configure a replicationlog

      6

      Why

      bull Keeps errorlog from getting bloated

      bull Isolates replication errors and warnings

      How

      bull Add an Apache Sling Logging Logger

      - Log File logsreplicationlog

      - Log Level Info

      - Logger comdaycqreplication

      bull Add an Apache Sling Logging Writer (for log rotation)

      - Log File logsreplicationlog

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 7

      Replication monitoring via JMX And Log Configuration

      DEMONSTRATION

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Replication Initializing and Queuing

      8

      User activatescontentgeometrixx-outdoorsensupport

      Durbo package

      varreplicationdata

      Content is packaged

      OSGievent is fired

      ReplicationAgentManager

      handles the event

      Sling Job Handlerqueuesstores the job

      slingeventJob

      vareventingjobs

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Replication Processing Jobs

      9

      SlingJob Handler

      Process the job through thecorrect TransportHandler

      ERROR Queue stuck

      SUCCESS Process

      next job in queue

      slingeventJob node

      vareventingjobs

      Read job from queue

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Replication Troubleshooting

      The queue can get stuck ifbull The Job Handler fails

      bull Error while sending the data- Failure to create Durbo package from

      varreplicationdata

      - Issue in class loading network malfunction etc

      bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

      unstable

      bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

      - Failure to saveimport the content

      10

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Optimizing Replication

      Optimizations

      bull Enable ldquoFile Storagerdquo of replication durbo packages

      - Go to httphostportsystemconsoleconfigMgr and login as admin

      - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

      - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

      bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

      - socketConnect can be 30 seconds = 30000

      - socketRead timeout can be 10 minutes = 600000

      11

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Optimizing Replication

      12

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Optimizing Replication

      Optimizations

      bull In the ldquoTriggersrdquo tab of the replication agent

      - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

      - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

      13

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Optimizing Replication

      14

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

      Reducing disk space usageDataStore Garbage Collection

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      What is the DataStore

      The DataStore (default implementation)

      bull Stores binary JCR properties gt 4KB (default)

      bull Only allows files to be added

      bull Stores files under crx-quickstartrepositoryrepositorydatastore

      bull Files are referenced by the JCR internal node record (persistence manager bundles)

      16

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      How does the DataStore work

      1 A unique id is generated from contents of the file

      2 The id is used for the filename

      3 The datastore directory structure is built like this

      bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

      bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

      4 Due to this files are stored uniquely so the same file will only be stored once

      17

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      DataStore Example

      User uploads the same image to two different locations

      18

      AEMpng

      Upload

      Upload

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      a2b98676377b947244bb954769def9b4fd625daa

      repositoryrepositorydatastore

      86

      b9

      a2

      DataStore Example

      19

      JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

      property

      JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

      originaljcrcontentdata property

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      How does DataStore GC work

      DataStore GC (Garbage Collection) is the only way to delete DataStore files

      How does it work

      bull ldquoScanrdquo Phase

      - Read all nodes in the JCR

      - Update the timestamp of each of the referenced datastore files

      bull ldquoDeleterdquo Phase

      - Find all files with timestamp older than when it started the scan phase and deletes them

      20

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      DataStore GC Avoiding common Pitfalls

      Before running DataStore GC make sure

      bull You have a backup of the datastore directory

      bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

      bull Date and time is in sync between network storage and CQ server

      bull CQ53 or 54 with CRX22 - at least hotfix 22070

      bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

      21

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

      How to run DataStore GCDEMONSTRATION

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      DataStore GC

      This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

      If you see that error then do not run datastore gc until you have restored the missing files

      To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

      bull Browse to Repository Configuration =gt Check Repositoryrdquo

      bull Check the Data store consistency check box

      bull Click ldquoRunrdquo

      bull This will output a list of nodes referencing the missing files along with the path of the missing file

      bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

      See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

      23

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

      How to run DataStore Consistency Check

      DEMONSTRATION

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

      Tar Persistence Manager Optimization

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Part 2 Topics Covered

      TarPM Optimization

      - What is the TarPM amp TarPM optimization

      - Best practices for maintaining AEM Instances

      - Tips and tricks for proactive things to monitor

      - Tips and tricks for reducing downtime amp Speed up the process

      Workflow Monitoring

      - Supported Features

      - Best practices for maintaining AEM Instances

      - Tips and tricks for proactive things to monitor

      26

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      What is TarPM

      27

      data_00000tar

      ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

      data_00001tar

      Bundle 01Bundle 02

      Bundle 03

      Bundle 04

      Adding New page

      Modifying

      page

      Del

      etin

      g

      page

      bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

      bull Tar PM model is append only

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      What is TarPM Optimization

      bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

      28

      bundle03

      bundle04

      bundle11

      bundle14

      data_00003tar

      TAR OPTIMIZATI

      ON

      bundle01

      bundle02

      bundle03

      bundle04

      data_00001tar

      bundle11

      bundle12

      bundle13

      bundle14

      data_00002tar

      Unused

      data

      Deletes old data tar file

      Deletes old data tar file

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Data Tar file location

      bull Default storage location of data tar files are

      29

      ltcq_homegtcrx-quickstartrepository

      data_00000tardata_00001tar

      workspaces

      crxdefault

      version

      data_00004tardata_00005tar

      data_00010tardata_00011tar

      tarJournal

      data_00012tardata_00013tar

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Best practices for maintaining AEM Instances

      Regularly run tar optimization during the low usage hours of your system

      bull Automatic Schedule-

      - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

      - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

      bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

      30

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Best practices for maintaining AEM Instances

      Manually execute TarPM optimization from JMX console

      31

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Best practices for maintaining AEM Instances

      Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

      32

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Tips and tricks for proactive things to monitor

      bull From JMX console monitor

      - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

      - TarOptimizationWork- The remaining optimization work in KiloBytes

      - TarOptimizationRate- TarPM optimization rate in KBsec

      33

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

      How to monitor Tar Optimization via JMX client

      DEMONSTRATION

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Tips and tricks for reducing downtime amp Speed up the process

      bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

      bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

      - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

      - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

      bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

      35

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Common Pitfalls to Avoid

      bull Scheduling tar optimization to run during the heavy usage hours of your system

      bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

      bull Do not run tar optimization while you are backing up instance

      bull Do not run tar optimization when datastore garbage collection is running

      bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

      36

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

      Workflow maintenance and Purge Obsolete Workflow Data

      Workflow Monitoring

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Workflow Purge

      bull Workflows enable you to automate Experience Manager activities

      bull Workflows events generate archived data

      bull This data can quickly grow over time as workflows are processed

      bull Purging this data on a regular schedule improves system performance

      bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

      38

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Best practices for maintaining AEM Instances

      Regularly run workflow purge to avoid the problems associated with a large volume of data

      bull Using user interface through Felix console

      bull Using CURL

      bull Creating a JMX client that uses Workflow Mbean

      httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

      39

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      Tips and tricks for proactive things to monitor

      40

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

      How to monitor workflow via JMX client

      DEMONSTRATION

      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

      • ADOBE CUSTOMER BROWN BAG SERIES
      • Whatrsquos Covered
      • Topics covered
      • Slide 4
      • Monitoring Replication
      • Configure a replicationlog
      • Slide 7
      • Replication Initializing and Queuing
      • Replication Processing Jobs
      • Replication Troubleshooting
      • Optimizing Replication
      • Optimizing Replication (2)
      • Optimizing Replication (3)
      • Optimizing Replication (4)
      • Slide 15
      • What is the DataStore
      • How does the DataStore work
      • DataStore Example
      • DataStore Example (2)
      • How does DataStore GC work
      • DataStore GC Avoiding common Pitfalls
      • Slide 22
      • DataStore GC
      • Slide 24
      • Slide 25
      • Part 2 Topics Covered
      • What is TarPM
      • What is TarPM Optimization
      • Data Tar file location
      • Best practices for maintaining AEM Instances
      • Best practices for maintaining AEM Instances (2)
      • Best practices for maintaining AEM Instances (3)
      • Tips and tricks for proactive things to monitor
      • Slide 34
      • Tips and tricks for reducing downtime amp Speed up the process
      • Common Pitfalls to Avoid
      • Slide 37
      • Workflow Purge
      • Best practices for maintaining AEM Instances (4)
      • Tips and tricks for proactive things to monitor (2)
      • Slide 41
      • Slide 42

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 4

        Optimizing replication

        Replication Tuning and Monitoring

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Monitoring Replication

        bull Replication can be monitored using JMX

        bull Each agent exposes an object

        bull The objects expose

        - If the agent is enabled

        - If the queue is blocked paused or invalid

        - The number of entries in the queue

        - Timing information

        5

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Configure a replicationlog

        6

        Why

        bull Keeps errorlog from getting bloated

        bull Isolates replication errors and warnings

        How

        bull Add an Apache Sling Logging Logger

        - Log File logsreplicationlog

        - Log Level Info

        - Logger comdaycqreplication

        bull Add an Apache Sling Logging Writer (for log rotation)

        - Log File logsreplicationlog

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 7

        Replication monitoring via JMX And Log Configuration

        DEMONSTRATION

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Replication Initializing and Queuing

        8

        User activatescontentgeometrixx-outdoorsensupport

        Durbo package

        varreplicationdata

        Content is packaged

        OSGievent is fired

        ReplicationAgentManager

        handles the event

        Sling Job Handlerqueuesstores the job

        slingeventJob

        vareventingjobs

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Replication Processing Jobs

        9

        SlingJob Handler

        Process the job through thecorrect TransportHandler

        ERROR Queue stuck

        SUCCESS Process

        next job in queue

        slingeventJob node

        vareventingjobs

        Read job from queue

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Replication Troubleshooting

        The queue can get stuck ifbull The Job Handler fails

        bull Error while sending the data- Failure to create Durbo package from

        varreplicationdata

        - Issue in class loading network malfunction etc

        bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

        unstable

        bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

        - Failure to saveimport the content

        10

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Optimizing Replication

        Optimizations

        bull Enable ldquoFile Storagerdquo of replication durbo packages

        - Go to httphostportsystemconsoleconfigMgr and login as admin

        - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

        - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

        bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

        - socketConnect can be 30 seconds = 30000

        - socketRead timeout can be 10 minutes = 600000

        11

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Optimizing Replication

        12

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Optimizing Replication

        Optimizations

        bull In the ldquoTriggersrdquo tab of the replication agent

        - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

        - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

        13

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Optimizing Replication

        14

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

        Reducing disk space usageDataStore Garbage Collection

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        What is the DataStore

        The DataStore (default implementation)

        bull Stores binary JCR properties gt 4KB (default)

        bull Only allows files to be added

        bull Stores files under crx-quickstartrepositoryrepositorydatastore

        bull Files are referenced by the JCR internal node record (persistence manager bundles)

        16

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        How does the DataStore work

        1 A unique id is generated from contents of the file

        2 The id is used for the filename

        3 The datastore directory structure is built like this

        bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

        bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

        4 Due to this files are stored uniquely so the same file will only be stored once

        17

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        DataStore Example

        User uploads the same image to two different locations

        18

        AEMpng

        Upload

        Upload

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        a2b98676377b947244bb954769def9b4fd625daa

        repositoryrepositorydatastore

        86

        b9

        a2

        DataStore Example

        19

        JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

        property

        JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

        originaljcrcontentdata property

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        How does DataStore GC work

        DataStore GC (Garbage Collection) is the only way to delete DataStore files

        How does it work

        bull ldquoScanrdquo Phase

        - Read all nodes in the JCR

        - Update the timestamp of each of the referenced datastore files

        bull ldquoDeleterdquo Phase

        - Find all files with timestamp older than when it started the scan phase and deletes them

        20

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        DataStore GC Avoiding common Pitfalls

        Before running DataStore GC make sure

        bull You have a backup of the datastore directory

        bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

        bull Date and time is in sync between network storage and CQ server

        bull CQ53 or 54 with CRX22 - at least hotfix 22070

        bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

        21

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

        How to run DataStore GCDEMONSTRATION

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        DataStore GC

        This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

        If you see that error then do not run datastore gc until you have restored the missing files

        To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

        bull Browse to Repository Configuration =gt Check Repositoryrdquo

        bull Check the Data store consistency check box

        bull Click ldquoRunrdquo

        bull This will output a list of nodes referencing the missing files along with the path of the missing file

        bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

        See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

        23

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

        How to run DataStore Consistency Check

        DEMONSTRATION

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

        Tar Persistence Manager Optimization

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Part 2 Topics Covered

        TarPM Optimization

        - What is the TarPM amp TarPM optimization

        - Best practices for maintaining AEM Instances

        - Tips and tricks for proactive things to monitor

        - Tips and tricks for reducing downtime amp Speed up the process

        Workflow Monitoring

        - Supported Features

        - Best practices for maintaining AEM Instances

        - Tips and tricks for proactive things to monitor

        26

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        What is TarPM

        27

        data_00000tar

        ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

        data_00001tar

        Bundle 01Bundle 02

        Bundle 03

        Bundle 04

        Adding New page

        Modifying

        page

        Del

        etin

        g

        page

        bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

        bull Tar PM model is append only

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        What is TarPM Optimization

        bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

        28

        bundle03

        bundle04

        bundle11

        bundle14

        data_00003tar

        TAR OPTIMIZATI

        ON

        bundle01

        bundle02

        bundle03

        bundle04

        data_00001tar

        bundle11

        bundle12

        bundle13

        bundle14

        data_00002tar

        Unused

        data

        Deletes old data tar file

        Deletes old data tar file

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Data Tar file location

        bull Default storage location of data tar files are

        29

        ltcq_homegtcrx-quickstartrepository

        data_00000tardata_00001tar

        workspaces

        crxdefault

        version

        data_00004tardata_00005tar

        data_00010tardata_00011tar

        tarJournal

        data_00012tardata_00013tar

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Best practices for maintaining AEM Instances

        Regularly run tar optimization during the low usage hours of your system

        bull Automatic Schedule-

        - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

        - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

        bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

        30

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Best practices for maintaining AEM Instances

        Manually execute TarPM optimization from JMX console

        31

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Best practices for maintaining AEM Instances

        Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

        32

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Tips and tricks for proactive things to monitor

        bull From JMX console monitor

        - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

        - TarOptimizationWork- The remaining optimization work in KiloBytes

        - TarOptimizationRate- TarPM optimization rate in KBsec

        33

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

        How to monitor Tar Optimization via JMX client

        DEMONSTRATION

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Tips and tricks for reducing downtime amp Speed up the process

        bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

        bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

        - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

        - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

        bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

        35

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Common Pitfalls to Avoid

        bull Scheduling tar optimization to run during the heavy usage hours of your system

        bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

        bull Do not run tar optimization while you are backing up instance

        bull Do not run tar optimization when datastore garbage collection is running

        bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

        36

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

        Workflow maintenance and Purge Obsolete Workflow Data

        Workflow Monitoring

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Workflow Purge

        bull Workflows enable you to automate Experience Manager activities

        bull Workflows events generate archived data

        bull This data can quickly grow over time as workflows are processed

        bull Purging this data on a regular schedule improves system performance

        bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

        38

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Best practices for maintaining AEM Instances

        Regularly run workflow purge to avoid the problems associated with a large volume of data

        bull Using user interface through Felix console

        bull Using CURL

        bull Creating a JMX client that uses Workflow Mbean

        httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

        39

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        Tips and tricks for proactive things to monitor

        40

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

        How to monitor workflow via JMX client

        DEMONSTRATION

        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

        • ADOBE CUSTOMER BROWN BAG SERIES
        • Whatrsquos Covered
        • Topics covered
        • Slide 4
        • Monitoring Replication
        • Configure a replicationlog
        • Slide 7
        • Replication Initializing and Queuing
        • Replication Processing Jobs
        • Replication Troubleshooting
        • Optimizing Replication
        • Optimizing Replication (2)
        • Optimizing Replication (3)
        • Optimizing Replication (4)
        • Slide 15
        • What is the DataStore
        • How does the DataStore work
        • DataStore Example
        • DataStore Example (2)
        • How does DataStore GC work
        • DataStore GC Avoiding common Pitfalls
        • Slide 22
        • DataStore GC
        • Slide 24
        • Slide 25
        • Part 2 Topics Covered
        • What is TarPM
        • What is TarPM Optimization
        • Data Tar file location
        • Best practices for maintaining AEM Instances
        • Best practices for maintaining AEM Instances (2)
        • Best practices for maintaining AEM Instances (3)
        • Tips and tricks for proactive things to monitor
        • Slide 34
        • Tips and tricks for reducing downtime amp Speed up the process
        • Common Pitfalls to Avoid
        • Slide 37
        • Workflow Purge
        • Best practices for maintaining AEM Instances (4)
        • Tips and tricks for proactive things to monitor (2)
        • Slide 41
        • Slide 42

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Monitoring Replication

          bull Replication can be monitored using JMX

          bull Each agent exposes an object

          bull The objects expose

          - If the agent is enabled

          - If the queue is blocked paused or invalid

          - The number of entries in the queue

          - Timing information

          5

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Configure a replicationlog

          6

          Why

          bull Keeps errorlog from getting bloated

          bull Isolates replication errors and warnings

          How

          bull Add an Apache Sling Logging Logger

          - Log File logsreplicationlog

          - Log Level Info

          - Logger comdaycqreplication

          bull Add an Apache Sling Logging Writer (for log rotation)

          - Log File logsreplicationlog

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 7

          Replication monitoring via JMX And Log Configuration

          DEMONSTRATION

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Replication Initializing and Queuing

          8

          User activatescontentgeometrixx-outdoorsensupport

          Durbo package

          varreplicationdata

          Content is packaged

          OSGievent is fired

          ReplicationAgentManager

          handles the event

          Sling Job Handlerqueuesstores the job

          slingeventJob

          vareventingjobs

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Replication Processing Jobs

          9

          SlingJob Handler

          Process the job through thecorrect TransportHandler

          ERROR Queue stuck

          SUCCESS Process

          next job in queue

          slingeventJob node

          vareventingjobs

          Read job from queue

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Replication Troubleshooting

          The queue can get stuck ifbull The Job Handler fails

          bull Error while sending the data- Failure to create Durbo package from

          varreplicationdata

          - Issue in class loading network malfunction etc

          bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

          unstable

          bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

          - Failure to saveimport the content

          10

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Optimizing Replication

          Optimizations

          bull Enable ldquoFile Storagerdquo of replication durbo packages

          - Go to httphostportsystemconsoleconfigMgr and login as admin

          - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

          - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

          bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

          - socketConnect can be 30 seconds = 30000

          - socketRead timeout can be 10 minutes = 600000

          11

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Optimizing Replication

          12

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Optimizing Replication

          Optimizations

          bull In the ldquoTriggersrdquo tab of the replication agent

          - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

          - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

          13

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Optimizing Replication

          14

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

          Reducing disk space usageDataStore Garbage Collection

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          What is the DataStore

          The DataStore (default implementation)

          bull Stores binary JCR properties gt 4KB (default)

          bull Only allows files to be added

          bull Stores files under crx-quickstartrepositoryrepositorydatastore

          bull Files are referenced by the JCR internal node record (persistence manager bundles)

          16

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          How does the DataStore work

          1 A unique id is generated from contents of the file

          2 The id is used for the filename

          3 The datastore directory structure is built like this

          bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

          bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

          4 Due to this files are stored uniquely so the same file will only be stored once

          17

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          DataStore Example

          User uploads the same image to two different locations

          18

          AEMpng

          Upload

          Upload

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          a2b98676377b947244bb954769def9b4fd625daa

          repositoryrepositorydatastore

          86

          b9

          a2

          DataStore Example

          19

          JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

          property

          JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

          originaljcrcontentdata property

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          How does DataStore GC work

          DataStore GC (Garbage Collection) is the only way to delete DataStore files

          How does it work

          bull ldquoScanrdquo Phase

          - Read all nodes in the JCR

          - Update the timestamp of each of the referenced datastore files

          bull ldquoDeleterdquo Phase

          - Find all files with timestamp older than when it started the scan phase and deletes them

          20

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          DataStore GC Avoiding common Pitfalls

          Before running DataStore GC make sure

          bull You have a backup of the datastore directory

          bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

          bull Date and time is in sync between network storage and CQ server

          bull CQ53 or 54 with CRX22 - at least hotfix 22070

          bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

          21

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

          How to run DataStore GCDEMONSTRATION

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          DataStore GC

          This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

          If you see that error then do not run datastore gc until you have restored the missing files

          To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

          bull Browse to Repository Configuration =gt Check Repositoryrdquo

          bull Check the Data store consistency check box

          bull Click ldquoRunrdquo

          bull This will output a list of nodes referencing the missing files along with the path of the missing file

          bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

          See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

          23

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

          How to run DataStore Consistency Check

          DEMONSTRATION

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

          Tar Persistence Manager Optimization

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Part 2 Topics Covered

          TarPM Optimization

          - What is the TarPM amp TarPM optimization

          - Best practices for maintaining AEM Instances

          - Tips and tricks for proactive things to monitor

          - Tips and tricks for reducing downtime amp Speed up the process

          Workflow Monitoring

          - Supported Features

          - Best practices for maintaining AEM Instances

          - Tips and tricks for proactive things to monitor

          26

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          What is TarPM

          27

          data_00000tar

          ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

          data_00001tar

          Bundle 01Bundle 02

          Bundle 03

          Bundle 04

          Adding New page

          Modifying

          page

          Del

          etin

          g

          page

          bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

          bull Tar PM model is append only

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          What is TarPM Optimization

          bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

          28

          bundle03

          bundle04

          bundle11

          bundle14

          data_00003tar

          TAR OPTIMIZATI

          ON

          bundle01

          bundle02

          bundle03

          bundle04

          data_00001tar

          bundle11

          bundle12

          bundle13

          bundle14

          data_00002tar

          Unused

          data

          Deletes old data tar file

          Deletes old data tar file

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Data Tar file location

          bull Default storage location of data tar files are

          29

          ltcq_homegtcrx-quickstartrepository

          data_00000tardata_00001tar

          workspaces

          crxdefault

          version

          data_00004tardata_00005tar

          data_00010tardata_00011tar

          tarJournal

          data_00012tardata_00013tar

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Best practices for maintaining AEM Instances

          Regularly run tar optimization during the low usage hours of your system

          bull Automatic Schedule-

          - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

          - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

          bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

          30

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Best practices for maintaining AEM Instances

          Manually execute TarPM optimization from JMX console

          31

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Best practices for maintaining AEM Instances

          Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

          32

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Tips and tricks for proactive things to monitor

          bull From JMX console monitor

          - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

          - TarOptimizationWork- The remaining optimization work in KiloBytes

          - TarOptimizationRate- TarPM optimization rate in KBsec

          33

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

          How to monitor Tar Optimization via JMX client

          DEMONSTRATION

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Tips and tricks for reducing downtime amp Speed up the process

          bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

          bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

          - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

          - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

          bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

          35

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Common Pitfalls to Avoid

          bull Scheduling tar optimization to run during the heavy usage hours of your system

          bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

          bull Do not run tar optimization while you are backing up instance

          bull Do not run tar optimization when datastore garbage collection is running

          bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

          36

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

          Workflow maintenance and Purge Obsolete Workflow Data

          Workflow Monitoring

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Workflow Purge

          bull Workflows enable you to automate Experience Manager activities

          bull Workflows events generate archived data

          bull This data can quickly grow over time as workflows are processed

          bull Purging this data on a regular schedule improves system performance

          bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

          38

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Best practices for maintaining AEM Instances

          Regularly run workflow purge to avoid the problems associated with a large volume of data

          bull Using user interface through Felix console

          bull Using CURL

          bull Creating a JMX client that uses Workflow Mbean

          httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

          39

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          Tips and tricks for proactive things to monitor

          40

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

          How to monitor workflow via JMX client

          DEMONSTRATION

          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

          • ADOBE CUSTOMER BROWN BAG SERIES
          • Whatrsquos Covered
          • Topics covered
          • Slide 4
          • Monitoring Replication
          • Configure a replicationlog
          • Slide 7
          • Replication Initializing and Queuing
          • Replication Processing Jobs
          • Replication Troubleshooting
          • Optimizing Replication
          • Optimizing Replication (2)
          • Optimizing Replication (3)
          • Optimizing Replication (4)
          • Slide 15
          • What is the DataStore
          • How does the DataStore work
          • DataStore Example
          • DataStore Example (2)
          • How does DataStore GC work
          • DataStore GC Avoiding common Pitfalls
          • Slide 22
          • DataStore GC
          • Slide 24
          • Slide 25
          • Part 2 Topics Covered
          • What is TarPM
          • What is TarPM Optimization
          • Data Tar file location
          • Best practices for maintaining AEM Instances
          • Best practices for maintaining AEM Instances (2)
          • Best practices for maintaining AEM Instances (3)
          • Tips and tricks for proactive things to monitor
          • Slide 34
          • Tips and tricks for reducing downtime amp Speed up the process
          • Common Pitfalls to Avoid
          • Slide 37
          • Workflow Purge
          • Best practices for maintaining AEM Instances (4)
          • Tips and tricks for proactive things to monitor (2)
          • Slide 41
          • Slide 42

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Configure a replicationlog

            6

            Why

            bull Keeps errorlog from getting bloated

            bull Isolates replication errors and warnings

            How

            bull Add an Apache Sling Logging Logger

            - Log File logsreplicationlog

            - Log Level Info

            - Logger comdaycqreplication

            bull Add an Apache Sling Logging Writer (for log rotation)

            - Log File logsreplicationlog

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 7

            Replication monitoring via JMX And Log Configuration

            DEMONSTRATION

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Replication Initializing and Queuing

            8

            User activatescontentgeometrixx-outdoorsensupport

            Durbo package

            varreplicationdata

            Content is packaged

            OSGievent is fired

            ReplicationAgentManager

            handles the event

            Sling Job Handlerqueuesstores the job

            slingeventJob

            vareventingjobs

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Replication Processing Jobs

            9

            SlingJob Handler

            Process the job through thecorrect TransportHandler

            ERROR Queue stuck

            SUCCESS Process

            next job in queue

            slingeventJob node

            vareventingjobs

            Read job from queue

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Replication Troubleshooting

            The queue can get stuck ifbull The Job Handler fails

            bull Error while sending the data- Failure to create Durbo package from

            varreplicationdata

            - Issue in class loading network malfunction etc

            bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

            unstable

            bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

            - Failure to saveimport the content

            10

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Optimizing Replication

            Optimizations

            bull Enable ldquoFile Storagerdquo of replication durbo packages

            - Go to httphostportsystemconsoleconfigMgr and login as admin

            - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

            - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

            bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

            - socketConnect can be 30 seconds = 30000

            - socketRead timeout can be 10 minutes = 600000

            11

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Optimizing Replication

            12

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Optimizing Replication

            Optimizations

            bull In the ldquoTriggersrdquo tab of the replication agent

            - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

            - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

            13

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Optimizing Replication

            14

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

            Reducing disk space usageDataStore Garbage Collection

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            What is the DataStore

            The DataStore (default implementation)

            bull Stores binary JCR properties gt 4KB (default)

            bull Only allows files to be added

            bull Stores files under crx-quickstartrepositoryrepositorydatastore

            bull Files are referenced by the JCR internal node record (persistence manager bundles)

            16

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            How does the DataStore work

            1 A unique id is generated from contents of the file

            2 The id is used for the filename

            3 The datastore directory structure is built like this

            bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

            bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

            4 Due to this files are stored uniquely so the same file will only be stored once

            17

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            DataStore Example

            User uploads the same image to two different locations

            18

            AEMpng

            Upload

            Upload

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            a2b98676377b947244bb954769def9b4fd625daa

            repositoryrepositorydatastore

            86

            b9

            a2

            DataStore Example

            19

            JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

            property

            JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

            originaljcrcontentdata property

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            How does DataStore GC work

            DataStore GC (Garbage Collection) is the only way to delete DataStore files

            How does it work

            bull ldquoScanrdquo Phase

            - Read all nodes in the JCR

            - Update the timestamp of each of the referenced datastore files

            bull ldquoDeleterdquo Phase

            - Find all files with timestamp older than when it started the scan phase and deletes them

            20

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            DataStore GC Avoiding common Pitfalls

            Before running DataStore GC make sure

            bull You have a backup of the datastore directory

            bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

            bull Date and time is in sync between network storage and CQ server

            bull CQ53 or 54 with CRX22 - at least hotfix 22070

            bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

            21

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

            How to run DataStore GCDEMONSTRATION

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            DataStore GC

            This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

            If you see that error then do not run datastore gc until you have restored the missing files

            To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

            bull Browse to Repository Configuration =gt Check Repositoryrdquo

            bull Check the Data store consistency check box

            bull Click ldquoRunrdquo

            bull This will output a list of nodes referencing the missing files along with the path of the missing file

            bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

            See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

            23

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

            How to run DataStore Consistency Check

            DEMONSTRATION

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

            Tar Persistence Manager Optimization

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Part 2 Topics Covered

            TarPM Optimization

            - What is the TarPM amp TarPM optimization

            - Best practices for maintaining AEM Instances

            - Tips and tricks for proactive things to monitor

            - Tips and tricks for reducing downtime amp Speed up the process

            Workflow Monitoring

            - Supported Features

            - Best practices for maintaining AEM Instances

            - Tips and tricks for proactive things to monitor

            26

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            What is TarPM

            27

            data_00000tar

            ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

            data_00001tar

            Bundle 01Bundle 02

            Bundle 03

            Bundle 04

            Adding New page

            Modifying

            page

            Del

            etin

            g

            page

            bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

            bull Tar PM model is append only

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            What is TarPM Optimization

            bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

            28

            bundle03

            bundle04

            bundle11

            bundle14

            data_00003tar

            TAR OPTIMIZATI

            ON

            bundle01

            bundle02

            bundle03

            bundle04

            data_00001tar

            bundle11

            bundle12

            bundle13

            bundle14

            data_00002tar

            Unused

            data

            Deletes old data tar file

            Deletes old data tar file

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Data Tar file location

            bull Default storage location of data tar files are

            29

            ltcq_homegtcrx-quickstartrepository

            data_00000tardata_00001tar

            workspaces

            crxdefault

            version

            data_00004tardata_00005tar

            data_00010tardata_00011tar

            tarJournal

            data_00012tardata_00013tar

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Best practices for maintaining AEM Instances

            Regularly run tar optimization during the low usage hours of your system

            bull Automatic Schedule-

            - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

            - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

            bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

            30

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Best practices for maintaining AEM Instances

            Manually execute TarPM optimization from JMX console

            31

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Best practices for maintaining AEM Instances

            Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

            32

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Tips and tricks for proactive things to monitor

            bull From JMX console monitor

            - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

            - TarOptimizationWork- The remaining optimization work in KiloBytes

            - TarOptimizationRate- TarPM optimization rate in KBsec

            33

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

            How to monitor Tar Optimization via JMX client

            DEMONSTRATION

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Tips and tricks for reducing downtime amp Speed up the process

            bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

            bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

            - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

            - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

            bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

            35

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Common Pitfalls to Avoid

            bull Scheduling tar optimization to run during the heavy usage hours of your system

            bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

            bull Do not run tar optimization while you are backing up instance

            bull Do not run tar optimization when datastore garbage collection is running

            bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

            36

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

            Workflow maintenance and Purge Obsolete Workflow Data

            Workflow Monitoring

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Workflow Purge

            bull Workflows enable you to automate Experience Manager activities

            bull Workflows events generate archived data

            bull This data can quickly grow over time as workflows are processed

            bull Purging this data on a regular schedule improves system performance

            bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

            38

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Best practices for maintaining AEM Instances

            Regularly run workflow purge to avoid the problems associated with a large volume of data

            bull Using user interface through Felix console

            bull Using CURL

            bull Creating a JMX client that uses Workflow Mbean

            httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

            39

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            Tips and tricks for proactive things to monitor

            40

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

            How to monitor workflow via JMX client

            DEMONSTRATION

            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

            • ADOBE CUSTOMER BROWN BAG SERIES
            • Whatrsquos Covered
            • Topics covered
            • Slide 4
            • Monitoring Replication
            • Configure a replicationlog
            • Slide 7
            • Replication Initializing and Queuing
            • Replication Processing Jobs
            • Replication Troubleshooting
            • Optimizing Replication
            • Optimizing Replication (2)
            • Optimizing Replication (3)
            • Optimizing Replication (4)
            • Slide 15
            • What is the DataStore
            • How does the DataStore work
            • DataStore Example
            • DataStore Example (2)
            • How does DataStore GC work
            • DataStore GC Avoiding common Pitfalls
            • Slide 22
            • DataStore GC
            • Slide 24
            • Slide 25
            • Part 2 Topics Covered
            • What is TarPM
            • What is TarPM Optimization
            • Data Tar file location
            • Best practices for maintaining AEM Instances
            • Best practices for maintaining AEM Instances (2)
            • Best practices for maintaining AEM Instances (3)
            • Tips and tricks for proactive things to monitor
            • Slide 34
            • Tips and tricks for reducing downtime amp Speed up the process
            • Common Pitfalls to Avoid
            • Slide 37
            • Workflow Purge
            • Best practices for maintaining AEM Instances (4)
            • Tips and tricks for proactive things to monitor (2)
            • Slide 41
            • Slide 42

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 7

              Replication monitoring via JMX And Log Configuration

              DEMONSTRATION

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Replication Initializing and Queuing

              8

              User activatescontentgeometrixx-outdoorsensupport

              Durbo package

              varreplicationdata

              Content is packaged

              OSGievent is fired

              ReplicationAgentManager

              handles the event

              Sling Job Handlerqueuesstores the job

              slingeventJob

              vareventingjobs

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Replication Processing Jobs

              9

              SlingJob Handler

              Process the job through thecorrect TransportHandler

              ERROR Queue stuck

              SUCCESS Process

              next job in queue

              slingeventJob node

              vareventingjobs

              Read job from queue

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Replication Troubleshooting

              The queue can get stuck ifbull The Job Handler fails

              bull Error while sending the data- Failure to create Durbo package from

              varreplicationdata

              - Issue in class loading network malfunction etc

              bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

              unstable

              bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

              - Failure to saveimport the content

              10

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Optimizing Replication

              Optimizations

              bull Enable ldquoFile Storagerdquo of replication durbo packages

              - Go to httphostportsystemconsoleconfigMgr and login as admin

              - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

              - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

              bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

              - socketConnect can be 30 seconds = 30000

              - socketRead timeout can be 10 minutes = 600000

              11

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Optimizing Replication

              12

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Optimizing Replication

              Optimizations

              bull In the ldquoTriggersrdquo tab of the replication agent

              - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

              - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

              13

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Optimizing Replication

              14

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

              Reducing disk space usageDataStore Garbage Collection

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              What is the DataStore

              The DataStore (default implementation)

              bull Stores binary JCR properties gt 4KB (default)

              bull Only allows files to be added

              bull Stores files under crx-quickstartrepositoryrepositorydatastore

              bull Files are referenced by the JCR internal node record (persistence manager bundles)

              16

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              How does the DataStore work

              1 A unique id is generated from contents of the file

              2 The id is used for the filename

              3 The datastore directory structure is built like this

              bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

              bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

              4 Due to this files are stored uniquely so the same file will only be stored once

              17

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              DataStore Example

              User uploads the same image to two different locations

              18

              AEMpng

              Upload

              Upload

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              a2b98676377b947244bb954769def9b4fd625daa

              repositoryrepositorydatastore

              86

              b9

              a2

              DataStore Example

              19

              JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

              property

              JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

              originaljcrcontentdata property

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              How does DataStore GC work

              DataStore GC (Garbage Collection) is the only way to delete DataStore files

              How does it work

              bull ldquoScanrdquo Phase

              - Read all nodes in the JCR

              - Update the timestamp of each of the referenced datastore files

              bull ldquoDeleterdquo Phase

              - Find all files with timestamp older than when it started the scan phase and deletes them

              20

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              DataStore GC Avoiding common Pitfalls

              Before running DataStore GC make sure

              bull You have a backup of the datastore directory

              bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

              bull Date and time is in sync between network storage and CQ server

              bull CQ53 or 54 with CRX22 - at least hotfix 22070

              bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

              21

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

              How to run DataStore GCDEMONSTRATION

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              DataStore GC

              This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

              If you see that error then do not run datastore gc until you have restored the missing files

              To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

              bull Browse to Repository Configuration =gt Check Repositoryrdquo

              bull Check the Data store consistency check box

              bull Click ldquoRunrdquo

              bull This will output a list of nodes referencing the missing files along with the path of the missing file

              bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

              See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

              23

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

              How to run DataStore Consistency Check

              DEMONSTRATION

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

              Tar Persistence Manager Optimization

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Part 2 Topics Covered

              TarPM Optimization

              - What is the TarPM amp TarPM optimization

              - Best practices for maintaining AEM Instances

              - Tips and tricks for proactive things to monitor

              - Tips and tricks for reducing downtime amp Speed up the process

              Workflow Monitoring

              - Supported Features

              - Best practices for maintaining AEM Instances

              - Tips and tricks for proactive things to monitor

              26

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              What is TarPM

              27

              data_00000tar

              ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

              data_00001tar

              Bundle 01Bundle 02

              Bundle 03

              Bundle 04

              Adding New page

              Modifying

              page

              Del

              etin

              g

              page

              bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

              bull Tar PM model is append only

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              What is TarPM Optimization

              bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

              28

              bundle03

              bundle04

              bundle11

              bundle14

              data_00003tar

              TAR OPTIMIZATI

              ON

              bundle01

              bundle02

              bundle03

              bundle04

              data_00001tar

              bundle11

              bundle12

              bundle13

              bundle14

              data_00002tar

              Unused

              data

              Deletes old data tar file

              Deletes old data tar file

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Data Tar file location

              bull Default storage location of data tar files are

              29

              ltcq_homegtcrx-quickstartrepository

              data_00000tardata_00001tar

              workspaces

              crxdefault

              version

              data_00004tardata_00005tar

              data_00010tardata_00011tar

              tarJournal

              data_00012tardata_00013tar

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Best practices for maintaining AEM Instances

              Regularly run tar optimization during the low usage hours of your system

              bull Automatic Schedule-

              - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

              - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

              bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

              30

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Best practices for maintaining AEM Instances

              Manually execute TarPM optimization from JMX console

              31

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Best practices for maintaining AEM Instances

              Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

              32

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Tips and tricks for proactive things to monitor

              bull From JMX console monitor

              - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

              - TarOptimizationWork- The remaining optimization work in KiloBytes

              - TarOptimizationRate- TarPM optimization rate in KBsec

              33

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

              How to monitor Tar Optimization via JMX client

              DEMONSTRATION

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Tips and tricks for reducing downtime amp Speed up the process

              bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

              bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

              - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

              - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

              bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

              35

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Common Pitfalls to Avoid

              bull Scheduling tar optimization to run during the heavy usage hours of your system

              bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

              bull Do not run tar optimization while you are backing up instance

              bull Do not run tar optimization when datastore garbage collection is running

              bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

              36

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

              Workflow maintenance and Purge Obsolete Workflow Data

              Workflow Monitoring

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Workflow Purge

              bull Workflows enable you to automate Experience Manager activities

              bull Workflows events generate archived data

              bull This data can quickly grow over time as workflows are processed

              bull Purging this data on a regular schedule improves system performance

              bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

              38

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Best practices for maintaining AEM Instances

              Regularly run workflow purge to avoid the problems associated with a large volume of data

              bull Using user interface through Felix console

              bull Using CURL

              bull Creating a JMX client that uses Workflow Mbean

              httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

              39

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              Tips and tricks for proactive things to monitor

              40

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

              How to monitor workflow via JMX client

              DEMONSTRATION

              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

              • ADOBE CUSTOMER BROWN BAG SERIES
              • Whatrsquos Covered
              • Topics covered
              • Slide 4
              • Monitoring Replication
              • Configure a replicationlog
              • Slide 7
              • Replication Initializing and Queuing
              • Replication Processing Jobs
              • Replication Troubleshooting
              • Optimizing Replication
              • Optimizing Replication (2)
              • Optimizing Replication (3)
              • Optimizing Replication (4)
              • Slide 15
              • What is the DataStore
              • How does the DataStore work
              • DataStore Example
              • DataStore Example (2)
              • How does DataStore GC work
              • DataStore GC Avoiding common Pitfalls
              • Slide 22
              • DataStore GC
              • Slide 24
              • Slide 25
              • Part 2 Topics Covered
              • What is TarPM
              • What is TarPM Optimization
              • Data Tar file location
              • Best practices for maintaining AEM Instances
              • Best practices for maintaining AEM Instances (2)
              • Best practices for maintaining AEM Instances (3)
              • Tips and tricks for proactive things to monitor
              • Slide 34
              • Tips and tricks for reducing downtime amp Speed up the process
              • Common Pitfalls to Avoid
              • Slide 37
              • Workflow Purge
              • Best practices for maintaining AEM Instances (4)
              • Tips and tricks for proactive things to monitor (2)
              • Slide 41
              • Slide 42

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Replication Initializing and Queuing

                8

                User activatescontentgeometrixx-outdoorsensupport

                Durbo package

                varreplicationdata

                Content is packaged

                OSGievent is fired

                ReplicationAgentManager

                handles the event

                Sling Job Handlerqueuesstores the job

                slingeventJob

                vareventingjobs

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Replication Processing Jobs

                9

                SlingJob Handler

                Process the job through thecorrect TransportHandler

                ERROR Queue stuck

                SUCCESS Process

                next job in queue

                slingeventJob node

                vareventingjobs

                Read job from queue

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Replication Troubleshooting

                The queue can get stuck ifbull The Job Handler fails

                bull Error while sending the data- Failure to create Durbo package from

                varreplicationdata

                - Issue in class loading network malfunction etc

                bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

                unstable

                bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

                - Failure to saveimport the content

                10

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Optimizing Replication

                Optimizations

                bull Enable ldquoFile Storagerdquo of replication durbo packages

                - Go to httphostportsystemconsoleconfigMgr and login as admin

                - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

                - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

                bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

                - socketConnect can be 30 seconds = 30000

                - socketRead timeout can be 10 minutes = 600000

                11

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Optimizing Replication

                12

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Optimizing Replication

                Optimizations

                bull In the ldquoTriggersrdquo tab of the replication agent

                - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

                - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

                13

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Optimizing Replication

                14

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                Reducing disk space usageDataStore Garbage Collection

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                What is the DataStore

                The DataStore (default implementation)

                bull Stores binary JCR properties gt 4KB (default)

                bull Only allows files to be added

                bull Stores files under crx-quickstartrepositoryrepositorydatastore

                bull Files are referenced by the JCR internal node record (persistence manager bundles)

                16

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                How does the DataStore work

                1 A unique id is generated from contents of the file

                2 The id is used for the filename

                3 The datastore directory structure is built like this

                bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                4 Due to this files are stored uniquely so the same file will only be stored once

                17

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                DataStore Example

                User uploads the same image to two different locations

                18

                AEMpng

                Upload

                Upload

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                a2b98676377b947244bb954769def9b4fd625daa

                repositoryrepositorydatastore

                86

                b9

                a2

                DataStore Example

                19

                JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                property

                JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                originaljcrcontentdata property

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                How does DataStore GC work

                DataStore GC (Garbage Collection) is the only way to delete DataStore files

                How does it work

                bull ldquoScanrdquo Phase

                - Read all nodes in the JCR

                - Update the timestamp of each of the referenced datastore files

                bull ldquoDeleterdquo Phase

                - Find all files with timestamp older than when it started the scan phase and deletes them

                20

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                DataStore GC Avoiding common Pitfalls

                Before running DataStore GC make sure

                bull You have a backup of the datastore directory

                bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                bull Date and time is in sync between network storage and CQ server

                bull CQ53 or 54 with CRX22 - at least hotfix 22070

                bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                21

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                How to run DataStore GCDEMONSTRATION

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                DataStore GC

                This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                If you see that error then do not run datastore gc until you have restored the missing files

                To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                bull Browse to Repository Configuration =gt Check Repositoryrdquo

                bull Check the Data store consistency check box

                bull Click ldquoRunrdquo

                bull This will output a list of nodes referencing the missing files along with the path of the missing file

                bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                23

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                How to run DataStore Consistency Check

                DEMONSTRATION

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                Tar Persistence Manager Optimization

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Part 2 Topics Covered

                TarPM Optimization

                - What is the TarPM amp TarPM optimization

                - Best practices for maintaining AEM Instances

                - Tips and tricks for proactive things to monitor

                - Tips and tricks for reducing downtime amp Speed up the process

                Workflow Monitoring

                - Supported Features

                - Best practices for maintaining AEM Instances

                - Tips and tricks for proactive things to monitor

                26

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                What is TarPM

                27

                data_00000tar

                ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                data_00001tar

                Bundle 01Bundle 02

                Bundle 03

                Bundle 04

                Adding New page

                Modifying

                page

                Del

                etin

                g

                page

                bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                bull Tar PM model is append only

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                What is TarPM Optimization

                bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                28

                bundle03

                bundle04

                bundle11

                bundle14

                data_00003tar

                TAR OPTIMIZATI

                ON

                bundle01

                bundle02

                bundle03

                bundle04

                data_00001tar

                bundle11

                bundle12

                bundle13

                bundle14

                data_00002tar

                Unused

                data

                Deletes old data tar file

                Deletes old data tar file

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Data Tar file location

                bull Default storage location of data tar files are

                29

                ltcq_homegtcrx-quickstartrepository

                data_00000tardata_00001tar

                workspaces

                crxdefault

                version

                data_00004tardata_00005tar

                data_00010tardata_00011tar

                tarJournal

                data_00012tardata_00013tar

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Best practices for maintaining AEM Instances

                Regularly run tar optimization during the low usage hours of your system

                bull Automatic Schedule-

                - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                30

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Best practices for maintaining AEM Instances

                Manually execute TarPM optimization from JMX console

                31

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Best practices for maintaining AEM Instances

                Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                32

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Tips and tricks for proactive things to monitor

                bull From JMX console monitor

                - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                - TarOptimizationWork- The remaining optimization work in KiloBytes

                - TarOptimizationRate- TarPM optimization rate in KBsec

                33

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                How to monitor Tar Optimization via JMX client

                DEMONSTRATION

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Tips and tricks for reducing downtime amp Speed up the process

                bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                35

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Common Pitfalls to Avoid

                bull Scheduling tar optimization to run during the heavy usage hours of your system

                bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                bull Do not run tar optimization while you are backing up instance

                bull Do not run tar optimization when datastore garbage collection is running

                bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                36

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                Workflow maintenance and Purge Obsolete Workflow Data

                Workflow Monitoring

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Workflow Purge

                bull Workflows enable you to automate Experience Manager activities

                bull Workflows events generate archived data

                bull This data can quickly grow over time as workflows are processed

                bull Purging this data on a regular schedule improves system performance

                bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                38

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Best practices for maintaining AEM Instances

                Regularly run workflow purge to avoid the problems associated with a large volume of data

                bull Using user interface through Felix console

                bull Using CURL

                bull Creating a JMX client that uses Workflow Mbean

                httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                39

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                Tips and tricks for proactive things to monitor

                40

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                How to monitor workflow via JMX client

                DEMONSTRATION

                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                • ADOBE CUSTOMER BROWN BAG SERIES
                • Whatrsquos Covered
                • Topics covered
                • Slide 4
                • Monitoring Replication
                • Configure a replicationlog
                • Slide 7
                • Replication Initializing and Queuing
                • Replication Processing Jobs
                • Replication Troubleshooting
                • Optimizing Replication
                • Optimizing Replication (2)
                • Optimizing Replication (3)
                • Optimizing Replication (4)
                • Slide 15
                • What is the DataStore
                • How does the DataStore work
                • DataStore Example
                • DataStore Example (2)
                • How does DataStore GC work
                • DataStore GC Avoiding common Pitfalls
                • Slide 22
                • DataStore GC
                • Slide 24
                • Slide 25
                • Part 2 Topics Covered
                • What is TarPM
                • What is TarPM Optimization
                • Data Tar file location
                • Best practices for maintaining AEM Instances
                • Best practices for maintaining AEM Instances (2)
                • Best practices for maintaining AEM Instances (3)
                • Tips and tricks for proactive things to monitor
                • Slide 34
                • Tips and tricks for reducing downtime amp Speed up the process
                • Common Pitfalls to Avoid
                • Slide 37
                • Workflow Purge
                • Best practices for maintaining AEM Instances (4)
                • Tips and tricks for proactive things to monitor (2)
                • Slide 41
                • Slide 42

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Replication Processing Jobs

                  9

                  SlingJob Handler

                  Process the job through thecorrect TransportHandler

                  ERROR Queue stuck

                  SUCCESS Process

                  next job in queue

                  slingeventJob node

                  vareventingjobs

                  Read job from queue

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Replication Troubleshooting

                  The queue can get stuck ifbull The Job Handler fails

                  bull Error while sending the data- Failure to create Durbo package from

                  varreplicationdata

                  - Issue in class loading network malfunction etc

                  bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

                  unstable

                  bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

                  - Failure to saveimport the content

                  10

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Optimizing Replication

                  Optimizations

                  bull Enable ldquoFile Storagerdquo of replication durbo packages

                  - Go to httphostportsystemconsoleconfigMgr and login as admin

                  - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

                  - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

                  bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

                  - socketConnect can be 30 seconds = 30000

                  - socketRead timeout can be 10 minutes = 600000

                  11

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Optimizing Replication

                  12

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Optimizing Replication

                  Optimizations

                  bull In the ldquoTriggersrdquo tab of the replication agent

                  - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

                  - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

                  13

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Optimizing Replication

                  14

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                  Reducing disk space usageDataStore Garbage Collection

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  What is the DataStore

                  The DataStore (default implementation)

                  bull Stores binary JCR properties gt 4KB (default)

                  bull Only allows files to be added

                  bull Stores files under crx-quickstartrepositoryrepositorydatastore

                  bull Files are referenced by the JCR internal node record (persistence manager bundles)

                  16

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  How does the DataStore work

                  1 A unique id is generated from contents of the file

                  2 The id is used for the filename

                  3 The datastore directory structure is built like this

                  bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                  bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                  4 Due to this files are stored uniquely so the same file will only be stored once

                  17

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  DataStore Example

                  User uploads the same image to two different locations

                  18

                  AEMpng

                  Upload

                  Upload

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  a2b98676377b947244bb954769def9b4fd625daa

                  repositoryrepositorydatastore

                  86

                  b9

                  a2

                  DataStore Example

                  19

                  JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                  property

                  JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                  originaljcrcontentdata property

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  How does DataStore GC work

                  DataStore GC (Garbage Collection) is the only way to delete DataStore files

                  How does it work

                  bull ldquoScanrdquo Phase

                  - Read all nodes in the JCR

                  - Update the timestamp of each of the referenced datastore files

                  bull ldquoDeleterdquo Phase

                  - Find all files with timestamp older than when it started the scan phase and deletes them

                  20

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  DataStore GC Avoiding common Pitfalls

                  Before running DataStore GC make sure

                  bull You have a backup of the datastore directory

                  bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                  bull Date and time is in sync between network storage and CQ server

                  bull CQ53 or 54 with CRX22 - at least hotfix 22070

                  bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                  21

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                  How to run DataStore GCDEMONSTRATION

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  DataStore GC

                  This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                  If you see that error then do not run datastore gc until you have restored the missing files

                  To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                  bull Browse to Repository Configuration =gt Check Repositoryrdquo

                  bull Check the Data store consistency check box

                  bull Click ldquoRunrdquo

                  bull This will output a list of nodes referencing the missing files along with the path of the missing file

                  bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                  See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                  23

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                  How to run DataStore Consistency Check

                  DEMONSTRATION

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                  Tar Persistence Manager Optimization

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Part 2 Topics Covered

                  TarPM Optimization

                  - What is the TarPM amp TarPM optimization

                  - Best practices for maintaining AEM Instances

                  - Tips and tricks for proactive things to monitor

                  - Tips and tricks for reducing downtime amp Speed up the process

                  Workflow Monitoring

                  - Supported Features

                  - Best practices for maintaining AEM Instances

                  - Tips and tricks for proactive things to monitor

                  26

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  What is TarPM

                  27

                  data_00000tar

                  ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                  data_00001tar

                  Bundle 01Bundle 02

                  Bundle 03

                  Bundle 04

                  Adding New page

                  Modifying

                  page

                  Del

                  etin

                  g

                  page

                  bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                  bull Tar PM model is append only

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  What is TarPM Optimization

                  bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                  28

                  bundle03

                  bundle04

                  bundle11

                  bundle14

                  data_00003tar

                  TAR OPTIMIZATI

                  ON

                  bundle01

                  bundle02

                  bundle03

                  bundle04

                  data_00001tar

                  bundle11

                  bundle12

                  bundle13

                  bundle14

                  data_00002tar

                  Unused

                  data

                  Deletes old data tar file

                  Deletes old data tar file

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Data Tar file location

                  bull Default storage location of data tar files are

                  29

                  ltcq_homegtcrx-quickstartrepository

                  data_00000tardata_00001tar

                  workspaces

                  crxdefault

                  version

                  data_00004tardata_00005tar

                  data_00010tardata_00011tar

                  tarJournal

                  data_00012tardata_00013tar

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Best practices for maintaining AEM Instances

                  Regularly run tar optimization during the low usage hours of your system

                  bull Automatic Schedule-

                  - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                  - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                  bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                  30

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Best practices for maintaining AEM Instances

                  Manually execute TarPM optimization from JMX console

                  31

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Best practices for maintaining AEM Instances

                  Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                  32

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Tips and tricks for proactive things to monitor

                  bull From JMX console monitor

                  - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                  - TarOptimizationWork- The remaining optimization work in KiloBytes

                  - TarOptimizationRate- TarPM optimization rate in KBsec

                  33

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                  How to monitor Tar Optimization via JMX client

                  DEMONSTRATION

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Tips and tricks for reducing downtime amp Speed up the process

                  bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                  bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                  - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                  - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                  bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                  35

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Common Pitfalls to Avoid

                  bull Scheduling tar optimization to run during the heavy usage hours of your system

                  bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                  bull Do not run tar optimization while you are backing up instance

                  bull Do not run tar optimization when datastore garbage collection is running

                  bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                  36

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                  Workflow maintenance and Purge Obsolete Workflow Data

                  Workflow Monitoring

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Workflow Purge

                  bull Workflows enable you to automate Experience Manager activities

                  bull Workflows events generate archived data

                  bull This data can quickly grow over time as workflows are processed

                  bull Purging this data on a regular schedule improves system performance

                  bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                  38

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Best practices for maintaining AEM Instances

                  Regularly run workflow purge to avoid the problems associated with a large volume of data

                  bull Using user interface through Felix console

                  bull Using CURL

                  bull Creating a JMX client that uses Workflow Mbean

                  httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                  39

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  Tips and tricks for proactive things to monitor

                  40

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                  How to monitor workflow via JMX client

                  DEMONSTRATION

                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                  • ADOBE CUSTOMER BROWN BAG SERIES
                  • Whatrsquos Covered
                  • Topics covered
                  • Slide 4
                  • Monitoring Replication
                  • Configure a replicationlog
                  • Slide 7
                  • Replication Initializing and Queuing
                  • Replication Processing Jobs
                  • Replication Troubleshooting
                  • Optimizing Replication
                  • Optimizing Replication (2)
                  • Optimizing Replication (3)
                  • Optimizing Replication (4)
                  • Slide 15
                  • What is the DataStore
                  • How does the DataStore work
                  • DataStore Example
                  • DataStore Example (2)
                  • How does DataStore GC work
                  • DataStore GC Avoiding common Pitfalls
                  • Slide 22
                  • DataStore GC
                  • Slide 24
                  • Slide 25
                  • Part 2 Topics Covered
                  • What is TarPM
                  • What is TarPM Optimization
                  • Data Tar file location
                  • Best practices for maintaining AEM Instances
                  • Best practices for maintaining AEM Instances (2)
                  • Best practices for maintaining AEM Instances (3)
                  • Tips and tricks for proactive things to monitor
                  • Slide 34
                  • Tips and tricks for reducing downtime amp Speed up the process
                  • Common Pitfalls to Avoid
                  • Slide 37
                  • Workflow Purge
                  • Best practices for maintaining AEM Instances (4)
                  • Tips and tricks for proactive things to monitor (2)
                  • Slide 41
                  • Slide 42

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Replication Troubleshooting

                    The queue can get stuck ifbull The Job Handler fails

                    bull Error while sending the data- Failure to create Durbo package from

                    varreplicationdata

                    - Issue in class loading network malfunction etc

                    bull The receiving end fails to respond - Publish instance is experiencing high traffic or is

                    unstable

                    bull The receiving end fails to import receive the replication during transport For example- Failure to read the durbo package

                    - Failure to saveimport the content

                    10

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Optimizing Replication

                    Optimizations

                    bull Enable ldquoFile Storagerdquo of replication durbo packages

                    - Go to httphostportsystemconsoleconfigMgr and login as admin

                    - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

                    - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

                    bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

                    - socketConnect can be 30 seconds = 30000

                    - socketRead timeout can be 10 minutes = 600000

                    11

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Optimizing Replication

                    12

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Optimizing Replication

                    Optimizations

                    bull In the ldquoTriggersrdquo tab of the replication agent

                    - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

                    - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

                    13

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Optimizing Replication

                    14

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                    Reducing disk space usageDataStore Garbage Collection

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    What is the DataStore

                    The DataStore (default implementation)

                    bull Stores binary JCR properties gt 4KB (default)

                    bull Only allows files to be added

                    bull Stores files under crx-quickstartrepositoryrepositorydatastore

                    bull Files are referenced by the JCR internal node record (persistence manager bundles)

                    16

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    How does the DataStore work

                    1 A unique id is generated from contents of the file

                    2 The id is used for the filename

                    3 The datastore directory structure is built like this

                    bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                    bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                    4 Due to this files are stored uniquely so the same file will only be stored once

                    17

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    DataStore Example

                    User uploads the same image to two different locations

                    18

                    AEMpng

                    Upload

                    Upload

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    a2b98676377b947244bb954769def9b4fd625daa

                    repositoryrepositorydatastore

                    86

                    b9

                    a2

                    DataStore Example

                    19

                    JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                    property

                    JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                    originaljcrcontentdata property

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    How does DataStore GC work

                    DataStore GC (Garbage Collection) is the only way to delete DataStore files

                    How does it work

                    bull ldquoScanrdquo Phase

                    - Read all nodes in the JCR

                    - Update the timestamp of each of the referenced datastore files

                    bull ldquoDeleterdquo Phase

                    - Find all files with timestamp older than when it started the scan phase and deletes them

                    20

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    DataStore GC Avoiding common Pitfalls

                    Before running DataStore GC make sure

                    bull You have a backup of the datastore directory

                    bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                    bull Date and time is in sync between network storage and CQ server

                    bull CQ53 or 54 with CRX22 - at least hotfix 22070

                    bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                    21

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                    How to run DataStore GCDEMONSTRATION

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    DataStore GC

                    This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                    If you see that error then do not run datastore gc until you have restored the missing files

                    To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                    bull Browse to Repository Configuration =gt Check Repositoryrdquo

                    bull Check the Data store consistency check box

                    bull Click ldquoRunrdquo

                    bull This will output a list of nodes referencing the missing files along with the path of the missing file

                    bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                    See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                    23

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                    How to run DataStore Consistency Check

                    DEMONSTRATION

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                    Tar Persistence Manager Optimization

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Part 2 Topics Covered

                    TarPM Optimization

                    - What is the TarPM amp TarPM optimization

                    - Best practices for maintaining AEM Instances

                    - Tips and tricks for proactive things to monitor

                    - Tips and tricks for reducing downtime amp Speed up the process

                    Workflow Monitoring

                    - Supported Features

                    - Best practices for maintaining AEM Instances

                    - Tips and tricks for proactive things to monitor

                    26

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    What is TarPM

                    27

                    data_00000tar

                    ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                    data_00001tar

                    Bundle 01Bundle 02

                    Bundle 03

                    Bundle 04

                    Adding New page

                    Modifying

                    page

                    Del

                    etin

                    g

                    page

                    bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                    bull Tar PM model is append only

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    What is TarPM Optimization

                    bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                    28

                    bundle03

                    bundle04

                    bundle11

                    bundle14

                    data_00003tar

                    TAR OPTIMIZATI

                    ON

                    bundle01

                    bundle02

                    bundle03

                    bundle04

                    data_00001tar

                    bundle11

                    bundle12

                    bundle13

                    bundle14

                    data_00002tar

                    Unused

                    data

                    Deletes old data tar file

                    Deletes old data tar file

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Data Tar file location

                    bull Default storage location of data tar files are

                    29

                    ltcq_homegtcrx-quickstartrepository

                    data_00000tardata_00001tar

                    workspaces

                    crxdefault

                    version

                    data_00004tardata_00005tar

                    data_00010tardata_00011tar

                    tarJournal

                    data_00012tardata_00013tar

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Best practices for maintaining AEM Instances

                    Regularly run tar optimization during the low usage hours of your system

                    bull Automatic Schedule-

                    - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                    - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                    bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                    30

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Best practices for maintaining AEM Instances

                    Manually execute TarPM optimization from JMX console

                    31

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Best practices for maintaining AEM Instances

                    Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                    32

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Tips and tricks for proactive things to monitor

                    bull From JMX console monitor

                    - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                    - TarOptimizationWork- The remaining optimization work in KiloBytes

                    - TarOptimizationRate- TarPM optimization rate in KBsec

                    33

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                    How to monitor Tar Optimization via JMX client

                    DEMONSTRATION

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Tips and tricks for reducing downtime amp Speed up the process

                    bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                    bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                    - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                    - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                    bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                    35

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Common Pitfalls to Avoid

                    bull Scheduling tar optimization to run during the heavy usage hours of your system

                    bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                    bull Do not run tar optimization while you are backing up instance

                    bull Do not run tar optimization when datastore garbage collection is running

                    bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                    36

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                    Workflow maintenance and Purge Obsolete Workflow Data

                    Workflow Monitoring

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Workflow Purge

                    bull Workflows enable you to automate Experience Manager activities

                    bull Workflows events generate archived data

                    bull This data can quickly grow over time as workflows are processed

                    bull Purging this data on a regular schedule improves system performance

                    bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                    38

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Best practices for maintaining AEM Instances

                    Regularly run workflow purge to avoid the problems associated with a large volume of data

                    bull Using user interface through Felix console

                    bull Using CURL

                    bull Creating a JMX client that uses Workflow Mbean

                    httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                    39

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    Tips and tricks for proactive things to monitor

                    40

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                    How to monitor workflow via JMX client

                    DEMONSTRATION

                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                    • ADOBE CUSTOMER BROWN BAG SERIES
                    • Whatrsquos Covered
                    • Topics covered
                    • Slide 4
                    • Monitoring Replication
                    • Configure a replicationlog
                    • Slide 7
                    • Replication Initializing and Queuing
                    • Replication Processing Jobs
                    • Replication Troubleshooting
                    • Optimizing Replication
                    • Optimizing Replication (2)
                    • Optimizing Replication (3)
                    • Optimizing Replication (4)
                    • Slide 15
                    • What is the DataStore
                    • How does the DataStore work
                    • DataStore Example
                    • DataStore Example (2)
                    • How does DataStore GC work
                    • DataStore GC Avoiding common Pitfalls
                    • Slide 22
                    • DataStore GC
                    • Slide 24
                    • Slide 25
                    • Part 2 Topics Covered
                    • What is TarPM
                    • What is TarPM Optimization
                    • Data Tar file location
                    • Best practices for maintaining AEM Instances
                    • Best practices for maintaining AEM Instances (2)
                    • Best practices for maintaining AEM Instances (3)
                    • Tips and tricks for proactive things to monitor
                    • Slide 34
                    • Tips and tricks for reducing downtime amp Speed up the process
                    • Common Pitfalls to Avoid
                    • Slide 37
                    • Workflow Purge
                    • Best practices for maintaining AEM Instances (4)
                    • Tips and tricks for proactive things to monitor (2)
                    • Slide 41
                    • Slide 42

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Optimizing Replication

                      Optimizations

                      bull Enable ldquoFile Storagerdquo of replication durbo packages

                      - Go to httphostportsystemconsoleconfigMgr and login as admin

                      - Find ldquoAdobe Granite Replication Content Factoryrdquo and click Edit

                      - Check the ldquoreplicationcontentuseFileStoragenamerdquo checkbox and Save

                      bull Set the connection timeout and socket timeout in the agent Extended configuration to avoid socketConnect and socketRead hang situations

                      - socketConnect can be 30 seconds = 30000

                      - socketRead timeout can be 10 minutes = 600000

                      11

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Optimizing Replication

                      12

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Optimizing Replication

                      Optimizations

                      bull In the ldquoTriggersrdquo tab of the replication agent

                      - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

                      - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

                      13

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Optimizing Replication

                      14

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                      Reducing disk space usageDataStore Garbage Collection

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      What is the DataStore

                      The DataStore (default implementation)

                      bull Stores binary JCR properties gt 4KB (default)

                      bull Only allows files to be added

                      bull Stores files under crx-quickstartrepositoryrepositorydatastore

                      bull Files are referenced by the JCR internal node record (persistence manager bundles)

                      16

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      How does the DataStore work

                      1 A unique id is generated from contents of the file

                      2 The id is used for the filename

                      3 The datastore directory structure is built like this

                      bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                      bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                      4 Due to this files are stored uniquely so the same file will only be stored once

                      17

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      DataStore Example

                      User uploads the same image to two different locations

                      18

                      AEMpng

                      Upload

                      Upload

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      a2b98676377b947244bb954769def9b4fd625daa

                      repositoryrepositorydatastore

                      86

                      b9

                      a2

                      DataStore Example

                      19

                      JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                      property

                      JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                      originaljcrcontentdata property

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      How does DataStore GC work

                      DataStore GC (Garbage Collection) is the only way to delete DataStore files

                      How does it work

                      bull ldquoScanrdquo Phase

                      - Read all nodes in the JCR

                      - Update the timestamp of each of the referenced datastore files

                      bull ldquoDeleterdquo Phase

                      - Find all files with timestamp older than when it started the scan phase and deletes them

                      20

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      DataStore GC Avoiding common Pitfalls

                      Before running DataStore GC make sure

                      bull You have a backup of the datastore directory

                      bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                      bull Date and time is in sync between network storage and CQ server

                      bull CQ53 or 54 with CRX22 - at least hotfix 22070

                      bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                      21

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                      How to run DataStore GCDEMONSTRATION

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      DataStore GC

                      This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                      If you see that error then do not run datastore gc until you have restored the missing files

                      To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                      bull Browse to Repository Configuration =gt Check Repositoryrdquo

                      bull Check the Data store consistency check box

                      bull Click ldquoRunrdquo

                      bull This will output a list of nodes referencing the missing files along with the path of the missing file

                      bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                      See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                      23

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                      How to run DataStore Consistency Check

                      DEMONSTRATION

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                      Tar Persistence Manager Optimization

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Part 2 Topics Covered

                      TarPM Optimization

                      - What is the TarPM amp TarPM optimization

                      - Best practices for maintaining AEM Instances

                      - Tips and tricks for proactive things to monitor

                      - Tips and tricks for reducing downtime amp Speed up the process

                      Workflow Monitoring

                      - Supported Features

                      - Best practices for maintaining AEM Instances

                      - Tips and tricks for proactive things to monitor

                      26

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      What is TarPM

                      27

                      data_00000tar

                      ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                      data_00001tar

                      Bundle 01Bundle 02

                      Bundle 03

                      Bundle 04

                      Adding New page

                      Modifying

                      page

                      Del

                      etin

                      g

                      page

                      bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                      bull Tar PM model is append only

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      What is TarPM Optimization

                      bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                      28

                      bundle03

                      bundle04

                      bundle11

                      bundle14

                      data_00003tar

                      TAR OPTIMIZATI

                      ON

                      bundle01

                      bundle02

                      bundle03

                      bundle04

                      data_00001tar

                      bundle11

                      bundle12

                      bundle13

                      bundle14

                      data_00002tar

                      Unused

                      data

                      Deletes old data tar file

                      Deletes old data tar file

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Data Tar file location

                      bull Default storage location of data tar files are

                      29

                      ltcq_homegtcrx-quickstartrepository

                      data_00000tardata_00001tar

                      workspaces

                      crxdefault

                      version

                      data_00004tardata_00005tar

                      data_00010tardata_00011tar

                      tarJournal

                      data_00012tardata_00013tar

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Best practices for maintaining AEM Instances

                      Regularly run tar optimization during the low usage hours of your system

                      bull Automatic Schedule-

                      - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                      - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                      bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                      30

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Best practices for maintaining AEM Instances

                      Manually execute TarPM optimization from JMX console

                      31

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Best practices for maintaining AEM Instances

                      Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                      32

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Tips and tricks for proactive things to monitor

                      bull From JMX console monitor

                      - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                      - TarOptimizationWork- The remaining optimization work in KiloBytes

                      - TarOptimizationRate- TarPM optimization rate in KBsec

                      33

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                      How to monitor Tar Optimization via JMX client

                      DEMONSTRATION

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Tips and tricks for reducing downtime amp Speed up the process

                      bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                      bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                      - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                      - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                      bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                      35

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Common Pitfalls to Avoid

                      bull Scheduling tar optimization to run during the heavy usage hours of your system

                      bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                      bull Do not run tar optimization while you are backing up instance

                      bull Do not run tar optimization when datastore garbage collection is running

                      bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                      36

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                      Workflow maintenance and Purge Obsolete Workflow Data

                      Workflow Monitoring

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Workflow Purge

                      bull Workflows enable you to automate Experience Manager activities

                      bull Workflows events generate archived data

                      bull This data can quickly grow over time as workflows are processed

                      bull Purging this data on a regular schedule improves system performance

                      bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                      38

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Best practices for maintaining AEM Instances

                      Regularly run workflow purge to avoid the problems associated with a large volume of data

                      bull Using user interface through Felix console

                      bull Using CURL

                      bull Creating a JMX client that uses Workflow Mbean

                      httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                      39

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      Tips and tricks for proactive things to monitor

                      40

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                      How to monitor workflow via JMX client

                      DEMONSTRATION

                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                      • ADOBE CUSTOMER BROWN BAG SERIES
                      • Whatrsquos Covered
                      • Topics covered
                      • Slide 4
                      • Monitoring Replication
                      • Configure a replicationlog
                      • Slide 7
                      • Replication Initializing and Queuing
                      • Replication Processing Jobs
                      • Replication Troubleshooting
                      • Optimizing Replication
                      • Optimizing Replication (2)
                      • Optimizing Replication (3)
                      • Optimizing Replication (4)
                      • Slide 15
                      • What is the DataStore
                      • How does the DataStore work
                      • DataStore Example
                      • DataStore Example (2)
                      • How does DataStore GC work
                      • DataStore GC Avoiding common Pitfalls
                      • Slide 22
                      • DataStore GC
                      • Slide 24
                      • Slide 25
                      • Part 2 Topics Covered
                      • What is TarPM
                      • What is TarPM Optimization
                      • Data Tar file location
                      • Best practices for maintaining AEM Instances
                      • Best practices for maintaining AEM Instances (2)
                      • Best practices for maintaining AEM Instances (3)
                      • Tips and tricks for proactive things to monitor
                      • Slide 34
                      • Tips and tricks for reducing downtime amp Speed up the process
                      • Common Pitfalls to Avoid
                      • Slide 37
                      • Workflow Purge
                      • Best practices for maintaining AEM Instances (4)
                      • Tips and tricks for proactive things to monitor (2)
                      • Slide 41
                      • Slide 42

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Optimizing Replication

                        12

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Optimizing Replication

                        Optimizations

                        bull In the ldquoTriggersrdquo tab of the replication agent

                        - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

                        - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

                        13

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Optimizing Replication

                        14

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                        Reducing disk space usageDataStore Garbage Collection

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        What is the DataStore

                        The DataStore (default implementation)

                        bull Stores binary JCR properties gt 4KB (default)

                        bull Only allows files to be added

                        bull Stores files under crx-quickstartrepositoryrepositorydatastore

                        bull Files are referenced by the JCR internal node record (persistence manager bundles)

                        16

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        How does the DataStore work

                        1 A unique id is generated from contents of the file

                        2 The id is used for the filename

                        3 The datastore directory structure is built like this

                        bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                        bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                        4 Due to this files are stored uniquely so the same file will only be stored once

                        17

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        DataStore Example

                        User uploads the same image to two different locations

                        18

                        AEMpng

                        Upload

                        Upload

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        a2b98676377b947244bb954769def9b4fd625daa

                        repositoryrepositorydatastore

                        86

                        b9

                        a2

                        DataStore Example

                        19

                        JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                        property

                        JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                        originaljcrcontentdata property

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        How does DataStore GC work

                        DataStore GC (Garbage Collection) is the only way to delete DataStore files

                        How does it work

                        bull ldquoScanrdquo Phase

                        - Read all nodes in the JCR

                        - Update the timestamp of each of the referenced datastore files

                        bull ldquoDeleterdquo Phase

                        - Find all files with timestamp older than when it started the scan phase and deletes them

                        20

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        DataStore GC Avoiding common Pitfalls

                        Before running DataStore GC make sure

                        bull You have a backup of the datastore directory

                        bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                        bull Date and time is in sync between network storage and CQ server

                        bull CQ53 or 54 with CRX22 - at least hotfix 22070

                        bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                        21

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                        How to run DataStore GCDEMONSTRATION

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        DataStore GC

                        This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                        If you see that error then do not run datastore gc until you have restored the missing files

                        To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                        bull Browse to Repository Configuration =gt Check Repositoryrdquo

                        bull Check the Data store consistency check box

                        bull Click ldquoRunrdquo

                        bull This will output a list of nodes referencing the missing files along with the path of the missing file

                        bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                        See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                        23

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                        How to run DataStore Consistency Check

                        DEMONSTRATION

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                        Tar Persistence Manager Optimization

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Part 2 Topics Covered

                        TarPM Optimization

                        - What is the TarPM amp TarPM optimization

                        - Best practices for maintaining AEM Instances

                        - Tips and tricks for proactive things to monitor

                        - Tips and tricks for reducing downtime amp Speed up the process

                        Workflow Monitoring

                        - Supported Features

                        - Best practices for maintaining AEM Instances

                        - Tips and tricks for proactive things to monitor

                        26

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        What is TarPM

                        27

                        data_00000tar

                        ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                        data_00001tar

                        Bundle 01Bundle 02

                        Bundle 03

                        Bundle 04

                        Adding New page

                        Modifying

                        page

                        Del

                        etin

                        g

                        page

                        bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                        bull Tar PM model is append only

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        What is TarPM Optimization

                        bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                        28

                        bundle03

                        bundle04

                        bundle11

                        bundle14

                        data_00003tar

                        TAR OPTIMIZATI

                        ON

                        bundle01

                        bundle02

                        bundle03

                        bundle04

                        data_00001tar

                        bundle11

                        bundle12

                        bundle13

                        bundle14

                        data_00002tar

                        Unused

                        data

                        Deletes old data tar file

                        Deletes old data tar file

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Data Tar file location

                        bull Default storage location of data tar files are

                        29

                        ltcq_homegtcrx-quickstartrepository

                        data_00000tardata_00001tar

                        workspaces

                        crxdefault

                        version

                        data_00004tardata_00005tar

                        data_00010tardata_00011tar

                        tarJournal

                        data_00012tardata_00013tar

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Best practices for maintaining AEM Instances

                        Regularly run tar optimization during the low usage hours of your system

                        bull Automatic Schedule-

                        - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                        - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                        bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                        30

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Best practices for maintaining AEM Instances

                        Manually execute TarPM optimization from JMX console

                        31

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Best practices for maintaining AEM Instances

                        Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                        32

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Tips and tricks for proactive things to monitor

                        bull From JMX console monitor

                        - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                        - TarOptimizationWork- The remaining optimization work in KiloBytes

                        - TarOptimizationRate- TarPM optimization rate in KBsec

                        33

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                        How to monitor Tar Optimization via JMX client

                        DEMONSTRATION

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Tips and tricks for reducing downtime amp Speed up the process

                        bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                        bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                        - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                        - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                        bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                        35

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Common Pitfalls to Avoid

                        bull Scheduling tar optimization to run during the heavy usage hours of your system

                        bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                        bull Do not run tar optimization while you are backing up instance

                        bull Do not run tar optimization when datastore garbage collection is running

                        bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                        36

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                        Workflow maintenance and Purge Obsolete Workflow Data

                        Workflow Monitoring

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Workflow Purge

                        bull Workflows enable you to automate Experience Manager activities

                        bull Workflows events generate archived data

                        bull This data can quickly grow over time as workflows are processed

                        bull Purging this data on a regular schedule improves system performance

                        bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                        38

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Best practices for maintaining AEM Instances

                        Regularly run workflow purge to avoid the problems associated with a large volume of data

                        bull Using user interface through Felix console

                        bull Using CURL

                        bull Creating a JMX client that uses Workflow Mbean

                        httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                        39

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        Tips and tricks for proactive things to monitor

                        40

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                        How to monitor workflow via JMX client

                        DEMONSTRATION

                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                        • ADOBE CUSTOMER BROWN BAG SERIES
                        • Whatrsquos Covered
                        • Topics covered
                        • Slide 4
                        • Monitoring Replication
                        • Configure a replicationlog
                        • Slide 7
                        • Replication Initializing and Queuing
                        • Replication Processing Jobs
                        • Replication Troubleshooting
                        • Optimizing Replication
                        • Optimizing Replication (2)
                        • Optimizing Replication (3)
                        • Optimizing Replication (4)
                        • Slide 15
                        • What is the DataStore
                        • How does the DataStore work
                        • DataStore Example
                        • DataStore Example (2)
                        • How does DataStore GC work
                        • DataStore GC Avoiding common Pitfalls
                        • Slide 22
                        • DataStore GC
                        • Slide 24
                        • Slide 25
                        • Part 2 Topics Covered
                        • What is TarPM
                        • What is TarPM Optimization
                        • Data Tar file location
                        • Best practices for maintaining AEM Instances
                        • Best practices for maintaining AEM Instances (2)
                        • Best practices for maintaining AEM Instances (3)
                        • Tips and tricks for proactive things to monitor
                        • Slide 34
                        • Tips and tricks for reducing downtime amp Speed up the process
                        • Common Pitfalls to Avoid
                        • Slide 37
                        • Workflow Purge
                        • Best practices for maintaining AEM Instances (4)
                        • Tips and tricks for proactive things to monitor (2)
                        • Slide 41
                        • Slide 42

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Optimizing Replication

                          Optimizations

                          bull In the ldquoTriggersrdquo tab of the replication agent

                          - ldquoNo Status Updaterdquo - if you do not need a status to track that the replication happened

                          - ldquoNo Versioningrdquo - if you do not need versions of the pages or assets generated on activations

                          13

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Optimizing Replication

                          14

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                          Reducing disk space usageDataStore Garbage Collection

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          What is the DataStore

                          The DataStore (default implementation)

                          bull Stores binary JCR properties gt 4KB (default)

                          bull Only allows files to be added

                          bull Stores files under crx-quickstartrepositoryrepositorydatastore

                          bull Files are referenced by the JCR internal node record (persistence manager bundles)

                          16

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          How does the DataStore work

                          1 A unique id is generated from contents of the file

                          2 The id is used for the filename

                          3 The datastore directory structure is built like this

                          bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                          bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                          4 Due to this files are stored uniquely so the same file will only be stored once

                          17

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          DataStore Example

                          User uploads the same image to two different locations

                          18

                          AEMpng

                          Upload

                          Upload

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          a2b98676377b947244bb954769def9b4fd625daa

                          repositoryrepositorydatastore

                          86

                          b9

                          a2

                          DataStore Example

                          19

                          JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                          property

                          JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                          originaljcrcontentdata property

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          How does DataStore GC work

                          DataStore GC (Garbage Collection) is the only way to delete DataStore files

                          How does it work

                          bull ldquoScanrdquo Phase

                          - Read all nodes in the JCR

                          - Update the timestamp of each of the referenced datastore files

                          bull ldquoDeleterdquo Phase

                          - Find all files with timestamp older than when it started the scan phase and deletes them

                          20

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          DataStore GC Avoiding common Pitfalls

                          Before running DataStore GC make sure

                          bull You have a backup of the datastore directory

                          bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                          bull Date and time is in sync between network storage and CQ server

                          bull CQ53 or 54 with CRX22 - at least hotfix 22070

                          bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                          21

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                          How to run DataStore GCDEMONSTRATION

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          DataStore GC

                          This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                          If you see that error then do not run datastore gc until you have restored the missing files

                          To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                          bull Browse to Repository Configuration =gt Check Repositoryrdquo

                          bull Check the Data store consistency check box

                          bull Click ldquoRunrdquo

                          bull This will output a list of nodes referencing the missing files along with the path of the missing file

                          bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                          See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                          23

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                          How to run DataStore Consistency Check

                          DEMONSTRATION

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                          Tar Persistence Manager Optimization

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Part 2 Topics Covered

                          TarPM Optimization

                          - What is the TarPM amp TarPM optimization

                          - Best practices for maintaining AEM Instances

                          - Tips and tricks for proactive things to monitor

                          - Tips and tricks for reducing downtime amp Speed up the process

                          Workflow Monitoring

                          - Supported Features

                          - Best practices for maintaining AEM Instances

                          - Tips and tricks for proactive things to monitor

                          26

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          What is TarPM

                          27

                          data_00000tar

                          ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                          data_00001tar

                          Bundle 01Bundle 02

                          Bundle 03

                          Bundle 04

                          Adding New page

                          Modifying

                          page

                          Del

                          etin

                          g

                          page

                          bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                          bull Tar PM model is append only

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          What is TarPM Optimization

                          bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                          28

                          bundle03

                          bundle04

                          bundle11

                          bundle14

                          data_00003tar

                          TAR OPTIMIZATI

                          ON

                          bundle01

                          bundle02

                          bundle03

                          bundle04

                          data_00001tar

                          bundle11

                          bundle12

                          bundle13

                          bundle14

                          data_00002tar

                          Unused

                          data

                          Deletes old data tar file

                          Deletes old data tar file

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Data Tar file location

                          bull Default storage location of data tar files are

                          29

                          ltcq_homegtcrx-quickstartrepository

                          data_00000tardata_00001tar

                          workspaces

                          crxdefault

                          version

                          data_00004tardata_00005tar

                          data_00010tardata_00011tar

                          tarJournal

                          data_00012tardata_00013tar

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Best practices for maintaining AEM Instances

                          Regularly run tar optimization during the low usage hours of your system

                          bull Automatic Schedule-

                          - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                          - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                          bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                          30

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Best practices for maintaining AEM Instances

                          Manually execute TarPM optimization from JMX console

                          31

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Best practices for maintaining AEM Instances

                          Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                          32

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Tips and tricks for proactive things to monitor

                          bull From JMX console monitor

                          - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                          - TarOptimizationWork- The remaining optimization work in KiloBytes

                          - TarOptimizationRate- TarPM optimization rate in KBsec

                          33

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                          How to monitor Tar Optimization via JMX client

                          DEMONSTRATION

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Tips and tricks for reducing downtime amp Speed up the process

                          bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                          bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                          - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                          - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                          bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                          35

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Common Pitfalls to Avoid

                          bull Scheduling tar optimization to run during the heavy usage hours of your system

                          bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                          bull Do not run tar optimization while you are backing up instance

                          bull Do not run tar optimization when datastore garbage collection is running

                          bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                          36

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                          Workflow maintenance and Purge Obsolete Workflow Data

                          Workflow Monitoring

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Workflow Purge

                          bull Workflows enable you to automate Experience Manager activities

                          bull Workflows events generate archived data

                          bull This data can quickly grow over time as workflows are processed

                          bull Purging this data on a regular schedule improves system performance

                          bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                          38

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Best practices for maintaining AEM Instances

                          Regularly run workflow purge to avoid the problems associated with a large volume of data

                          bull Using user interface through Felix console

                          bull Using CURL

                          bull Creating a JMX client that uses Workflow Mbean

                          httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                          39

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          Tips and tricks for proactive things to monitor

                          40

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                          How to monitor workflow via JMX client

                          DEMONSTRATION

                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                          • ADOBE CUSTOMER BROWN BAG SERIES
                          • Whatrsquos Covered
                          • Topics covered
                          • Slide 4
                          • Monitoring Replication
                          • Configure a replicationlog
                          • Slide 7
                          • Replication Initializing and Queuing
                          • Replication Processing Jobs
                          • Replication Troubleshooting
                          • Optimizing Replication
                          • Optimizing Replication (2)
                          • Optimizing Replication (3)
                          • Optimizing Replication (4)
                          • Slide 15
                          • What is the DataStore
                          • How does the DataStore work
                          • DataStore Example
                          • DataStore Example (2)
                          • How does DataStore GC work
                          • DataStore GC Avoiding common Pitfalls
                          • Slide 22
                          • DataStore GC
                          • Slide 24
                          • Slide 25
                          • Part 2 Topics Covered
                          • What is TarPM
                          • What is TarPM Optimization
                          • Data Tar file location
                          • Best practices for maintaining AEM Instances
                          • Best practices for maintaining AEM Instances (2)
                          • Best practices for maintaining AEM Instances (3)
                          • Tips and tricks for proactive things to monitor
                          • Slide 34
                          • Tips and tricks for reducing downtime amp Speed up the process
                          • Common Pitfalls to Avoid
                          • Slide 37
                          • Workflow Purge
                          • Best practices for maintaining AEM Instances (4)
                          • Tips and tricks for proactive things to monitor (2)
                          • Slide 41
                          • Slide 42

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Optimizing Replication

                            14

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                            Reducing disk space usageDataStore Garbage Collection

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            What is the DataStore

                            The DataStore (default implementation)

                            bull Stores binary JCR properties gt 4KB (default)

                            bull Only allows files to be added

                            bull Stores files under crx-quickstartrepositoryrepositorydatastore

                            bull Files are referenced by the JCR internal node record (persistence manager bundles)

                            16

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            How does the DataStore work

                            1 A unique id is generated from contents of the file

                            2 The id is used for the filename

                            3 The datastore directory structure is built like this

                            bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                            bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                            4 Due to this files are stored uniquely so the same file will only be stored once

                            17

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            DataStore Example

                            User uploads the same image to two different locations

                            18

                            AEMpng

                            Upload

                            Upload

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            a2b98676377b947244bb954769def9b4fd625daa

                            repositoryrepositorydatastore

                            86

                            b9

                            a2

                            DataStore Example

                            19

                            JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                            property

                            JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                            originaljcrcontentdata property

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            How does DataStore GC work

                            DataStore GC (Garbage Collection) is the only way to delete DataStore files

                            How does it work

                            bull ldquoScanrdquo Phase

                            - Read all nodes in the JCR

                            - Update the timestamp of each of the referenced datastore files

                            bull ldquoDeleterdquo Phase

                            - Find all files with timestamp older than when it started the scan phase and deletes them

                            20

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            DataStore GC Avoiding common Pitfalls

                            Before running DataStore GC make sure

                            bull You have a backup of the datastore directory

                            bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                            bull Date and time is in sync between network storage and CQ server

                            bull CQ53 or 54 with CRX22 - at least hotfix 22070

                            bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                            21

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                            How to run DataStore GCDEMONSTRATION

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            DataStore GC

                            This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                            If you see that error then do not run datastore gc until you have restored the missing files

                            To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                            bull Browse to Repository Configuration =gt Check Repositoryrdquo

                            bull Check the Data store consistency check box

                            bull Click ldquoRunrdquo

                            bull This will output a list of nodes referencing the missing files along with the path of the missing file

                            bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                            See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                            23

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                            How to run DataStore Consistency Check

                            DEMONSTRATION

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                            Tar Persistence Manager Optimization

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Part 2 Topics Covered

                            TarPM Optimization

                            - What is the TarPM amp TarPM optimization

                            - Best practices for maintaining AEM Instances

                            - Tips and tricks for proactive things to monitor

                            - Tips and tricks for reducing downtime amp Speed up the process

                            Workflow Monitoring

                            - Supported Features

                            - Best practices for maintaining AEM Instances

                            - Tips and tricks for proactive things to monitor

                            26

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            What is TarPM

                            27

                            data_00000tar

                            ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                            data_00001tar

                            Bundle 01Bundle 02

                            Bundle 03

                            Bundle 04

                            Adding New page

                            Modifying

                            page

                            Del

                            etin

                            g

                            page

                            bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                            bull Tar PM model is append only

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            What is TarPM Optimization

                            bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                            28

                            bundle03

                            bundle04

                            bundle11

                            bundle14

                            data_00003tar

                            TAR OPTIMIZATI

                            ON

                            bundle01

                            bundle02

                            bundle03

                            bundle04

                            data_00001tar

                            bundle11

                            bundle12

                            bundle13

                            bundle14

                            data_00002tar

                            Unused

                            data

                            Deletes old data tar file

                            Deletes old data tar file

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Data Tar file location

                            bull Default storage location of data tar files are

                            29

                            ltcq_homegtcrx-quickstartrepository

                            data_00000tardata_00001tar

                            workspaces

                            crxdefault

                            version

                            data_00004tardata_00005tar

                            data_00010tardata_00011tar

                            tarJournal

                            data_00012tardata_00013tar

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Best practices for maintaining AEM Instances

                            Regularly run tar optimization during the low usage hours of your system

                            bull Automatic Schedule-

                            - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                            - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                            bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                            30

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Best practices for maintaining AEM Instances

                            Manually execute TarPM optimization from JMX console

                            31

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Best practices for maintaining AEM Instances

                            Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                            32

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Tips and tricks for proactive things to monitor

                            bull From JMX console monitor

                            - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                            - TarOptimizationWork- The remaining optimization work in KiloBytes

                            - TarOptimizationRate- TarPM optimization rate in KBsec

                            33

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                            How to monitor Tar Optimization via JMX client

                            DEMONSTRATION

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Tips and tricks for reducing downtime amp Speed up the process

                            bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                            bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                            - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                            - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                            bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                            35

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Common Pitfalls to Avoid

                            bull Scheduling tar optimization to run during the heavy usage hours of your system

                            bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                            bull Do not run tar optimization while you are backing up instance

                            bull Do not run tar optimization when datastore garbage collection is running

                            bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                            36

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                            Workflow maintenance and Purge Obsolete Workflow Data

                            Workflow Monitoring

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Workflow Purge

                            bull Workflows enable you to automate Experience Manager activities

                            bull Workflows events generate archived data

                            bull This data can quickly grow over time as workflows are processed

                            bull Purging this data on a regular schedule improves system performance

                            bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                            38

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Best practices for maintaining AEM Instances

                            Regularly run workflow purge to avoid the problems associated with a large volume of data

                            bull Using user interface through Felix console

                            bull Using CURL

                            bull Creating a JMX client that uses Workflow Mbean

                            httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                            39

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            Tips and tricks for proactive things to monitor

                            40

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                            How to monitor workflow via JMX client

                            DEMONSTRATION

                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                            • ADOBE CUSTOMER BROWN BAG SERIES
                            • Whatrsquos Covered
                            • Topics covered
                            • Slide 4
                            • Monitoring Replication
                            • Configure a replicationlog
                            • Slide 7
                            • Replication Initializing and Queuing
                            • Replication Processing Jobs
                            • Replication Troubleshooting
                            • Optimizing Replication
                            • Optimizing Replication (2)
                            • Optimizing Replication (3)
                            • Optimizing Replication (4)
                            • Slide 15
                            • What is the DataStore
                            • How does the DataStore work
                            • DataStore Example
                            • DataStore Example (2)
                            • How does DataStore GC work
                            • DataStore GC Avoiding common Pitfalls
                            • Slide 22
                            • DataStore GC
                            • Slide 24
                            • Slide 25
                            • Part 2 Topics Covered
                            • What is TarPM
                            • What is TarPM Optimization
                            • Data Tar file location
                            • Best practices for maintaining AEM Instances
                            • Best practices for maintaining AEM Instances (2)
                            • Best practices for maintaining AEM Instances (3)
                            • Tips and tricks for proactive things to monitor
                            • Slide 34
                            • Tips and tricks for reducing downtime amp Speed up the process
                            • Common Pitfalls to Avoid
                            • Slide 37
                            • Workflow Purge
                            • Best practices for maintaining AEM Instances (4)
                            • Tips and tricks for proactive things to monitor (2)
                            • Slide 41
                            • Slide 42

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 15

                              Reducing disk space usageDataStore Garbage Collection

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              What is the DataStore

                              The DataStore (default implementation)

                              bull Stores binary JCR properties gt 4KB (default)

                              bull Only allows files to be added

                              bull Stores files under crx-quickstartrepositoryrepositorydatastore

                              bull Files are referenced by the JCR internal node record (persistence manager bundles)

                              16

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              How does the DataStore work

                              1 A unique id is generated from contents of the file

                              2 The id is used for the filename

                              3 The datastore directory structure is built like this

                              bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                              bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                              4 Due to this files are stored uniquely so the same file will only be stored once

                              17

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              DataStore Example

                              User uploads the same image to two different locations

                              18

                              AEMpng

                              Upload

                              Upload

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              a2b98676377b947244bb954769def9b4fd625daa

                              repositoryrepositorydatastore

                              86

                              b9

                              a2

                              DataStore Example

                              19

                              JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                              property

                              JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                              originaljcrcontentdata property

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              How does DataStore GC work

                              DataStore GC (Garbage Collection) is the only way to delete DataStore files

                              How does it work

                              bull ldquoScanrdquo Phase

                              - Read all nodes in the JCR

                              - Update the timestamp of each of the referenced datastore files

                              bull ldquoDeleterdquo Phase

                              - Find all files with timestamp older than when it started the scan phase and deletes them

                              20

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              DataStore GC Avoiding common Pitfalls

                              Before running DataStore GC make sure

                              bull You have a backup of the datastore directory

                              bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                              bull Date and time is in sync between network storage and CQ server

                              bull CQ53 or 54 with CRX22 - at least hotfix 22070

                              bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                              21

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                              How to run DataStore GCDEMONSTRATION

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              DataStore GC

                              This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                              If you see that error then do not run datastore gc until you have restored the missing files

                              To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                              bull Browse to Repository Configuration =gt Check Repositoryrdquo

                              bull Check the Data store consistency check box

                              bull Click ldquoRunrdquo

                              bull This will output a list of nodes referencing the missing files along with the path of the missing file

                              bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                              See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                              23

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                              How to run DataStore Consistency Check

                              DEMONSTRATION

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                              Tar Persistence Manager Optimization

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Part 2 Topics Covered

                              TarPM Optimization

                              - What is the TarPM amp TarPM optimization

                              - Best practices for maintaining AEM Instances

                              - Tips and tricks for proactive things to monitor

                              - Tips and tricks for reducing downtime amp Speed up the process

                              Workflow Monitoring

                              - Supported Features

                              - Best practices for maintaining AEM Instances

                              - Tips and tricks for proactive things to monitor

                              26

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              What is TarPM

                              27

                              data_00000tar

                              ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                              data_00001tar

                              Bundle 01Bundle 02

                              Bundle 03

                              Bundle 04

                              Adding New page

                              Modifying

                              page

                              Del

                              etin

                              g

                              page

                              bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                              bull Tar PM model is append only

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              What is TarPM Optimization

                              bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                              28

                              bundle03

                              bundle04

                              bundle11

                              bundle14

                              data_00003tar

                              TAR OPTIMIZATI

                              ON

                              bundle01

                              bundle02

                              bundle03

                              bundle04

                              data_00001tar

                              bundle11

                              bundle12

                              bundle13

                              bundle14

                              data_00002tar

                              Unused

                              data

                              Deletes old data tar file

                              Deletes old data tar file

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Data Tar file location

                              bull Default storage location of data tar files are

                              29

                              ltcq_homegtcrx-quickstartrepository

                              data_00000tardata_00001tar

                              workspaces

                              crxdefault

                              version

                              data_00004tardata_00005tar

                              data_00010tardata_00011tar

                              tarJournal

                              data_00012tardata_00013tar

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Best practices for maintaining AEM Instances

                              Regularly run tar optimization during the low usage hours of your system

                              bull Automatic Schedule-

                              - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                              - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                              bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                              30

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Best practices for maintaining AEM Instances

                              Manually execute TarPM optimization from JMX console

                              31

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Best practices for maintaining AEM Instances

                              Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                              32

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Tips and tricks for proactive things to monitor

                              bull From JMX console monitor

                              - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                              - TarOptimizationWork- The remaining optimization work in KiloBytes

                              - TarOptimizationRate- TarPM optimization rate in KBsec

                              33

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                              How to monitor Tar Optimization via JMX client

                              DEMONSTRATION

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Tips and tricks for reducing downtime amp Speed up the process

                              bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                              bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                              - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                              - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                              bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                              35

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Common Pitfalls to Avoid

                              bull Scheduling tar optimization to run during the heavy usage hours of your system

                              bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                              bull Do not run tar optimization while you are backing up instance

                              bull Do not run tar optimization when datastore garbage collection is running

                              bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                              36

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                              Workflow maintenance and Purge Obsolete Workflow Data

                              Workflow Monitoring

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Workflow Purge

                              bull Workflows enable you to automate Experience Manager activities

                              bull Workflows events generate archived data

                              bull This data can quickly grow over time as workflows are processed

                              bull Purging this data on a regular schedule improves system performance

                              bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                              38

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Best practices for maintaining AEM Instances

                              Regularly run workflow purge to avoid the problems associated with a large volume of data

                              bull Using user interface through Felix console

                              bull Using CURL

                              bull Creating a JMX client that uses Workflow Mbean

                              httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                              39

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              Tips and tricks for proactive things to monitor

                              40

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                              How to monitor workflow via JMX client

                              DEMONSTRATION

                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                              • ADOBE CUSTOMER BROWN BAG SERIES
                              • Whatrsquos Covered
                              • Topics covered
                              • Slide 4
                              • Monitoring Replication
                              • Configure a replicationlog
                              • Slide 7
                              • Replication Initializing and Queuing
                              • Replication Processing Jobs
                              • Replication Troubleshooting
                              • Optimizing Replication
                              • Optimizing Replication (2)
                              • Optimizing Replication (3)
                              • Optimizing Replication (4)
                              • Slide 15
                              • What is the DataStore
                              • How does the DataStore work
                              • DataStore Example
                              • DataStore Example (2)
                              • How does DataStore GC work
                              • DataStore GC Avoiding common Pitfalls
                              • Slide 22
                              • DataStore GC
                              • Slide 24
                              • Slide 25
                              • Part 2 Topics Covered
                              • What is TarPM
                              • What is TarPM Optimization
                              • Data Tar file location
                              • Best practices for maintaining AEM Instances
                              • Best practices for maintaining AEM Instances (2)
                              • Best practices for maintaining AEM Instances (3)
                              • Tips and tricks for proactive things to monitor
                              • Slide 34
                              • Tips and tricks for reducing downtime amp Speed up the process
                              • Common Pitfalls to Avoid
                              • Slide 37
                              • Workflow Purge
                              • Best practices for maintaining AEM Instances (4)
                              • Tips and tricks for proactive things to monitor (2)
                              • Slide 41
                              • Slide 42

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                What is the DataStore

                                The DataStore (default implementation)

                                bull Stores binary JCR properties gt 4KB (default)

                                bull Only allows files to be added

                                bull Stores files under crx-quickstartrepositoryrepositorydatastore

                                bull Files are referenced by the JCR internal node record (persistence manager bundles)

                                16

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                How does the DataStore work

                                1 A unique id is generated from contents of the file

                                2 The id is used for the filename

                                3 The datastore directory structure is built like this

                                bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                                bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                                4 Due to this files are stored uniquely so the same file will only be stored once

                                17

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                DataStore Example

                                User uploads the same image to two different locations

                                18

                                AEMpng

                                Upload

                                Upload

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                a2b98676377b947244bb954769def9b4fd625daa

                                repositoryrepositorydatastore

                                86

                                b9

                                a2

                                DataStore Example

                                19

                                JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                                property

                                JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                                originaljcrcontentdata property

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                How does DataStore GC work

                                DataStore GC (Garbage Collection) is the only way to delete DataStore files

                                How does it work

                                bull ldquoScanrdquo Phase

                                - Read all nodes in the JCR

                                - Update the timestamp of each of the referenced datastore files

                                bull ldquoDeleterdquo Phase

                                - Find all files with timestamp older than when it started the scan phase and deletes them

                                20

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                DataStore GC Avoiding common Pitfalls

                                Before running DataStore GC make sure

                                bull You have a backup of the datastore directory

                                bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                                bull Date and time is in sync between network storage and CQ server

                                bull CQ53 or 54 with CRX22 - at least hotfix 22070

                                bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                                21

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                                How to run DataStore GCDEMONSTRATION

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                DataStore GC

                                This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                If you see that error then do not run datastore gc until you have restored the missing files

                                To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                bull Check the Data store consistency check box

                                bull Click ldquoRunrdquo

                                bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                23

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                How to run DataStore Consistency Check

                                DEMONSTRATION

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                Tar Persistence Manager Optimization

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Part 2 Topics Covered

                                TarPM Optimization

                                - What is the TarPM amp TarPM optimization

                                - Best practices for maintaining AEM Instances

                                - Tips and tricks for proactive things to monitor

                                - Tips and tricks for reducing downtime amp Speed up the process

                                Workflow Monitoring

                                - Supported Features

                                - Best practices for maintaining AEM Instances

                                - Tips and tricks for proactive things to monitor

                                26

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                What is TarPM

                                27

                                data_00000tar

                                ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                data_00001tar

                                Bundle 01Bundle 02

                                Bundle 03

                                Bundle 04

                                Adding New page

                                Modifying

                                page

                                Del

                                etin

                                g

                                page

                                bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                bull Tar PM model is append only

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                What is TarPM Optimization

                                bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                28

                                bundle03

                                bundle04

                                bundle11

                                bundle14

                                data_00003tar

                                TAR OPTIMIZATI

                                ON

                                bundle01

                                bundle02

                                bundle03

                                bundle04

                                data_00001tar

                                bundle11

                                bundle12

                                bundle13

                                bundle14

                                data_00002tar

                                Unused

                                data

                                Deletes old data tar file

                                Deletes old data tar file

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Data Tar file location

                                bull Default storage location of data tar files are

                                29

                                ltcq_homegtcrx-quickstartrepository

                                data_00000tardata_00001tar

                                workspaces

                                crxdefault

                                version

                                data_00004tardata_00005tar

                                data_00010tardata_00011tar

                                tarJournal

                                data_00012tardata_00013tar

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Best practices for maintaining AEM Instances

                                Regularly run tar optimization during the low usage hours of your system

                                bull Automatic Schedule-

                                - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                30

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Best practices for maintaining AEM Instances

                                Manually execute TarPM optimization from JMX console

                                31

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Best practices for maintaining AEM Instances

                                Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                32

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Tips and tricks for proactive things to monitor

                                bull From JMX console monitor

                                - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                - TarOptimizationWork- The remaining optimization work in KiloBytes

                                - TarOptimizationRate- TarPM optimization rate in KBsec

                                33

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                How to monitor Tar Optimization via JMX client

                                DEMONSTRATION

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Tips and tricks for reducing downtime amp Speed up the process

                                bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                35

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Common Pitfalls to Avoid

                                bull Scheduling tar optimization to run during the heavy usage hours of your system

                                bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                bull Do not run tar optimization while you are backing up instance

                                bull Do not run tar optimization when datastore garbage collection is running

                                bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                36

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                Workflow maintenance and Purge Obsolete Workflow Data

                                Workflow Monitoring

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Workflow Purge

                                bull Workflows enable you to automate Experience Manager activities

                                bull Workflows events generate archived data

                                bull This data can quickly grow over time as workflows are processed

                                bull Purging this data on a regular schedule improves system performance

                                bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                38

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Best practices for maintaining AEM Instances

                                Regularly run workflow purge to avoid the problems associated with a large volume of data

                                bull Using user interface through Felix console

                                bull Using CURL

                                bull Creating a JMX client that uses Workflow Mbean

                                httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                39

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                Tips and tricks for proactive things to monitor

                                40

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                How to monitor workflow via JMX client

                                DEMONSTRATION

                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                • ADOBE CUSTOMER BROWN BAG SERIES
                                • Whatrsquos Covered
                                • Topics covered
                                • Slide 4
                                • Monitoring Replication
                                • Configure a replicationlog
                                • Slide 7
                                • Replication Initializing and Queuing
                                • Replication Processing Jobs
                                • Replication Troubleshooting
                                • Optimizing Replication
                                • Optimizing Replication (2)
                                • Optimizing Replication (3)
                                • Optimizing Replication (4)
                                • Slide 15
                                • What is the DataStore
                                • How does the DataStore work
                                • DataStore Example
                                • DataStore Example (2)
                                • How does DataStore GC work
                                • DataStore GC Avoiding common Pitfalls
                                • Slide 22
                                • DataStore GC
                                • Slide 24
                                • Slide 25
                                • Part 2 Topics Covered
                                • What is TarPM
                                • What is TarPM Optimization
                                • Data Tar file location
                                • Best practices for maintaining AEM Instances
                                • Best practices for maintaining AEM Instances (2)
                                • Best practices for maintaining AEM Instances (3)
                                • Tips and tricks for proactive things to monitor
                                • Slide 34
                                • Tips and tricks for reducing downtime amp Speed up the process
                                • Common Pitfalls to Avoid
                                • Slide 37
                                • Workflow Purge
                                • Best practices for maintaining AEM Instances (4)
                                • Tips and tricks for proactive things to monitor (2)
                                • Slide 41
                                • Slide 42

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  How does the DataStore work

                                  1 A unique id is generated from contents of the file

                                  2 The id is used for the filename

                                  3 The datastore directory structure is built like this

                                  bull datastore1st 2 chars id2nd 2 chars id3rd 2 chars idid

                                  bull Eg datastorea2b986a2b98676377b947244bb954769def9b4fd625daa

                                  4 Due to this files are stored uniquely so the same file will only be stored once

                                  17

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  DataStore Example

                                  User uploads the same image to two different locations

                                  18

                                  AEMpng

                                  Upload

                                  Upload

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  a2b98676377b947244bb954769def9b4fd625daa

                                  repositoryrepositorydatastore

                                  86

                                  b9

                                  a2

                                  DataStore Example

                                  19

                                  JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                                  property

                                  JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                                  originaljcrcontentdata property

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  How does DataStore GC work

                                  DataStore GC (Garbage Collection) is the only way to delete DataStore files

                                  How does it work

                                  bull ldquoScanrdquo Phase

                                  - Read all nodes in the JCR

                                  - Update the timestamp of each of the referenced datastore files

                                  bull ldquoDeleterdquo Phase

                                  - Find all files with timestamp older than when it started the scan phase and deletes them

                                  20

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  DataStore GC Avoiding common Pitfalls

                                  Before running DataStore GC make sure

                                  bull You have a backup of the datastore directory

                                  bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                                  bull Date and time is in sync between network storage and CQ server

                                  bull CQ53 or 54 with CRX22 - at least hotfix 22070

                                  bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                                  21

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                                  How to run DataStore GCDEMONSTRATION

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  DataStore GC

                                  This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                  If you see that error then do not run datastore gc until you have restored the missing files

                                  To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                  bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                  bull Check the Data store consistency check box

                                  bull Click ldquoRunrdquo

                                  bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                  bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                  See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                  23

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                  How to run DataStore Consistency Check

                                  DEMONSTRATION

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                  Tar Persistence Manager Optimization

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Part 2 Topics Covered

                                  TarPM Optimization

                                  - What is the TarPM amp TarPM optimization

                                  - Best practices for maintaining AEM Instances

                                  - Tips and tricks for proactive things to monitor

                                  - Tips and tricks for reducing downtime amp Speed up the process

                                  Workflow Monitoring

                                  - Supported Features

                                  - Best practices for maintaining AEM Instances

                                  - Tips and tricks for proactive things to monitor

                                  26

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  What is TarPM

                                  27

                                  data_00000tar

                                  ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                  data_00001tar

                                  Bundle 01Bundle 02

                                  Bundle 03

                                  Bundle 04

                                  Adding New page

                                  Modifying

                                  page

                                  Del

                                  etin

                                  g

                                  page

                                  bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                  bull Tar PM model is append only

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  What is TarPM Optimization

                                  bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                  28

                                  bundle03

                                  bundle04

                                  bundle11

                                  bundle14

                                  data_00003tar

                                  TAR OPTIMIZATI

                                  ON

                                  bundle01

                                  bundle02

                                  bundle03

                                  bundle04

                                  data_00001tar

                                  bundle11

                                  bundle12

                                  bundle13

                                  bundle14

                                  data_00002tar

                                  Unused

                                  data

                                  Deletes old data tar file

                                  Deletes old data tar file

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Data Tar file location

                                  bull Default storage location of data tar files are

                                  29

                                  ltcq_homegtcrx-quickstartrepository

                                  data_00000tardata_00001tar

                                  workspaces

                                  crxdefault

                                  version

                                  data_00004tardata_00005tar

                                  data_00010tardata_00011tar

                                  tarJournal

                                  data_00012tardata_00013tar

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Best practices for maintaining AEM Instances

                                  Regularly run tar optimization during the low usage hours of your system

                                  bull Automatic Schedule-

                                  - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                  - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                  bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                  30

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Best practices for maintaining AEM Instances

                                  Manually execute TarPM optimization from JMX console

                                  31

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Best practices for maintaining AEM Instances

                                  Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                  32

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Tips and tricks for proactive things to monitor

                                  bull From JMX console monitor

                                  - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                  - TarOptimizationWork- The remaining optimization work in KiloBytes

                                  - TarOptimizationRate- TarPM optimization rate in KBsec

                                  33

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                  How to monitor Tar Optimization via JMX client

                                  DEMONSTRATION

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Tips and tricks for reducing downtime amp Speed up the process

                                  bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                  bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                  - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                  - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                  bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                  35

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Common Pitfalls to Avoid

                                  bull Scheduling tar optimization to run during the heavy usage hours of your system

                                  bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                  bull Do not run tar optimization while you are backing up instance

                                  bull Do not run tar optimization when datastore garbage collection is running

                                  bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                  36

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                  Workflow maintenance and Purge Obsolete Workflow Data

                                  Workflow Monitoring

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Workflow Purge

                                  bull Workflows enable you to automate Experience Manager activities

                                  bull Workflows events generate archived data

                                  bull This data can quickly grow over time as workflows are processed

                                  bull Purging this data on a regular schedule improves system performance

                                  bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                  38

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Best practices for maintaining AEM Instances

                                  Regularly run workflow purge to avoid the problems associated with a large volume of data

                                  bull Using user interface through Felix console

                                  bull Using CURL

                                  bull Creating a JMX client that uses Workflow Mbean

                                  httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                  39

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  Tips and tricks for proactive things to monitor

                                  40

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                  How to monitor workflow via JMX client

                                  DEMONSTRATION

                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                  • ADOBE CUSTOMER BROWN BAG SERIES
                                  • Whatrsquos Covered
                                  • Topics covered
                                  • Slide 4
                                  • Monitoring Replication
                                  • Configure a replicationlog
                                  • Slide 7
                                  • Replication Initializing and Queuing
                                  • Replication Processing Jobs
                                  • Replication Troubleshooting
                                  • Optimizing Replication
                                  • Optimizing Replication (2)
                                  • Optimizing Replication (3)
                                  • Optimizing Replication (4)
                                  • Slide 15
                                  • What is the DataStore
                                  • How does the DataStore work
                                  • DataStore Example
                                  • DataStore Example (2)
                                  • How does DataStore GC work
                                  • DataStore GC Avoiding common Pitfalls
                                  • Slide 22
                                  • DataStore GC
                                  • Slide 24
                                  • Slide 25
                                  • Part 2 Topics Covered
                                  • What is TarPM
                                  • What is TarPM Optimization
                                  • Data Tar file location
                                  • Best practices for maintaining AEM Instances
                                  • Best practices for maintaining AEM Instances (2)
                                  • Best practices for maintaining AEM Instances (3)
                                  • Tips and tricks for proactive things to monitor
                                  • Slide 34
                                  • Tips and tricks for reducing downtime amp Speed up the process
                                  • Common Pitfalls to Avoid
                                  • Slide 37
                                  • Workflow Purge
                                  • Best practices for maintaining AEM Instances (4)
                                  • Tips and tricks for proactive things to monitor (2)
                                  • Slide 41
                                  • Slide 42

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    DataStore Example

                                    User uploads the same image to two different locations

                                    18

                                    AEMpng

                                    Upload

                                    Upload

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    a2b98676377b947244bb954769def9b4fd625daa

                                    repositoryrepositorydatastore

                                    86

                                    b9

                                    a2

                                    DataStore Example

                                    19

                                    JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                                    property

                                    JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                                    originaljcrcontentdata property

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    How does DataStore GC work

                                    DataStore GC (Garbage Collection) is the only way to delete DataStore files

                                    How does it work

                                    bull ldquoScanrdquo Phase

                                    - Read all nodes in the JCR

                                    - Update the timestamp of each of the referenced datastore files

                                    bull ldquoDeleterdquo Phase

                                    - Find all files with timestamp older than when it started the scan phase and deletes them

                                    20

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    DataStore GC Avoiding common Pitfalls

                                    Before running DataStore GC make sure

                                    bull You have a backup of the datastore directory

                                    bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                                    bull Date and time is in sync between network storage and CQ server

                                    bull CQ53 or 54 with CRX22 - at least hotfix 22070

                                    bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                                    21

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                                    How to run DataStore GCDEMONSTRATION

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    DataStore GC

                                    This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                    If you see that error then do not run datastore gc until you have restored the missing files

                                    To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                    bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                    bull Check the Data store consistency check box

                                    bull Click ldquoRunrdquo

                                    bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                    bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                    See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                    23

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                    How to run DataStore Consistency Check

                                    DEMONSTRATION

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                    Tar Persistence Manager Optimization

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Part 2 Topics Covered

                                    TarPM Optimization

                                    - What is the TarPM amp TarPM optimization

                                    - Best practices for maintaining AEM Instances

                                    - Tips and tricks for proactive things to monitor

                                    - Tips and tricks for reducing downtime amp Speed up the process

                                    Workflow Monitoring

                                    - Supported Features

                                    - Best practices for maintaining AEM Instances

                                    - Tips and tricks for proactive things to monitor

                                    26

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    What is TarPM

                                    27

                                    data_00000tar

                                    ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                    data_00001tar

                                    Bundle 01Bundle 02

                                    Bundle 03

                                    Bundle 04

                                    Adding New page

                                    Modifying

                                    page

                                    Del

                                    etin

                                    g

                                    page

                                    bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                    bull Tar PM model is append only

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    What is TarPM Optimization

                                    bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                    28

                                    bundle03

                                    bundle04

                                    bundle11

                                    bundle14

                                    data_00003tar

                                    TAR OPTIMIZATI

                                    ON

                                    bundle01

                                    bundle02

                                    bundle03

                                    bundle04

                                    data_00001tar

                                    bundle11

                                    bundle12

                                    bundle13

                                    bundle14

                                    data_00002tar

                                    Unused

                                    data

                                    Deletes old data tar file

                                    Deletes old data tar file

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Data Tar file location

                                    bull Default storage location of data tar files are

                                    29

                                    ltcq_homegtcrx-quickstartrepository

                                    data_00000tardata_00001tar

                                    workspaces

                                    crxdefault

                                    version

                                    data_00004tardata_00005tar

                                    data_00010tardata_00011tar

                                    tarJournal

                                    data_00012tardata_00013tar

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Best practices for maintaining AEM Instances

                                    Regularly run tar optimization during the low usage hours of your system

                                    bull Automatic Schedule-

                                    - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                    - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                    bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                    30

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Best practices for maintaining AEM Instances

                                    Manually execute TarPM optimization from JMX console

                                    31

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Best practices for maintaining AEM Instances

                                    Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                    32

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Tips and tricks for proactive things to monitor

                                    bull From JMX console monitor

                                    - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                    - TarOptimizationWork- The remaining optimization work in KiloBytes

                                    - TarOptimizationRate- TarPM optimization rate in KBsec

                                    33

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                    How to monitor Tar Optimization via JMX client

                                    DEMONSTRATION

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Tips and tricks for reducing downtime amp Speed up the process

                                    bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                    bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                    - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                    - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                    bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                    35

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Common Pitfalls to Avoid

                                    bull Scheduling tar optimization to run during the heavy usage hours of your system

                                    bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                    bull Do not run tar optimization while you are backing up instance

                                    bull Do not run tar optimization when datastore garbage collection is running

                                    bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                    36

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                    Workflow maintenance and Purge Obsolete Workflow Data

                                    Workflow Monitoring

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Workflow Purge

                                    bull Workflows enable you to automate Experience Manager activities

                                    bull Workflows events generate archived data

                                    bull This data can quickly grow over time as workflows are processed

                                    bull Purging this data on a regular schedule improves system performance

                                    bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                    38

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Best practices for maintaining AEM Instances

                                    Regularly run workflow purge to avoid the problems associated with a large volume of data

                                    bull Using user interface through Felix console

                                    bull Using CURL

                                    bull Creating a JMX client that uses Workflow Mbean

                                    httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                    39

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    Tips and tricks for proactive things to monitor

                                    40

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                    How to monitor workflow via JMX client

                                    DEMONSTRATION

                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                    • ADOBE CUSTOMER BROWN BAG SERIES
                                    • Whatrsquos Covered
                                    • Topics covered
                                    • Slide 4
                                    • Monitoring Replication
                                    • Configure a replicationlog
                                    • Slide 7
                                    • Replication Initializing and Queuing
                                    • Replication Processing Jobs
                                    • Replication Troubleshooting
                                    • Optimizing Replication
                                    • Optimizing Replication (2)
                                    • Optimizing Replication (3)
                                    • Optimizing Replication (4)
                                    • Slide 15
                                    • What is the DataStore
                                    • How does the DataStore work
                                    • DataStore Example
                                    • DataStore Example (2)
                                    • How does DataStore GC work
                                    • DataStore GC Avoiding common Pitfalls
                                    • Slide 22
                                    • DataStore GC
                                    • Slide 24
                                    • Slide 25
                                    • Part 2 Topics Covered
                                    • What is TarPM
                                    • What is TarPM Optimization
                                    • Data Tar file location
                                    • Best practices for maintaining AEM Instances
                                    • Best practices for maintaining AEM Instances (2)
                                    • Best practices for maintaining AEM Instances (3)
                                    • Tips and tricks for proactive things to monitor
                                    • Slide 34
                                    • Tips and tricks for reducing downtime amp Speed up the process
                                    • Common Pitfalls to Avoid
                                    • Slide 37
                                    • Workflow Purge
                                    • Best practices for maintaining AEM Instances (4)
                                    • Tips and tricks for proactive things to monitor (2)
                                    • Slide 41
                                    • Slide 42

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      a2b98676377b947244bb954769def9b4fd625daa

                                      repositoryrepositorydatastore

                                      86

                                      b9

                                      a2

                                      DataStore Example

                                      19

                                      JCR NodecontentdamAEMpngrenditionsoriginaljcrcontentdata

                                      property

                                      JCR Nodecontentdamgeometrixx-mediaAEMpngrenditions

                                      originaljcrcontentdata property

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      How does DataStore GC work

                                      DataStore GC (Garbage Collection) is the only way to delete DataStore files

                                      How does it work

                                      bull ldquoScanrdquo Phase

                                      - Read all nodes in the JCR

                                      - Update the timestamp of each of the referenced datastore files

                                      bull ldquoDeleterdquo Phase

                                      - Find all files with timestamp older than when it started the scan phase and deletes them

                                      20

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      DataStore GC Avoiding common Pitfalls

                                      Before running DataStore GC make sure

                                      bull You have a backup of the datastore directory

                                      bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                                      bull Date and time is in sync between network storage and CQ server

                                      bull CQ53 or 54 with CRX22 - at least hotfix 22070

                                      bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                                      21

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                                      How to run DataStore GCDEMONSTRATION

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      DataStore GC

                                      This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                      If you see that error then do not run datastore gc until you have restored the missing files

                                      To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                      bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                      bull Check the Data store consistency check box

                                      bull Click ldquoRunrdquo

                                      bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                      bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                      See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                      23

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                      How to run DataStore Consistency Check

                                      DEMONSTRATION

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                      Tar Persistence Manager Optimization

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Part 2 Topics Covered

                                      TarPM Optimization

                                      - What is the TarPM amp TarPM optimization

                                      - Best practices for maintaining AEM Instances

                                      - Tips and tricks for proactive things to monitor

                                      - Tips and tricks for reducing downtime amp Speed up the process

                                      Workflow Monitoring

                                      - Supported Features

                                      - Best practices for maintaining AEM Instances

                                      - Tips and tricks for proactive things to monitor

                                      26

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      What is TarPM

                                      27

                                      data_00000tar

                                      ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                      data_00001tar

                                      Bundle 01Bundle 02

                                      Bundle 03

                                      Bundle 04

                                      Adding New page

                                      Modifying

                                      page

                                      Del

                                      etin

                                      g

                                      page

                                      bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                      bull Tar PM model is append only

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      What is TarPM Optimization

                                      bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                      28

                                      bundle03

                                      bundle04

                                      bundle11

                                      bundle14

                                      data_00003tar

                                      TAR OPTIMIZATI

                                      ON

                                      bundle01

                                      bundle02

                                      bundle03

                                      bundle04

                                      data_00001tar

                                      bundle11

                                      bundle12

                                      bundle13

                                      bundle14

                                      data_00002tar

                                      Unused

                                      data

                                      Deletes old data tar file

                                      Deletes old data tar file

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Data Tar file location

                                      bull Default storage location of data tar files are

                                      29

                                      ltcq_homegtcrx-quickstartrepository

                                      data_00000tardata_00001tar

                                      workspaces

                                      crxdefault

                                      version

                                      data_00004tardata_00005tar

                                      data_00010tardata_00011tar

                                      tarJournal

                                      data_00012tardata_00013tar

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Best practices for maintaining AEM Instances

                                      Regularly run tar optimization during the low usage hours of your system

                                      bull Automatic Schedule-

                                      - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                      - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                      bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                      30

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Best practices for maintaining AEM Instances

                                      Manually execute TarPM optimization from JMX console

                                      31

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Best practices for maintaining AEM Instances

                                      Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                      32

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Tips and tricks for proactive things to monitor

                                      bull From JMX console monitor

                                      - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                      - TarOptimizationWork- The remaining optimization work in KiloBytes

                                      - TarOptimizationRate- TarPM optimization rate in KBsec

                                      33

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                      How to monitor Tar Optimization via JMX client

                                      DEMONSTRATION

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Tips and tricks for reducing downtime amp Speed up the process

                                      bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                      bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                      - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                      - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                      bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                      35

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Common Pitfalls to Avoid

                                      bull Scheduling tar optimization to run during the heavy usage hours of your system

                                      bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                      bull Do not run tar optimization while you are backing up instance

                                      bull Do not run tar optimization when datastore garbage collection is running

                                      bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                      36

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                      Workflow maintenance and Purge Obsolete Workflow Data

                                      Workflow Monitoring

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Workflow Purge

                                      bull Workflows enable you to automate Experience Manager activities

                                      bull Workflows events generate archived data

                                      bull This data can quickly grow over time as workflows are processed

                                      bull Purging this data on a regular schedule improves system performance

                                      bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                      38

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Best practices for maintaining AEM Instances

                                      Regularly run workflow purge to avoid the problems associated with a large volume of data

                                      bull Using user interface through Felix console

                                      bull Using CURL

                                      bull Creating a JMX client that uses Workflow Mbean

                                      httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                      39

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      Tips and tricks for proactive things to monitor

                                      40

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                      How to monitor workflow via JMX client

                                      DEMONSTRATION

                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                      • ADOBE CUSTOMER BROWN BAG SERIES
                                      • Whatrsquos Covered
                                      • Topics covered
                                      • Slide 4
                                      • Monitoring Replication
                                      • Configure a replicationlog
                                      • Slide 7
                                      • Replication Initializing and Queuing
                                      • Replication Processing Jobs
                                      • Replication Troubleshooting
                                      • Optimizing Replication
                                      • Optimizing Replication (2)
                                      • Optimizing Replication (3)
                                      • Optimizing Replication (4)
                                      • Slide 15
                                      • What is the DataStore
                                      • How does the DataStore work
                                      • DataStore Example
                                      • DataStore Example (2)
                                      • How does DataStore GC work
                                      • DataStore GC Avoiding common Pitfalls
                                      • Slide 22
                                      • DataStore GC
                                      • Slide 24
                                      • Slide 25
                                      • Part 2 Topics Covered
                                      • What is TarPM
                                      • What is TarPM Optimization
                                      • Data Tar file location
                                      • Best practices for maintaining AEM Instances
                                      • Best practices for maintaining AEM Instances (2)
                                      • Best practices for maintaining AEM Instances (3)
                                      • Tips and tricks for proactive things to monitor
                                      • Slide 34
                                      • Tips and tricks for reducing downtime amp Speed up the process
                                      • Common Pitfalls to Avoid
                                      • Slide 37
                                      • Workflow Purge
                                      • Best practices for maintaining AEM Instances (4)
                                      • Tips and tricks for proactive things to monitor (2)
                                      • Slide 41
                                      • Slide 42

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        How does DataStore GC work

                                        DataStore GC (Garbage Collection) is the only way to delete DataStore files

                                        How does it work

                                        bull ldquoScanrdquo Phase

                                        - Read all nodes in the JCR

                                        - Update the timestamp of each of the referenced datastore files

                                        bull ldquoDeleterdquo Phase

                                        - Find all files with timestamp older than when it started the scan phase and deletes them

                                        20

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        DataStore GC Avoiding common Pitfalls

                                        Before running DataStore GC make sure

                                        bull You have a backup of the datastore directory

                                        bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                                        bull Date and time is in sync between network storage and CQ server

                                        bull CQ53 or 54 with CRX22 - at least hotfix 22070

                                        bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                                        21

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                                        How to run DataStore GCDEMONSTRATION

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        DataStore GC

                                        This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                        If you see that error then do not run datastore gc until you have restored the missing files

                                        To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                        bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                        bull Check the Data store consistency check box

                                        bull Click ldquoRunrdquo

                                        bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                        bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                        See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                        23

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                        How to run DataStore Consistency Check

                                        DEMONSTRATION

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                        Tar Persistence Manager Optimization

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Part 2 Topics Covered

                                        TarPM Optimization

                                        - What is the TarPM amp TarPM optimization

                                        - Best practices for maintaining AEM Instances

                                        - Tips and tricks for proactive things to monitor

                                        - Tips and tricks for reducing downtime amp Speed up the process

                                        Workflow Monitoring

                                        - Supported Features

                                        - Best practices for maintaining AEM Instances

                                        - Tips and tricks for proactive things to monitor

                                        26

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        What is TarPM

                                        27

                                        data_00000tar

                                        ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                        data_00001tar

                                        Bundle 01Bundle 02

                                        Bundle 03

                                        Bundle 04

                                        Adding New page

                                        Modifying

                                        page

                                        Del

                                        etin

                                        g

                                        page

                                        bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                        bull Tar PM model is append only

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        What is TarPM Optimization

                                        bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                        28

                                        bundle03

                                        bundle04

                                        bundle11

                                        bundle14

                                        data_00003tar

                                        TAR OPTIMIZATI

                                        ON

                                        bundle01

                                        bundle02

                                        bundle03

                                        bundle04

                                        data_00001tar

                                        bundle11

                                        bundle12

                                        bundle13

                                        bundle14

                                        data_00002tar

                                        Unused

                                        data

                                        Deletes old data tar file

                                        Deletes old data tar file

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Data Tar file location

                                        bull Default storage location of data tar files are

                                        29

                                        ltcq_homegtcrx-quickstartrepository

                                        data_00000tardata_00001tar

                                        workspaces

                                        crxdefault

                                        version

                                        data_00004tardata_00005tar

                                        data_00010tardata_00011tar

                                        tarJournal

                                        data_00012tardata_00013tar

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Best practices for maintaining AEM Instances

                                        Regularly run tar optimization during the low usage hours of your system

                                        bull Automatic Schedule-

                                        - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                        - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                        bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                        30

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Best practices for maintaining AEM Instances

                                        Manually execute TarPM optimization from JMX console

                                        31

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Best practices for maintaining AEM Instances

                                        Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                        32

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Tips and tricks for proactive things to monitor

                                        bull From JMX console monitor

                                        - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                        - TarOptimizationWork- The remaining optimization work in KiloBytes

                                        - TarOptimizationRate- TarPM optimization rate in KBsec

                                        33

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                        How to monitor Tar Optimization via JMX client

                                        DEMONSTRATION

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Tips and tricks for reducing downtime amp Speed up the process

                                        bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                        bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                        - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                        - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                        bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                        35

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Common Pitfalls to Avoid

                                        bull Scheduling tar optimization to run during the heavy usage hours of your system

                                        bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                        bull Do not run tar optimization while you are backing up instance

                                        bull Do not run tar optimization when datastore garbage collection is running

                                        bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                        36

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                        Workflow maintenance and Purge Obsolete Workflow Data

                                        Workflow Monitoring

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Workflow Purge

                                        bull Workflows enable you to automate Experience Manager activities

                                        bull Workflows events generate archived data

                                        bull This data can quickly grow over time as workflows are processed

                                        bull Purging this data on a regular schedule improves system performance

                                        bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                        38

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Best practices for maintaining AEM Instances

                                        Regularly run workflow purge to avoid the problems associated with a large volume of data

                                        bull Using user interface through Felix console

                                        bull Using CURL

                                        bull Creating a JMX client that uses Workflow Mbean

                                        httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                        39

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        Tips and tricks for proactive things to monitor

                                        40

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                        How to monitor workflow via JMX client

                                        DEMONSTRATION

                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                        • ADOBE CUSTOMER BROWN BAG SERIES
                                        • Whatrsquos Covered
                                        • Topics covered
                                        • Slide 4
                                        • Monitoring Replication
                                        • Configure a replicationlog
                                        • Slide 7
                                        • Replication Initializing and Queuing
                                        • Replication Processing Jobs
                                        • Replication Troubleshooting
                                        • Optimizing Replication
                                        • Optimizing Replication (2)
                                        • Optimizing Replication (3)
                                        • Optimizing Replication (4)
                                        • Slide 15
                                        • What is the DataStore
                                        • How does the DataStore work
                                        • DataStore Example
                                        • DataStore Example (2)
                                        • How does DataStore GC work
                                        • DataStore GC Avoiding common Pitfalls
                                        • Slide 22
                                        • DataStore GC
                                        • Slide 24
                                        • Slide 25
                                        • Part 2 Topics Covered
                                        • What is TarPM
                                        • What is TarPM Optimization
                                        • Data Tar file location
                                        • Best practices for maintaining AEM Instances
                                        • Best practices for maintaining AEM Instances (2)
                                        • Best practices for maintaining AEM Instances (3)
                                        • Tips and tricks for proactive things to monitor
                                        • Slide 34
                                        • Tips and tricks for reducing downtime amp Speed up the process
                                        • Common Pitfalls to Avoid
                                        • Slide 37
                                        • Workflow Purge
                                        • Best practices for maintaining AEM Instances (4)
                                        • Tips and tricks for proactive things to monitor (2)
                                        • Slide 41
                                        • Slide 42

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          DataStore GC Avoiding common Pitfalls

                                          Before running DataStore GC make sure

                                          bull You have a backup of the datastore directory

                                          bull No issues with setting timestamps (this especially applies of your datastore is on a network storage)

                                          bull Date and time is in sync between network storage and CQ server

                                          bull CQ53 or 54 with CRX22 - at least hotfix 22070

                                          bull CQ561 - do NOT use stopDataStoreGarbageCollection in JMX to stop the GC process

                                          21

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                                          How to run DataStore GCDEMONSTRATION

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          DataStore GC

                                          This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                          If you see that error then do not run datastore gc until you have restored the missing files

                                          To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                          bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                          bull Check the Data store consistency check box

                                          bull Click ldquoRunrdquo

                                          bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                          bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                          See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                          23

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                          How to run DataStore Consistency Check

                                          DEMONSTRATION

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                          Tar Persistence Manager Optimization

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Part 2 Topics Covered

                                          TarPM Optimization

                                          - What is the TarPM amp TarPM optimization

                                          - Best practices for maintaining AEM Instances

                                          - Tips and tricks for proactive things to monitor

                                          - Tips and tricks for reducing downtime amp Speed up the process

                                          Workflow Monitoring

                                          - Supported Features

                                          - Best practices for maintaining AEM Instances

                                          - Tips and tricks for proactive things to monitor

                                          26

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          What is TarPM

                                          27

                                          data_00000tar

                                          ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                          data_00001tar

                                          Bundle 01Bundle 02

                                          Bundle 03

                                          Bundle 04

                                          Adding New page

                                          Modifying

                                          page

                                          Del

                                          etin

                                          g

                                          page

                                          bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                          bull Tar PM model is append only

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          What is TarPM Optimization

                                          bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                          28

                                          bundle03

                                          bundle04

                                          bundle11

                                          bundle14

                                          data_00003tar

                                          TAR OPTIMIZATI

                                          ON

                                          bundle01

                                          bundle02

                                          bundle03

                                          bundle04

                                          data_00001tar

                                          bundle11

                                          bundle12

                                          bundle13

                                          bundle14

                                          data_00002tar

                                          Unused

                                          data

                                          Deletes old data tar file

                                          Deletes old data tar file

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Data Tar file location

                                          bull Default storage location of data tar files are

                                          29

                                          ltcq_homegtcrx-quickstartrepository

                                          data_00000tardata_00001tar

                                          workspaces

                                          crxdefault

                                          version

                                          data_00004tardata_00005tar

                                          data_00010tardata_00011tar

                                          tarJournal

                                          data_00012tardata_00013tar

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Best practices for maintaining AEM Instances

                                          Regularly run tar optimization during the low usage hours of your system

                                          bull Automatic Schedule-

                                          - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                          - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                          bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                          30

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Best practices for maintaining AEM Instances

                                          Manually execute TarPM optimization from JMX console

                                          31

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Best practices for maintaining AEM Instances

                                          Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                          32

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Tips and tricks for proactive things to monitor

                                          bull From JMX console monitor

                                          - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                          - TarOptimizationWork- The remaining optimization work in KiloBytes

                                          - TarOptimizationRate- TarPM optimization rate in KBsec

                                          33

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                          How to monitor Tar Optimization via JMX client

                                          DEMONSTRATION

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Tips and tricks for reducing downtime amp Speed up the process

                                          bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                          bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                          - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                          - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                          bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                          35

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Common Pitfalls to Avoid

                                          bull Scheduling tar optimization to run during the heavy usage hours of your system

                                          bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                          bull Do not run tar optimization while you are backing up instance

                                          bull Do not run tar optimization when datastore garbage collection is running

                                          bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                          36

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                          Workflow maintenance and Purge Obsolete Workflow Data

                                          Workflow Monitoring

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Workflow Purge

                                          bull Workflows enable you to automate Experience Manager activities

                                          bull Workflows events generate archived data

                                          bull This data can quickly grow over time as workflows are processed

                                          bull Purging this data on a regular schedule improves system performance

                                          bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                          38

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Best practices for maintaining AEM Instances

                                          Regularly run workflow purge to avoid the problems associated with a large volume of data

                                          bull Using user interface through Felix console

                                          bull Using CURL

                                          bull Creating a JMX client that uses Workflow Mbean

                                          httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                          39

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          Tips and tricks for proactive things to monitor

                                          40

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                          How to monitor workflow via JMX client

                                          DEMONSTRATION

                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                          • ADOBE CUSTOMER BROWN BAG SERIES
                                          • Whatrsquos Covered
                                          • Topics covered
                                          • Slide 4
                                          • Monitoring Replication
                                          • Configure a replicationlog
                                          • Slide 7
                                          • Replication Initializing and Queuing
                                          • Replication Processing Jobs
                                          • Replication Troubleshooting
                                          • Optimizing Replication
                                          • Optimizing Replication (2)
                                          • Optimizing Replication (3)
                                          • Optimizing Replication (4)
                                          • Slide 15
                                          • What is the DataStore
                                          • How does the DataStore work
                                          • DataStore Example
                                          • DataStore Example (2)
                                          • How does DataStore GC work
                                          • DataStore GC Avoiding common Pitfalls
                                          • Slide 22
                                          • DataStore GC
                                          • Slide 24
                                          • Slide 25
                                          • Part 2 Topics Covered
                                          • What is TarPM
                                          • What is TarPM Optimization
                                          • Data Tar file location
                                          • Best practices for maintaining AEM Instances
                                          • Best practices for maintaining AEM Instances (2)
                                          • Best practices for maintaining AEM Instances (3)
                                          • Tips and tricks for proactive things to monitor
                                          • Slide 34
                                          • Tips and tricks for reducing downtime amp Speed up the process
                                          • Common Pitfalls to Avoid
                                          • Slide 37
                                          • Workflow Purge
                                          • Best practices for maintaining AEM Instances (4)
                                          • Tips and tricks for proactive things to monitor (2)
                                          • Slide 41
                                          • Slide 42

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 22

                                            How to run DataStore GCDEMONSTRATION

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            DataStore GC

                                            This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                            If you see that error then do not run datastore gc until you have restored the missing files

                                            To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                            bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                            bull Check the Data store consistency check box

                                            bull Click ldquoRunrdquo

                                            bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                            bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                            See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                            23

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                            How to run DataStore Consistency Check

                                            DEMONSTRATION

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                            Tar Persistence Manager Optimization

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Part 2 Topics Covered

                                            TarPM Optimization

                                            - What is the TarPM amp TarPM optimization

                                            - Best practices for maintaining AEM Instances

                                            - Tips and tricks for proactive things to monitor

                                            - Tips and tricks for reducing downtime amp Speed up the process

                                            Workflow Monitoring

                                            - Supported Features

                                            - Best practices for maintaining AEM Instances

                                            - Tips and tricks for proactive things to monitor

                                            26

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            What is TarPM

                                            27

                                            data_00000tar

                                            ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                            data_00001tar

                                            Bundle 01Bundle 02

                                            Bundle 03

                                            Bundle 04

                                            Adding New page

                                            Modifying

                                            page

                                            Del

                                            etin

                                            g

                                            page

                                            bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                            bull Tar PM model is append only

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            What is TarPM Optimization

                                            bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                            28

                                            bundle03

                                            bundle04

                                            bundle11

                                            bundle14

                                            data_00003tar

                                            TAR OPTIMIZATI

                                            ON

                                            bundle01

                                            bundle02

                                            bundle03

                                            bundle04

                                            data_00001tar

                                            bundle11

                                            bundle12

                                            bundle13

                                            bundle14

                                            data_00002tar

                                            Unused

                                            data

                                            Deletes old data tar file

                                            Deletes old data tar file

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Data Tar file location

                                            bull Default storage location of data tar files are

                                            29

                                            ltcq_homegtcrx-quickstartrepository

                                            data_00000tardata_00001tar

                                            workspaces

                                            crxdefault

                                            version

                                            data_00004tardata_00005tar

                                            data_00010tardata_00011tar

                                            tarJournal

                                            data_00012tardata_00013tar

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Best practices for maintaining AEM Instances

                                            Regularly run tar optimization during the low usage hours of your system

                                            bull Automatic Schedule-

                                            - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                            - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                            bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                            30

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Best practices for maintaining AEM Instances

                                            Manually execute TarPM optimization from JMX console

                                            31

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Best practices for maintaining AEM Instances

                                            Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                            32

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Tips and tricks for proactive things to monitor

                                            bull From JMX console monitor

                                            - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                            - TarOptimizationWork- The remaining optimization work in KiloBytes

                                            - TarOptimizationRate- TarPM optimization rate in KBsec

                                            33

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                            How to monitor Tar Optimization via JMX client

                                            DEMONSTRATION

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Tips and tricks for reducing downtime amp Speed up the process

                                            bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                            bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                            - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                            - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                            bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                            35

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Common Pitfalls to Avoid

                                            bull Scheduling tar optimization to run during the heavy usage hours of your system

                                            bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                            bull Do not run tar optimization while you are backing up instance

                                            bull Do not run tar optimization when datastore garbage collection is running

                                            bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                            36

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                            Workflow maintenance and Purge Obsolete Workflow Data

                                            Workflow Monitoring

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Workflow Purge

                                            bull Workflows enable you to automate Experience Manager activities

                                            bull Workflows events generate archived data

                                            bull This data can quickly grow over time as workflows are processed

                                            bull Purging this data on a regular schedule improves system performance

                                            bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                            38

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Best practices for maintaining AEM Instances

                                            Regularly run workflow purge to avoid the problems associated with a large volume of data

                                            bull Using user interface through Felix console

                                            bull Using CURL

                                            bull Creating a JMX client that uses Workflow Mbean

                                            httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                            39

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            Tips and tricks for proactive things to monitor

                                            40

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                            How to monitor workflow via JMX client

                                            DEMONSTRATION

                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                            • ADOBE CUSTOMER BROWN BAG SERIES
                                            • Whatrsquos Covered
                                            • Topics covered
                                            • Slide 4
                                            • Monitoring Replication
                                            • Configure a replicationlog
                                            • Slide 7
                                            • Replication Initializing and Queuing
                                            • Replication Processing Jobs
                                            • Replication Troubleshooting
                                            • Optimizing Replication
                                            • Optimizing Replication (2)
                                            • Optimizing Replication (3)
                                            • Optimizing Replication (4)
                                            • Slide 15
                                            • What is the DataStore
                                            • How does the DataStore work
                                            • DataStore Example
                                            • DataStore Example (2)
                                            • How does DataStore GC work
                                            • DataStore GC Avoiding common Pitfalls
                                            • Slide 22
                                            • DataStore GC
                                            • Slide 24
                                            • Slide 25
                                            • Part 2 Topics Covered
                                            • What is TarPM
                                            • What is TarPM Optimization
                                            • Data Tar file location
                                            • Best practices for maintaining AEM Instances
                                            • Best practices for maintaining AEM Instances (2)
                                            • Best practices for maintaining AEM Instances (3)
                                            • Tips and tricks for proactive things to monitor
                                            • Slide 34
                                            • Tips and tricks for reducing downtime amp Speed up the process
                                            • Common Pitfalls to Avoid
                                            • Slide 37
                                            • Workflow Purge
                                            • Best practices for maintaining AEM Instances (4)
                                            • Tips and tricks for proactive things to monitor (2)
                                            • Slide 41
                                            • Slide 42

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              DataStore GC

                                              This error means you are missing a file from your datastoreldquoDataStoreException Record not foundrdquo

                                              If you see that error then do not run datastore gc until you have restored the missing files

                                              To identify all missing filesbull Go to crxexplorerindexjsp and login as admin (crxindexjsp CQ54 and earlier)

                                              bull Browse to Repository Configuration =gt Check Repositoryrdquo

                                              bull Check the Data store consistency check box

                                              bull Click ldquoRunrdquo

                                              bull This will output a list of nodes referencing the missing files along with the path of the missing file

                                              bull Since the files are unique you can copy the missing files over from any other AEM (CQ) instances that the same file

                                              See this article for more detailsbull httphelpxadobecomcrxkbDataStoreGarbageCollectionhtml

                                              23

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                              How to run DataStore Consistency Check

                                              DEMONSTRATION

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                              Tar Persistence Manager Optimization

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Part 2 Topics Covered

                                              TarPM Optimization

                                              - What is the TarPM amp TarPM optimization

                                              - Best practices for maintaining AEM Instances

                                              - Tips and tricks for proactive things to monitor

                                              - Tips and tricks for reducing downtime amp Speed up the process

                                              Workflow Monitoring

                                              - Supported Features

                                              - Best practices for maintaining AEM Instances

                                              - Tips and tricks for proactive things to monitor

                                              26

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              What is TarPM

                                              27

                                              data_00000tar

                                              ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                              data_00001tar

                                              Bundle 01Bundle 02

                                              Bundle 03

                                              Bundle 04

                                              Adding New page

                                              Modifying

                                              page

                                              Del

                                              etin

                                              g

                                              page

                                              bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                              bull Tar PM model is append only

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              What is TarPM Optimization

                                              bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                              28

                                              bundle03

                                              bundle04

                                              bundle11

                                              bundle14

                                              data_00003tar

                                              TAR OPTIMIZATI

                                              ON

                                              bundle01

                                              bundle02

                                              bundle03

                                              bundle04

                                              data_00001tar

                                              bundle11

                                              bundle12

                                              bundle13

                                              bundle14

                                              data_00002tar

                                              Unused

                                              data

                                              Deletes old data tar file

                                              Deletes old data tar file

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Data Tar file location

                                              bull Default storage location of data tar files are

                                              29

                                              ltcq_homegtcrx-quickstartrepository

                                              data_00000tardata_00001tar

                                              workspaces

                                              crxdefault

                                              version

                                              data_00004tardata_00005tar

                                              data_00010tardata_00011tar

                                              tarJournal

                                              data_00012tardata_00013tar

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Best practices for maintaining AEM Instances

                                              Regularly run tar optimization during the low usage hours of your system

                                              bull Automatic Schedule-

                                              - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                              - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                              bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                              30

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Best practices for maintaining AEM Instances

                                              Manually execute TarPM optimization from JMX console

                                              31

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Best practices for maintaining AEM Instances

                                              Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                              32

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Tips and tricks for proactive things to monitor

                                              bull From JMX console monitor

                                              - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                              - TarOptimizationWork- The remaining optimization work in KiloBytes

                                              - TarOptimizationRate- TarPM optimization rate in KBsec

                                              33

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                              How to monitor Tar Optimization via JMX client

                                              DEMONSTRATION

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Tips and tricks for reducing downtime amp Speed up the process

                                              bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                              bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                              - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                              - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                              bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                              35

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Common Pitfalls to Avoid

                                              bull Scheduling tar optimization to run during the heavy usage hours of your system

                                              bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                              bull Do not run tar optimization while you are backing up instance

                                              bull Do not run tar optimization when datastore garbage collection is running

                                              bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                              36

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                              Workflow maintenance and Purge Obsolete Workflow Data

                                              Workflow Monitoring

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Workflow Purge

                                              bull Workflows enable you to automate Experience Manager activities

                                              bull Workflows events generate archived data

                                              bull This data can quickly grow over time as workflows are processed

                                              bull Purging this data on a regular schedule improves system performance

                                              bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                              38

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Best practices for maintaining AEM Instances

                                              Regularly run workflow purge to avoid the problems associated with a large volume of data

                                              bull Using user interface through Felix console

                                              bull Using CURL

                                              bull Creating a JMX client that uses Workflow Mbean

                                              httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                              39

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              Tips and tricks for proactive things to monitor

                                              40

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                              How to monitor workflow via JMX client

                                              DEMONSTRATION

                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                              • ADOBE CUSTOMER BROWN BAG SERIES
                                              • Whatrsquos Covered
                                              • Topics covered
                                              • Slide 4
                                              • Monitoring Replication
                                              • Configure a replicationlog
                                              • Slide 7
                                              • Replication Initializing and Queuing
                                              • Replication Processing Jobs
                                              • Replication Troubleshooting
                                              • Optimizing Replication
                                              • Optimizing Replication (2)
                                              • Optimizing Replication (3)
                                              • Optimizing Replication (4)
                                              • Slide 15
                                              • What is the DataStore
                                              • How does the DataStore work
                                              • DataStore Example
                                              • DataStore Example (2)
                                              • How does DataStore GC work
                                              • DataStore GC Avoiding common Pitfalls
                                              • Slide 22
                                              • DataStore GC
                                              • Slide 24
                                              • Slide 25
                                              • Part 2 Topics Covered
                                              • What is TarPM
                                              • What is TarPM Optimization
                                              • Data Tar file location
                                              • Best practices for maintaining AEM Instances
                                              • Best practices for maintaining AEM Instances (2)
                                              • Best practices for maintaining AEM Instances (3)
                                              • Tips and tricks for proactive things to monitor
                                              • Slide 34
                                              • Tips and tricks for reducing downtime amp Speed up the process
                                              • Common Pitfalls to Avoid
                                              • Slide 37
                                              • Workflow Purge
                                              • Best practices for maintaining AEM Instances (4)
                                              • Tips and tricks for proactive things to monitor (2)
                                              • Slide 41
                                              • Slide 42

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 24

                                                How to run DataStore Consistency Check

                                                DEMONSTRATION

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                                Tar Persistence Manager Optimization

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Part 2 Topics Covered

                                                TarPM Optimization

                                                - What is the TarPM amp TarPM optimization

                                                - Best practices for maintaining AEM Instances

                                                - Tips and tricks for proactive things to monitor

                                                - Tips and tricks for reducing downtime amp Speed up the process

                                                Workflow Monitoring

                                                - Supported Features

                                                - Best practices for maintaining AEM Instances

                                                - Tips and tricks for proactive things to monitor

                                                26

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                What is TarPM

                                                27

                                                data_00000tar

                                                ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                                data_00001tar

                                                Bundle 01Bundle 02

                                                Bundle 03

                                                Bundle 04

                                                Adding New page

                                                Modifying

                                                page

                                                Del

                                                etin

                                                g

                                                page

                                                bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                                bull Tar PM model is append only

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                What is TarPM Optimization

                                                bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                                28

                                                bundle03

                                                bundle04

                                                bundle11

                                                bundle14

                                                data_00003tar

                                                TAR OPTIMIZATI

                                                ON

                                                bundle01

                                                bundle02

                                                bundle03

                                                bundle04

                                                data_00001tar

                                                bundle11

                                                bundle12

                                                bundle13

                                                bundle14

                                                data_00002tar

                                                Unused

                                                data

                                                Deletes old data tar file

                                                Deletes old data tar file

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Data Tar file location

                                                bull Default storage location of data tar files are

                                                29

                                                ltcq_homegtcrx-quickstartrepository

                                                data_00000tardata_00001tar

                                                workspaces

                                                crxdefault

                                                version

                                                data_00004tardata_00005tar

                                                data_00010tardata_00011tar

                                                tarJournal

                                                data_00012tardata_00013tar

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Best practices for maintaining AEM Instances

                                                Regularly run tar optimization during the low usage hours of your system

                                                bull Automatic Schedule-

                                                - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                                - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                                bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                                30

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Best practices for maintaining AEM Instances

                                                Manually execute TarPM optimization from JMX console

                                                31

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Best practices for maintaining AEM Instances

                                                Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                32

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Tips and tricks for proactive things to monitor

                                                bull From JMX console monitor

                                                - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                - TarOptimizationRate- TarPM optimization rate in KBsec

                                                33

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                How to monitor Tar Optimization via JMX client

                                                DEMONSTRATION

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Tips and tricks for reducing downtime amp Speed up the process

                                                bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                35

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Common Pitfalls to Avoid

                                                bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                bull Do not run tar optimization while you are backing up instance

                                                bull Do not run tar optimization when datastore garbage collection is running

                                                bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                36

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                Workflow maintenance and Purge Obsolete Workflow Data

                                                Workflow Monitoring

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Workflow Purge

                                                bull Workflows enable you to automate Experience Manager activities

                                                bull Workflows events generate archived data

                                                bull This data can quickly grow over time as workflows are processed

                                                bull Purging this data on a regular schedule improves system performance

                                                bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                38

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Best practices for maintaining AEM Instances

                                                Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                bull Using user interface through Felix console

                                                bull Using CURL

                                                bull Creating a JMX client that uses Workflow Mbean

                                                httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                39

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                Tips and tricks for proactive things to monitor

                                                40

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                How to monitor workflow via JMX client

                                                DEMONSTRATION

                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                • ADOBE CUSTOMER BROWN BAG SERIES
                                                • Whatrsquos Covered
                                                • Topics covered
                                                • Slide 4
                                                • Monitoring Replication
                                                • Configure a replicationlog
                                                • Slide 7
                                                • Replication Initializing and Queuing
                                                • Replication Processing Jobs
                                                • Replication Troubleshooting
                                                • Optimizing Replication
                                                • Optimizing Replication (2)
                                                • Optimizing Replication (3)
                                                • Optimizing Replication (4)
                                                • Slide 15
                                                • What is the DataStore
                                                • How does the DataStore work
                                                • DataStore Example
                                                • DataStore Example (2)
                                                • How does DataStore GC work
                                                • DataStore GC Avoiding common Pitfalls
                                                • Slide 22
                                                • DataStore GC
                                                • Slide 24
                                                • Slide 25
                                                • Part 2 Topics Covered
                                                • What is TarPM
                                                • What is TarPM Optimization
                                                • Data Tar file location
                                                • Best practices for maintaining AEM Instances
                                                • Best practices for maintaining AEM Instances (2)
                                                • Best practices for maintaining AEM Instances (3)
                                                • Tips and tricks for proactive things to monitor
                                                • Slide 34
                                                • Tips and tricks for reducing downtime amp Speed up the process
                                                • Common Pitfalls to Avoid
                                                • Slide 37
                                                • Workflow Purge
                                                • Best practices for maintaining AEM Instances (4)
                                                • Tips and tricks for proactive things to monitor (2)
                                                • Slide 41
                                                • Slide 42

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 25

                                                  Tar Persistence Manager Optimization

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Part 2 Topics Covered

                                                  TarPM Optimization

                                                  - What is the TarPM amp TarPM optimization

                                                  - Best practices for maintaining AEM Instances

                                                  - Tips and tricks for proactive things to monitor

                                                  - Tips and tricks for reducing downtime amp Speed up the process

                                                  Workflow Monitoring

                                                  - Supported Features

                                                  - Best practices for maintaining AEM Instances

                                                  - Tips and tricks for proactive things to monitor

                                                  26

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  What is TarPM

                                                  27

                                                  data_00000tar

                                                  ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                                  data_00001tar

                                                  Bundle 01Bundle 02

                                                  Bundle 03

                                                  Bundle 04

                                                  Adding New page

                                                  Modifying

                                                  page

                                                  Del

                                                  etin

                                                  g

                                                  page

                                                  bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                                  bull Tar PM model is append only

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  What is TarPM Optimization

                                                  bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                                  28

                                                  bundle03

                                                  bundle04

                                                  bundle11

                                                  bundle14

                                                  data_00003tar

                                                  TAR OPTIMIZATI

                                                  ON

                                                  bundle01

                                                  bundle02

                                                  bundle03

                                                  bundle04

                                                  data_00001tar

                                                  bundle11

                                                  bundle12

                                                  bundle13

                                                  bundle14

                                                  data_00002tar

                                                  Unused

                                                  data

                                                  Deletes old data tar file

                                                  Deletes old data tar file

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Data Tar file location

                                                  bull Default storage location of data tar files are

                                                  29

                                                  ltcq_homegtcrx-quickstartrepository

                                                  data_00000tardata_00001tar

                                                  workspaces

                                                  crxdefault

                                                  version

                                                  data_00004tardata_00005tar

                                                  data_00010tardata_00011tar

                                                  tarJournal

                                                  data_00012tardata_00013tar

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Best practices for maintaining AEM Instances

                                                  Regularly run tar optimization during the low usage hours of your system

                                                  bull Automatic Schedule-

                                                  - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                                  - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                                  bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                                  30

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Best practices for maintaining AEM Instances

                                                  Manually execute TarPM optimization from JMX console

                                                  31

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Best practices for maintaining AEM Instances

                                                  Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                  32

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Tips and tricks for proactive things to monitor

                                                  bull From JMX console monitor

                                                  - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                  - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                  - TarOptimizationRate- TarPM optimization rate in KBsec

                                                  33

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                  How to monitor Tar Optimization via JMX client

                                                  DEMONSTRATION

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Tips and tricks for reducing downtime amp Speed up the process

                                                  bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                  bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                  - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                  - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                  bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                  35

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Common Pitfalls to Avoid

                                                  bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                  bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                  bull Do not run tar optimization while you are backing up instance

                                                  bull Do not run tar optimization when datastore garbage collection is running

                                                  bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                  36

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                  Workflow maintenance and Purge Obsolete Workflow Data

                                                  Workflow Monitoring

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Workflow Purge

                                                  bull Workflows enable you to automate Experience Manager activities

                                                  bull Workflows events generate archived data

                                                  bull This data can quickly grow over time as workflows are processed

                                                  bull Purging this data on a regular schedule improves system performance

                                                  bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                  38

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Best practices for maintaining AEM Instances

                                                  Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                  bull Using user interface through Felix console

                                                  bull Using CURL

                                                  bull Creating a JMX client that uses Workflow Mbean

                                                  httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                  39

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  Tips and tricks for proactive things to monitor

                                                  40

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                  How to monitor workflow via JMX client

                                                  DEMONSTRATION

                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                  • ADOBE CUSTOMER BROWN BAG SERIES
                                                  • Whatrsquos Covered
                                                  • Topics covered
                                                  • Slide 4
                                                  • Monitoring Replication
                                                  • Configure a replicationlog
                                                  • Slide 7
                                                  • Replication Initializing and Queuing
                                                  • Replication Processing Jobs
                                                  • Replication Troubleshooting
                                                  • Optimizing Replication
                                                  • Optimizing Replication (2)
                                                  • Optimizing Replication (3)
                                                  • Optimizing Replication (4)
                                                  • Slide 15
                                                  • What is the DataStore
                                                  • How does the DataStore work
                                                  • DataStore Example
                                                  • DataStore Example (2)
                                                  • How does DataStore GC work
                                                  • DataStore GC Avoiding common Pitfalls
                                                  • Slide 22
                                                  • DataStore GC
                                                  • Slide 24
                                                  • Slide 25
                                                  • Part 2 Topics Covered
                                                  • What is TarPM
                                                  • What is TarPM Optimization
                                                  • Data Tar file location
                                                  • Best practices for maintaining AEM Instances
                                                  • Best practices for maintaining AEM Instances (2)
                                                  • Best practices for maintaining AEM Instances (3)
                                                  • Tips and tricks for proactive things to monitor
                                                  • Slide 34
                                                  • Tips and tricks for reducing downtime amp Speed up the process
                                                  • Common Pitfalls to Avoid
                                                  • Slide 37
                                                  • Workflow Purge
                                                  • Best practices for maintaining AEM Instances (4)
                                                  • Tips and tricks for proactive things to monitor (2)
                                                  • Slide 41
                                                  • Slide 42

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Part 2 Topics Covered

                                                    TarPM Optimization

                                                    - What is the TarPM amp TarPM optimization

                                                    - Best practices for maintaining AEM Instances

                                                    - Tips and tricks for proactive things to monitor

                                                    - Tips and tricks for reducing downtime amp Speed up the process

                                                    Workflow Monitoring

                                                    - Supported Features

                                                    - Best practices for maintaining AEM Instances

                                                    - Tips and tricks for proactive things to monitor

                                                    26

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    What is TarPM

                                                    27

                                                    data_00000tar

                                                    ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                                    data_00001tar

                                                    Bundle 01Bundle 02

                                                    Bundle 03

                                                    Bundle 04

                                                    Adding New page

                                                    Modifying

                                                    page

                                                    Del

                                                    etin

                                                    g

                                                    page

                                                    bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                                    bull Tar PM model is append only

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    What is TarPM Optimization

                                                    bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                                    28

                                                    bundle03

                                                    bundle04

                                                    bundle11

                                                    bundle14

                                                    data_00003tar

                                                    TAR OPTIMIZATI

                                                    ON

                                                    bundle01

                                                    bundle02

                                                    bundle03

                                                    bundle04

                                                    data_00001tar

                                                    bundle11

                                                    bundle12

                                                    bundle13

                                                    bundle14

                                                    data_00002tar

                                                    Unused

                                                    data

                                                    Deletes old data tar file

                                                    Deletes old data tar file

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Data Tar file location

                                                    bull Default storage location of data tar files are

                                                    29

                                                    ltcq_homegtcrx-quickstartrepository

                                                    data_00000tardata_00001tar

                                                    workspaces

                                                    crxdefault

                                                    version

                                                    data_00004tardata_00005tar

                                                    data_00010tardata_00011tar

                                                    tarJournal

                                                    data_00012tardata_00013tar

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Best practices for maintaining AEM Instances

                                                    Regularly run tar optimization during the low usage hours of your system

                                                    bull Automatic Schedule-

                                                    - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                                    - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                                    bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                                    30

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Best practices for maintaining AEM Instances

                                                    Manually execute TarPM optimization from JMX console

                                                    31

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Best practices for maintaining AEM Instances

                                                    Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                    32

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Tips and tricks for proactive things to monitor

                                                    bull From JMX console monitor

                                                    - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                    - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                    - TarOptimizationRate- TarPM optimization rate in KBsec

                                                    33

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                    How to monitor Tar Optimization via JMX client

                                                    DEMONSTRATION

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Tips and tricks for reducing downtime amp Speed up the process

                                                    bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                    bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                    - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                    - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                    bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                    35

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Common Pitfalls to Avoid

                                                    bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                    bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                    bull Do not run tar optimization while you are backing up instance

                                                    bull Do not run tar optimization when datastore garbage collection is running

                                                    bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                    36

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                    Workflow maintenance and Purge Obsolete Workflow Data

                                                    Workflow Monitoring

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Workflow Purge

                                                    bull Workflows enable you to automate Experience Manager activities

                                                    bull Workflows events generate archived data

                                                    bull This data can quickly grow over time as workflows are processed

                                                    bull Purging this data on a regular schedule improves system performance

                                                    bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                    38

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Best practices for maintaining AEM Instances

                                                    Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                    bull Using user interface through Felix console

                                                    bull Using CURL

                                                    bull Creating a JMX client that uses Workflow Mbean

                                                    httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                    39

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    Tips and tricks for proactive things to monitor

                                                    40

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                    How to monitor workflow via JMX client

                                                    DEMONSTRATION

                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                    • ADOBE CUSTOMER BROWN BAG SERIES
                                                    • Whatrsquos Covered
                                                    • Topics covered
                                                    • Slide 4
                                                    • Monitoring Replication
                                                    • Configure a replicationlog
                                                    • Slide 7
                                                    • Replication Initializing and Queuing
                                                    • Replication Processing Jobs
                                                    • Replication Troubleshooting
                                                    • Optimizing Replication
                                                    • Optimizing Replication (2)
                                                    • Optimizing Replication (3)
                                                    • Optimizing Replication (4)
                                                    • Slide 15
                                                    • What is the DataStore
                                                    • How does the DataStore work
                                                    • DataStore Example
                                                    • DataStore Example (2)
                                                    • How does DataStore GC work
                                                    • DataStore GC Avoiding common Pitfalls
                                                    • Slide 22
                                                    • DataStore GC
                                                    • Slide 24
                                                    • Slide 25
                                                    • Part 2 Topics Covered
                                                    • What is TarPM
                                                    • What is TarPM Optimization
                                                    • Data Tar file location
                                                    • Best practices for maintaining AEM Instances
                                                    • Best practices for maintaining AEM Instances (2)
                                                    • Best practices for maintaining AEM Instances (3)
                                                    • Tips and tricks for proactive things to monitor
                                                    • Slide 34
                                                    • Tips and tricks for reducing downtime amp Speed up the process
                                                    • Common Pitfalls to Avoid
                                                    • Slide 37
                                                    • Workflow Purge
                                                    • Best practices for maintaining AEM Instances (4)
                                                    • Tips and tricks for proactive things to monitor (2)
                                                    • Slide 41
                                                    • Slide 42

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      What is TarPM

                                                      27

                                                      data_00000tar

                                                      ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefault

                                                      data_00001tar

                                                      Bundle 01Bundle 02

                                                      Bundle 03

                                                      Bundle 04

                                                      Adding New page

                                                      Modifying

                                                      page

                                                      Del

                                                      etin

                                                      g

                                                      page

                                                      bull CRX Stores nodes and properties as one entity (bundle) in data tar file using Tar Persistance Manager (Tar PM)

                                                      bull Tar PM model is append only

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      What is TarPM Optimization

                                                      bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                                      28

                                                      bundle03

                                                      bundle04

                                                      bundle11

                                                      bundle14

                                                      data_00003tar

                                                      TAR OPTIMIZATI

                                                      ON

                                                      bundle01

                                                      bundle02

                                                      bundle03

                                                      bundle04

                                                      data_00001tar

                                                      bundle11

                                                      bundle12

                                                      bundle13

                                                      bundle14

                                                      data_00002tar

                                                      Unused

                                                      data

                                                      Deletes old data tar file

                                                      Deletes old data tar file

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Data Tar file location

                                                      bull Default storage location of data tar files are

                                                      29

                                                      ltcq_homegtcrx-quickstartrepository

                                                      data_00000tardata_00001tar

                                                      workspaces

                                                      crxdefault

                                                      version

                                                      data_00004tardata_00005tar

                                                      data_00010tardata_00011tar

                                                      tarJournal

                                                      data_00012tardata_00013tar

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Best practices for maintaining AEM Instances

                                                      Regularly run tar optimization during the low usage hours of your system

                                                      bull Automatic Schedule-

                                                      - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                                      - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                                      bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                                      30

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Best practices for maintaining AEM Instances

                                                      Manually execute TarPM optimization from JMX console

                                                      31

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Best practices for maintaining AEM Instances

                                                      Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                      32

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Tips and tricks for proactive things to monitor

                                                      bull From JMX console monitor

                                                      - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                      - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                      - TarOptimizationRate- TarPM optimization rate in KBsec

                                                      33

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                      How to monitor Tar Optimization via JMX client

                                                      DEMONSTRATION

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Tips and tricks for reducing downtime amp Speed up the process

                                                      bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                      bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                      - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                      - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                      bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                      35

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Common Pitfalls to Avoid

                                                      bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                      bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                      bull Do not run tar optimization while you are backing up instance

                                                      bull Do not run tar optimization when datastore garbage collection is running

                                                      bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                      36

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                      Workflow maintenance and Purge Obsolete Workflow Data

                                                      Workflow Monitoring

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Workflow Purge

                                                      bull Workflows enable you to automate Experience Manager activities

                                                      bull Workflows events generate archived data

                                                      bull This data can quickly grow over time as workflows are processed

                                                      bull Purging this data on a regular schedule improves system performance

                                                      bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                      38

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Best practices for maintaining AEM Instances

                                                      Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                      bull Using user interface through Felix console

                                                      bull Using CURL

                                                      bull Creating a JMX client that uses Workflow Mbean

                                                      httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                      39

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      Tips and tricks for proactive things to monitor

                                                      40

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                      How to monitor workflow via JMX client

                                                      DEMONSTRATION

                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                      • ADOBE CUSTOMER BROWN BAG SERIES
                                                      • Whatrsquos Covered
                                                      • Topics covered
                                                      • Slide 4
                                                      • Monitoring Replication
                                                      • Configure a replicationlog
                                                      • Slide 7
                                                      • Replication Initializing and Queuing
                                                      • Replication Processing Jobs
                                                      • Replication Troubleshooting
                                                      • Optimizing Replication
                                                      • Optimizing Replication (2)
                                                      • Optimizing Replication (3)
                                                      • Optimizing Replication (4)
                                                      • Slide 15
                                                      • What is the DataStore
                                                      • How does the DataStore work
                                                      • DataStore Example
                                                      • DataStore Example (2)
                                                      • How does DataStore GC work
                                                      • DataStore GC Avoiding common Pitfalls
                                                      • Slide 22
                                                      • DataStore GC
                                                      • Slide 24
                                                      • Slide 25
                                                      • Part 2 Topics Covered
                                                      • What is TarPM
                                                      • What is TarPM Optimization
                                                      • Data Tar file location
                                                      • Best practices for maintaining AEM Instances
                                                      • Best practices for maintaining AEM Instances (2)
                                                      • Best practices for maintaining AEM Instances (3)
                                                      • Tips and tricks for proactive things to monitor
                                                      • Slide 34
                                                      • Tips and tricks for reducing downtime amp Speed up the process
                                                      • Common Pitfalls to Avoid
                                                      • Slide 37
                                                      • Workflow Purge
                                                      • Best practices for maintaining AEM Instances (4)
                                                      • Tips and tricks for proactive things to monitor (2)
                                                      • Slide 41
                                                      • Slide 42

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        What is TarPM Optimization

                                                        bull Tar Optimization is a process which cleans up the old unreferenced data to improve the overall performance amp reduce disk usage

                                                        28

                                                        bundle03

                                                        bundle04

                                                        bundle11

                                                        bundle14

                                                        data_00003tar

                                                        TAR OPTIMIZATI

                                                        ON

                                                        bundle01

                                                        bundle02

                                                        bundle03

                                                        bundle04

                                                        data_00001tar

                                                        bundle11

                                                        bundle12

                                                        bundle13

                                                        bundle14

                                                        data_00002tar

                                                        Unused

                                                        data

                                                        Deletes old data tar file

                                                        Deletes old data tar file

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Data Tar file location

                                                        bull Default storage location of data tar files are

                                                        29

                                                        ltcq_homegtcrx-quickstartrepository

                                                        data_00000tardata_00001tar

                                                        workspaces

                                                        crxdefault

                                                        version

                                                        data_00004tardata_00005tar

                                                        data_00010tardata_00011tar

                                                        tarJournal

                                                        data_00012tardata_00013tar

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Best practices for maintaining AEM Instances

                                                        Regularly run tar optimization during the low usage hours of your system

                                                        bull Automatic Schedule-

                                                        - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                                        - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                                        bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                                        30

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Best practices for maintaining AEM Instances

                                                        Manually execute TarPM optimization from JMX console

                                                        31

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Best practices for maintaining AEM Instances

                                                        Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                        32

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Tips and tricks for proactive things to monitor

                                                        bull From JMX console monitor

                                                        - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                        - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                        - TarOptimizationRate- TarPM optimization rate in KBsec

                                                        33

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                        How to monitor Tar Optimization via JMX client

                                                        DEMONSTRATION

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Tips and tricks for reducing downtime amp Speed up the process

                                                        bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                        bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                        - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                        - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                        bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                        35

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Common Pitfalls to Avoid

                                                        bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                        bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                        bull Do not run tar optimization while you are backing up instance

                                                        bull Do not run tar optimization when datastore garbage collection is running

                                                        bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                        36

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                        Workflow maintenance and Purge Obsolete Workflow Data

                                                        Workflow Monitoring

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Workflow Purge

                                                        bull Workflows enable you to automate Experience Manager activities

                                                        bull Workflows events generate archived data

                                                        bull This data can quickly grow over time as workflows are processed

                                                        bull Purging this data on a regular schedule improves system performance

                                                        bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                        38

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Best practices for maintaining AEM Instances

                                                        Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                        bull Using user interface through Felix console

                                                        bull Using CURL

                                                        bull Creating a JMX client that uses Workflow Mbean

                                                        httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                        39

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        Tips and tricks for proactive things to monitor

                                                        40

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                        How to monitor workflow via JMX client

                                                        DEMONSTRATION

                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                        • ADOBE CUSTOMER BROWN BAG SERIES
                                                        • Whatrsquos Covered
                                                        • Topics covered
                                                        • Slide 4
                                                        • Monitoring Replication
                                                        • Configure a replicationlog
                                                        • Slide 7
                                                        • Replication Initializing and Queuing
                                                        • Replication Processing Jobs
                                                        • Replication Troubleshooting
                                                        • Optimizing Replication
                                                        • Optimizing Replication (2)
                                                        • Optimizing Replication (3)
                                                        • Optimizing Replication (4)
                                                        • Slide 15
                                                        • What is the DataStore
                                                        • How does the DataStore work
                                                        • DataStore Example
                                                        • DataStore Example (2)
                                                        • How does DataStore GC work
                                                        • DataStore GC Avoiding common Pitfalls
                                                        • Slide 22
                                                        • DataStore GC
                                                        • Slide 24
                                                        • Slide 25
                                                        • Part 2 Topics Covered
                                                        • What is TarPM
                                                        • What is TarPM Optimization
                                                        • Data Tar file location
                                                        • Best practices for maintaining AEM Instances
                                                        • Best practices for maintaining AEM Instances (2)
                                                        • Best practices for maintaining AEM Instances (3)
                                                        • Tips and tricks for proactive things to monitor
                                                        • Slide 34
                                                        • Tips and tricks for reducing downtime amp Speed up the process
                                                        • Common Pitfalls to Avoid
                                                        • Slide 37
                                                        • Workflow Purge
                                                        • Best practices for maintaining AEM Instances (4)
                                                        • Tips and tricks for proactive things to monitor (2)
                                                        • Slide 41
                                                        • Slide 42

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Data Tar file location

                                                          bull Default storage location of data tar files are

                                                          29

                                                          ltcq_homegtcrx-quickstartrepository

                                                          data_00000tardata_00001tar

                                                          workspaces

                                                          crxdefault

                                                          version

                                                          data_00004tardata_00005tar

                                                          data_00010tardata_00011tar

                                                          tarJournal

                                                          data_00012tardata_00013tar

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Best practices for maintaining AEM Instances

                                                          Regularly run tar optimization during the low usage hours of your system

                                                          bull Automatic Schedule-

                                                          - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                                          - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                                          bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                                          30

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Best practices for maintaining AEM Instances

                                                          Manually execute TarPM optimization from JMX console

                                                          31

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Best practices for maintaining AEM Instances

                                                          Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                          32

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Tips and tricks for proactive things to monitor

                                                          bull From JMX console monitor

                                                          - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                          - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                          - TarOptimizationRate- TarPM optimization rate in KBsec

                                                          33

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                          How to monitor Tar Optimization via JMX client

                                                          DEMONSTRATION

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Tips and tricks for reducing downtime amp Speed up the process

                                                          bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                          bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                          - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                          - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                          bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                          35

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Common Pitfalls to Avoid

                                                          bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                          bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                          bull Do not run tar optimization while you are backing up instance

                                                          bull Do not run tar optimization when datastore garbage collection is running

                                                          bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                          36

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                          Workflow maintenance and Purge Obsolete Workflow Data

                                                          Workflow Monitoring

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Workflow Purge

                                                          bull Workflows enable you to automate Experience Manager activities

                                                          bull Workflows events generate archived data

                                                          bull This data can quickly grow over time as workflows are processed

                                                          bull Purging this data on a regular schedule improves system performance

                                                          bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                          38

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Best practices for maintaining AEM Instances

                                                          Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                          bull Using user interface through Felix console

                                                          bull Using CURL

                                                          bull Creating a JMX client that uses Workflow Mbean

                                                          httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                          39

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          Tips and tricks for proactive things to monitor

                                                          40

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                          How to monitor workflow via JMX client

                                                          DEMONSTRATION

                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                          • ADOBE CUSTOMER BROWN BAG SERIES
                                                          • Whatrsquos Covered
                                                          • Topics covered
                                                          • Slide 4
                                                          • Monitoring Replication
                                                          • Configure a replicationlog
                                                          • Slide 7
                                                          • Replication Initializing and Queuing
                                                          • Replication Processing Jobs
                                                          • Replication Troubleshooting
                                                          • Optimizing Replication
                                                          • Optimizing Replication (2)
                                                          • Optimizing Replication (3)
                                                          • Optimizing Replication (4)
                                                          • Slide 15
                                                          • What is the DataStore
                                                          • How does the DataStore work
                                                          • DataStore Example
                                                          • DataStore Example (2)
                                                          • How does DataStore GC work
                                                          • DataStore GC Avoiding common Pitfalls
                                                          • Slide 22
                                                          • DataStore GC
                                                          • Slide 24
                                                          • Slide 25
                                                          • Part 2 Topics Covered
                                                          • What is TarPM
                                                          • What is TarPM Optimization
                                                          • Data Tar file location
                                                          • Best practices for maintaining AEM Instances
                                                          • Best practices for maintaining AEM Instances (2)
                                                          • Best practices for maintaining AEM Instances (3)
                                                          • Tips and tricks for proactive things to monitor
                                                          • Slide 34
                                                          • Tips and tricks for reducing downtime amp Speed up the process
                                                          • Common Pitfalls to Avoid
                                                          • Slide 37
                                                          • Workflow Purge
                                                          • Best practices for maintaining AEM Instances (4)
                                                          • Tips and tricks for proactive things to monitor (2)
                                                          • Slide 41
                                                          • Slide 42

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Best practices for maintaining AEM Instances

                                                            Regularly run tar optimization during the low usage hours of your system

                                                            bull Automatic Schedule-

                                                            - By default CRX automatically runs Tar PM optimization in midnight between 2 AM to 5 AM

                                                            - To reconfigure a scheduled optimization add a param autoOptimizeAt to PersistenceManager element at repositoryxml and workspacexml

                                                            bull ltPersistenceManager class=comdaycrxpersistencetarTarPersistenceManagergtltparam name=autoOptimizeAt value=0100-0400 gtltPersistenceManagergt

                                                            30

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Best practices for maintaining AEM Instances

                                                            Manually execute TarPM optimization from JMX console

                                                            31

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Best practices for maintaining AEM Instances

                                                            Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                            32

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Tips and tricks for proactive things to monitor

                                                            bull From JMX console monitor

                                                            - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                            - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                            - TarOptimizationRate- TarPM optimization rate in KBsec

                                                            33

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                            How to monitor Tar Optimization via JMX client

                                                            DEMONSTRATION

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Tips and tricks for reducing downtime amp Speed up the process

                                                            bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                            bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                            - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                            - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                            bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                            35

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Common Pitfalls to Avoid

                                                            bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                            bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                            bull Do not run tar optimization while you are backing up instance

                                                            bull Do not run tar optimization when datastore garbage collection is running

                                                            bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                            36

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                            Workflow maintenance and Purge Obsolete Workflow Data

                                                            Workflow Monitoring

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Workflow Purge

                                                            bull Workflows enable you to automate Experience Manager activities

                                                            bull Workflows events generate archived data

                                                            bull This data can quickly grow over time as workflows are processed

                                                            bull Purging this data on a regular schedule improves system performance

                                                            bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                            38

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Best practices for maintaining AEM Instances

                                                            Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                            bull Using user interface through Felix console

                                                            bull Using CURL

                                                            bull Creating a JMX client that uses Workflow Mbean

                                                            httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                            39

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            Tips and tricks for proactive things to monitor

                                                            40

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                            How to monitor workflow via JMX client

                                                            DEMONSTRATION

                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                            • ADOBE CUSTOMER BROWN BAG SERIES
                                                            • Whatrsquos Covered
                                                            • Topics covered
                                                            • Slide 4
                                                            • Monitoring Replication
                                                            • Configure a replicationlog
                                                            • Slide 7
                                                            • Replication Initializing and Queuing
                                                            • Replication Processing Jobs
                                                            • Replication Troubleshooting
                                                            • Optimizing Replication
                                                            • Optimizing Replication (2)
                                                            • Optimizing Replication (3)
                                                            • Optimizing Replication (4)
                                                            • Slide 15
                                                            • What is the DataStore
                                                            • How does the DataStore work
                                                            • DataStore Example
                                                            • DataStore Example (2)
                                                            • How does DataStore GC work
                                                            • DataStore GC Avoiding common Pitfalls
                                                            • Slide 22
                                                            • DataStore GC
                                                            • Slide 24
                                                            • Slide 25
                                                            • Part 2 Topics Covered
                                                            • What is TarPM
                                                            • What is TarPM Optimization
                                                            • Data Tar file location
                                                            • Best practices for maintaining AEM Instances
                                                            • Best practices for maintaining AEM Instances (2)
                                                            • Best practices for maintaining AEM Instances (3)
                                                            • Tips and tricks for proactive things to monitor
                                                            • Slide 34
                                                            • Tips and tricks for reducing downtime amp Speed up the process
                                                            • Common Pitfalls to Avoid
                                                            • Slide 37
                                                            • Workflow Purge
                                                            • Best practices for maintaining AEM Instances (4)
                                                            • Tips and tricks for proactive things to monitor (2)
                                                            • Slide 41
                                                            • Slide 42

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Best practices for maintaining AEM Instances

                                                              Manually execute TarPM optimization from JMX console

                                                              31

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Best practices for maintaining AEM Instances

                                                              Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                              32

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Tips and tricks for proactive things to monitor

                                                              bull From JMX console monitor

                                                              - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                              - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                              - TarOptimizationRate- TarPM optimization rate in KBsec

                                                              33

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                              How to monitor Tar Optimization via JMX client

                                                              DEMONSTRATION

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Tips and tricks for reducing downtime amp Speed up the process

                                                              bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                              bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                              - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                              - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                              bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                              35

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Common Pitfalls to Avoid

                                                              bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                              bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                              bull Do not run tar optimization while you are backing up instance

                                                              bull Do not run tar optimization when datastore garbage collection is running

                                                              bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                              36

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                              Workflow maintenance and Purge Obsolete Workflow Data

                                                              Workflow Monitoring

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Workflow Purge

                                                              bull Workflows enable you to automate Experience Manager activities

                                                              bull Workflows events generate archived data

                                                              bull This data can quickly grow over time as workflows are processed

                                                              bull Purging this data on a regular schedule improves system performance

                                                              bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                              38

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Best practices for maintaining AEM Instances

                                                              Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                              bull Using user interface through Felix console

                                                              bull Using CURL

                                                              bull Creating a JMX client that uses Workflow Mbean

                                                              httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                              39

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              Tips and tricks for proactive things to monitor

                                                              40

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                              How to monitor workflow via JMX client

                                                              DEMONSTRATION

                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                              • ADOBE CUSTOMER BROWN BAG SERIES
                                                              • Whatrsquos Covered
                                                              • Topics covered
                                                              • Slide 4
                                                              • Monitoring Replication
                                                              • Configure a replicationlog
                                                              • Slide 7
                                                              • Replication Initializing and Queuing
                                                              • Replication Processing Jobs
                                                              • Replication Troubleshooting
                                                              • Optimizing Replication
                                                              • Optimizing Replication (2)
                                                              • Optimizing Replication (3)
                                                              • Optimizing Replication (4)
                                                              • Slide 15
                                                              • What is the DataStore
                                                              • How does the DataStore work
                                                              • DataStore Example
                                                              • DataStore Example (2)
                                                              • How does DataStore GC work
                                                              • DataStore GC Avoiding common Pitfalls
                                                              • Slide 22
                                                              • DataStore GC
                                                              • Slide 24
                                                              • Slide 25
                                                              • Part 2 Topics Covered
                                                              • What is TarPM
                                                              • What is TarPM Optimization
                                                              • Data Tar file location
                                                              • Best practices for maintaining AEM Instances
                                                              • Best practices for maintaining AEM Instances (2)
                                                              • Best practices for maintaining AEM Instances (3)
                                                              • Tips and tricks for proactive things to monitor
                                                              • Slide 34
                                                              • Tips and tricks for reducing downtime amp Speed up the process
                                                              • Common Pitfalls to Avoid
                                                              • Slide 37
                                                              • Workflow Purge
                                                              • Best practices for maintaining AEM Instances (4)
                                                              • Tips and tricks for proactive things to monitor (2)
                                                              • Slide 41
                                                              • Slide 42

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                Best practices for maintaining AEM Instances

                                                                Manually by creating an optimization file ldquooptimizetarrdquo in the desired workspace folder

                                                                32

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                Tips and tricks for proactive things to monitor

                                                                bull From JMX console monitor

                                                                - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                                - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                                - TarOptimizationRate- TarPM optimization rate in KBsec

                                                                33

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                                How to monitor Tar Optimization via JMX client

                                                                DEMONSTRATION

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                Tips and tricks for reducing downtime amp Speed up the process

                                                                bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                                bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                                - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                                - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                                bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                                35

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                Common Pitfalls to Avoid

                                                                bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                                bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                                bull Do not run tar optimization while you are backing up instance

                                                                bull Do not run tar optimization when datastore garbage collection is running

                                                                bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                                36

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                                Workflow maintenance and Purge Obsolete Workflow Data

                                                                Workflow Monitoring

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                Workflow Purge

                                                                bull Workflows enable you to automate Experience Manager activities

                                                                bull Workflows events generate archived data

                                                                bull This data can quickly grow over time as workflows are processed

                                                                bull Purging this data on a regular schedule improves system performance

                                                                bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                                38

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                Best practices for maintaining AEM Instances

                                                                Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                bull Using user interface through Felix console

                                                                bull Using CURL

                                                                bull Creating a JMX client that uses Workflow Mbean

                                                                httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                39

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                Tips and tricks for proactive things to monitor

                                                                40

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                How to monitor workflow via JMX client

                                                                DEMONSTRATION

                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                • ADOBE CUSTOMER BROWN BAG SERIES
                                                                • Whatrsquos Covered
                                                                • Topics covered
                                                                • Slide 4
                                                                • Monitoring Replication
                                                                • Configure a replicationlog
                                                                • Slide 7
                                                                • Replication Initializing and Queuing
                                                                • Replication Processing Jobs
                                                                • Replication Troubleshooting
                                                                • Optimizing Replication
                                                                • Optimizing Replication (2)
                                                                • Optimizing Replication (3)
                                                                • Optimizing Replication (4)
                                                                • Slide 15
                                                                • What is the DataStore
                                                                • How does the DataStore work
                                                                • DataStore Example
                                                                • DataStore Example (2)
                                                                • How does DataStore GC work
                                                                • DataStore GC Avoiding common Pitfalls
                                                                • Slide 22
                                                                • DataStore GC
                                                                • Slide 24
                                                                • Slide 25
                                                                • Part 2 Topics Covered
                                                                • What is TarPM
                                                                • What is TarPM Optimization
                                                                • Data Tar file location
                                                                • Best practices for maintaining AEM Instances
                                                                • Best practices for maintaining AEM Instances (2)
                                                                • Best practices for maintaining AEM Instances (3)
                                                                • Tips and tricks for proactive things to monitor
                                                                • Slide 34
                                                                • Tips and tricks for reducing downtime amp Speed up the process
                                                                • Common Pitfalls to Avoid
                                                                • Slide 37
                                                                • Workflow Purge
                                                                • Best practices for maintaining AEM Instances (4)
                                                                • Tips and tricks for proactive things to monitor (2)
                                                                • Slide 41
                                                                • Slide 42

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                  Tips and tricks for proactive things to monitor

                                                                  bull From JMX console monitor

                                                                  - TarOptimizationRunningSince- The timestamp when the current Tar PM optimization was started or 0 if currently not running

                                                                  - TarOptimizationWork- The remaining optimization work in KiloBytes

                                                                  - TarOptimizationRate- TarPM optimization rate in KBsec

                                                                  33

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                                  How to monitor Tar Optimization via JMX client

                                                                  DEMONSTRATION

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                  Tips and tricks for reducing downtime amp Speed up the process

                                                                  bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                                  bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                                  - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                                  - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                                  bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                                  35

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                  Common Pitfalls to Avoid

                                                                  bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                                  bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                                  bull Do not run tar optimization while you are backing up instance

                                                                  bull Do not run tar optimization when datastore garbage collection is running

                                                                  bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                                  36

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                                  Workflow maintenance and Purge Obsolete Workflow Data

                                                                  Workflow Monitoring

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                  Workflow Purge

                                                                  bull Workflows enable you to automate Experience Manager activities

                                                                  bull Workflows events generate archived data

                                                                  bull This data can quickly grow over time as workflows are processed

                                                                  bull Purging this data on a regular schedule improves system performance

                                                                  bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                                  38

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                  Best practices for maintaining AEM Instances

                                                                  Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                  bull Using user interface through Felix console

                                                                  bull Using CURL

                                                                  bull Creating a JMX client that uses Workflow Mbean

                                                                  httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                  39

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                  Tips and tricks for proactive things to monitor

                                                                  40

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                  How to monitor workflow via JMX client

                                                                  DEMONSTRATION

                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                  • ADOBE CUSTOMER BROWN BAG SERIES
                                                                  • Whatrsquos Covered
                                                                  • Topics covered
                                                                  • Slide 4
                                                                  • Monitoring Replication
                                                                  • Configure a replicationlog
                                                                  • Slide 7
                                                                  • Replication Initializing and Queuing
                                                                  • Replication Processing Jobs
                                                                  • Replication Troubleshooting
                                                                  • Optimizing Replication
                                                                  • Optimizing Replication (2)
                                                                  • Optimizing Replication (3)
                                                                  • Optimizing Replication (4)
                                                                  • Slide 15
                                                                  • What is the DataStore
                                                                  • How does the DataStore work
                                                                  • DataStore Example
                                                                  • DataStore Example (2)
                                                                  • How does DataStore GC work
                                                                  • DataStore GC Avoiding common Pitfalls
                                                                  • Slide 22
                                                                  • DataStore GC
                                                                  • Slide 24
                                                                  • Slide 25
                                                                  • Part 2 Topics Covered
                                                                  • What is TarPM
                                                                  • What is TarPM Optimization
                                                                  • Data Tar file location
                                                                  • Best practices for maintaining AEM Instances
                                                                  • Best practices for maintaining AEM Instances (2)
                                                                  • Best practices for maintaining AEM Instances (3)
                                                                  • Tips and tricks for proactive things to monitor
                                                                  • Slide 34
                                                                  • Tips and tricks for reducing downtime amp Speed up the process
                                                                  • Common Pitfalls to Avoid
                                                                  • Slide 37
                                                                  • Workflow Purge
                                                                  • Best practices for maintaining AEM Instances (4)
                                                                  • Tips and tricks for proactive things to monitor (2)
                                                                  • Slide 41
                                                                  • Slide 42

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 34

                                                                    How to monitor Tar Optimization via JMX client

                                                                    DEMONSTRATION

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                    Tips and tricks for reducing downtime amp Speed up the process

                                                                    bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                                    bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                                    - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                                    - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                                    bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                                    35

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                    Common Pitfalls to Avoid

                                                                    bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                                    bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                                    bull Do not run tar optimization while you are backing up instance

                                                                    bull Do not run tar optimization when datastore garbage collection is running

                                                                    bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                                    36

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                                    Workflow maintenance and Purge Obsolete Workflow Data

                                                                    Workflow Monitoring

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                    Workflow Purge

                                                                    bull Workflows enable you to automate Experience Manager activities

                                                                    bull Workflows events generate archived data

                                                                    bull This data can quickly grow over time as workflows are processed

                                                                    bull Purging this data on a regular schedule improves system performance

                                                                    bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                                    38

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                    Best practices for maintaining AEM Instances

                                                                    Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                    bull Using user interface through Felix console

                                                                    bull Using CURL

                                                                    bull Creating a JMX client that uses Workflow Mbean

                                                                    httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                    39

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                    Tips and tricks for proactive things to monitor

                                                                    40

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                    How to monitor workflow via JMX client

                                                                    DEMONSTRATION

                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                    • ADOBE CUSTOMER BROWN BAG SERIES
                                                                    • Whatrsquos Covered
                                                                    • Topics covered
                                                                    • Slide 4
                                                                    • Monitoring Replication
                                                                    • Configure a replicationlog
                                                                    • Slide 7
                                                                    • Replication Initializing and Queuing
                                                                    • Replication Processing Jobs
                                                                    • Replication Troubleshooting
                                                                    • Optimizing Replication
                                                                    • Optimizing Replication (2)
                                                                    • Optimizing Replication (3)
                                                                    • Optimizing Replication (4)
                                                                    • Slide 15
                                                                    • What is the DataStore
                                                                    • How does the DataStore work
                                                                    • DataStore Example
                                                                    • DataStore Example (2)
                                                                    • How does DataStore GC work
                                                                    • DataStore GC Avoiding common Pitfalls
                                                                    • Slide 22
                                                                    • DataStore GC
                                                                    • Slide 24
                                                                    • Slide 25
                                                                    • Part 2 Topics Covered
                                                                    • What is TarPM
                                                                    • What is TarPM Optimization
                                                                    • Data Tar file location
                                                                    • Best practices for maintaining AEM Instances
                                                                    • Best practices for maintaining AEM Instances (2)
                                                                    • Best practices for maintaining AEM Instances (3)
                                                                    • Tips and tricks for proactive things to monitor
                                                                    • Slide 34
                                                                    • Tips and tricks for reducing downtime amp Speed up the process
                                                                    • Common Pitfalls to Avoid
                                                                    • Slide 37
                                                                    • Workflow Purge
                                                                    • Best practices for maintaining AEM Instances (4)
                                                                    • Tips and tricks for proactive things to monitor (2)
                                                                    • Slide 41
                                                                    • Slide 42

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                      Tips and tricks for reducing downtime amp Speed up the process

                                                                      bull Configure the TarOptimizationDelay property- Number of milliseconds to sleep after optimizing one transaction

                                                                      bull Load the index files into the buffer cache every few minutes from both the crxdefault and the version directory

                                                                      - cat ltcq_homegtcrx-quickstartrepositoryworkspacescrxdefaultindextar gt devnullrdquo

                                                                      - cat ltcq_homegtcrx-quickstartrepositoryversionindextar gt devnullrdquo

                                                                      bull To enable Index in memory option refer httpdevdaycomdocsencrxcurrentadministeringpersistence_managershtmlConfiguring the indexInMemory Property

                                                                      35

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                      Common Pitfalls to Avoid

                                                                      bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                                      bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                                      bull Do not run tar optimization while you are backing up instance

                                                                      bull Do not run tar optimization when datastore garbage collection is running

                                                                      bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                                      36

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                                      Workflow maintenance and Purge Obsolete Workflow Data

                                                                      Workflow Monitoring

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                      Workflow Purge

                                                                      bull Workflows enable you to automate Experience Manager activities

                                                                      bull Workflows events generate archived data

                                                                      bull This data can quickly grow over time as workflows are processed

                                                                      bull Purging this data on a regular schedule improves system performance

                                                                      bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                                      38

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                      Best practices for maintaining AEM Instances

                                                                      Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                      bull Using user interface through Felix console

                                                                      bull Using CURL

                                                                      bull Creating a JMX client that uses Workflow Mbean

                                                                      httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                      39

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                      Tips and tricks for proactive things to monitor

                                                                      40

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                      How to monitor workflow via JMX client

                                                                      DEMONSTRATION

                                                                      copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                      • ADOBE CUSTOMER BROWN BAG SERIES
                                                                      • Whatrsquos Covered
                                                                      • Topics covered
                                                                      • Slide 4
                                                                      • Monitoring Replication
                                                                      • Configure a replicationlog
                                                                      • Slide 7
                                                                      • Replication Initializing and Queuing
                                                                      • Replication Processing Jobs
                                                                      • Replication Troubleshooting
                                                                      • Optimizing Replication
                                                                      • Optimizing Replication (2)
                                                                      • Optimizing Replication (3)
                                                                      • Optimizing Replication (4)
                                                                      • Slide 15
                                                                      • What is the DataStore
                                                                      • How does the DataStore work
                                                                      • DataStore Example
                                                                      • DataStore Example (2)
                                                                      • How does DataStore GC work
                                                                      • DataStore GC Avoiding common Pitfalls
                                                                      • Slide 22
                                                                      • DataStore GC
                                                                      • Slide 24
                                                                      • Slide 25
                                                                      • Part 2 Topics Covered
                                                                      • What is TarPM
                                                                      • What is TarPM Optimization
                                                                      • Data Tar file location
                                                                      • Best practices for maintaining AEM Instances
                                                                      • Best practices for maintaining AEM Instances (2)
                                                                      • Best practices for maintaining AEM Instances (3)
                                                                      • Tips and tricks for proactive things to monitor
                                                                      • Slide 34
                                                                      • Tips and tricks for reducing downtime amp Speed up the process
                                                                      • Common Pitfalls to Avoid
                                                                      • Slide 37
                                                                      • Workflow Purge
                                                                      • Best practices for maintaining AEM Instances (4)
                                                                      • Tips and tricks for proactive things to monitor (2)
                                                                      • Slide 41
                                                                      • Slide 42

                                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                        Common Pitfalls to Avoid

                                                                        bull Scheduling tar optimization to run during the heavy usage hours of your system

                                                                        bull If you are optimizing tar files in a cluster you need to ensure that the Tar optimization time are set to the same value on all cluster nodes

                                                                        bull Do not run tar optimization while you are backing up instance

                                                                        bull Do not run tar optimization when datastore garbage collection is running

                                                                        bull Donrsquot ignore the message ldquoFile not foundrdquo exception when tar optimization is running Please contact daycare

                                                                        36

                                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                                        Workflow maintenance and Purge Obsolete Workflow Data

                                                                        Workflow Monitoring

                                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                        Workflow Purge

                                                                        bull Workflows enable you to automate Experience Manager activities

                                                                        bull Workflows events generate archived data

                                                                        bull This data can quickly grow over time as workflows are processed

                                                                        bull Purging this data on a regular schedule improves system performance

                                                                        bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                                        38

                                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                        Best practices for maintaining AEM Instances

                                                                        Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                        bull Using user interface through Felix console

                                                                        bull Using CURL

                                                                        bull Creating a JMX client that uses Workflow Mbean

                                                                        httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                        39

                                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                        Tips and tricks for proactive things to monitor

                                                                        40

                                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                        How to monitor workflow via JMX client

                                                                        DEMONSTRATION

                                                                        copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                        • ADOBE CUSTOMER BROWN BAG SERIES
                                                                        • Whatrsquos Covered
                                                                        • Topics covered
                                                                        • Slide 4
                                                                        • Monitoring Replication
                                                                        • Configure a replicationlog
                                                                        • Slide 7
                                                                        • Replication Initializing and Queuing
                                                                        • Replication Processing Jobs
                                                                        • Replication Troubleshooting
                                                                        • Optimizing Replication
                                                                        • Optimizing Replication (2)
                                                                        • Optimizing Replication (3)
                                                                        • Optimizing Replication (4)
                                                                        • Slide 15
                                                                        • What is the DataStore
                                                                        • How does the DataStore work
                                                                        • DataStore Example
                                                                        • DataStore Example (2)
                                                                        • How does DataStore GC work
                                                                        • DataStore GC Avoiding common Pitfalls
                                                                        • Slide 22
                                                                        • DataStore GC
                                                                        • Slide 24
                                                                        • Slide 25
                                                                        • Part 2 Topics Covered
                                                                        • What is TarPM
                                                                        • What is TarPM Optimization
                                                                        • Data Tar file location
                                                                        • Best practices for maintaining AEM Instances
                                                                        • Best practices for maintaining AEM Instances (2)
                                                                        • Best practices for maintaining AEM Instances (3)
                                                                        • Tips and tricks for proactive things to monitor
                                                                        • Slide 34
                                                                        • Tips and tricks for reducing downtime amp Speed up the process
                                                                        • Common Pitfalls to Avoid
                                                                        • Slide 37
                                                                        • Workflow Purge
                                                                        • Best practices for maintaining AEM Instances (4)
                                                                        • Tips and tricks for proactive things to monitor (2)
                                                                        • Slide 41
                                                                        • Slide 42

                                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 37

                                                                          Workflow maintenance and Purge Obsolete Workflow Data

                                                                          Workflow Monitoring

                                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                          Workflow Purge

                                                                          bull Workflows enable you to automate Experience Manager activities

                                                                          bull Workflows events generate archived data

                                                                          bull This data can quickly grow over time as workflows are processed

                                                                          bull Purging this data on a regular schedule improves system performance

                                                                          bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                                          38

                                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                          Best practices for maintaining AEM Instances

                                                                          Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                          bull Using user interface through Felix console

                                                                          bull Using CURL

                                                                          bull Creating a JMX client that uses Workflow Mbean

                                                                          httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                          39

                                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                          Tips and tricks for proactive things to monitor

                                                                          40

                                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                          How to monitor workflow via JMX client

                                                                          DEMONSTRATION

                                                                          copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                          • ADOBE CUSTOMER BROWN BAG SERIES
                                                                          • Whatrsquos Covered
                                                                          • Topics covered
                                                                          • Slide 4
                                                                          • Monitoring Replication
                                                                          • Configure a replicationlog
                                                                          • Slide 7
                                                                          • Replication Initializing and Queuing
                                                                          • Replication Processing Jobs
                                                                          • Replication Troubleshooting
                                                                          • Optimizing Replication
                                                                          • Optimizing Replication (2)
                                                                          • Optimizing Replication (3)
                                                                          • Optimizing Replication (4)
                                                                          • Slide 15
                                                                          • What is the DataStore
                                                                          • How does the DataStore work
                                                                          • DataStore Example
                                                                          • DataStore Example (2)
                                                                          • How does DataStore GC work
                                                                          • DataStore GC Avoiding common Pitfalls
                                                                          • Slide 22
                                                                          • DataStore GC
                                                                          • Slide 24
                                                                          • Slide 25
                                                                          • Part 2 Topics Covered
                                                                          • What is TarPM
                                                                          • What is TarPM Optimization
                                                                          • Data Tar file location
                                                                          • Best practices for maintaining AEM Instances
                                                                          • Best practices for maintaining AEM Instances (2)
                                                                          • Best practices for maintaining AEM Instances (3)
                                                                          • Tips and tricks for proactive things to monitor
                                                                          • Slide 34
                                                                          • Tips and tricks for reducing downtime amp Speed up the process
                                                                          • Common Pitfalls to Avoid
                                                                          • Slide 37
                                                                          • Workflow Purge
                                                                          • Best practices for maintaining AEM Instances (4)
                                                                          • Tips and tricks for proactive things to monitor (2)
                                                                          • Slide 41
                                                                          • Slide 42

                                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                            Workflow Purge

                                                                            bull Workflows enable you to automate Experience Manager activities

                                                                            bull Workflows events generate archived data

                                                                            bull This data can quickly grow over time as workflows are processed

                                                                            bull Purging this data on a regular schedule improves system performance

                                                                            bull In AEM(CQ) 56 the Workflow JMX MBean support has been added in order to maintain workflow system

                                                                            38

                                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                            Best practices for maintaining AEM Instances

                                                                            Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                            bull Using user interface through Felix console

                                                                            bull Using CURL

                                                                            bull Creating a JMX client that uses Workflow Mbean

                                                                            httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                            39

                                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                            Tips and tricks for proactive things to monitor

                                                                            40

                                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                            How to monitor workflow via JMX client

                                                                            DEMONSTRATION

                                                                            copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                            • ADOBE CUSTOMER BROWN BAG SERIES
                                                                            • Whatrsquos Covered
                                                                            • Topics covered
                                                                            • Slide 4
                                                                            • Monitoring Replication
                                                                            • Configure a replicationlog
                                                                            • Slide 7
                                                                            • Replication Initializing and Queuing
                                                                            • Replication Processing Jobs
                                                                            • Replication Troubleshooting
                                                                            • Optimizing Replication
                                                                            • Optimizing Replication (2)
                                                                            • Optimizing Replication (3)
                                                                            • Optimizing Replication (4)
                                                                            • Slide 15
                                                                            • What is the DataStore
                                                                            • How does the DataStore work
                                                                            • DataStore Example
                                                                            • DataStore Example (2)
                                                                            • How does DataStore GC work
                                                                            • DataStore GC Avoiding common Pitfalls
                                                                            • Slide 22
                                                                            • DataStore GC
                                                                            • Slide 24
                                                                            • Slide 25
                                                                            • Part 2 Topics Covered
                                                                            • What is TarPM
                                                                            • What is TarPM Optimization
                                                                            • Data Tar file location
                                                                            • Best practices for maintaining AEM Instances
                                                                            • Best practices for maintaining AEM Instances (2)
                                                                            • Best practices for maintaining AEM Instances (3)
                                                                            • Tips and tricks for proactive things to monitor
                                                                            • Slide 34
                                                                            • Tips and tricks for reducing downtime amp Speed up the process
                                                                            • Common Pitfalls to Avoid
                                                                            • Slide 37
                                                                            • Workflow Purge
                                                                            • Best practices for maintaining AEM Instances (4)
                                                                            • Tips and tricks for proactive things to monitor (2)
                                                                            • Slide 41
                                                                            • Slide 42

                                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                              Best practices for maintaining AEM Instances

                                                                              Regularly run workflow purge to avoid the problems associated with a large volume of data

                                                                              bull Using user interface through Felix console

                                                                              bull Using CURL

                                                                              bull Creating a JMX client that uses Workflow Mbean

                                                                              httphelpxadobecomcqkbworkflow-monitor-via-jmxhtml

                                                                              39

                                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                              Tips and tricks for proactive things to monitor

                                                                              40

                                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                              How to monitor workflow via JMX client

                                                                              DEMONSTRATION

                                                                              copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                              • ADOBE CUSTOMER BROWN BAG SERIES
                                                                              • Whatrsquos Covered
                                                                              • Topics covered
                                                                              • Slide 4
                                                                              • Monitoring Replication
                                                                              • Configure a replicationlog
                                                                              • Slide 7
                                                                              • Replication Initializing and Queuing
                                                                              • Replication Processing Jobs
                                                                              • Replication Troubleshooting
                                                                              • Optimizing Replication
                                                                              • Optimizing Replication (2)
                                                                              • Optimizing Replication (3)
                                                                              • Optimizing Replication (4)
                                                                              • Slide 15
                                                                              • What is the DataStore
                                                                              • How does the DataStore work
                                                                              • DataStore Example
                                                                              • DataStore Example (2)
                                                                              • How does DataStore GC work
                                                                              • DataStore GC Avoiding common Pitfalls
                                                                              • Slide 22
                                                                              • DataStore GC
                                                                              • Slide 24
                                                                              • Slide 25
                                                                              • Part 2 Topics Covered
                                                                              • What is TarPM
                                                                              • What is TarPM Optimization
                                                                              • Data Tar file location
                                                                              • Best practices for maintaining AEM Instances
                                                                              • Best practices for maintaining AEM Instances (2)
                                                                              • Best practices for maintaining AEM Instances (3)
                                                                              • Tips and tricks for proactive things to monitor
                                                                              • Slide 34
                                                                              • Tips and tricks for reducing downtime amp Speed up the process
                                                                              • Common Pitfalls to Avoid
                                                                              • Slide 37
                                                                              • Workflow Purge
                                                                              • Best practices for maintaining AEM Instances (4)
                                                                              • Tips and tricks for proactive things to monitor (2)
                                                                              • Slide 41
                                                                              • Slide 42

                                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                                Tips and tricks for proactive things to monitor

                                                                                40

                                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                                How to monitor workflow via JMX client

                                                                                DEMONSTRATION

                                                                                copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                                • ADOBE CUSTOMER BROWN BAG SERIES
                                                                                • Whatrsquos Covered
                                                                                • Topics covered
                                                                                • Slide 4
                                                                                • Monitoring Replication
                                                                                • Configure a replicationlog
                                                                                • Slide 7
                                                                                • Replication Initializing and Queuing
                                                                                • Replication Processing Jobs
                                                                                • Replication Troubleshooting
                                                                                • Optimizing Replication
                                                                                • Optimizing Replication (2)
                                                                                • Optimizing Replication (3)
                                                                                • Optimizing Replication (4)
                                                                                • Slide 15
                                                                                • What is the DataStore
                                                                                • How does the DataStore work
                                                                                • DataStore Example
                                                                                • DataStore Example (2)
                                                                                • How does DataStore GC work
                                                                                • DataStore GC Avoiding common Pitfalls
                                                                                • Slide 22
                                                                                • DataStore GC
                                                                                • Slide 24
                                                                                • Slide 25
                                                                                • Part 2 Topics Covered
                                                                                • What is TarPM
                                                                                • What is TarPM Optimization
                                                                                • Data Tar file location
                                                                                • Best practices for maintaining AEM Instances
                                                                                • Best practices for maintaining AEM Instances (2)
                                                                                • Best practices for maintaining AEM Instances (3)
                                                                                • Tips and tricks for proactive things to monitor
                                                                                • Slide 34
                                                                                • Tips and tricks for reducing downtime amp Speed up the process
                                                                                • Common Pitfalls to Avoid
                                                                                • Slide 37
                                                                                • Workflow Purge
                                                                                • Best practices for maintaining AEM Instances (4)
                                                                                • Tips and tricks for proactive things to monitor (2)
                                                                                • Slide 41
                                                                                • Slide 42

                                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential 41

                                                                                  How to monitor workflow via JMX client

                                                                                  DEMONSTRATION

                                                                                  copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                                  • ADOBE CUSTOMER BROWN BAG SERIES
                                                                                  • Whatrsquos Covered
                                                                                  • Topics covered
                                                                                  • Slide 4
                                                                                  • Monitoring Replication
                                                                                  • Configure a replicationlog
                                                                                  • Slide 7
                                                                                  • Replication Initializing and Queuing
                                                                                  • Replication Processing Jobs
                                                                                  • Replication Troubleshooting
                                                                                  • Optimizing Replication
                                                                                  • Optimizing Replication (2)
                                                                                  • Optimizing Replication (3)
                                                                                  • Optimizing Replication (4)
                                                                                  • Slide 15
                                                                                  • What is the DataStore
                                                                                  • How does the DataStore work
                                                                                  • DataStore Example
                                                                                  • DataStore Example (2)
                                                                                  • How does DataStore GC work
                                                                                  • DataStore GC Avoiding common Pitfalls
                                                                                  • Slide 22
                                                                                  • DataStore GC
                                                                                  • Slide 24
                                                                                  • Slide 25
                                                                                  • Part 2 Topics Covered
                                                                                  • What is TarPM
                                                                                  • What is TarPM Optimization
                                                                                  • Data Tar file location
                                                                                  • Best practices for maintaining AEM Instances
                                                                                  • Best practices for maintaining AEM Instances (2)
                                                                                  • Best practices for maintaining AEM Instances (3)
                                                                                  • Tips and tricks for proactive things to monitor
                                                                                  • Slide 34
                                                                                  • Tips and tricks for reducing downtime amp Speed up the process
                                                                                  • Common Pitfalls to Avoid
                                                                                  • Slide 37
                                                                                  • Workflow Purge
                                                                                  • Best practices for maintaining AEM Instances (4)
                                                                                  • Tips and tricks for proactive things to monitor (2)
                                                                                  • Slide 41
                                                                                  • Slide 42

                                                                                    copy 2013 Adobe Systems Incorporated All Rights Reserved Adobe Confidential

                                                                                    • ADOBE CUSTOMER BROWN BAG SERIES
                                                                                    • Whatrsquos Covered
                                                                                    • Topics covered
                                                                                    • Slide 4
                                                                                    • Monitoring Replication
                                                                                    • Configure a replicationlog
                                                                                    • Slide 7
                                                                                    • Replication Initializing and Queuing
                                                                                    • Replication Processing Jobs
                                                                                    • Replication Troubleshooting
                                                                                    • Optimizing Replication
                                                                                    • Optimizing Replication (2)
                                                                                    • Optimizing Replication (3)
                                                                                    • Optimizing Replication (4)
                                                                                    • Slide 15
                                                                                    • What is the DataStore
                                                                                    • How does the DataStore work
                                                                                    • DataStore Example
                                                                                    • DataStore Example (2)
                                                                                    • How does DataStore GC work
                                                                                    • DataStore GC Avoiding common Pitfalls
                                                                                    • Slide 22
                                                                                    • DataStore GC
                                                                                    • Slide 24
                                                                                    • Slide 25
                                                                                    • Part 2 Topics Covered
                                                                                    • What is TarPM
                                                                                    • What is TarPM Optimization
                                                                                    • Data Tar file location
                                                                                    • Best practices for maintaining AEM Instances
                                                                                    • Best practices for maintaining AEM Instances (2)
                                                                                    • Best practices for maintaining AEM Instances (3)
                                                                                    • Tips and tricks for proactive things to monitor
                                                                                    • Slide 34
                                                                                    • Tips and tricks for reducing downtime amp Speed up the process
                                                                                    • Common Pitfalls to Avoid
                                                                                    • Slide 37
                                                                                    • Workflow Purge
                                                                                    • Best practices for maintaining AEM Instances (4)
                                                                                    • Tips and tricks for proactive things to monitor (2)
                                                                                    • Slide 41
                                                                                    • Slide 42

                                                                                      top related

                                                                                      Invito all E.M.E CQ CQ CQ Sezione A.R.I. Lucca 13 novembre.....
                                                                                      Documents
                                                                                      Gebruikershandleiding AEM-trommelfiters - AEM-Products ·.....
                                                                                      Documents
                                                                                      CQ Webinar - SHRM-Alaska 052016 · 5/4/2016 1 1 You Know...
                                                                                      Documents
                                                                                      Installing the Agility AEM Connector...1. Open the AEM...
                                                                                      Documents
                                                                                      CONTENT MANAGER SURVEY - Old Dominion University · Worked....
                                                                                      Documents
                                                                                      Adobe Certified Expert Exam Guide · are best for you. You....
                                                                                      Documents
                                                                                      AEM Tutorials
                                                                                      Documents
                                                                                      Sandeep aem resume | AEM Training online
                                                                                      Presentations & Public Speaking
                                                                                      AEM & Apache SlingŒauš... · Sling Models Apache Sling .....
                                                                                      Documents
                                                                                      AEM GEMS Session SAML authentication in AEM
                                                                                      Software
                                                                                      APPLICATIONS EXPLORER MISSIONS (AEM) - NASA EXPLORER...
                                                                                      Documents
                                                                                      CQ WW RTTY Contest · 1o 3f 6 19-Sep-10 16:28 RTTY CQ WW...
                                                                                      Documents
                                                                                      AEM responsive
                                                                                      Software
                                                                                      AEM portfolio_APload
                                                                                      Documents
                                                                                      AEM- Iping.ppt
                                                                                      Documents
                                                                                      Taming your CQ/AEM instances with the Apache Sling Health...
                                                                                      Technology