CORAL and COOL news for ATLAS (update since March 2012 ATLAS sw workshop)March 2012 Andrea Valassi (IT-SDC) ATLAS Database Meeting 24 th October 2013.

IT-SDC : Support for Distributed Computing

CORAL and COOLnews for ATLAS

(update since March 2012 ATLAS sw workshop)

Andrea Valassi (IT-SDC)

ATLAS Database Meeting 24th October 2013

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 2

Outline

A few recent enhancements CORAL handling of network glitches Kerberos authentication COOL performance validation on Oracle 12c

servers And a few more… see the most recent

release notes

Upcoming releases and work in progress COOL vector payload New CORAL server protocol Port to ROOT6

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 3

Network glitch handling in CORAL

Major improvements in OracleAccess plugin Automatically and transparently reconnect to Oracle after a

connection glitch (unless it broke an active transaction) Implemented by ‘refreshing’ Oracle OCI pointers to avoid

crashes, hangs and other issues reported in the past Released in CORAL 2.3.2 in 2012 (see CHEP2012 paper)

Other improvements Fixes in CoralServerProxy to address observed HLT crash Generally improved connection handling in multi-threaded

use cases, but limitations remain in non-Oracle back-ends

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 4

Kerberos authentication

An alternative to username/password authentication Supported in CORAL and COOL since the end of 2012 While Oracle support for X509 certificates is still missing

Two ways to use your Kerberos ticket (~AFS token) Principal authentication (must create new Oracle users) Nicer: proxy authentication (map Kerberos to Oracle user)

Must be explicitly enabled on the Oracle server Now only on CORAL test server, not on any ATLAS server Also requires custom client-side sqlnet.ora

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 5

Validation on Oracle12c servers (1)

COOL performance validated on 12c servers Details in the CoolPerformanceTests twiki page Using the same tool developed for the 10g→11g migration

Not impressed with the “adaptive” features of 12c! Without COOL hints, in some situations Oracle never finds

a good execution plan if adaptive optimization is enabled! Disable adaptive optimization in COOL at query-level Add optional hook to disable it in CORAL at session-level

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 6

Validation on Oracle12c servers (2)

COOL performance report on Oracle 12c With 12c “adaptive” features disabled (new COOL

default) COOL hints (developed on 11g) ensure good

execution plans independently of statistics and bind variable peeking

With hints Without hints

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 7

Oracle client

Currently using 11.2.0.3.0 (since Q3 2012) Addresses security vulnerability in logon protocol Includes fixes for SElinux and for AMD multicore nodes Includes Kerberos bug workaround in custom sqlnet.ora Using it on Linux and more recently also on MacOSX

Work in progress: testing 12.1.0.1.0 Following up Kerberos/password authentication issues Expect minor improvements in redefinition of Kerberos

and GSSAPI symbols, but this was declared a “Won’t fix”

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 8

Platforms and infrastructure

Some recent changes CVS to SVN migration (also POOL for data

preservation) Support on gcc4.8 with c++11, clang3.3, icc13

On the to-do list CMT to cmake migration Savannah to Jira migration Quattor to puppet migration (CORAL server test

instance)

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 9

Tests and QA

Static code analysis Fixed several issues reported by Coverity (others

will be included in the upcoming API changes)

Memory analysis and time profiling Fixed several leaks reported by valgrind and igprof A few studies of elapsed/CPU time with gperftools

too

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 10

Work in progress

Upcoming release by end 2013 COOL vector payload (currently validating

performance) New CORAL server protocol (but no monitoring

added) Other extensions (and bug fixes) in the API’s

Work in progress on the port to ROOT6 Only affects PyCool (Reflex to cling/pypy migration)

Plan integration tests with GaudiHive MT framework

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 11

COOL vector payload

This is only meant as a replacement of “CoraCool” Useful in the ongoing ATLAS conditions database

review

There are at least 3 options for vector-like conditions Separate channels, vector payload, inline BLOBs… See the CoolVectorPayload twiki page

Being tested from the COOL nightlies Before this is released, can you confirm the

present functionalities and implementation are ok for ATLAS?

IT-SDC 24th October 2013A. Valassi – CORAL and COOL news for ATLAS 12

Summary

A few recent enhancements CORAL handling of network glitches Kerberos authentication COOL performance validation on Oracle 12c servers

Upcoming releases and work in progress COOL vector payload New CORAL server protocol Port to ROOT6

Thanks to IT-DB, to the SPI team and to ATLAS users/DBAs!