CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré
Institut de Physique Nucléaire ORSAY
Unité mixte de recherche
CNRS-IN2P3-Université Paris-Sud 11 91406 Orsay cedex Tél. : +33 1 69 15 73 40 Fax : +33 1 69 15 64 70 http://ipnweb.in2p3.fr
Acquisition
development @ IPN 2008-2012
Juillet 2013
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.2
Acquisition & Development Group
ALICE in CERN
GEANT4 / VMC
AGATA (technical contribution: NARVAL)
Activities @ TANDEM-ALTO european facility
Yann Aubert
Jean-Louis Coacolo
Dominique Delbourg
Xavier Grave
Luz Guevara
Ivana Hrivnacova
Vincent Lafage
Kane Nguyen-Kim
Jean Peyré
Sylvain Rousseau
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.3
IPNO/D2I/S2I Jean Peyré
P.3
ALICE:
A Large Ion Collider Experiment
Pour l’expérience ALICE, le LHC fera entrer en collision des ions plomb afin de recréer en laboratoire les conditions qui régnaient juste après le Big Bang. Les données obtenues permettront d’étudier l’évolution de la matière de la naissance de l’Univers à nos jours.
Ivana Hrivnacova Vincent Lafage Sylvain Rousseau
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.4
P.
4
Detector readout
FFT SYNC BUSY L0 RESET TTCRQ FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 µP TRIGGER CROCUS INTERFACE TCI DAQ TTC CLK GEN LTU µP TTCVI TTCEXCENTRAL TRIGGER PROCESSOR +
TIMING TRIGGER & CONTROL CTP
Optical Link
& LVDS
DETECTEURSOptical Link
160 Mo/s
module CROCUS 5 FRT Cards 1 CRT Card CROCUS400 Mo/s
FRT: FRonT Card CRT: ConcentRaTorLVDS
20 Patch n Patch n+1 Patch n+4 5 li n e s 5 li n e s 20 Mo/s 20 Mo/sLVDS
Vincent Lafage Sylvain RousseauCST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.5
P.
5
TTC CLK GEN LTU µP TTCVI TTCEX
CENTRAL TRIGGER PROCESSOR +
TIMING TRIGGER & CONTROL
CTP FFT SYNC BUSY L0 RESET TTCRQ FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 µP TRIGGER CROCUS INTERFACE TCI
L0 Trigger Transfer
Patch n Patch n+1 Patch n+4 5 li n e s 5 li n e s module CROCUS 5 FRT Cards 1 CRT Card CROCUS DETECTEURS DAQ L0 BUSY 1,2μS L1 6μS 80μS L2 170μS L0: collision L1: centrality, … L2: pileup TPC L0 L0 L0 L0 8 FRT: FRonT Card CRT: ConcentRaTor L0 L0 Trigger SignalCST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.6
P.
6
FFT SYNC BUSY L0 RESET TTCRQ FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 FTD C R O C U S -0 C R O C U S -1 C R O C US -2 C R O C U S -3 µP TRIGGER CROCUS INTERFACE TCI TTC CLK GEN LTU µP TTCVI TTCEXCENTRAL TRIGGER PROCESSOR +
TIMING TRIGGER & CONTROL CTP
Data Transfer
Patch n Patch n+1 Patch n+4 5 li n e s 5 li n e s module CROCUS 5 FRT Cards 1 CRT Card FRT: FRonT Card CRT: ConcentRaTor CROCUS DETECTEURS DAQ Trigger Signal L1,L2 L1,L2 8 Raw Data Condition L1 Condition L1 Condition L2 Sub-Event L0: collision L1: centrality, … L2: pileup TPC L0 BUSY 1,2μS L1 6μS 80μS L2 170μS Vincent Lafage Sylvain RousseauCST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.7
IPNO/D2I/S2I Jean Peyré
P.7
"Trigger Dispatching" crate:
Crocus emergency recovery
« dispatching » proxy:
reset control for ECS
"C
ROCUS
" crate:
"C
ROCUS
" configuration:
o
local control & command : GUI for users
o
ECS scripts
("E
XPERIMENTC
ONTROLS
YSTEM" – CERN
interface)
: automatic configuration loading for
all "C
ROCUS
"
fine-tuning "C
ROCUS
" start.
in-flight "C
ROCUS
" reconfiguration
L1r trigger FPGA new firmware
PMD group support (Photon Multiplicity Detector)
adapting to their detector.
FFT SYNC BUSY L0 RESET TTCRQ FTD C R O C U S -0 CR O C U S -1 CR O C U S -2 CR O C U S -3 FTD C R O C U S -0 CR O C U S -1 CR O C U S -2 CR O C U S -3 FTD C R O C U S -0 CR O C U S -1 CR O C U S -2 CR O C U S -3 FTD C R O C U S -0 CR O C U S -1 CR O C U S -2 CR O C U S -3 FTD C R O C U S -0 CR O C U S -1 CR O C U S -2 CR O C U S -3 µP TRIGGER CROCUS INTERFACE TCI module CROCUS 5 Cartes FRT 1 Cartes CRT CROCUS 400 Mo/s FRT: Carte FRonTale CRT: ConcentRaTeur
PMD
ALICE
Dimuons Spectrometer
DAQ:
Development & maintenance
Vincent Lafage Sylvain Rousseau
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.8
IPNO/D2I/S2I Jean Peyré
P.8
Performance improvement & new fonctionnalities
Current code improvement:
- Hard real-time & L1 trigger rejection dead-time improvement (12µs
instead of 25µs)
- Detector restart reliability improvement after data taking emergency
stop
- Detector readout self-diagnosis after data taking
Preparing future developments:
- Study of an hardware architecture relying on
rSoC* in FPGA ALTERA ARRIA II Gx in order to
improve the detector readout dead-time.
Radiation Hardening:
- Installation online monitoring setup on 1 CROCUS
in muon tracker to investigate DSP’s flux sensitivity
module CROCUS 5 Cartes FRT 1 Cartes CRT CROCUS 400 Mo/s FRT: Carte FRonTale CRT: ConcentRaTeur
ALICE
Dimuons Spectrometer
DAQ:
Development & maintenance
Vincent Lafage Sylvain Rousseau
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.9
IPNO/D2I/S2I Jean Peyré
P.9
• Coordination of software development for dimuon arm in
AliRoot,
code maintenance ;
project representation in the
ALICE Computing Board
• Setup of the grid test productions with
Geant4
for
validation of Geant4 simulation (presentation in CHEP
2011).
• IPNO ALICE Dimuon
team support
ALICE
OFFLINE
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.10
IPNO/D2I/S2I Jean Peyré
P.10
16 working groups, >100 members (1 in IPN Orsay)
IPN Orsay contributions
●
“Novice and Extended
Examples”
●
2011, group coordination : new
"basic"
example set development, for more details, see
Geant4 User's Guide for Application Developers , 10.1. Basic Examples
●
2012, revision of extended examples (80 examples of Geant4 applications)
●
Working Group Representation in Geant4 Steering Board
●
“Persistency”
●
Since 2011, new module
"Analysis"
providing management tools for histograms &
"n-tuple/trees" production under ROOT, AIDA and HBOOK format & based on INLIB / EXLIB tools.
●
Then adding new features, support for multithreading (for the release in 2013)
●
For more details, see:
Geant4 User's Guide for Application Developers, 9. Analysis
●
Also participation in Geometry and Documentation Working Groups.
Geant4
A tool to simulate particles-matter interaction
http://geant4.web.cern.ch/geant4/
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.11
IPNO/D2I/S2I Jean Peyré
P.11
Developed by ALICE and ROOT team, in
ROOT distribution since 2002
IPN Orsay Contributions:
●
Maintenance & development for
Geant4 VMC
package (adding new features on users’
demands)
●
Latest developments:
●
Geant4 VMC MT prototype
(multithreading)
●
New example A01
●
More in
CHEP 2012 poster
and publication
●Documentation maintenance in "ROOT" site
●Responsible of the Git Geant4 VMC repository
VMC: Virtual Monte Carlo
A tool to run differents Monte Carlo style simulation without changing user code, detector geometry or detector response definition
http://root.cern.ch/drupal/content/vmc
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.12
NARVAL
NARVAL:
Nouvelle Acquisition temps
Reel Version 1.14 Avec
Linux Yann Aubert Dominique Delbourg Xavier Grave Luz Guevara Kane Nguyen-Kim Jean Peyré
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.13
NARVAL
2008
2012
-Version: 1.06
-Version: 1.14
-Data management
with 3 buffers
-Data management with N buffers
-Error management improved
-Technology upgrade
(GLADE -> POLYORB)
-AdaCore support
2013
-Version: 2.0
-memory and network management out of NARVAL
(possible use with ENX)
-DAQ4PN group
(IPN-CSNSM-GANIL)
-NARVAL Training
(IPN-CSNSM-GANIL)
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.14
NARVAL
2008
2012
NARVAL: a
distributed
system for
management of high-performance
data stream
tending to a collection efficiency of 100% of
events.
- Possibility of
processing data stream online & in parallel
- Towards a development of
building blocks
to enable
optimization when reusing them (memory and network -
Common Bricks with ENX). This is particularly important in the
case of
"multi-detectors"
- The whole set ("data acquisition" + "control - command") is
then seen through a unified interface via "SOAP"
- Ease of development for distributed elements via Annex E of
Ada (through AdaCore support)
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.15
General management system
AWS
S hellENX
NARVAL ENXpartition
management
P
EB
C
SSC
F
P
EB
C
SSC
AWS
S hellF
NNS
Slow control
NARVAL
1
NARVAL
2
DAQ x2
Data flux:
-TCP/IP
-Unix Fifo …
Distributed System Annex
HTTP - AWS - Soap
SSC: Sub System Coordinator
NNS: Narval Naming Services
AWS-Shell: Ada Web Services Shell
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.16
AGATA:
Advanced GAmma Tracking Array
4
π
gamma spectrometer made only of Germanium detectors.Yann Aubert Xavier Grave Luz Guevarra
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.17
AGATA - DAQ Acquisition System
It includes :
the data stream from the
front-end electronic (FEE)
to the DAQ.
The pulse shape analysis
(PSA farm)
The event builder system
(EB)
The tracking
reconstruction
The data archiving in a
transient storage system
or/and to a permanent
storage system.
The DAQ system also
includes software packages
performing the overall
control of the system: Run
control, data monitoring,
system performance
monitoring, and
configuration system. It
also includes management
software for farm
infrastructure.
The Orsay group is in charge of the
development of the DAQ acquisition
system for the demonstrator and the final
configuration of Agata. Narval has been
adopted for the data stream management
Time/Energ y Position >1000 Proc
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.18
AGATA
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.19
AGATA
In Legnaro
-NARVAL Version: 1.06
-Version: 1.14
In GSI
- 25 Linux PC connected
to cristals
- Connected by optical
fibers to 4 Linux machines
accessing the data at
high-speed (> 400MB / s)
concurrently by GPFS*
*GPFS: IBM General Parallel File
System
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.20
AGATA: Topology Manager
TM
GEC
Reset, setup, etc Connections, Status, Info devices Global Electronic Controlhttps://forge.in2p3.fr/projects/topology-manager
SC
Topology Manager Slow ControlThe "Topology Manager" developed mainly by IPNO:
•
Centralises technical information, connections
(configuration tree) and the statements of the detector.
•
Provides insights of the configuration of the detection
system at a given time.
•
Used to hide electronics to users via a web interface (they
do not have to deal with the complexity of the material).
•
Simplifies obtaining information (connection, states, etc
...) in all the processes that are performed by the GEC on
the detector electronics.
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.21
: Accélérateur Linéaire et Tandem d'Orsay
Kane Nguyen-KimCST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.22
XYZ Movements :
-Axial displacement of a carbon target in vacuum
CCD Caméra Si Detectors
AGAT Experience for ALTO
Coupling TANDEM acquisition with X-ray camera
Coupling several acquisition "NARVAL" systems
AGAT Project
Study of the collision between aggregates or molecules and atoms at high speed.
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.23
X-CCD Camera (
Narval 1.10
)
Digitiser (X8)
CAMAC
(16 ADC & CLE)
Pulse Shape Analysis
on Silicon detector
AGAT Project
VME-PCI
VME-CAMAC
PC (
Narval 1.4
)
Heterogeneous systems
CST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.24
Development of software codes for acquisition systems at
ALTO, SPLITPOLE & others
Alto Projects
Kane Nguyen-KimCST Juillet 2013 IPNO/S2I
Vincent Lafage - Jean Peyré P.25
Perspectives
Signal processing
Andromede, neutron detection (image processing)
Silicon detector (Pulse Shape Analysis)
Involvement in detector & acquisition
upgrade
ALICE
AGATA (increase of crystal number)
Parallel computing & GPU group