CERN LCG-1 Status Markus Schulz LCG EDG Project Conference 29 September 2003.
LCG Generator
-
Upload
william-garza -
Category
Documents
-
view
56 -
download
0
description
Transcript of LCG Generator
September 27 2004September 27 2004
CHEP 2004CHEP 2004
LCG GeneratorLCG Generator
P. BartaliniP. Bartalini(University of Florida)(University of Florida)
F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev, F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev,
F. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. VologdinF. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. Vologdin
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
LCG Simulation Project OrganizationLCG Simulation Project Organization
Simulation ProjectG.Cosmo
FrameworkV. Pokorski
Geant4J.Apostolakis
FLUKAIntegration
A.Ferrari
PhysicsValidation
F.Gianotti/A.Ribon
ShowerParam
Geant4Project
FLUKAProject
ExperimentValidation
WPWP
WP
WPWP
WP
WPWP
WPWP
WP
WPWP
GeneratorServicesP.Bartalini
MC4LHC
WPWP
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
LCG GeneratorLCG Generator
Florida (Coordination)CERN (Event Interfaces)
LCG-Russia (Library & Data Base)LCG-Spain (Production)
Collaboration with independent projects: LCG-UK (Validation, New MCs)Contact persons/Collaborators in MC Projects and LHC Experiments
GOAL: to guarantee the generator support for LHC
Started May 2003Started May 2003Long Term ProjectLong Term Project
Workshop on MC’s for the LHC (MC4LHC) Workshop on MC’s for the LHC (MC4LHC) CERN, July 7 - August 2 2003CERN, July 7 - August 2 2003
WPA: GENERATOR SERVICES LIBRARY (GENSER)
WPB: TUNING AND VALIDATION
WPC: SHARED EVENT FILES: PRODUCTION & DATA BASE
WPD: EVENT FORMATS AND EVENT INTERFACES
GENSER Review CERN, March 25 2004 CERN, March 25 2004
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Between Two Different WorldsBetween Two Different Worlds
Small Theoretical groupsSmall Theoretical groups Huge fortran packages still in developmentHuge fortran packages still in development Need help with the new OO packagesNeed help with the new OO packages Need to share user support dutiesNeed to share user support duties
Large Experimental Collaborations
Complex OO Simulation Frameworks
Need easy access to many generators, responsive user support, bug fixes etc.
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPA. The LCG Generator Library (GENSER)
Mandate: Collaborate with MC authors to prepare LCG Compliant Code
HERWIG (P.Richardson), PYTHIA (T.Sjöstrand), HIJING (X.N. Wang), ISAJET (F.E. Paige), LHAPDF (M.Whalley), ALPGEN (M.Mangano), COMPHEP (A.Sherstnev), EVTGENLHC (P. Robbe), GLAUBER (V.Uzhinsky), FROZEN (PHOTOS, PDFLIB), ORIGINAL CODE (Validation, Data Base, Production)
Future: DPMJET, MC@NLO, GRACE, MADGRAPH, NEXUS, PHOJET, SFM, TAUOLA, HERWIG++, PYTHIA 7, SHERPA, etc.
Clients: Addressed to LHC experimentalists and theorists both at CERN and in external laboratories. (Other users welcome!)
Tested by all the LHC experiments Quarterly Release Scheme
Librarian (MSU, ITEP, Troitsk, Protvino, CERN) ~ 1 FTE~ 1 FTE
One person based at CERN another one rotating with ~ quarterly shiftsOne person based at CERN another one rotating with ~ quarterly shifts
GOAL: to replace the obsolete CERN Library
ATLASATLAS PRODUCTION PRODUCTIONRELIES ON GENSER !!! RELIES ON GENSER !!!
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPA. GENSER: Policy and Structure Releases decoupled from large library releases
Quarterly official releases, quick bug fixes and special versions
Most of the MC package versions released by the authors are installed Old versions have to be maintained as long as they are used
Manage to provide all the requested LCG supported platforms
CVS repository, AFS, Compact Tarball distribution, LCG Tools
SCRAM release and building tool for librarian and end-users Binary distribution also provided
Test/Validation software (provided by authors, end-users and librarians) Installed in the «Example» and «Test» modules
Code development for WPA, WPB, WPC, WPD
Documentation: http://lcgapp.cern.ch/project/simu/generator Savannah Portal: http://savannah.cern.ch/projects/simu/AFS: /afs/cern.ch/sw/lcg/app/releases/GENSER
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPA. MC Packages: Inside or Outside WPA. MC Packages: Inside or Outside GENSER ?GENSER ?
Three possibilities:Three possibilities:
1) To develop the MC package in GENSER: 1) To develop the MC package in GENSER: MCDB, EVTGENLHCMCDB, EVTGENLHC EVTGENLHCEVTGENLHC derives from derives from EVTGENEVTGEN: : http://agenda.cern.ch/fullAgenda.php?ida=a035838http://agenda.cern.ch/fullAgenda.php?ida=a035838
Provided (Adapted) by LHCb Provided (Adapted) by LHCb Contact person P.Robbe Contact person P.Robbe LHCb has LHCb has full accessfull access to the package in the GENSER repository to the package in the GENSER repository Other contributors have a Other contributors have a limited accesslimited access (development of new decay models, decay files etc.) (development of new decay models, decay files etc.)
2) 2) To fully export the MC generator code in GENSER defining the corresponding sub-package: To fully export the MC generator code in GENSER defining the corresponding sub-package: MOST OF THE INSTALLED MCsMOST OF THE INSTALLED MCs
3) 3) To install the MC generator as external software packages in the LCG environment and to store in To install the MC generator as external software packages in the LCG environment and to store in GENSER just tests suites and other related code GENSER just tests suites and other related code COMPHEP, EVTGENCOMPHEP, EVTGEN
Just a technical issue! Just a technical issue! For each MC package an ad-hoc solution is found For each MC package an ad-hoc solution is found
taking into account the user requirementstaking into account the user requirements
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPA. GENSER Repository WPA. GENSER Repository StructureStructure
GENSER_0_2_0GENSER_0_2_0|||--- config/|--- config/
|--- doc/|--- doc/
|--- include/|--- include/|--- logs/|--- logs/
|--- release.notes|--- release.notes |--- rh73_gcc323/|--- rh73_gcc323/lib/lib/
bin/bin/
tests/tests/
| ---include/| ---include/
|--- src/|--- src/herwig/herwig/data/data/
doc/doc/
dummy/dummy/
examples/examples/
includes/includes/
src/src/
MC Package version provided as CVS Tag
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
GENSER_0_1_0: Mid Apr. 2004 (GENSER_0_1_0: Mid Apr. 2004 (rh73_gcc32rh73_gcc32) ) GENSER_0_2_0: Mid Sep. 2004 (GENSER_0_2_0: Mid Sep. 2004 (+ rh73_gcc323+ rh73_gcc323))
GENSER_1_0_0: Mid Dec. 2004 (GENSER_1_0_0: Mid Dec. 2004 (+ Scientific + Scientific LinuxLinux))
PYTHIA: PYTHIA: 6.205, 6.217, 6.220, 6.221, 6.222, 6.205, 6.217, 6.220, 6.221, 6.222, 6.223, 6.224, 6.304, 6.223, 6.224, 6.304, …… HERWIG: HERWIG: 6.500, 6.503, 6.504, 6.504b1, 6.500, 6.503, 6.504, 6.504b1, 6.505, 6.505, …… JIMMY: JIMMY: 4.1, 4.1, …… ISAJET: ISAJET: 7.67, 7.69, 7.67, 7.69, …… EvtGen:EvtGen: alpha-00-11-07alpha-00-11-07 EvtGenLHC: EvtGenLHC: 1.0, 1.0, …… AlpGen: AlpGen: 1.3.2, 1.3.2, …… CompHEP: CompHEP: 4.4.0, 4.4.0, …… LHAPDF: LHAPDF: 1.1, 2.0, 1.1, 2.0, …… PDFLIB: PDFLIB: 804804 PHOTOS: PHOTOS: 202, 207202, 207 Glauber Xs (Heavy Ions): Glauber Xs (Heavy Ions): 1.0, 1.0, …… HIJING (Heavy Ions): HIJING (Heavy Ions): 1.36, 1.37, 1.383, 1.383b, 1.36, 1.37, 1.383, 1.383b, …… Packages in the waiting list, with particular emphasis on SHERPAPackages in the waiting list, with particular emphasis on SHERPA
GENSER_0_2_0:GENSER_0_2_0:11 Generators11 Generators
2 PDF Packages2 PDF Packages30 Versions30 Versions
WPA.
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPB. Monte Carlo Validation and Tuning
GOAL: to cross-check MCs and compare with data
Basic Sanity Checks Reference distributions (multiplicities, PT Spectra etc.)
Standalone Studies
Work on GENSER subpackages (Librarian, Beta Testers in Experiments)
ALPGEN Validation (Perugia) Essential to verify ALPGEN in GENSER
HIJING Validation (JINR, Dubna) Encouraged to contribute to JetWeb
Validation Framework
JetWeb: in production
LCG-UK (U.C.London)
http://jetweb.hep.ucl.ac.uk/
[Comp. Phys. Comm. vol 153/2 164-178 (2003)]
Database of Data, MC & Comparisons Web Database of Data, MC & Comparisons Web interface, Job submissioninterface, Job submission
Will switch soon to Will switch soon to GENSER GENSER ??
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Production framework
Proposal June 2004June 2004 Design Available. Prototype Stage Active institutions: CERN, Santander, Oviedo
Production centre
Configuration & Book-keeping
~ 1 FTE from LCG Russia (MSU, ITEP, JINR) MCDB: version Deployed!
WPC: Production of Shared Event Files
GOAL: to produce certified generator level events
Will Be Officially Will Be Officially Adopted By Adopted By CMSCMS
Tested At Tested At FermilabFermilabTested By Tested By CMS CMS
Use them for benchmarks, comparisons & combinations in LHC W.G. Improve the quality of shared samples with respect to LEP W.G. era !!!
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPC. Monte Carlo Data Base (MCDB)
Motivations Motivations To Provide To Provide ConfigurationConfiguration, , Book-keepingBook-keeping, , DocumentationDocumentation, , StorageStorage for the for the
Shared Event FilesShared Event Files To keep track of the full generation chain, To keep track of the full generation chain, Exploiting the Competences of Exploiting the Competences of
Monte Carlo Experts and Monte Carlo AuthorsMonte Carlo Experts and Monte Carlo Authors
CMS MCDB CMS MCDB http://cmsdoc.cern.ch/cms/generators/mcdb/http://cmsdoc.cern.ch/cms/generators/mcdb/ Only parton level files; AFS storage; No Searchable; No SQLOnly parton level files; AFS storage; No Searchable; No SQL
LCG MCDB LCG MCDB [[hep-ph/0404241hep-ph/0404241]] Same authors + Additional human resources and technical support Same authors + Additional human resources and technical support Core software supported by LCG Software Project InfrastructureCore software supported by LCG Software Project Infrastructure
MySQL; POOL; CASTOR (RFIO); CGI; Perl; ApacheMySQL; POOL; CASTOR (RFIO); CGI; Perl; Apache Web Interface, Dedicated Web Server http://mcdb.cern.chWeb Interface, Dedicated Web Server http://mcdb.cern.ch
version supports only Mozilla Browserversion supports only Mozilla Browser
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPC. MCDB: SQL Structure WPC. MCDB: SQL Structure and Access Policyand Access PolicyEnd-UserEnd-User Read articles, comments, newsRead articles, comments, news Download event filesDownload event files
AuthorAuthor Post articlesPost articles Upload event filesUpload event files Post news and answer the commentsPost news and answer the comments
ModeratorModerator Manage users profilesManage users profiles Moderate articles and commentsModerate articles and comments
AdministratorAdministrator Control the systemControl the system Technical database managementTechnical database management
Application Package InterfaceApplication Package Interface Automated articles posting/retrieving and samples upload/downloadAutomated articles posting/retrieving and samples upload/download
SQL Table Structure
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPC. MCDB Web Interface Screen-WPC. MCDB Web Interface Screen-shotshot
http://mcdb.cern.ch
Only Mozilla Browser Supported (for the time being)
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPD. WPD. Event Formats and Event Event Formats and Event InterfacesInterfaces
The modularisationThe modularisation Basic idea in Basic idea in ThePEGThePEG, , PYTHIA 7PYTHIA 7, , HERWIG++HERWIG++, , SHERPASHERPA From April 2004 LCG Generator participates to the development of From April 2004 LCG Generator participates to the development of
ThePEGThePEG We started with improving the doxygen documentation (A.Ribon)We started with improving the doxygen documentation (A.Ribon) Activity coordinated with Activity coordinated with PhenogridPhenogrid (N.Glover et al.) (N.Glover et al.) Relevant for the Relevant for the Herwig++Herwig++ development development
The MC truthThe MC truth Interface Interface HEPMLHEPML proposal (XML - proposal (XML - Les Houches Agreement ILes Houches Agreement I compliant) compliant)
Meta-data format facilitating automated documentationMeta-data format facilitating automated documentation HEPMCHEPMC
Under the responsibility of Under the responsibility of CLHEPCLHEP (still some problems with translators)(still some problems with translators)
GOAL: standardize interfaces, support the new OO MCs
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPD. HEPML ProposalWPD. HEPML Proposal
All data in event file are divided in two partsAll data in event file are divided in two parts Header -Header - describe the general informationdescribe the general information
Author, the file itself (Author, the file itself (creation date etc.creation date etc.), supported specifications, ), supported specifications, collider description etc.collider description etc.
Generator specific info, cuts, physical parameters etc.Generator specific info, cuts, physical parameters etc. Info for parser (Info for parser (format of event records etc.format of event records etc.))
Event Records - Event Records - variable data of events written in some variable data of events written in some compact format to one string (compact format to one string (particle momenta, color particle momenta, color chains etcchains etc.).)
Header is stored in a txt file with Header is stored in a txt file with XML SyntaxXML Syntax Event RecordsEvent Records are (zip) compressed and attached to are (zip) compressed and attached to
the the HeaderHeader file file
(COMPHEP Collaboration)
[S.Sherstnev]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPD. WPD. XML in HEPXML in HEPA.KryukovA.Kryukov
Skobeltsyn Institute of Nuclear PhysicsSkobeltsyn Institute of Nuclear Physics([email protected])([email protected])
On behalf of CompHEP CollaborationOn behalf of CompHEP Collaboration
Presented to LCG-GeneratorPresented to LCG-Generator
http://agenda.cern.ch/fullAgenda.php?ida=a035826http://agenda.cern.ch/fullAgenda.php?ida=a035826
Why XML ?Why XML ? Describe the document structureDescribe the document structure Extensible languageExtensible language WEB readyWEB ready Well defined open standardWell defined open standard Available tools to treat of XMLAvailable tools to treat of XML
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
LCG Generator Future PlansLCG Generator Future Plans
MILESTONESMILESTONES
Q4/2004-WPA- GENSER: release version (Q4/2004-WPA- GENSER: release version (ref. ref. MC RTAG reportMC RTAG report)) Q1/2005-WPA- SHERPA (Q1/2005-WPA- SHERPA (F.Krauss et al.F.Krauss et al.) fully integrated in GENSER) fully integrated in GENSER Q2/2005-WPC- Generator level production framework: beta versionQ2/2005-WPC- Generator level production framework: beta version Q3/2005-WPD- First test of ThePEG and EvtGenLHC integration in Q3/2005-WPD- First test of ThePEG and EvtGenLHC integration in
Herwig++Herwig++ (and Possible insertion of Herwig++ in GENSER) (and Possible insertion of Herwig++ in GENSER) Q3/2005-WPC- Production centre integrated in the grid-middlewareQ3/2005-WPC- Production centre integrated in the grid-middleware Q4/2005-WPC- Generator level production framework: release versionQ4/2005-WPC- Generator level production framework: release version Q1/2006-WPC- MCDB Integration with Generator level production Q1/2006-WPC- MCDB Integration with Generator level production
framework, experiment specific APIs and management of large filesframework, experiment specific APIs and management of large files WPB milestones to be verified with other independent projectsWPB milestones to be verified with other independent projects
Enphasis on the collaboration with Enphasis on the collaboration with Object Oriented MC projectsObject Oriented MC projects
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WEB pagehttp://lcgapp.cern.ch/project/simu/generator
Links to relevant documentation, CVS repository, release.notes etc.
CDS Agenda Home > Projects > LHC Computing Grid > Physics Generators Minutes of meetings, slides of presentations
Meetings: Last Thursday of the month at 5 PM in CERN-32-1-A24 & VRVS
(Last and Next meetings anticipated to SEP 23 and OCT 21 respectively) Next meeting will be devoted to the Management of GENSER Releases
Applications area mailing list: [email protected]
Organisational Issues
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
BackupBackup
General
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Agenda of LCG Generator Review Agenda of LCG Generator Review (March 2004)(March 2004)
13:45 Introduction (Bartalini, P.)
13:50 LHAPDF v2 (Whalley, M.)
14:20 GENSER, the generator library (Alexander, S.)
14:50 GENSER validation (Ambroglini, F.)
15:05 User experience with GENSER (Hinchliffe, I.)
15:25 The LCG generator library (Discussion) (all)
16:25 ---Coffee---
16:40 A framework for generator level production&validation (Bartalini, P.)
16:55 The MCDB project (Dudko, L.)
17:10 MCDB Implementation (Vologdin, A.)
17:25 The HEPCODE project (Stirling, W.J.)
17:35 Event formats & Monte Carlo data base. (Discussion) (all)
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
WPC. Simple Generator Level WPC. Simple Generator Level Production FrameworkProduction Framework
Progress on the simple generator level production Progress on the simple generator level production framework were achieved during the quarter. framework were achieved during the quarter.
A Prototype is being developed by A Prototype is being developed by H.NavesH.Naves and and J.CuevasJ.Cuevas ( (SantanderSantander). ).
It reads It reads generator cardsgenerator cards, produces , produces eventsevents, performs , performs basic event selectionbasic event selection, and writes out using the , and writes out using the HEPMCHEPMC structure in structure in POOLPOOL and in and in ROOTROOT formats. formats.
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
BackupBackup
MCDB
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
MCDB IntroductionMCDB Introduction
Correct Monte Carlo simulation of complicated Correct Monte Carlo simulation of complicated processes requires rather sophisticated expertiseprocesses requires rather sophisticated expertise
Different physics groups often are in need of the Different physics groups often are in need of the same MC samplessame MC samples
Public availability of the event files speeds up their Public availability of the event files speeds up their validationvalidation
Central and public location where well-documented Central and public location where well-documented event files can be found would be very usefulevent files can be found would be very useful
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
CMS MCDBCMS MCDBAdvantagesAdvantages
Based on web Based on web technologiestechnologies
Stores detailed Stores detailed documentation for each documentation for each set of event samplesset of event samples
Storing data on AFS let Storing data on AFS let make its easy of accessmake its easy of access
Provide rapid Provide rapid communication between communication between users and expertsusers and experts
ProblemsProblems
Stores parton level events onlyStores parton level events only The expected number of physics The expected number of physics
processes in the database is processes in the database is several hundred (data are stored several hundred (data are stored on AFS so there is a space on AFS so there is a space limitation)limitation)
Cannot serve sophisticated Cannot serve sophisticated queries owing to it isn’t SQL queries owing to it isn’t SQL basedbased
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Main Features of LCG MCDBMain Features of LCG MCDB
The most important reason to develop LCG MCDB is to The most important reason to develop LCG MCDB is to expel the restrictions of CMS MCDBexpel the restrictions of CMS MCDB
An SQL-based databaseAn SQL-based database Wide search abilitiesWide search abilities Possibility to keep the events at particle level as well as at Possibility to keep the events at particle level as well as at
partonic levelpartonic level Direct programming interface from LCG collaboration Direct programming interface from LCG collaboration
softwaresoftware Inheritance of all the advantages of the predecessor - CMS Inheritance of all the advantages of the predecessor - CMS
MCDBMCDB
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
MCDB: General Conceptions and MCDB: General Conceptions and TermsTerms
Event file (sample)Event file (sample) – the file containing particle or partonic – the file containing particle or partonic eventsevents
ArticleArticle – a document describing the set of samples – a document describing the set of samples Event dataEvent data – the events themselves, all the data are stored into – the events themselves, all the data are stored into
event filesevent files Event metadataEvent metadata – information which describes all events in a – information which describes all events in a
sample in general (beam description, physics parameters, sample in general (beam description, physics parameters, applied cuts, etc.)applied cuts, etc.)
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
MCDB InterfacesMCDB Interfaces
Search formSearch form Article management (creating, changing, removing)Article management (creating, changing, removing) Downloading sample filesDownloading sample files User management (registration, editing profiles, removing)User management (registration, editing profiles, removing) Editing metadata on physical models and parametersEditing metadata on physical models and parameters Moderating articles and user comments on themModerating articles and user comments on them Application programming interface to allow program-based Application programming interface to allow program-based
article creationarticle creation Comment the articlesComment the articles
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Access Ways to LCG MCDBAccess Ways to LCG MCDB
End-UserEnd-User Read articles, comments, newsRead articles, comments, news Download event filesDownload event files
AuthorAuthor Post articles and upload event filesPost articles and upload event files Post news and answer the commentsPost news and answer the comments
ModeratorModerator Manage users profilesManage users profiles Moderate articles and commentsModerate articles and comments
AdministratorAdministrator Control the systemControl the system Technical database managementTechnical database management
Application softwareApplication software Automatic articles posting and samples uploadAutomatic articles posting and samples upload
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
The Most Common Operations with The Most Common Operations with MCDBMCDB
Users in generalUsers in general
1)1) Browses articles via the tree view of physics categoriesBrowses articles via the tree view of physics categories
2)2) Searches by author, title, keywords, physical processes, Searches by author, title, keywords, physical processes, parameters values, etc.parameters values, etc.
3)3) Downloads desired sample after agreement on MCDB LicenseDownloads desired sample after agreement on MCDB License
Articles’ authorsArticles’ authors
1)1) Uploading event filesUploading event files
2)2) Completing article with the information that wasn’t not included Completing article with the information that wasn’t not included in the description of an event filein the description of an event file
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
MCDB: Software SelectionMCDB: Software Selection
SQL DBMS: MySQLSQL DBMS: MySQL Script system: PerlScript system: Perl Web-server: Apache2Web-server: Apache2 Web-interface: CGI+PerlWeb-interface: CGI+Perl CASTOR: RFIO packageCASTOR: RFIO package
All the products are supported as standard software in LCGAll the products are supported as standard software in LCG
[A.Sherstnev]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
SQL tables in MCDBSQL tables in MCDB
AuthorsAuthors ArticlesArticles CategoriesCategories Generators and their parametersGenerators and their parameters Models and parameters namesModels and parameters names Model parameters’ valuesModel parameters’ values Processes, initial and final statesProcesses, initial and final states Applied cutsApplied cuts Event files, graph filesEvent files, graph files
and a few other tablesand a few other tables
[S.Belov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
MCDB: Current StatusMCDB: Current Status
SQL tables structure: doneSQL tables structure: done Internal Perl modules (access to the MCDB SQL tables, parse Internal Perl modules (access to the MCDB SQL tables, parse
configuration file, many others): partly doneconfiguration file, many others): partly done User area:User area:
Web site: first prototype done (mcdb.cern.ch)Web site: first prototype done (mcdb.cern.ch) Web catalog script: doneWeb catalog script: done
Author areaAuthor area Web interface for creation of articles: doneWeb interface for creation of articles: done Uploading of files to HDD: done, to CASTOR: in progressUploading of files to HDD: done, to CASTOR: in progress Web interface for editing of articles: in progressWeb interface for editing of articles: in progress
Administrative area:Administrative area: User management interface: doneUser management interface: done Article management interface: in progressArticle management interface: in progress
[A.Sherstnev]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
MCDB: Short Term PlansMCDB: Short Term Plans
DocumentationDocumentation Internal programming interface with CASTORInternal programming interface with CASTOR Web-interface for editing of articlesWeb-interface for editing of articles First real testsFirst real tests Web access control: internal login/password, GRID certificatesWeb access control: internal login/password, GRID certificates Internal access control: to provide author’s privacyInternal access control: to provide author’s privacy Web-server tuningWeb-server tuning Providing of compatibility with different browsers (IE, Providing of compatibility with different browsers (IE,
Netscape, Opera)Netscape, Opera) HEPML: developing of XML tag setHEPML: developing of XML tag set Main milestone: first working prototype in DecemberMain milestone: first working prototype in December
[A.Sherstnev]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
MCDB: Mid Term PlansMCDB: Mid Term Plans
Search engine in MCDB SQL databaseSearch engine in MCDB SQL database Moderator interface (to manage articles and Moderator interface (to manage articles and
related objects, user comments, Web catolog)related objects, user comments, Web catolog) Internal parser for HEPMLInternal parser for HEPML Security system Security system Logging systemLogging system System of collection of statisticsSystem of collection of statistics MCDB Integration APIsMCDB Integration APIs
[A.Sherstnev]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
BackupBackup
A.KryukovA.KryukovSkobeltsyn Institute of Nuclear PhysicsSkobeltsyn Institute of Nuclear Physics
([email protected])([email protected])On behalf of CompHEP CollaborationOn behalf of CompHEP Collaboration
Presented to LCG-GeneratorPresented to LCG-Generatorhttp://agenda.cern.ch/fullAgenda.php?ida=a035826 http://agenda.cern.ch/fullAgenda.php?ida=a035826
XML in HEPXML in HEP
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
OutlookOutlook
Why XML ?Why XML ? Describe the document structureDescribe the document structure Extensible languageExtensible language WEB readyWEB ready Well defined open standardWell defined open standard Available tools to treat of XML Available tools to treat of XML
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Outlook (continue)Outlook (continue)
Experimental events and/or events simulation Experimental events and/or events simulation (illustration)(illustration) Detector modelsDetector models HEP modelsHEP models Partonic event structurePartonic event structure Hadronized eventsHadronized events Digitized eventsDigitized events
ConclusionConclusion[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Why XML ?Why XML ?
XML describe the document structure.XML describe the document structure. Most information in HEP can be and must be Most information in HEP can be and must be
presented as a tree structure or in more general presented as a tree structure or in more general case acyclic graphcase acyclic graph
XML is extensible languageXML is extensible language XML has no fixed set of targets and attributes. XML has no fixed set of targets and attributes.
User can introduce own targets and attributes.User can introduce own targets and attributes.
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Why XML (continue) ?Why XML (continue) ?
WEB readyWEB ready XML document can be distribute through InternetXML document can be distribute through Internet XML document can be displayed in different way XML document can be displayed in different way
depends on the user request (XSLT, XSD)depends on the user request (XSLT, XSD) Most modern Web-browsers (Mozilla, IE) can Most modern Web-browsers (Mozilla, IE) can
display XML documents by default.display XML documents by default. Well defined open standardWell defined open standard
Recomended by W3CRecomended by W3C Supported by IBM, Sun, Microsoft, Linux/UN*X Supported by IBM, Sun, Microsoft, Linux/UN*X
communitycommunity[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Why XML (continue) ?Why XML (continue) ?
Available tools to treat of XMLAvailable tools to treat of XML SAX - JavaSAX - Java Expat – C/C++Expat – C/C++ PerlPerl PythonPython Other …Other …
SW developer can re-use these tools for SW developer can re-use these tools for applicationsapplications
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Experimental events and/or Experimental events and/or simulated eventssimulated events
HEP models
ME Gen(CompHEP)
Hadronization(Pythia)
2 3
1
5
Simulation(Geant)
Detector or it models
4
Reconstruction(ORCA)
7
6
Phys. analysis
Event DB
5’
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
1. HEP models1. HEP models
<<modelmodel>><<namename>>QEDQED</</namename>><<parametersparameters>>
<<parameterparameter namename=“alpha” =“alpha” typetype=“float” =“float” valuevalue=“0.00729927”>=“0.00729927”>Alpha QED (1/137)Alpha QED (1/137)
</ </ parameterparameter>></</parametersparameters>><<particlesparticles>>
<<particleparticle idid=“e” =“e” massmass=“0.511” =“0.511” typetype=“fermion”>=“fermion”>ElectronElectron
</</particleparticle>></</particlesparticles>>
</</modelmodel>>(See more details in A.Demichev, A.Kryukov, A.Rodionov, (See more details in A.Demichev, A.Kryukov, A.Rodionov,
hep-ph/0203102. See also http://theory.sinp.msu.ru/FeynXML)hep-ph/0203102. See also http://theory.sinp.msu.ru/FeynXML)
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
2. ME events: partonic level2. ME events: partonic level
<<MachineMachine> > The LHC projectThe LHC project <<BeamBeam idid="1" ="1" energyenergy="7.00000E+03">="7.00000E+03"> <<ParticleParticle namename="proton" ="proton" KFKF="2212" ="2212" massmass="9.38000E-01"/>="9.38000E-01"/> <<StrfunStrfun namename='CTEQ' ='CTEQ' versionversion='5l'> <='5l'> <PDFLIBinfoPDFLIBinfo idid="46" ="46" grgr="4"/> ="4"/> </</BeamBeam> > </</MachineMachine>><<TaskTask>> <<ProcessProcess ID="1"> ID="1"> u, D -> n, e, E, b, B u, D -> n, e, E, b, B </</ProcessProcess>> <<GeneralInfoGeneralInfo>> <<CrosSection CrosSection value="1.11227E-03" error="1.90987E-03" Nevent="100"/>value="1.11227E-03" error="1.90987E-03" Nevent="100"/> <<GeneratorGenerator name="CompHEP" version="4.2.0"/> name="CompHEP" version="4.2.0"/> </</GeneralInfoGeneralInfo> > </</TaskTask>>……((Below partonic events. Below partonic events. NOT in XML format!NOT in XML format!)…)…
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
3. Simulated events: particle level 3. Simulated events: particle level (illustration)(illustration)
<<headerheader>>
<<experimentexperiment namename=“CMS” =“CMS” datedate=“20070101”/>=“20070101”/>
<<beambeam typetype=“pp” =“pp” energyenergy=“14000”/>=“14000”/>
<!– etc. <!– etc. </</headerheader>>
(Below Pythia-like events. (Below Pythia-like events. NOT in XML format!NOT in XML format!))
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
4. Detector models (illustration)4. Detector models (illustration)
<<detectordetector>><<namename idid=“CMS” =“CMS” versionversion=“2.33”>=“2.33”>
Compact Muon SolenoidCompact Muon Solenoid</</namename>><<basic_elementbasic_element idid=1 =1 URIURI=“http://xxx.cern.ch/cms/belement1” />=“http://xxx.cern.ch/cms/belement1” /><<basic_elementbasic_element idid=1 =1 URIURI=“http://xxx.cern.ch/cms/belement2” />=“http://xxx.cern.ch/cms/belement2” /><<unitunit namename=“shift” =“shift” dimdim=“mm”/>=“mm”/><<unitunit namename=“rotate” =“rotate” dimdim=“grad”/>=“grad”/><<elementelement deploy_fromdeploy_from=1 =1 shiftshift=“x,y,z” =“x,y,z” rotaterotate=“a,b,g” =“a,b,g” numbernumber=“100”/>=“100”/><<elementelement deploy_fromdeploy_from=2 =2 shiftshift=“0.0.0” =“0.0.0” rotaterotate=“10.0.0” =“10.0.0” materialmaterial=“Si”/>=“Si”/><<elementelement deploy_fromdeploy_from=2 =2 shiftshift=“x,y,z” =“x,y,z” rotaterotate=“0.0.0” =“0.0.0” materialmaterial=“Cu”/>=“Cu”/><!– etc. <!– etc.
</</detectordetector>>
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Next points …Next points …
5.5. Simulated/experimental eventsSimulated/experimental events
6.6. Reconstructed eventsReconstructed events
7.7. Visualization, Web browsingVisualization, Web browsing
8.8. What else?What else?
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Conclusions (pro)Conclusions (pro)
XML is very useful for presentation of XML is very useful for presentation of structured datastructured data Models, EventsModels, Events
Easy for realization on Java, C/C++, Perl, …Easy for realization on Java, C/C++, Perl, … Give a lot of possibilities for publication Give a lot of possibilities for publication
results through the WEB.results through the WEB. Unify interfaces of application softwareUnify interfaces of application software XML DB id native format of data base for XML DB id native format of data base for
XML presented data.XML presented data.
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Conclusions (contra)Conclusions (contra)
Poor structured informationPoor structured information
Huge amount of information with strong Huge amount of information with strong defined and fixed structuredefined and fixed structure ME generated events, Pythia events and othersME generated events, Pythia events and others
[A.Kryukov][A.Kryukov]
P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004
Main conclusion: Main conclusion: XML has XML has great advantage in HEP great advantage in HEP
applicationapplication
Thank you for attention!Thank you for attention!