1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko...

30
1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015

Transcript of 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko...

Page 1: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

1

C-Tagger Development Status Update

Kittikul Kovitanggoon* (CU)Gerrit Van Onsem (VUB)

Dinko Ferencek (RU)

CMS-POG BTAG-WG Meeting

June 18, 2015

Page 2: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

Overview

• CMSSW-based c-tagger based on CMSSW-based CSV b-tag algorithm (using the JetTagMVAExtractor code, so called ‘VariableExtractor’ for the tree production)

• TMVA-based c-tagger(s) – “v1” using Clemens' setup (using ‘VariableExtractor’ for the tree production) – “v2” using Dinko and Stevens' setup (using ‘BTagAnalyzer’ , PAT–based, for the tree production)

• C-tag twiki with work plan, link to presentations, ...

https://twiki.cern.ch/twiki/bin/viewauth/CMS/BTagCTagger

2

• We are aiming to use the BTagAnalyzer as the future tree production for at least the TMVA- based b/c taggers because BTagAnalyzer are in general more flexible and better maintained by BTV group (involving more expertise) than the current VariableExtractor.

• In this talk, we will present the status and problem we are encountering.

Page 3: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

3

Introduction of TMVA-based v2 ●TMVA-based c-tagger (i.e. training outside CMSSW) based on the b-tagging setup of Dinko Ferencek (and others)[1][2]

[1]https://indico.cern.ch/event/346575/contribution/2/material/slides/0.pdf

[2]https://indico.cern.ch/event/356329/session/1/contribution/7/material/slides/0.pdf

[1]https://indico.cern.ch/event/346575/contribution/2/material/slides/0.pdf

BTagAnalyzer is used to extract ntuple containing

variables for b- tag training

Current set up is using the CSV not IVF

Studying BTagAnalyzer and TagVarExtractor in order to be modified for c-tag purpose Including IVF on top of CSVOptimized the selections based on charm

quark kinematicsAdding ATLAS variables

Page 4: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

4

Setting Up BTagAnalyzer●Set up by using BTagAnalyzer 'lite' version which including the same IVF as

VariableExtractor with CMSSW_5_3_20

https://github.com/cms-btv-pog/RecoBTag/BTagAnalyzerLite/tree/5_3_X

●Adding selections to distinguish charm jets from b jets

- process.inclusiveVertexFinder.vertexMinDLen2DSig = cms.double(1.25) #2.5 sigma for b tagger. However, lifetime D mesons on average about half of lifetime of B meson -> half of significance- process.inclusiveVertexFinder.vertexMinDLenSig = cms.double(0.25) #0.5 sigma for b tagger. However, lifetime D mesons on average about half of lifetime of B meson -> half of significance- process.inclusiveSecondaryVertexFinderTagInfosAODPFlow.vertexCuts.distSig2dMin = 1.5 #default value 2.0 to release cuts on flight dist. However, lifetime D mesons on average about half of lifetime of B meson -> half of distance

●Adding variables to BTagAnalyzer to match the VariableExtractor including ATLAS variables

• Dataset:/TTJets_MassiveBinDECAY_TuneZ2star_8TeV-madgraph-tauola/Summer12_DR53X-PU_S10_START53_V7A-v1/AODSIM

• Running on the same root file 0244AEA1-7CE1-E111-956B-0025901D4C3C.root for the exact same 100 events (event numbers checked)

Page 5: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

5

WorkflowsBTagAnalyzer (PAT Based) VariableExtractor (CMSSW Based)

selectedPATAK5PFJets with PF2PAT

Hadron-based jet flavour

inclusiveSVFinderTagInfosAODPFlow

IPTagInfosAODPFlow

CombinedSVComputerV2

Ntuple

PF CHS

selectedAK5PFJets

Hadron-based jet flavour

inclusiveSVFinderTagInfos

IPTagInfos

CombinedSVComputerV2

Ntuple

Page 6: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

6

Status of BTagAnalyzer for C-tag• At first, there are several discrepancies between the trees of BTagAnalyzer and VariableExtractor.

• Most of the differences are identified and solved.

• All jet kinematic and SV variables are agreed between the both frameworks.

• More comparisons are in the BackUp.

➢ Changed Track weight in CombinedSVComputerV2➢ Turned off PF2PAT➢ Turned off PF CHS➢ Removed the filter in BtagAnalyzer➢ Used raw jet pT➢ Used only default sorting by sip2dSig➢ Same GT for both VariableExtractor and BTaganalyzer “START53_V27”➢ Raw Jet pT > 30 GeV and |eta|<2.4

● However, The track variables at the first track (“_0”) have good agreements ● The agreements in the shape of the second (“_1”) and the third track (“_2”). There might be some selections different between the two frameworks.

Page 7: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

7

VariableExtractor VS BTagAnalyzer

Page 8: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

8

VariableExtractor VS BTagAnalyzer

Page 9: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

9

Investigating by Printing out Variables● We are also using “cout” into the BtagAnalyzer, CombinedSVComputerV2, and TagVarExtractor.

1. BTagAnalyzer gives the same values as from CombinedSVComputerV2 for each jets.

2. If flightDistance2dVal is not exist in CombinedSVComputerV2,BTagAnalyzer will fill -9999 as set for the default value.

3. The track variables are sorted with trackSip2dsig.

4. In some events, BTagAnalyzer gives more jets than CombinedSVComputerV2. This is due to the Computer will not save the jets with less than 1 track.

● Gerrit provided the “cout” from the VariableExtractor. It was checked. We have the same jets and same track variable values.

● While BtagAnalyzer is using the TagVarExtractor to get the flat tree, VariableExtractor is using the local script to get the flat tree. We suspect that this might be the cause of discrepancies we saw in the second and third track variables.

Page 10: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

10

Conclusions

● All variables are well agreed between BTagAnalyzer and VariableExtractor except the second and third track variables.

● Need to check the local script to get the flat tree for VariableExtractor.

● As of now our priority is to implement the C-tag in CMSSW for Run II, this study will be less piority.

Page 11: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

Back Up

11

Page 12: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

12

VariableExtractor VS BTagAnalyzer

Page 13: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

13

VariableExtractor VS BTagAnalyzer

Page 14: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

14

VariableExtractor VS BTagAnalyzer

Page 15: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

15

VariableExtractor VS BTagAnalyzer

Page 16: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

16

VariableExtractor VS BTagAnalyzer

Page 17: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

17

VariableExtractor VS BTagAnalyzer

Page 18: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

18

VariableExtractor VS BTagAnalyzer

Page 19: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

19

VariableExtractor VS BTagAnalyzer

Page 20: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

20

VariableExtractor VS BTagAnalyzer

Page 21: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

21

VariableExtractor VS BTagAnalyzer

Page 22: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

22

VariableExtractor VS BTagAnalyzer

Page 23: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

23

VariableExtractor VS BTagAnalyzer

Page 24: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

24

VariableExtractor VS BTagAnalyzer

Page 25: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

25

VariableExtractor VS BTagAnalyzer

Page 26: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

26

VariableExtractor VS BTagAnalyzer

Page 27: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

27

VariableExtractor VS BTagAnalyzer

Page 28: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

28

VariableExtractor VS BTagAnalyzer

Page 29: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

29

VariableExtractor VS BTagAnalyzer

Page 30: 1 C-Tagger Development Status Update Kittikul Kovitanggoon* (CU) Gerrit Van Onsem (VUB) Dinko Ferencek (RU) CMS-POG BTAG-WG Meeting June 18, 2015.

30

VariableExtractor VS BTagAnalyzer