Fix the python configuration for the TICLDumper #47576

AuroraPerego · 2025-03-12T15:54:34Z

PR description:

When using the TICLDumper with the ticl_v5 process modifier, the wrong collection of trackster was used. This PR fixes this.
In addition, workflows that run also the dumper have been added.

PR validation:

dumped and ran the new workflows with runTheMatrix.py -w upgrade -l 29688.206,29688.207

FYI @felicepantaleo @waredjeb @Moanwar

cmsbuild · 2025-03-12T15:55:03Z

cms-bot internal usage

cmsbuild · 2025-03-12T15:57:17Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47576/44061

There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): CA Extension to strips #47090, add vertex trimming to the phase2 hlt tracking iterations #47113, Custom Phase-2 L1 Trigger NanoAOD #47178, Updates for runTheMatrix.py: input checks, GPUs repartition, input recycling #47377, MTD geometry: update ETL geometry to most recent drawings (scenarios v9 and v10) #47535

cmsbuild · 2025-03-12T15:57:42Z

A new Pull Request was created by @AuroraPerego for master.

It involves the following packages:

Configuration/PyReleaseValidation (pdmv, upgrade)
RecoHGCal/TICL (upgrade, reconstruction)

@AdrianoDee, @Moanwar, @cmsbuild, @DickyChant, @jfernan2, @mandrenguyen, @miquork, @srimanob, @subirsarkar can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @apsallid, @denizsun, @fabiocos, @felicepantaleo, @forthommel, @hatakeyamak, @lecriste, @makortel, @missirol, @rovere, @salimcerci, @sameasy, @slomeo, @sobhatta, @youyingli this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

jfernan2 · 2025-03-13T11:47:29Z

test parameters:

workflows = 29688.206,29688.207

jfernan2 · 2025-03-13T11:49:24Z

please test

cmsbuild · 2025-03-13T13:06:36Z

-1

Failed Tests: RelVals
Size: This PR adds an extra 40KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-072cc1/44961/summary.html
COMMIT: 15aa40e
CMSSW: CMSSW_15_1_X_2025-03-12-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47576/44961/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

ValueError: Undefined workflows: 29688.206, 29688.207

AdrianoDee · 2025-03-13T13:10:09Z

test parameters:

workflows = 29688.206,29688.207
relvals_opt = -w upgrade

AdrianoDee · 2025-03-13T13:10:15Z

please test

cmsbuild · 2025-03-13T15:08:29Z

-1

Failed Tests: RelVals RelVals-INPUT AddOn
Size: This PR adds an extra 40KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-072cc1/44963/summary.html
COMMIT: 15aa40e
CMSSW: CMSSW_15_1_X_2025-03-12-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47576/44963/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

RelVals

10224.0

----- Begin Fatal Exception 13-Mar-2025 14:44:26 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/1888d3ef-3019-4e81-bf79-7e50c5657e64.root?tried=+1213xrootd-redic.pi.infn.it&xrdcl.requuid=abe712ca-e6d9-47a5-8af8-446582c640e6
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

4.53

----- Begin Fatal Exception 13-Mar-2025 14:34:35 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/data/Run2012B/SinglePhoton/RAW/v1/000/194/533/1084D9DA-AEA2-E111-B3AB-001D09F24DA8.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/data/Run2012B/SinglePhoton/RAW/v1/000/194/533/1084D9DA-AEA2-E111-B3AB-001D09F24DA8.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/data/Run2012B/SinglePhoton/RAW/v1/000/194/533/1084D9DA-AEA2-E111-B3AB-001D09F24DA8.root
      [c] Input file root://xrootd-cms.infn.it//store/data/Run2012B/SinglePhoton/RAW/v1/000/194/533/1084D9DA-AEA2-E111-B3AB-001D09F24DA8.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/data/Run2012B/SinglePhoton/RAW/v1/000/194/533/1084D9DA-AEA2-E111-B3AB-001D09F24DA8.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/data/Run2012B/SinglePhoton/RAW/v1/000/194/533/1084D9DA-AEA2-E111-B3AB-001D09F24DA8.root?tried=+1213xrootd-redic.pi.infn.it&xrdcl.requuid=49cfa34e-aef3-4f77-94ba-283eccb47a29
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

312.0

----- Begin Fatal Exception 13-Mar-2025 14:39:23 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_12_5_1/RelValHydjetQ_B12_5020GeV_2021_ppReco/GEN-SIM/125X_mcRun3_2022_realistic_HI_v5-v1/2580000/edc7e74b-7952-4792-80c6-7c4adffc9a26.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_12_5_1/RelValHydjetQ_B12_5020GeV_2021_ppReco/GEN-SIM/125X_mcRun3_2022_realistic_HI_v5-v1/2580000/edc7e74b-7952-4792-80c6-7c4adffc9a26.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_12_5_1/RelValHydjetQ_B12_5020GeV_2021_ppReco/GEN-SIM/125X_mcRun3_2022_realistic_HI_v5-v1/2580000/edc7e74b-7952-4792-80c6-7c4adffc9a26.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_12_5_1/RelValHydjetQ_B12_5020GeV_2021_ppReco/GEN-SIM/125X_mcRun3_2022_realistic_HI_v5-v1/2580000/edc7e74b-7952-4792-80c6-7c4adffc9a26.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_12_5_1/RelValHydjetQ_B12_5020GeV_2021_ppReco/GEN-SIM/125X_mcRun3_2022_realistic_HI_v5-v1/2580000/edc7e74b-7952-4792-80c6-7c4adffc9a26.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_12_5_1/RelValHydjetQ_B12_5020GeV_2021_ppReco/GEN-SIM/125X_mcRun3_2022_realistic_HI_v5-v1/2580000/edc7e74b-7952-4792-80c6-7c4adffc9a26.root?tried=+1213llrxrd-redir.in2p3.fr&xrdcl.requuid=ee2e5c61-859e-4cfc-9648-a3c489618f8c
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

RelVals-INPUT

136.74136.74_RunMET2016C/step2_RunMET2016C.log
134.91134.91_RunSingleMu2015D/step2_RunSingleMu2015D.log
4.174.17_RunMinBias2011A/step2_RunMinBias2011A.log

Expand to see more relval errors ...

AddOn Tests

read312RV

----- Begin Fatal Exception 13-Mar-2025 14:35:42 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/data/Run2010A/MinimumBias/RAW/v1/000/137/289/B419A444-BD73-DF11-A22C-0030487CD812.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/data/Run2010A/MinimumBias/RAW/v1/000/137/289/B419A444-BD73-DF11-A22C-0030487CD812.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/data/Run2010A/MinimumBias/RAW/v1/000/137/289/B419A444-BD73-DF11-A22C-0030487CD812.root
      [c] Input file root://xrootd-cms.infn.it//store/data/Run2010A/MinimumBias/RAW/v1/000/137/289/B419A444-BD73-DF11-A22C-0030487CD812.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/data/Run2010A/MinimumBias/RAW/v1/000/137/289/B419A444-BD73-DF11-A22C-0030487CD812.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/data/Run2010A/MinimumBias/RAW/v1/000/137/289/B419A444-BD73-DF11-A22C-0030487CD812.root?tried=+1213xrootd-redic.pi.infn.it&xrdcl.requuid=889ae670-2ffc-4198-90d8-0f90844f5a5c
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

pat1

----- Begin Fatal Exception 13-Mar-2025 14:35:57 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_9_2_2/RelValProdTTbar_13/AODSIM/91X_mcRun2_asymptotic_v3-v1/10000/EEB99F74-DA4D-E711-A41C-0025905A48F2.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_9_2_2/RelValProdTTbar_13/AODSIM/91X_mcRun2_asymptotic_v3-v1/10000/EEB99F74-DA4D-E711-A41C-0025905A48F2.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_9_2_2/RelValProdTTbar_13/AODSIM/91X_mcRun2_asymptotic_v3-v1/10000/EEB99F74-DA4D-E711-A41C-0025905A48F2.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_9_2_2/RelValProdTTbar_13/AODSIM/91X_mcRun2_asymptotic_v3-v1/10000/EEB99F74-DA4D-E711-A41C-0025905A48F2.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_9_2_2/RelValProdTTbar_13/AODSIM/91X_mcRun2_asymptotic_v3-v1/10000/EEB99F74-DA4D-E711-A41C-0025905A48F2.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_9_2_2/RelValProdTTbar_13/AODSIM/91X_mcRun2_asymptotic_v3-v1/10000/EEB99F74-DA4D-E711-A41C-0025905A48F2.root?tried=+1213xrootd-cms-redir-int.cr.cnaf.infn.it&xrdcl.requuid=75bd95f3-2b53-46ce-99fb-0f4414a741bb
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

hlt_data_Fake

----- Begin Fatal Exception 13-Mar-2025 14:35:00 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root
      [c] Input file root://xrootd-cms.infn.it//store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root?tried=+1213llrxrd-redir.in2p3.fr&xrdcl.requuid=3e274cbf-60be-4888-ab2f-45129504969b
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

AuroraPerego added 2 commits March 12, 2025 16:35

fix trackstersInCand for TICLv5 dumper

ed01b30

add wfs that run the dumper

15aa40e

cmsbuild added this to the CMSSW_15_1_X milestone Mar 12, 2025

cmsbuild added reconstruction-pending pending-signatures tests-pending orp-pending pdmv-pending upgrade-pending code-checks-pending labels Mar 12, 2025

cmsbuild added code-checks-approved and removed code-checks-pending labels Mar 12, 2025

cmsbuild added tests-started and removed tests-pending labels Mar 13, 2025

cmsbuild added tests-rejected and removed tests-started labels Mar 13, 2025

cmsbuild added tests-started and removed tests-rejected labels Mar 13, 2025

cmsbuild added tests-rejected and removed tests-started labels Mar 13, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix the python configuration for the TICLDumper #47576

Fix the python configuration for the TICLDumper #47576

AuroraPerego commented Mar 12, 2025 •

edited

Loading

cmsbuild commented Mar 12, 2025 •

edited

Loading

cmsbuild commented Mar 12, 2025

cmsbuild commented Mar 12, 2025

jfernan2 commented Mar 13, 2025

jfernan2 commented Mar 13, 2025

cmsbuild commented Mar 13, 2025

AdrianoDee commented Mar 13, 2025

AdrianoDee commented Mar 13, 2025

cmsbuild commented Mar 13, 2025

Fix the python configuration for the TICLDumper #47576

Are you sure you want to change the base?

Fix the python configuration for the TICLDumper #47576

Conversation

AuroraPerego commented Mar 12, 2025 • edited Loading

PR description:

PR validation:

cmsbuild commented Mar 12, 2025 • edited Loading

cmsbuild commented Mar 12, 2025

cmsbuild commented Mar 12, 2025

jfernan2 commented Mar 13, 2025

jfernan2 commented Mar 13, 2025

cmsbuild commented Mar 13, 2025

RelVals

AdrianoDee commented Mar 13, 2025

AdrianoDee commented Mar 13, 2025

cmsbuild commented Mar 13, 2025

RelVals

RelVals-INPUT

AddOn Tests

AuroraPerego commented Mar 12, 2025 •

edited

Loading

cmsbuild commented Mar 12, 2025 •

edited

Loading