Add dependency on CLUEstering #9604

sbaldu · 2025-01-09T09:39:59Z

This PR adds the CLUEstering library as an external dependency.

cmsbuild · 2025-01-09T09:40:20Z

A new Pull Request was created by @sbaldu for branch IB/CMSSW_15_0_X/master.

@cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2025-01-09T09:40:21Z

cms-bot internal usage

cmsbuild · 2025-01-13T10:38:56Z

Pull request #9604 was updated.

cmsbuild · 2025-01-15T07:57:34Z

Pull request #9604 was updated.

smuzaffar · 2025-01-16T07:34:52Z

@sbaldu , this is a new external, can you please open a github issue at https://github.com/cms-sw/cmssw/issues with details e.g. why it is needed and where it will be used?

Note that we already have CLUE as externals ... is CLUEsteing has any deps on CLUE ?

For new externals you also need to provide

tool definition file e.g. for this we will need scram-tools.file/tools/CLUEstering/CLUEstering.xml
Add CLUEstering dependency in https://github.com/cms-sw/cmsdist/blob/IB/CMSSW_15_0_X/master/cmssw-tools.spec

sbaldu · 2025-01-16T09:21:06Z

I opened issue #9618.

cmsbuild · 2025-01-16T09:21:47Z

Pull request #9604 was updated.

smuzaffar · 2025-02-17T13:42:27Z

please test

cmsbuild · 2025-02-17T13:46:18Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eb02ef/44424/summary.html
COMMIT: a518239
CMSSW: CMSSW_15_1_X_2025-02-17-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9604/44424/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

smuzaffar · 2025-02-17T13:50:17Z

please test

cmsbuild · 2025-02-17T13:50:26Z

Pull request #9604 was updated.

cmsbuild · 2025-02-17T13:55:29Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eb02ef/44425/summary.html
COMMIT: 6b88f9e
CMSSW: CMSSW_15_1_X_2025-02-17-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9604/44425/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

cmsbuild · 2025-10-01T14:40:04Z

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eb02ef/48397/summary.html
COMMIT: 6cb6713
CMSSW: CMSSW_16_0_X_2025-10-01-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9604/48397/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

2024.0070001DAS Error
2024.0060001DAS Error
2024.0050001DAS Error

smuzaffar · 2025-10-08T07:07:01Z

please test

cmsbuild · 2025-10-08T07:07:02Z

Pull request #9604 was updated.

smuzaffar · 2025-10-08T07:07:50Z

unhold

cmsbuild · 2025-10-08T08:45:21Z

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eb02ef/48532/summary.html
COMMIT: ed1f1d2
CMSSW: CMSSW_16_0_X_2025-10-07-2300/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9604/48532/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

10224.0

----- Begin Fatal Exception 08-Oct-2025 10:23:22 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 1 stream: 0
   [1] Running path 'prevalidation_step'
   [2] Calling method for module MixingModule/'mix'
   [3] Calling RootInputFileSequence::initTheFile()
   [4] Calling StorageFactory::open()
   [5] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/10b42b56-9e4e-408e-98c2-f378b07201db.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/10b42b56-9e4e-408e-98c2-f378b07201db.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/10b42b56-9e4e-408e-98c2-f378b07201db.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/10b42b56-9e4e-408e-98c2-f378b07201db.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/10b42b56-9e4e-408e-98c2-f378b07201db.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_12_0_0_pre4/RelValMinBias_13/GEN-SIM/113X_mc2017_realistic_v5-v1/00000/10b42b56-9e4e-408e-98c2-f378b07201db.root?tried=+1213llrxrd-redir.in2p3.fr&xrdcl.requuid=903150bd-d58b-46b6-9427-690ebb12a933
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

14234.0

----- Begin Fatal Exception 08-Oct-2025 10:06:44 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/0bb7340f-b7e5-47fb-9fcc-8444cd727ca3.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/0bb7340f-b7e5-47fb-9fcc-8444cd727ca3.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/0bb7340f-b7e5-47fb-9fcc-8444cd727ca3.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/0bb7340f-b7e5-47fb-9fcc-8444cd727ca3.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/0bb7340f-b7e5-47fb-9fcc-8444cd727ca3.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_13_0_11/RelValMinBias_14TeV/GEN-SIM-RECO/130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v1/2580000/0bb7340f-b7e5-47fb-9fcc-8444cd727ca3.root?tried=+1213xrootd-cms-redir-int.cr.cnaf.infn.it&xrdcl.requuid=1ef9aba0-8870-497b-9395-c3d1d1ee7658
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

13034.0

----- Begin Fatal Exception 08-Oct-2025 10:07:24 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/relval/CMSSW_14_1_0_pre7/RelValMinBias_14TeV/GEN-SIM/140X_mcRun3_2024_realistic_v21_STD_RegeneratedGS_2024_noPU-v1/2580000/3085925f-924c-4066-9d2c-488075092714.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/relval/CMSSW_14_1_0_pre7/RelValMinBias_14TeV/GEN-SIM/140X_mcRun3_2024_realistic_v21_STD_RegeneratedGS_2024_noPU-v1/2580000/3085925f-924c-4066-9d2c-488075092714.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_14_1_0_pre7/RelValMinBias_14TeV/GEN-SIM/140X_mcRun3_2024_realistic_v21_STD_RegeneratedGS_2024_noPU-v1/2580000/3085925f-924c-4066-9d2c-488075092714.root
      [c] Input file root://xrootd-cms.infn.it//store/relval/CMSSW_14_1_0_pre7/RelValMinBias_14TeV/GEN-SIM/140X_mcRun3_2024_realistic_v21_STD_RegeneratedGS_2024_noPU-v1/2580000/3085925f-924c-4066-9d2c-488075092714.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/relval/CMSSW_14_1_0_pre7/RelValMinBias_14TeV/GEN-SIM/140X_mcRun3_2024_realistic_v21_STD_RegeneratedGS_2024_noPU-v1/2580000/3085925f-924c-4066-9d2c-488075092714.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/relval/CMSSW_14_1_0_pre7/RelValMinBias_14TeV/GEN-SIM/140X_mcRun3_2024_realistic_v21_STD_RegeneratedGS_2024_noPU-v1/2580000/3085925f-924c-4066-9d2c-488075092714.root?tried=+1213xrootd-redic.pi.infn.it&xrdcl.requuid=e02b9f60-7010-4d5e-ba87-b9a5c9717254
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

fwyzard · 2025-10-09T14:26:03Z

please test

cmsbuild · 2025-10-09T16:38:49Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-eb02ef/48573/summary.html
COMMIT: ed1f1d2
CMSSW: CMSSW_16_0_X_2025-10-09-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9604/48573/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 16 lines to the logs
Reco comparison results: 10 differences found in the comparisons
DQMHistoTests: Total files compared: 51
DQMHistoTests: Total histograms compared: 3940073
DQMHistoTests: Total failures: 466
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3939587
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 50 files compared)
Checked 218 log files, 188 edm output root files, 51 DQM output files
TriggerResults: no differences found

smuzaffar · 2025-10-13T13:25:44Z

+externals

cmsbuild · 2025-10-13T13:26:06Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_16_0_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @mandrenguyen, @ftenchini (and backports should be raised in the release meeting by the corresponding L2)

Add dependency on CLUEstering

7cb2e1e

cmsbuild added tests-pending externals-pending pending-signatures orp-pending labels Jan 9, 2025

Update to version 2.3.3

23402c5

Update to 2.4.0

8651e2f

sbaldu added 3 commits January 16, 2025 08:58

Specify CLUEstering as dep for linux platforms

978fb14

Add tool definition file for CLUEstering

4fe6803

Update to version 2.4.0.1

a518239

smuzaffar changed the base branch from IB/CMSSW_15_0_X/master to IB/CMSSW_15_1_X/master February 7, 2025 08:45

cmsbuild added tests-started and removed tests-pending labels Feb 17, 2025

cmsbuild added tests-rejected and removed tests-started labels Feb 17, 2025

Rename cluestering.spec to CLUEstering.spec

6b88f9e

cmsbuild added tests-started and removed tests-rejected labels Feb 17, 2025

cmsbuild added tests-started and removed tests-pending labels Oct 1, 2025

cmsbuild added tests-rejected and removed tests-started labels Oct 1, 2025

removed wrong cluestering.spec; improved CLUEstering.xml

ed1f1d2

cmsbuild added tests-pending and removed tests-rejected labels Oct 8, 2025

cmsbuild added tests-started and removed tests-pending labels Oct 8, 2025

cmsbuild removed the hold label Oct 8, 2025

cmsbuild added tests-rejected and removed tests-started labels Oct 8, 2025

cmsbuild added tests-started and removed tests-rejected labels Oct 9, 2025

cmsbuild added tests-approved and removed tests-started labels Oct 9, 2025

smuzaffar merged commit fcaf802 into cms-sw:IB/CMSSW_16_0_X/master Oct 13, 2025
8 checks passed

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Oct 13, 2025

Add dependency on CLUEstering #9604

Add dependency on CLUEstering #9604

Uh oh!

Conversation

sbaldu commented Jan 9, 2025

Uh oh!

cmsbuild commented Jan 9, 2025

Uh oh!

cmsbuild commented Jan 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Jan 13, 2025

Uh oh!

cmsbuild commented Jan 15, 2025

Uh oh!

smuzaffar commented Jan 16, 2025

Uh oh!

sbaldu commented Jan 16, 2025

Uh oh!

cmsbuild commented Jan 16, 2025

Uh oh!

smuzaffar commented Feb 17, 2025

Uh oh!

cmsbuild commented Feb 17, 2025

External Build

Uh oh!

smuzaffar commented Feb 17, 2025

Uh oh!

cmsbuild commented Feb 17, 2025

Uh oh!

cmsbuild commented Feb 17, 2025

External Build

Uh oh!

cmsbuild commented Oct 1, 2025

RelVals

Uh oh!

smuzaffar commented Oct 8, 2025

Uh oh!

cmsbuild commented Oct 8, 2025

Uh oh!

smuzaffar commented Oct 8, 2025

Uh oh!

cmsbuild commented Oct 8, 2025

RelVals

Uh oh!

fwyzard commented Oct 9, 2025

Uh oh!

cmsbuild commented Oct 9, 2025

Comparison Summary

Uh oh!

smuzaffar commented Oct 13, 2025

Uh oh!

Uh oh!

cmsbuild commented Oct 13, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

cmsbuild commented Jan 9, 2025 •

edited

Loading