Skip to content

DM-53494: Add ability to run submit processes as batch jobs. - #232

Open
MichelleGower wants to merge 4 commits into
mainfrom
tickets/DM-53494
Open

DM-53494: Add ability to run submit processes as batch jobs.#232
MichelleGower wants to merge 4 commits into
mainfrom
tickets/DM-53494

Conversation

@MichelleGower

@MichelleGower MichelleGower commented Feb 20, 2026

Copy link
Copy Markdown
Collaborator

Note: Limited to same cluster with shared filesystems.

Checklist

  • ran Jenkins
  • added a release note for user-visible changes to doc/changes

@codecov

codecov Bot commented Feb 20, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 99.27536% with 6 lines in your changes missing coverage. Please review.
✅ Project coverage is 92.69%. Comparing base (e3e32f3) to head (16b698b).
✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
python/lsst/ctrl/bps/drivers.py 94.28% 2 Missing and 2 partials ⚠️
python/lsst/ctrl/bps/batch_submit.py 99.17% 0 Missing and 1 partial ⚠️
python/lsst/ctrl/bps/pre_transform.py 88.88% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #232      +/-   ##
==========================================
+ Coverage   90.51%   92.69%   +2.18%     
==========================================
  Files          51       53       +2     
  Lines        5627     6351     +724     
  Branches      544      572      +28     
==========================================
+ Hits         5093     5887     +794     
+ Misses        436      365      -71     
- Partials       98       99       +1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

@MichelleGower
MichelleGower force-pushed the tickets/DM-53494 branch 3 times, most recently from 2982c22 to 7261b98 Compare April 22, 2026 00:13
@MichelleGower
MichelleGower force-pushed the tickets/DM-53494 branch 2 times, most recently from 0030b99 to f2a719b Compare June 30, 2026 21:21
@MichelleGower
MichelleGower marked this pull request as ready for review July 29, 2026 21:19
sections with corresponding names similar to ``finalJob``. Currently the
logging-related command-line arguments aren't passed from ``bps batch-submit``
to these jobs. Instead, one can set ``bpsPreCommandOpts``, which has the
same default as the payload job.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unless I missed something, the new command this PR implements (bps batch-submit) appears out of nowhere. Please, either provide more context what this command is or rewrite this paragraph without mentioning it at all. For example.

Currently the logging-related command-line arguments aren't passed to these jobs.

config_file : `str`
Name of the configuration file.
**kwargs : `~typing.Any`
**kwargs : `dict` [`str`, `~typing.Any`]

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of fixing the type specification, I'd remove it entirely. See the example in the LSST Dev Guide.

Parameters
----------
config : `lsst.ctrl.bps.BpsConfig`
Configuration.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Configuration." -> "BPS configuration."?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants