Developer Release Notes - version 25.04

This is a developer facing release info - list of all merge requests related to this release for the projects relevant for the platform. See user facing changelog here

Development

Galaxy Tools, v25.04.0

• Fix image path for topaz tool (thanks to Sergey Yakubov). Merge Request 268
• Bump topaz data reduction version (thanks to Sergey Yakubov). Merge Request 266
• Update topaz gui (thanks to John Duggan). Merge Request 261
• Update ingress help (thanks to Gregory Cage). Merge Request 260
• Update biosans gui (thanks to John Duggan). Merge Request 258
• Update sunny. add kernel using packagecompiler (thanks to Andrew Ayres). Merge Request 257
• Sunny v0.3.0 (thanks to Andrew Ayres). Merge Request 256
• Update ct & biosans gui versions (thanks to John Duggan). Merge Request 254
• Update autoingress tool to use kafka (thanks to Sergey Yakubov). Merge Request 255
• Update interactive_tools.py (thanks to Andrew Ayres). Merge Request 253
• Update topaz gui & jana2020 images (thanks to John Duggan). Merge Request 250
• Bump sunny container version (thanks to Andrew Ayres). Merge Request 251
• Fix jana launch for topaz gui (thanks to John Duggan). Merge Request 248
• Update topaz gui tool.xml to match latest prototype content (thanks to John Duggan). Merge Request 246
• Link downloads directory for isodistort (thanks to John Duggan). Merge Request 245
• Make the linked directory in jana match the original dirname (thanks to John Duggan). Merge Request 244
• Update asrp tools (thanks to Sergey Yakubov). Merge Request 243
• Updated imaginex peak finding test data (thanks to Sergey Yakubov). Merge Request 242
• Removes format input for imaginex peak finding tool (thanks to Marshall McDonnell). Merge Request 241
• Switches asrp powder diffraction tools to ornl harbor images (thanks to Marshall McDonnell). Merge Request 239
• Swaps imagine-x tools to ornl harbor images (thanks to Marshall McDonnell). Merge Request 240
• Remove jana2020 workflow inputs/outputs (thanks to John Duggan). Merge Request 236
• Adjust cp2k tool for nersc (thanks to Sergey Yakubov). Merge Request 237
• Create test using new high level package (thanks to Andrew Ayres). Merge Request 232
• Update sans reduction tool configs (thanks to John Duggan). Merge Request 235
• Gravitas: sunny.jl tool v0.1.0 (thanks to Andrew Ayres). Merge Request 233
• Allow no tests for main branch (thanks to Sergey Yakubov). Merge Request 231
• Fix tool tests (thanks to Sergey Yakubov). Merge Request 229
• Bump topaz reduction gui to 0.13.2 (thanks to John Duggan). Merge Request 228
• Add biosans reduction tool (thanks to John Duggan). Merge Request 227
• Bump topaz gui version (thanks to John Duggan). Merge Request 225
• Test ct scan visualizer (thanks to John Duggan). Merge Request 222
• Make input dataset optional (thanks to Andrew Ayres). Merge Request 223
• Fix trame loading screen error (thanks to John Duggan). Merge Request 219
• Update sammy to use data for output format. (thanks to Gregory Watson). Merge Request 220
• Deploy sammy (thanks to Gregory Watson). Merge Request 218
• Change input file type for neutrons_mcu_sample_simulator (thanks to Sergey Yakubov). Merge Request 216
• Aadd drtsans notebook (thanks to Sergey Yakubov). Merge Request 215
• Move our images to savannah repo (thanks to Sergey Yakubov). Merge Request 214
• Update tools files (thanks to Sergey Yakubov). Merge Request 212
• Retire tools (thanks to Sergey Yakubov). Merge Request 211
• Retire qclimax and reduce120 tools (thanks to Sergey Yakubov). Merge Request 210
• Add tool owners (thanks to Sergey Yakubov). Merge Request 208
• Update sans gui version (thanks to Sergey Yakubov). Merge Request 206
• Move sans/topaz guis to harbor (thanks to John Duggan). Merge Request 204

Galaxy, v24.2.dev0.ornl

• Update to 24.2 (thanks to Sergey Yakubov). Merge Request 113
• Fix objectstore (thanks to Sergey Yakubov). Merge Request 112
• Fix twine (thanks to Sergey Yakubov). Merge Request 111
• Fix conflicts with upstream galaxy (thanks to Sergey Yakubov). Merge Request 109
• Sync with dev (thanks to Sergey Yakubov). Merge Request 108
• Bump galaxy version (thanks to Sergey Yakubov). Merge Request 107
• Only send kill signal when stopping jobs instead of using states (thanks to Gregory Cage). Merge Request 106
• Ensure stdout/stderr from pulsar is not processed as none (thanks to Sergey Yakubov). Merge Request 104
• Remove build button for colletion upload dialog (thanks to Gregory Cage). Merge Request 103
• Implement cancel button instead of pause. (thanks to Gregory Cage). Merge Request 102
• Add option to disable batch mode for all tools (thanks to Gregory Cage). Merge Request 101
• Change hint for multiple datasets to be clear that single input is allowed (thanks to Gregory Cage). Merge Request 100
• Disable batch and collection form inputs for repated input forms (thanks to Gregory Cage). Merge Request 97
• Sync with dev to apply security changes (thanks to Sergey Yakubov). Merge Request 99
• Apply html escape for main mako template (thanks to Sergey Yakubov). Merge Request 98

Pulsar, 0.15.7.dev0.ornl

• Update to 0.15.7 (thanks to Sergey Yakubov). Merge Request 54
• Update galaxy dependencies (thanks to Sergey Yakubov). Merge Request 53
• Do not attempt to complete pre- or post-process if jobs are cancelled in (thanks to Sergey Yakubov). Merge Request 52
• Handle soft_kill in http client (thanks to Gregory Cage). Merge Request 51
• Update to work with nersc (thanks to Sergey Yakubov). Merge Request 50

Remote Data Broker, v0.5.1

• Add documentation (thanks to Sergey Yakubov). Merge Request 14

OIDC PAM module, v0.4.0

• Update ci to push to harbor (thanks to Gregory Cage). Merge Request 11

Deployment

Calvera, v25.04.0

• Dynamic resource orchestration (thanks to Sergey Yakubov). Merge Request 333
• Deploy nova-dashboard 0.8.0 (thanks to John Duggan). Merge Request 331
• Fix rucio task for cleanupdb script (thanks to Sergey Yakubov). Merge Request 330
• Deploy nova-dashboard 0.7.1 (thanks to John Duggan). Merge Request 329
• Bump versions (thanks to Sergey Yakubov). Merge Request 328
• Create a tools.json file for prototype tools (thanks to John Duggan). Merge Request 326
• Use galaxy 24.2 (thanks to Sergey Yakubov). Merge Request 327
• Move sasview to cpu1 temporarily (thanks to Andrew Ayres). Merge Request 325
• Add mailto to metrics push cron job (thanks to Sergey Yakubov). Merge Request 323
• Set rucio-clients version to 33.6.0 (thanks to Sergey Yakubov). Merge Request 321
• Configure documentation server deployment and monitoring (thanks to Sergey Yakubov). Merge Request 319
• Update oidc utils package for pulsars (thanks to Sergey Yakubov). Merge Request 317
• Fix node exporter (thanks to Sergey Yakubov). Merge Request 315
• Fix node exporter (thanks to Sergey Yakubov). Merge Request 313
• Add rucio deployment to ci/cd (thanks to Sergey Yakubov). Merge Request 311
• Deploy nova-dashboard 0.6.1 (thanks to John Duggan). Merge Request 309
• Point calvera deployment to proper ssh key (thanks to John Duggan). Merge Request 308
• Improve cleanup (thanks to Sergey Yakubov). Merge Request 305
• Deploy biosans gui to calvera.ornl.gov and nova.ornl.gov (thanks to John Duggan). Merge Request 303
• Restart galaxy on prototype tools update (thanks to Sergey Yakubov). Merge Request 302
• Update prometheus-sources.yaml for webmon-test to use https (thanks to Sergey Yakubov). Merge Request 301
• Move ingress proxy to another machine, configure kafka (thanks to Sergey Yakubov). Merge Request 300
• Add gpfs mount to sns pulsar config (thanks to John Duggan). Merge Request 299
• Remove amira from nova.ornl.gov (thanks to John Duggan). Merge Request 298
• Automatically populate prototype section (thanks to Sergey Yakubov). Merge Request 295
• Bump galaxy version for production (thanks to Sergey Yakubov). Merge Request 296
• Add rucio config to nersc's pulsar (thanks to Sergey Yakubov). Merge Request 293
• Update dashboard to 0.5.1 (thanks to John Duggan). Merge Request 291
• Switch nesrc to rmq (thanks to Sergey Yakubov). Merge Request 290
• Move topaz gui out of prototype branch (thanks to John Duggan). Merge Request 288
• Add metrics monitoring for webmon prod (thanks to Sergey Yakubov). Merge Request 287
• Added new imagine-x tools (thanks to Andrew Ayres). Merge Request 286
• Adding gravitas wgl makie (thanks to Andrew Ayres). Merge Request 285
• Move jana2020 to sns node (thanks to John Duggan). Merge Request 280
• Add neutrons_remote_command destination to calvera (thanks to Sergey Yakubov). Merge Request 283
• Add nersc config for ndip (thanks to Sergey Yakubov). Merge Request 281
• Update nova-dashboard to 0.5.0 (thanks to John Duggan). Merge Request 279
• Remove decommissioned webreflectivity from prometheus-sources.yaml (thanks to Sergey Yakubov). Merge Request 278
• Move gpsans gui to pulsar node with oncat secrets (thanks to John Duggan). Merge Request 277
• Add tutorial to nova nginx (thanks to Andrew Ayres). Merge Request 276
• Update nova-dashboard to 0.4.0 (thanks to John Duggan). Merge Request 274
• Move topaz gui to prototype branch (thanks to John Duggan). Merge Request 275
• Move topaz gui onto pulsar node with analysis cluster write access (thanks to John Duggan). Merge Request 273
• Move gravitas sunny off prototype branch (thanks to Andrew Ayres). Merge Request 271
• Update azure client secret for dashboard (thanks to John Duggan). Merge Request 269
• Add oncat secrets for calvera (thanks to Sergey Yakubov). Merge Request 268
• Bump dashboard version (thanks to John Duggan). Merge Request 266
• Add job walltime limit of 5 days for all jobs (thanks to Sergey Yakubov). Merge Request 265
• Add alerts for tools tests (thanks to Sergey Yakubov). Merge Request 264
• Correctly trigger nova dashboard restart on config change (thanks to Sergey Yakubov). Merge Request 263
• Add biosans tool source (thanks to John Duggan). Merge Request 262
• Add a prototype tool to calvera-test and dashboard (thanks to Sergey Yakubov). Merge Request 261
• Adds imagine-x tools (thanks to Andrew Ayres). Merge Request 260
• Adds gravitas visualization tool to calvera-test (thanks to Andrew Ayres). Merge Request 258
• Adds subhkl tools (thanks to Andrew Ayres). Merge Request 254
• Split production/test for nova tools.json (thanks to John Duggan). Merge Request 257
• Add metadata to allow querying tools from nova dashboard (thanks to John Duggan). Merge Request 256
• Bump nova-dashboard version (thanks to John Duggan). Merge Request 255
• Add ct scan visualizer tool to calvera-test (thanks to John Duggan). Merge Request 253
• Bump nova-dashboard image version (thanks to John Duggan). Merge Request 251
• Monitor docker (thanks to Sergey Yakubov). Merge Request 250
• Add monitoring of webmon test servers to prometheus config (thanks to Sergey Yakubov). Merge Request 249
• Update tool_conf.xml.j2 for sammy deployment (thanks to Gregory Watson). Merge Request 248
• Update xcams credentials and redirect path (thanks to Sergey Yakubov). Merge Request 246
• Fix nova and nova-test environments for new redirect url patterns (thanks to John Duggan). Merge Request 244
• Add nova deployment (thanks to Sergey Yakubov). Merge Request 243
• Add drtsans notebook tool (thanks to Sergey Yakubov). Merge Request 242
• Update certs (thanks to Sergey Yakubov). Merge Request 241
• Fix indention (thanks to Andrew Ayres). Merge Request 240
• Moving amira to gpu (thanks to Andrew Ayres). Merge Request 237
• Switch image repo to savannah (thanks to Sergey Yakubov). Merge Request 239
• Add sammy tool config (thanks to Sergey Yakubov). Merge Request 238
• Rename oncat tool (thanks to Sergey Yakubov). Merge Request 235
• Deploy pulsar on a new vm (thanks to Sergey Yakubov). Merge Request 234
• Remove qclimax and reduce120 tools (thanks to Sergey Yakubov). Merge Request 232
• Add cron jobs to clean up disks (thanks to Sergey Yakubov). Merge Request 231
• Add daily cleanup job (thanks to Sergey Yakubov). Merge Request 230
• Hide the upload file tool in tool panel (thanks to Sergey Yakubov). Merge Request 229
• Set disable_batch_input to true in galaxy config (thanks to Sergey Yakubov). Merge Request 228
• Bump galaxy version form calvera (thanks to Sergey Yakubov). Merge Request 227
• Bump galaxy version for calvera (thanks to Sergey Yakubov). Merge Request 226
• Fix typo in power diffraction name (thanks to Sergey Yakubov). Merge Request 225
• Fix typo in powder diffraction name (thanks to Sergey Yakubov). Merge Request 224
• Bump platform version (thanks to Sergey Yakubov). Merge Request 223
• Sync with dev to address security vulnerabilities (thanks to Sergey Yakubov). Merge Request 222
• Update nginx settings to fix security vulnerabilities (thanks to Sergey Yakubov). Merge Request 221
• Switch rabbitmq to use ssl/tls (thanks to Sergey Yakubov). Merge Request 220
• Fix ansible playbook (thanks to Sergey Yakubov). Merge Request 219
• Add another mlsans tool (thanks to Sergey Yakubov). Merge Request 218
• Fix directory mode (thanks to Sergey Yakubov). Merge Request 217
• Create symlinks for certificates (thanks to Sergey Yakubov). Merge Request 216
• Add two mlsans dev tools (thanks to Sergey Yakubov). Merge Request 215
• Add tool branch check (thanks to Sergey Yakubov). Merge Request 214
• Update deployment instructions (thanks to Sergey Yakubov). Merge Request 213
• Cleanup prometheus stuff (thanks to Sergey Yakubov). Merge Request 212
• Monitor new rabbitmqs on calvera and calvera-test (thanks to Sergey Yakubov). Merge Request 211

info

see previous changelog here