Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
101 commits
Select commit Hold shift + click to select a range
2615b55
ipynb to py for helper files
gsharma99 Dec 22, 2025
bf9ba7e
files for the Neural likelihood training
gsharma99 Dec 22, 2025
0db7fd1
updating script to use the training paraeters from the YAML file
gsharma99 Dec 25, 2025
889f3f4
py script for the Preselection script
gsharma99 Dec 25, 2025
501e912
script for the Systematic uncertanity. Training params are saved in t…
gsharma99 Dec 25, 2025
3847ceb
using YAML instead of a python file for training configration
gsharma99 Dec 25, 2025
c43f16f
bigfix: no indentation required for systematic_uncertainty_training
gsharma99 Dec 25, 2025
af501a3
Merge pull request #36 from gsharma99/hpc_workflow_management
JaySandesara Jan 15, 2026
28dbe79
added a basic DAG workflow structure
JaySandesara Jan 30, 2026
c08a4dc
simple working submit workflow
JaySandesara Jan 30, 2026
1c57989
path bug fix
JaySandesara Jan 30, 2026
b2e6f60
added missin install enviornment command
JaySandesara Jan 30, 2026
8d2d721
added missing transfer files for pip install .
JaySandesara Jan 30, 2026
2d06513
removed dag log files
JaySandesara Jan 30, 2026
958a47e
bug fixes and gitignore log files
JaySandesara Jan 30, 2026
98fd223
adding apptainer image and minor fix
JaySandesara Jan 30, 2026
e43dc48
bug fixes - runs
JaySandesara Jan 30, 2026
92c9fe5
bug fixes
JaySandesara Jan 30, 2026
cb44a88
Merge branch 'main' into HEAD
JaySandesara Jan 30, 2026
b94b7b2
restructuring
JaySandesara Jan 30, 2026
4f890bf
config-based workflow
JaySandesara Jan 31, 2026
d056a9c
added missing condor scripts
JaySandesara Jan 31, 2026
fc925c8
added remaps to output files
JaySandesara Jan 31, 2026
478d694
minor changes
JaySandesara Jan 31, 2026
c25db3f
the grand renaming
JaySandesara Jan 31, 2026
1132430
Update README to remove workflow steps
JaySandesara Jan 31, 2026
73473c6
added a basic density ratio lightning module. Addresses #13
JaySandesara Feb 1, 2026
34e3a75
Merge branch 'hpc_workflow_management' into HEAD
JaySandesara Feb 1, 2026
aa124fb
deleted build_model and replaced with Lightning
JaySandesara Feb 1, 2026
4932fca
added callbacks for plotting loss vs epoch
JaySandesara Feb 1, 2026
66199e6
basic lightning setup for multiclass presel
JaySandesara Feb 1, 2026
8aef2c4
added learning rate scheduler
JaySandesara Feb 1, 2026
9c18a15
minor bug fixes. Almost completely addresses #13
JaySandesara Feb 1, 2026
d2168f6
add config-driven scripts/data_preprocessing script and move feature …
gsharma99 Feb 5, 2026
2596331
add config-driven scripts/parameter_fitting script and move feature d…
gsharma99 Feb 5, 2026
2f19c72
add config-driven scripts/preselection_network script and the config.…
gsharma99 Feb 6, 2026
b432648
add config-driven scripts/nerual_likelihood_ratio_estimation script a…
gsharma99 Feb 6, 2026
324d33c
correction in the config.pipeline.yaml for training params for script…
gsharma99 Feb 6, 2026
aab2c1b
add config-driven scripts/systematic_uncertainty_training script and …
gsharma99 Feb 6, 2026
d58dae1
steps defined in htcondor dag files. Also output dir into the job.sh,…
gsharma99 Feb 6, 2026
61f79e3
bug fixes in PR
JaySandesara Feb 7, 2026
661ecf8
Merge pull request #2 from gsharma99/pr-44
JaySandesara Feb 7, 2026
4476773
added skip step and fixed output issue
JaySandesara Feb 7, 2026
2ce13ae
updates on the preselection network step
JaySandesara Feb 7, 2026
63c8dfe
added torch to pixi
JaySandesara Feb 7, 2026
c0668e6
Merge pull request #3 from gsharma99/pr-44
JaySandesara Feb 7, 2026
347b1a1
updated pixi with lightning
JaySandesara Feb 7, 2026
d8ef70d
fixes and added logger. added single output
JaySandesara Feb 7, 2026
1561f90
bug fixes training
JaySandesara Feb 7, 2026
77df108
loading req part of config.pipeline.yml, not the full config per srip…
gsharma99 Feb 7, 2026
9eb5dd6
changed config.pipeline and data_preprocessing to use flat feature li…
gsharma99 Feb 7, 2026
255024b
added nJets into inpur feature list, issue #12
gsharma99 Feb 7, 2026
ce585ab
updated torch dependencies, added cpu and arm environment support
JaySandesara Feb 8, 2026
6086c59
Merge branch 'feature/config-driven-pipeline' into pr-44
JaySandesara Feb 8, 2026
520aee5
Merge pull request #4 from gsharma99/pr-44
JaySandesara Feb 8, 2026
fad4b80
pixi build that works
JaySandesara Feb 8, 2026
e056d71
fixed log override bug
JaySandesara Feb 8, 2026
76feea2
added log file dirs to gitignore
JaySandesara Feb 8, 2026
137a746
modified datasets save ntuple logic to keep original branches intact
JaySandesara Feb 10, 2026
9427d29
datasets library bug fix - overwrite issue fixed
JaySandesara Feb 10, 2026
1d6cb12
split workflow into stages - prelim
JaySandesara Feb 10, 2026
7b0a659
Merge pull request #5 from gsharma99/pr-44
JaySandesara Feb 11, 2026
3c0162e
minor fixes in datasets and data_preprocessing including feature list
JaySandesara Feb 11, 2026
cf794f4
removed unnecessary helper method
JaySandesara Feb 12, 2026
d9dbeaa
hard-coded temporary fix to overwriting trees
JaySandesara Feb 12, 2026
2a0fad7
added missing methods in datasets library
JaySandesara Feb 12, 2026
7fa30c2
added back missing methods
JaySandesara Feb 13, 2026
969fb29
bug fixes, new naming
JaySandesara Feb 13, 2026
3c4f6a1
minor bug fix
JaySandesara Feb 14, 2026
59c0523
new loss definition
JaySandesara Feb 14, 2026
c3c7a9c
minor fixes
JaySandesara Feb 14, 2026
19694e6
added separate lightning modules in the library
JaySandesara Feb 14, 2026
8c2144d
Merge pull request #6 from gsharma99/pr-44
JaySandesara Feb 14, 2026
e88ad78
minor changes
JaySandesara Feb 15, 2026
045fe99
final big fixes - runs
JaySandesara Feb 15, 2026
898742d
added accuracy metrics
JaySandesara Feb 15, 2026
3716ca8
comments resolved and removed debugs
JaySandesara Feb 15, 2026
67c3d51
Merge pull request #7 from gsharma99/pr-44
JaySandesara Feb 15, 2026
a0b9790
Merge pull request #44 from gsharma99/feature/config-driven-pipeline
JaySandesara Feb 15, 2026
71aa2ed
added missing figure
JaySandesara Feb 15, 2026
a5d7c19
documentation added to training script
JaySandesara Feb 17, 2026
9778721
changed universe to container
JaySandesara Feb 17, 2026
446e5d8
bug fixes in datasets.py
JaySandesara Feb 17, 2026
09546d0
restructuring, and more documented notebooks
JaySandesara Feb 18, 2026
67491c5
data processing and loading notebooks done
JaySandesara Feb 18, 2026
4a02206
added root ntuples
JaySandesara Feb 21, 2026
476e67f
Merge branch 'hpc_workflow_management' of github.com:iris-hep/NSBI-wo…
JaySandesara Feb 21, 2026
7d4fdd5
fixed onnxruntime gpu update in pixi and minor changes
JaySandesara Feb 21, 2026
c46e2da
updated config.pipeline
JaySandesara Feb 21, 2026
34a18b7
minor update
JaySandesara Feb 21, 2026
87adceb
Merge branch 'hpc_workflow_management' of github.com:iris-hep/NSBI-wo…
JaySandesara Feb 21, 2026
4171953
added output training models
JaySandesara Feb 21, 2026
6850890
density ratio training fix
JaySandesara Feb 21, 2026
571d10f
training restructuring and new files submit
JaySandesara Feb 21, 2026
c9f3688
updated models, num_workers, pin memory fixes
JaySandesara Feb 21, 2026
3825679
added preselection model and tracked files
JaySandesara Feb 21, 2026
a9230f3
better trained models
JaySandesara Feb 22, 2026
9594796
removed outdated config
JaySandesara Feb 22, 2026
baa95d7
evaluation script and added systematics outputs
JaySandesara Feb 22, 2026
45fa0eb
updated reference definition and trained models
JaySandesara Feb 22, 2026
a96705e
pixi to run the notebooks training on mac GPU mps
gsharma99 Mar 21, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -1,2 +1,9 @@
# SCM syntax highlighting & preventing 3-way merges
pixi.lock merge=binary linguist-language=YAML linguist-generated=true
FAIR_universe_Higgs_tautau/saved_datasets/dataset_*.root filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.png filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.data filter=lfs diff=lfs merge=lfs -text
11 changes: 11 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -189,9 +189,20 @@ cython_debug/

# Ignore cached_data directory
cached_data/
saved_datasets/

# Ignore library version files
src/nsbi_common_utils/_version.py
# pixi environments
.pixi/*
!.pixi/config.toml

*.dag.*

apptainer-build.sub

logs/*

lightning_logs/

data/
Loading