higgs_dna.submission package
Submodules
higgs_dna.submission.lxplus module
- class higgs_dna.submission.lxplus.LXPlusVanillaSubmitter(analysis_name, analysis_dict, original_analysis_path, sample_dict, args_string, queue='longlunch', memory='10GB', files_per_job=1, cluster_per_sample=True, max_materialize=None, dump_dir=None, stage_output=False)[source]
Bases:
objectA class for submitting jobs on the CERN’s LXPlus cluster using HTCondor, one job per file in a sample list of an analysis. All jobs for a given sample are submitted to the same cluster. The constructor creates a directory .higgs_dna_vanilla_lxplus if it does not exist and another one called .higgs_dna_vanilla_lxplus/<analysis_name>. The date and time (YMD_HMS) is appended to the end of <analysis_name> to avoid overwriting previous submissions. Inside this directory two subdirectories called <inputs> and <jobs> will be created. In the former the split JSON files will be stored, in the latter the HTCondor job files will be stored. To send each job to a separate cluster then set cluster_per_sample=False in the class constructor. Note: This submission method works well on lxplus, but has also been tested on other infrastructures like RWTH Aachen because it does not rely on any specific EOS or HTCondor features. It is simply a generic HTCondor submitter that relies on an automated submission of automatically generated sh and sub files.