Package iceprod :: Package server :: Package plugins :: Module pbs :: Class PBSDag

Class PBSDag

grid.iGrid --+    
             |    
           Pbs --+
                 |
                PBSDag

This class represents a job that executes in multiple parts using a DAG.

Instance Methods

[hide private]

__init__(self)

source code

__del__(self)

source code

GetLogs(self, job)
Read output logs from job

source code

WriteConfig(self, job, config_file)
Write condor submit file to a file.

source code

IsUrl(self, path)

source code

GetFiles(self, job, td, args, idx=False, iter=False, catalog=False)

source code

FindFile(self, steering, td, catalog, file)

source code

WriteFileManifest(self, job, filename, input, output, notes)

source code

WriteDAGNode(self, job, dagfile, nodename, filename, parents=None, done=False)

source code

FinishDAGNode(self, job, dagfile)

source code

get_id(self, submit_status)
Parse string returned by pbs on submission to extract the id of the job cluster

source code

EnumerateParentNodes(self, steering, td)

source code

GetArguments(self, job, td, idx=False, iter=False, output='str') source code

ArgStrToDict(self, argstr)

source code

getAdditionalOptions(self, job)

source code

WriteSubmitFile(self, job, filename, td, idx=False, iter=False)

source code

CheckJobStatus(self, jobs)
Querie status of job on PBS queue

source code

QRemove(self, job)
Remove cluster or job from queue

source code

CleanQ(self, jobs=None)
Not implemeted for DAG yet

source code

GetAdditionalOptions(self, job)

source code

Inherited from Pbs: CheckQ

Inherited from Pbs (private): _choose_queue

Inherited from grid.iGrid: AddArgOption, AddEnv, AddParam, Clean, CleanDir, FileName, GetActiveJobs, GetArgOpt, GetArgOptions, GetClusterId, GetEnv, GetFinishedJobs, GetHost, GetInitialdir, GetJob, GetJobIds, GetJobList, GetMetadataPath, GetMonitorDB, GetParam, GetParamKeys, GetPort, GetProcessingJobs, GetProduction, GetQueue, GetQueuedJobs, GetResetJobs, GetRootDir, GetSimDBKey, GetSteering, GetSubmitHost, GetURL, PopJob, PostCopy, PushJob, QueueJobs, SelfPickle, SetCopyClass, SetHost, SetInitialdir, SetMetadataPath, SetMonitorDB, SetPort, SetProduction, SetQueue, SetRootDir, SetSimDBKey, SetStatus, SetSteering, SetSubmitHost, SetURL, Submit, Suffix, UpdateMetadata, format_arg, jobfinalize, reset_old_jobs, urlcopy, wait

Inherited from grid.iGrid (private): _submit

Class Variables

[hide private]

Inherited from grid.iGrid: CopyStatusEnum

Method Details

[hide private]

init(self)
(Constructor)

source code

Overrides: grid.iGrid.__init__

GetLogs(self, job)

source code

Read output logs from job

Overrides: grid.iGrid.GetLogs

WriteConfig(self, job, config_file)

source code

Write condor submit file to a file.

Parameters:

job - i3Job object
config_file - path to file where submit file will be written

Overrides: Pbs.WriteConfig

IsUrl(self, path)

source code

Overrides: grid.iGrid.IsUrl

get_id(self, submit_status)

source code

Parse string returned by pbs on submission to extract the id of the job cluster

Parameters:

submit_status - string returned by condor_submit

Overrides: Pbs.get_id

CheckJobStatus(self, jobs)

source code

Querie status of job on PBS queue

Overrides: grid.iGrid.CheckJobStatus

QRemove(self, job)

source code

Remove cluster or job from queue

Overrides: grid.iGrid.QRemove

CleanQ(self, jobs=None)

source code

Not implemeted for DAG yet

Overrides: grid.iGrid.CleanQ

Class PBSDag

__init__(self) (Constructor)

GetLogs(self, job)

WriteConfig(self, job, config_file)

IsUrl(self, path)

get_id(self, submit_status)

CheckJobStatus(self, jobs)

QRemove(self, job)

CleanQ(self, jobs=None)

init(self)
(Constructor)