iceprod :: core :: exe :: RunInstanceDAG :: Class RunInstanceDAG

Class RunInstanceDAG

RunInstance --+
              |
             RunInstanceDAG

Instance Methods

[hide private]

__init__(self, opts)
RunInstance constructor for multipart jobs.

source code

run(self)
Runs a task in a multipart simulation job.

source code

execute(self, task_id, tray, iter)
Executes a given tray and iteration within this task.

source code

setstats(self, name, value)
Set task statistics.

source code

startsoap(self, url, dataset, procnum, passkey)
Connects to the monitoring daemon and gets the task ID.

source code

fetch_dependencies(self)
Does nothing; dependencies will be fetched during fetch_input().

source code

check_retval(self, retval, msg='') source code

server_start_task(self, idx, iter)

source code

server_abort(self, task_id)

source code

server_finish_task(self, task_id, stats={}) source code

server_finish_job(self)

source code

server_processing(self, task_id)

source code

server_copying_input(self, task_id)

source code

server_copying_output(self, task_id)

source code

task_run_externs(self)

source code

task_run_cleanup(self)
Remove the intermediate output from all parts of this multipart job.

source code

handle_exception(self, msg=None)

source code

store_output(self)
Store intermediate output from this task.

source code

fetch_input(self)
Fetch input from previous tasks.

source code

handle_file_manifest(self, type='input')
Processes a file manifest and copies the files contained therein. source code

fetch_checksum(self, source, dest)

source code

store_checksum(self, source, dest)

source code

generate_checksum(self, file, checksum)

source code

verify_checksum(self, file)

source code

copy_file(self, source, dest)

source code

uberftp(self, host, cmd)
Perform an FTP command on a remote host using uberftp.

source code

get_intermediate_directory(self)

source code

Inherited from RunInstance: abort, configure, fetch_metaproject, finish, flush_output, get_trays, getenv, getmemusage, getstats, runextern, setenv, setlog4cplus, tarwork

Method Details

[hide private]

init(self, opts)
(Constructor)

source code

RunInstance constructor for multipart jobs.

Overrides: RunInstance.__init__

run(self)

source code

Runs a task in a multipart simulation job.

Returns:: execution value (0 if everything went ok)
Overrides: RunInstance.run

execute(self, task_id, tray, iter)

source code

Executes a given tray and iteration within this task.

Overrides: RunInstance.execute

setstats(self, name, value)

source code

Set task statistics. This version is non-cumulative.

Overrides: RunInstance.setstats

startsoap(self, url, dataset, procnum, passkey)

source code

Connects to the monitoring daemon and gets the task ID.

Overrides: RunInstance.startsoap

fetch_dependencies(self)

source code

Does nothing; dependencies will be fetched during fetch_input().

Overrides: RunInstance.fetch_dependencies

task_run_cleanup(self)

source code

Remove the intermediate output from all parts of this multipart job.

This executed by the trashcan job that's added to the end of all the DAGs; it deletes the incidental files created by each node of the DAG and marks the job itself as complete.

Class RunInstanceDAG

__init__(self, opts) (Constructor)

run(self)

execute(self, task_id, tray, iter)

setstats(self, name, value)

startsoap(self, url, dataset, procnum, passkey)

fetch_dependencies(self)

task_run_cleanup(self)

init(self, opts)
(Constructor)