Package iceprod :: Package server :: Module server :: Class Monitor

Class Monitor

Known Subclasses:

MonitorCGI

XMLRPC server class for monitoring jobs job connect to server from compute nodes and make status updates Creates own HTTP server

Instance Methods

[hide private]

getvalue(self, key)
Retrive dictionary entry

source code

getfile(self, key, dataset_id=0)
Retrive dictionary entry

source code

get_tarball(self, metaproject_name, metaproject_version, platform, gccversion, ppc=0)
Get best matching tarball in file repository @param metaproject_name @param metaproject_version @param platform @param gccversion

source code

getconfig(self, dataset)
Download configuration from database

source code

getmetadata(self, dataset)
Download configuration from database

source code

start(self, hostname, dataset=0, job_id=0, key='', grid=0)
Change the status of a job to indicate it is currently running @param : hostname @param : dataset simdb_id @param : job_id @param : key a passkey to prevent processes from overriding entries source code

ping(self, dataset_id, job_id, host, key='', tray=0, iter=0)
Let server know that job is still running source code

finish(self, dataset_id, job_id, stats, key='', mode=0)
Update monitoring for job and write statistics source code

copying(self, dataset_id, job_id, key='')
Update monitoring for job and write statistics source code

abort(self, job_id, dataset_id, error, errormessage='', key='', stats='(d.')
Reset any pending jobs to they get reprocesses. source code

AddFileURL(self, dataset_id, job_id, url, md5sum, filesize, transfertime, key='')
Add or change the global location of a file source code

get_storage_url(self, dataset_id, queue_id, passkey='', storage_type='INPUT') source code

multipart_job_start(self, dataset_id, queue_id, key='')
Change the status of a job to indicate it is currently running @param : dataset simdb_id @param : job_id @param : key a passkey to prevent processes from overriding entries source code

multipart_job_finish(self, dataset_id, queue_id, key='') source code

task_start(self, dataset_id, queue_id, taskname, tray, iter, hostname, key='') source code

task_copying_input(self, task_id, key='') source code

task_processing(self, task_id, key='') source code

task_copying_output(self, task_id, key='') source code

task_update_status(self, task_id, status, key='') source code

task_abort(self, task_id, key='') source code

task_finish(self, task_id, stats, key='') source code

serve_forever(self, server)
For some reason SOAPpy throws an exception if we get an HTTP instead of HTTPS request when using SSL

source code

echo(self, msg)

source code

register_module(self)
Register daemon with database and update status

source code

register_functions(self)

source code

monitor(self)

source code

SetSemaphore(self, semaphore)

source code

__init__(self, cfg)

source code

Method Details

[hide private]

getvalue(self, key)

source code

Retrive dictionary entry

Returns:: string value

getfile(self, key, dataset_id=0)

source code

Retrive dictionary entry

Returns:: string value

get_tarball(self, metaproject_name, metaproject_version, platform, gccversion, ppc=0)

source code

Get best matching tarball in file repository @param metaproject_name @param metaproject_version @param platform @param gccversion

Returns:: string path to tarball

start(self, hostname, dataset=0, job_id=0, key=`''`, grid=0)

source code

Change the status of a job to indicate it is currently running @param : hostname @param : dataset simdb_id @param : job_id @param : key a passkey to prevent processes from overriding entries

Returns:: dataset_id,nproc,procnum

ping(self, dataset_id, job_id, host, key=`''`, tray=0, iter=0)

source code

Let server know that job is still running

Parameters:

dataset_id - runconfig index
job_id - process number within dataset
host - hostname of computing node

finish(self, dataset_id, job_id, stats, key=`''`, mode=0)

source code

Update monitoring for job and write statistics

Parameters:

dataset_id - runconfig index
job_id - process number within dataset
stats - dictonary of stat entries
key - security passkey assigned to job
mode - if true, finalize job and set status to COPIED instead of setting its status to READYTOCOPY

copying(self, dataset_id, job_id, key=`''`)

source code

Update monitoring for job and write statistics

Parameters:

dataset_id - runconfig index
job_id - process number within dataset
stats - dictonary of stat entries

abort(self, job_id, dataset_id, error, errormessage=`''`, key=`''`, stats=`'(d.'`)

source code

Reset any pending jobs to they get reprocesses. This would typically be run at startup in case the daemon crashed previously.

multipart_job_start(self, dataset_id, queue_id, key=`''`)

source code

Change the status of a job to indicate it is currently running @param : dataset simdb_id @param : job_id @param : key a passkey to prevent processes from overriding entries

Returns:: dataset_id,nproc,procnum

Class Monitor

getvalue(self, key)

getfile(self, key, dataset_id=0)

get_tarball(self, metaproject_name, metaproject_version, platform, gccversion, ppc=0)

start(self, hostname, dataset=0, job_id=0, key='', grid=0)

ping(self, dataset_id, job_id, host, key='', tray=0, iter=0)

finish(self, dataset_id, job_id, stats, key='', mode=0)

copying(self, dataset_id, job_id, key='')

abort(self, job_id, dataset_id, error, errormessage='', key='', stats='(d.')

multipart_job_start(self, dataset_id, queue_id, key='')

start(self, hostname, dataset=0, job_id=0, key=`''`, grid=0)

ping(self, dataset_id, job_id, host, key=`''`, tray=0, iter=0)

finish(self, dataset_id, job_id, stats, key=`''`, mode=0)

copying(self, dataset_id, job_id, key=`''`)

abort(self, job_id, dataset_id, error, errormessage=`''`, key=`''`, stats=`'(d.'`)

multipart_job_start(self, dataset_id, queue_id, key=`''`)