php - automatically retrieve results of bsub -


i looking general advice rather coding solution. when submitting job via bsub can retrieve log of stdin/stdout specifying of following:

bsub -o log.txt      % sends stdout log.txt bsub -u me@email     % sends stdout email

these both great, program creates folder when submitted bsub , stored on remote server. want

a) retrieve folder , it's contents b) automatically when job finishes

so technically using scp -r, have manually. not bad if email alert when job finished, still - i'd have manually this.

so onto b):

well can't see special flag bsub retreive actual results, stdout. suppose have script uses sleep , sets job time (perhaps bit linger safe), like

#!/bin/bash  scp myfile.txt server:main/subfolder ssh bsub < myprogram.sh -u my@email sleep <job-time> scp -r server:main/subfolder result_folder

however concerned being logged out etc , script terminating before job finished.

does have suggestions?

i want have interface (website in future) user can submit file, file analysed remotely, user sent emails when job starts/finishes, results automatically retrieved local/webserver, user gets email saying can pick results.

one step @ time though!

you can tar results directory stdout, logfile. un-tar logfile retrieve directory.

add tar czf - ... command end of script.

if have other stuff appearing on stdout first, move stderr instead, or echo unique string before tar, grep it, , tar there. here's sort of test of principle:

marker='#magic' # unique string log=/tmp/b # logfile echo 'test' >/tmp/a # tar test  # -- in script, @ end -- #  echo "$marker"; tar cf - /tmp/a # -- equivalent in test: (echo 'hello'; echo "$marker"; tar cf - /tmp/a) >$log  # -- recover tar -- start=$(grep -ab "$marker" <$log | awk -f: '{print 1+$1+length($2)}') dd skip=1 bs=$start <$log | tar tvf - # use tar x

Comments

Post a Comment

Popular posts from this blog

searchKeyword not working in AngularJS filter -

i writing app using angularjs on front end. want search through table word/field; 1 search box everything. according article here: http://hello-angularjs.appspot.com/searchtable can use filter: searchkeyword this. this code, , not working expected. <label>search: <input ng-model="searchkeyword"></label> <table ng-repeat="post in posts | orderby: sort | filter: searchkeyword"> <tr> <td> {{index(post)}} </td> <td> {{post.title}} </td> <td> {{post.author}} </td> <td> {{post.content}} </td> <td> {{post.date | date: "d/m/yyyy"}} </td> </tr> </table> what should do? thank you try this: controller $scope.posts = [ {title:'title one', author:'author one', content: 'content one'}, {title:'title two', author:'author two', content: 'cont...
Read more

sequelize.js - Sequelize: sort by enum cases -

i have model ( article ) field (the name type ) of type enum('source', 'translated') , return 1 article ordered type field. source articles should returned before translated articles. like: article.findone(order: [ { type: [ 'source', 'translated' ] } ]); unfortunately there appears no built-in solution sorting enums. instead have sort by case , couldn't find documentation on how sequelize. what conventional approach here? sorting case hard in sequelize, sort field (the second answer in linked post) should possible: order: sequelize.fn('field', sequelize.col('type'), 'source', 'translated') it's supported mysql far know though
Read more

user interface - how to replace an ongoing process of image capture from another process call over the same ImageLabel in python's GUI TKinter -

i trying use following code create interactive gui changes color-space(hsv, rbg, grayscale etc) on event of button click. display opencv video in tkinter using multiprocessing being new python having problems multiprocessing , attempts on making gui change it's color space on button clicks hangs entire system. on it's implementation highly appreciated. thankyou. below code: import cv2 pil import image,imagetk import tkinter tk import numpy np multiprocessing import process , queue def quit_it(root,process): root.destroy() process.terminate() def black_andwhite(root,process): process.terminate p=process(target=capture_image, args=(5,queue, )) p.start() root.after(0, func=lambda: update_all(root, image_label, queue)) def update_image(image_label, queue): frame = queue.get() = image.fromarray(frame) b = imagetk.photoimage(image=a) image_label.configure(image=b) image_label._image_cache = b root.update() def update_all(root...
Read more