node.js - Memory leak while uploading files -


i'm trying upload file(30gb) using formidable.whenever upload starts ram increases drastically , it's using 99% of ram. here upload logic..

app.post('/upload', function (req, res) { var path; var randomfilename; var uuid; var form = new formidable.incomingform(); encodingmodule.generateuuid(function(uuid){     uuid = uuid; }); form.on('filebegin', function(name, file) {   console.log(file.name);         file.path = null;   randomfilename = uuid+'.'+file.name.split('.').pop();   path = file.path = "./contentcache/"+randomfilename; });  form.on('end', function(){     encodingmodule.getmetadata(path,function(data){             parseapp.update('contentfile', req.query.objectid, {'fileid':randomfilename, 'videocodec':data.streams[0].codec_name, 'videobitrate':data.format.bit_rate, 'audiocodec':data.streams[1].codec_name, 'audiobitrate':data.streams[1].bit_rate, 'resolutionx':data.streams[0].width, 'resolutiony':data.streams[0].height}, function(err,response){             if(err){                 console.log("metadata:error updating object");             }             console.log(response);          });      });          console.log('local: upload successfull..!');     res.send({msg: "local: uploaded!", objectid: req.query.objectid});      videoqueue.add({video: path, filename:randomfilename, objectid:req.query.objectid});   });   //on upload error form.on('error', function(err) {   console.log('local: error occured while uploading: '+err); });  //on abort form.on('aborted', function(){    console.log('upload aborted');  });  //azure upload onfinished(req, function (err, req) {          azureupload(req.query.objectid, randomfilename, path, function(result){             console.log(result);     });        });        //parse incoming nodejs request form.parse(req); });

here pick file pc , upload virtual machine node server hosted.after upload ends encodes(logic in file dont want).so whenever upload starts ram usage drastically increases 10% 99% within 15 minutes.how solve this? there problem upload logic.here use express don't use body parser

first, how ram machine have ?

i'm not familiar internals of formidable maybe should try open file streamwriter , write file chunks coming in.

from formidable documentation :

form.onpart = function(part) {   part.addlistener('data', function() {     // here should write 'part' streamwriter   }); }

this might take off load ram , have file on disk


Comments

Post a Comment

Popular posts from this blog

javascript - Using jquery append to add option values into a select element not working -

i'm looking dynamically populate select element names of items stored array. for reason it's not working , i'm not sure why. html: <div class="col-md-4 col-md-offset-4"> <select class="select1"> </select> , <select class="select2"> </select> </div> note i'm using bootstrap layout. here's jquery i'm using try , populate ".select1" jquery: select: function() { $.each(state.greens, function(index, value) { $(".select1").append("<option value =' " + index + " '>" + state.greens[index].name + "</option>"); }); } note function 'select' stored within object called 'display'. state.greens name of array i'm trying access. so @ end of html page call display.select(); call function. no error messages showing in console. also, saw question: appending
Read more

Android soft keyboard reverts to default keyboard on orientation change -

i'm building android soft keyboard , can't seem fix bug - have arabic , qwerty keyboard , when rotate device on qwerty keyboard (or arabic shift), it's if program has "restarted" , becomes arabic keyboard without shift. the onsaveinstancestate(bundle savedinstancestate) not work because application not extend activity inputmethodservice . i put following in android manifest android:configchanges="keyboard|keyboardhidden|orientation" android:windowsoftinputmode="stateunchanged|adjustresize"> i tried using @override public void onconfigurationchanged(configuration newconfig) { super.onconfigurationchanged(newconfig); log.i(mydebug, "config changed " + currentkeyboard.equals(qwerty)); } however, currentkeyboard.equals(qwerty)) results false , made sure true before orientation change. any appreciated. i think applications fault. if application restarting on orientation change
Read more

Rendering JButton to get the JCheckBox behavior in a JTable by using images does not update my table -

i rendering jbutton image on simulate jcheckbox behavior. why don't let jtable render jcheckbox? because need bigger checkboxes , there's no way can resize them (as far know). so, have own table cell renderer , editor. both renders jbutton , checkbox images on them. trying change image checked image unchecked image (or vice versa) , update cell value (boolean true or false). however, reason, getcelleditorvalue() not update table. so, release mouse, value goes original one. any appreciated! lot! public class tableexample extends jframe { jscrollpane pane; jpanel panel; jtable table; object[][] data; mytablemodel tm; renderer buttoncolumn; public tableexample(object[][] data) throws ioexception { string[] columns = {"column#1", "column#2", "column#3", "column#4", "column#5", "column#6"}; this.data = data; this.setpreferredsize(new dimension(700, 500));
Read more