[plug] Mount Compressed Image

[Alexander Hartner]

These are not really logs as they are heap dumps. Typically these dumps are created at odd intervals. When they occur the goals are to document their cause via the dump and then to restart the process as soon as possible. Once the process is running again the dumps are extracted for further investigation. I should have clarified this first. Also the application is not leaking memory, but given a certain work load it could possibly run out of available resources. Typically we would at worst case keep two heap dumps on the file system. 

Thanks for your input though.

Alex


On 07/06/2012, at 14:35 , Lucas van staden wrote:

> Hi , not a solution, just a question/observation regarding your solution.
> 
> Considering how large your logs are already, how much more will they grow, and at what rate?
> 
> Your solution, although a lot more elegant than just increasing volume space, would potentially have the same issue down the line, which would then require more time to solve the same issue again.
> 
> Is that really thus a good solution? Not dissing your idea, and some good thinking out the box, but sometimes staying within the box is better ;)
> -Lucas
> 
> www.dedmeet.com
> 
> On Jun 7, 2012 3:58 PM, "Alexander Hartner" <alex at j2anywhere.com> wrote:
> Hi all,
> 
> We have a process which every so often could run out of memory. To diagnose the problem we are generating a full memory dump of the process. Our problem is that the generated dump does not fit onto the available allocated disk space. Before you go off and tell me to get more disk space I have to say that this is in a VM. We could increase the amount of space available, however before doing this I was contemplating other options. What I came up with was to use a compressed image to write the logs to. Something like mounting a ZIP file in read / write mode. Writing speed is not that much of an issue here as long as it is comparable to using an NFS share. The file being generated is possibly several GB large. In testing GZIP managed to reduce it significantly.
> 
> I had a look online and found several options to achieve this in read-only mode, but I need write access to the compressed disk image as well.
> 
> Thanks in advance
> Alex
> _______________________________________________
> PLUG discussion list: plug at plug.org.au
> http://lists.plug.org.au/mailman/listinfo/plug
> Committee e-mail: committee at plug.org.au
> PLUG Membership: http://www.plug.org.au/membership
> _______________________________________________
> PLUG discussion list: plug at plug.org.au
> http://lists.plug.org.au/mailman/listinfo/plug
> Committee e-mail: committee at plug.org.au
> PLUG Membership: http://www.plug.org.au/membership

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.plug.org.au/pipermail/plug/attachments/20120607/54ab9070/attachment.html>