[plug] Mount Compressed Image

[Evert]

Is it an option to mount a network share to dump the logs straight to 
the share rather than to compress and copy?


On 07-June-2012 15:07, Alexander Hartner wrote:
> These are not really logs as they are heap dumps. Typically these 
> dumps are created at odd intervals. When they occur the goals are to 
> document their cause via the dump and then to restart the process as 
> soon as possible. Once the process is running again the dumps are 
> extracted for further investigation. I should have clarified this 
> first. Also the application is not leaking memory, but given a certain 
> work load it could possibly run out of available resources. Typically 
> we would at worst case keep two heap dumps on the file system.
>
> Thanks for your input though.
>
> Alex
>
>
> On 07/06/2012, at 14:35 , Lucas van staden wrote:
>
>> Hi , not a solution, just a question/observation regarding your solution.
>>
>> Considering how large your logs are already, how much more will they 
>> grow, and at what rate?
>>
>> Your solution, although a lot more elegant than just increasing 
>> volume space, would potentially have the same issue down the line, 
>> which would then require more time to solve the same issue again.
>>
>> Is that really thus a good solution? Not dissing your idea, and some 
>> good thinking out the box, but sometimes staying within the box is 
>> better ;)
>>
>> -Lucas
>>
>> www.dedmeet.com <http://www.dedmeet.com/>
>>
>> On Jun 7, 2012 3:58 PM, "Alexander Hartner" <alex at j2anywhere.com 
>> <mailto:alex at j2anywhere.com>> wrote:
>>
>>     Hi all,
>>
>>     We have a process which every so often could run out of memory.
>>     To diagnose the problem we are generating a full memory dump of
>>     the process. Our problem is that the generated dump does not fit
>>     onto the available allocated disk space. Before you go off and
>>     tell me to get more disk space I have to say that this is in a
>>     VM. We could increase the amount of space available, however
>>     before doing this I was contemplating other options. What I came
>>     up with was to use a compressed image to write the logs to.
>>     Something like mounting a ZIP file in read / write mode. Writing
>>     speed is not that much of an issue here as long as it is
>>     comparable to using an NFS share. The file being generated is
>>     possibly several GB large. In testing GZIP managed to reduce it
>>     significantly.
>>
>>     I had a look online and found several options to achieve this in
>>     read-only mode, but I need write access to the compressed disk
>>     image as well.
>>
>>     Thanks in advance
>>     Alex
>>     _______________________________________________
>>     PLUG discussion list: plug at plug.org.au <mailto:plug at plug.org.au>
>>     http://lists.plug.org.au/mailman/listinfo/plug
>>     Committee e-mail: committee at plug.org.au
>>     <mailto:committee at plug.org.au>
>>     PLUG Membership: http://www.plug.org.au/membership
>>
>> _______________________________________________
>> PLUG discussion list: plug at plug.org.au <mailto:plug at plug.org.au>
>> http://lists.plug.org.au/mailman/listinfo/plug
>> Committee e-mail: committee at plug.org.au
>> PLUG Membership: http://www.plug.org.au/membership
>
>
>
> _______________________________________________
> PLUG discussion list: plug at plug.org.au
> http://lists.plug.org.au/mailman/listinfo/plug
> Committee e-mail: committee at plug.org.au
> PLUG Membership: http://www.plug.org.au/membership


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.plug.org.au/pipermail/plug/attachments/20120607/d488dfbb/attachment.html>