Sorry for not including information on my swap before:<div><br><div class="gmail_quote">On 9 May 2012 02:11, emilio brambilla <span dir="ltr"><<a href="mailto:emilio@antispam.it" target="_blank">emilio@antispam.it</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">hello,<div class="im"><br>
<br>
On 2012/05/08 8:02 PM, Sparsh Gupta wrote:<br>
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
I have a bunch of Varnish servers (Exactly same configurations, caching different keys on Intel 2650 series Computer + 16GB RAM + 32GB SSD each). I am enclosing my configurations and settings along with my current varnishstats.<br>
<br>
I am looking for more debug information and how to find the route cause of my varnish getting restarting every 6-8 hours (all varnish servers)<br>
<br></div>
VARNISH_STORAGE_SIZE=32G<br>
VARNISH_STORAGE_MALLOC="<u></u>malloc"<br>
</blockquote>
if you have 16 Gb of phisical ram you should not malloc 32 Gb, but something less than 16 Gb (usually 20% less than the phisical)<br>
<br></blockquote><div><br></div><div>Each box is configured with 24GB of swap. they have 16GB physical making them 40GB of available memory. I am using only 80% of it in Varnish as adviced.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
how many swap did you set on these boxes? maybe the varnish is restarting because the kernel cannot allocate the ram it want.<br></blockquote><div><br></div><div>It seems Kernel is indeed killing the varnish daemon due to no memory available.</div>
<div><br></div><div><div>May 9 12:27:51 localhost kernel: [168419.861130] Node 0 DMA: 2*4kB 1*8kB 1*16kB 2*32kB 2*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15840kB</div><div>May 9 12:27:51 localhost kernel: [168419.926467] Node 0 DMA32: 119*4kB 218*8kB 62*16kB 19*32kB 5*64kB 5*128kB 2*256kB 2*512kB 1*1024kB 3*2048kB 3*4096kB = 25772kB</div>
<div>May 9 12:27:51 localhost kernel: [168419.995910] Node 0 Normal: 910*4kB 0*8kB 0*16kB 0*32kB 0*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 4792kB</div><div>May 9 12:27:51 localhost kernel: [168420.063296] Node 1 Normal: 494*4kB 0*8kB 3*16kB 0*32kB 1*64kB 5*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 1*4096kB = 7336kB</div>
<div>May 9 12:27:51 localhost kernel: [168420.130742] 35438 total pagecache pages</div><div>May 9 12:27:51 localhost kernel: [168420.154201] 32999 pages in swap cache</div><div>May 9 12:27:51 localhost kernel: [168420.176624] Swap cache stats: add 31746386, delete 31713387, find 4761486/8157803</div>
<div>May 9 12:27:51 localhost kernel: [168420.221926] Free swap = 0kB</div><div>May 9 12:27:51 localhost kernel: [168420.239681] Total swap = 25999352kB</div><div>May 9 12:27:51 localhost kernel: [168420.328578] 4194288 pages RAM</div>
<div>May 9 12:27:51 localhost kernel: [168420.346865] 83407 pages reserved</div><div>May 9 12:27:51 localhost kernel: [168420.366696] 9039 pages shared</div><div>May 9 12:27:51 localhost kernel: [168420.385006] 4091500 pages non-shared</div>
<div>May 9 12:27:51 localhost kernel: [168420.406909] Out of memory: kill process 2984 (varnishd) score 103268864 or a child</div><div>May 9 12:27:51 localhost kernel: [168420.452754] Killed process 2985 (varnishd)</div>
</div><div><br></div><div> </div><div>I am unable to figure out a lot of sense out of these numbers and will appreciate any help in fine tuning my varnish instance. I can try with 30G or 28G but what is an idea number if we can conclude something based on this info I found in my syslog</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
if you want to use more than space you may use 'file' instead of 'malloc' (but I don't know if it's a good idea to use SSD for the cache.... how many rewrite does your ssd allow?)<span class="HOEnZb"><font color="#888888"><br>
<br></font></span></blockquote><div><br></div><div>Before buying the boxes, I read that fast SSDs are good enough for Varnish. I got fast read write SSDs available these days on the servers</div><div><br></div><div> </div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="HOEnZb"><font color="#888888">
-- <br>
bye,<br>
emilio<br>
<br></font></span></blockquote><div><br></div><div>Thanks</div><div>Sparsh </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="HOEnZb"><font color="#888888">
______________________________<u></u>_________________<br>
varnish-misc mailing list<br>
<a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a><br>
<a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc" target="_blank">https://www.varnish-cache.org/<u></u>lists/mailman/listinfo/<u></u>varnish-misc</a><br>
</font></span></blockquote></div><br></div>