<div dir="ltr">As far as I know there is no "-q" option on varnishlog for Varnish 3.0.6<div><br></div><div>The VCL is too complicated to post but I have added a ton of syslog conditional calls to show that the right lines and blocks in the VCL are being run.</div><div><br></div><div>but here is some:</div><div><br></div><div><div>sub vcl_hash {</div><div> hash_data(req.url);</div><div> return(hash);</div><div>}</div></div><div><br></div><div><br></div><div>sub vcl_fetch {</div><div>...</div><div><br></div><div><div> if ( req.url ~ "^/my/url/.*" ) {</div><div> set beresp.ttl = 24h;</div><div>C{</div><div> syslog(LOG_ERR, "TTL was set to 24h");</div><div>}C</div><div> }</div></div><div><br></div><div> return(deliver);</div><div>}</div><div><br></div><div><br></div><div>sub vcl_deliver {</div><div><br></div><div> return(deliver);</div><div>}</div><div><br></div><div><br></div><div>In my varnishncsa I print "hit" and "miss" with the option: %{Varnish:handling}x</div><div><br></div><div>That is where I am seeing the miss requests.</div><div><br></div><div><br></div><div>tail -f varnishncsa.access_log | grep "\/my\/url" | grep "miss"</div><div><br></div><div><br></div><div>Sometimes I get a miss within 2 minutes, other times it can go 20 minutes.</div><div><br></div><div><br></div><div>I also have a staging system with the exact same VCL and it never happens. So it does not appear to be something forcing a cache clearing (There re no PURGE or BAN requests) and I am currently ignoring all cache related headers. and force a return(deliver) so that the default varnish handler for vcl_fetch does not run.</div><div><br></div><div><br></div><div>Again, I see no lru_objects, I do see some lru_moved objects and I see quite a few lock operations but I do not know what they mean. So my guess is that this problem has to do with some type of contention whether it be threads or locks.</div><div><br></div><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:12px;font-weight:bold"><span style="white-space:pre-wrap"><u> </u></span></div><div style="color:rgb(0,0,0)"><font face="Helvetica"><span style="font-size:12px">Raymond Jennings III</span></font></div></div><span style="color:rgb(0,0,0);text-align:-webkit-auto;font-family:Helvetica"><font face="Rockwell Extra Bold" style="font-size:19px"><b><a href="http://nytimes.com/" style="color:rgb(17,85,204)" target="_blank">nytimes.com</a></b></font><br></span><div style="color:rgb(0,0,0);font-family:Helvetica"><span style="text-align:-webkit-auto"><span style="font-size:12px;text-align:-webkit-auto"><b><div style="display:inline!important">Office:<span style="font-weight:normal"> <a href="tel:212-556-7786" target="_blank">212.556.7786</a></span></div></b></span><span style="text-align:-webkit-auto"><span style="text-align:-webkit-auto"><b style="font-size:12px;text-align:-webkit-auto"><div>iPhone:<span style="font-weight:normal"> <a href="tel:914-330-5074" target="_blank">914.330.5074</a></span></div><div><b style="font-size:13px">E-mail: </b><a href="mailto:Raymond.Jennings@nytimes.com" style="font-size:13px;font-weight:normal;color:rgb(17,85,204)" target="_blank">Raymond.Jennings@nytimes.com</a><br></div><div>FaceTime:<span style="font-weight:normal"> <a href="mailto:Raymond.Jennings@nytimes.com" style="color:rgb(17,85,204)" target="_blank">Raymond.Jennings@nytimes.com</a></span></div></b></span></span></span></div></div></div></div></div></div></div></div></div></div>
<br><div class="gmail_quote">On Fri, Jan 16, 2015 at 10:21 AM, Viktor Gunnarson <span dir="ltr"><<a href="mailto:viktor.gunnarson@ericsson.com" target="_blank">viktor.gunnarson@ericsson.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="SV" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Have you tried logging the requests that get misses? Perhaps that could give some additional info.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">varnishlog -q "VCL_call ~ 'MISS'"<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Also you could provide the vcl because without that it’s really hard to know what happens...<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Best regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Viktor<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> varnish-misc-bounces+viktor.gunnarson=<a href="mailto:ericsson.com@varnish-cache.org" target="_blank">ericsson.com@varnish-cache.org</a>
[mailto:<a href="mailto:varnish-misc-bounces%2Bviktor.gunnarson" target="_blank">varnish-misc-bounces+viktor.gunnarson</a>=<a href="mailto:ericsson.com@varnish-cache.org" target="_blank">ericsson.com@varnish-cache.org</a>] <b>
On Behalf Of </b>Jennings III, Raymond<br>
<b>Sent:</b> den 16 januari 2015 16:07<br>
<b>To:</b> Dridi Boukelmoune<br>
<b>Cc:</b> varnish-misc<br>
<b>Subject:</b> Re: Cannot figure out why I am getting a miss on a static URL<u></u><u></u></span></p><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">varnishncsa clearly shows hits and misses within a 24 hour period despite clearly setting the TTL to 24 hours. Varnishlog clearly shows the TTL being set to 24 hours. I have NO lru_nuked objects as clearly shown by the varnish stats.<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I'm not sure what is vague. I am setting an object for a TTL of 24 hours yet during that 24 hour period it is still getting miss requests. The URLs in question have no GET parameters. I am hashing only on the URL and not the hostname.<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">So what does this tell me? It tells me that my cache size is big enough.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">My guess is there is some type of contention from locking of some type given other requests coming through. There are quite a few PUT and POST requests that pass through this Varnish server.<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Ummmm, I hardly think that "anyone can't help me." I think most definitely "someone" that has some insight about the internals could shed some light on this problem.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><br clear="all">
<u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">Raymond Jennings III</span><span style="color:black"><u></u><u></u></span></p>
</div>
</div>
<p class="MsoNormal"><b><span style="font-size:14.5pt;font-family:"Rockwell Extra Bold","serif";color:black"><a href="http://nytimes.com/" target="_blank"><span style="color:#1155cc">nytimes.com</span></a></span></b><u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><b><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">Office:</span></b><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"> <a href="tel:212-556-7786" target="_blank">212.556.7786</a><b><u></u><u></u></b></span></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">iPhone:</span></b><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"> <a href="tel:914-330-5074" target="_blank">914.330.5074</a><b><u></u><u></u></b></span></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Helvetica","sans-serif";color:black">E-mail: </span></b><b><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"><a href="mailto:Raymond.Jennings@nytimes.com" target="_blank"><span style="font-size:10.0pt;color:#1155cc;font-weight:normal">Raymond.Jennings@nytimes.com</span></a><u></u><u></u></span></b></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">FaceTime:</span></b><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"> <a href="mailto:Raymond.Jennings@nytimes.com" target="_blank"><span style="color:#1155cc">Raymond.Jennings@nytimes.com</span></a><b><u></u><u></u></b></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Fri, Jan 16, 2015 at 10:01 AM, Dridi Boukelmoune <<a href="mailto:dridi.boukelmoune@zenika.com" target="_blank">dridi.boukelmoune@zenika.com</a>> wrote:<u></u><u></u></p>
<p class="MsoNormal">Hi Raymond,<br>
<br>
Have you looked at the logs?<br>
<br>
Your description of the issue is too vague, I don't think anyone can<br>
help you with just that.<br>
<br>
Cheers,<br>
Dridi<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><br>
On Thu, Jan 15, 2015 at 3:36 PM, Jennings III, Raymond<br>
<<a href="mailto:raymond.jennings@nytimes.com" target="_blank">raymond.jennings@nytimes.com</a>> wrote:<br>
> I have a static URL that I set a TTL for 24h but yet every so many minutes I<br>
> get a "miss" (as shown in my varnishncsa.)<br>
><br>
> I purge this URL every 24 hours.<br>
><br>
> 1 - The URL never has any parameters.<br>
> 2 - I do not hash over the hostname only the URI<br>
> 3 - Nobody is issuing any PURGE or BAN requests<br>
> 4 - n_lru_nuked is always 0<br>
> 5 - There are no 500 or 400 responses<br>
><br>
> What is causing this URL to get a miss when everything I see looks good? If<br>
> the cache size has been exceeded I would have expected to see the nuked<br>
> value be something other than 0.<br>
><br>
> vcl_fetch is basically just:<br>
><br>
> set beresp.ttl = 24h;<br>
> return(deliver);<br>
><br>
> Any reason why Varnish seems to be taking it upon itself to cause this miss?<br>
> In 24 hours I get about 12000 requests and out of those 120 misses and I<br>
> should see 2 miss requests at most.<br>
><br>
> The backends are healthy.<br>
><br>
> This is varnish-3.0.6-1.el6.x86_64<br>
><br>
> Thanks.<br>
><br>
><br>
><br>
> Raymond Jennings III<br>
> <a href="http://nytimes.com" target="_blank">nytimes.com</a><br>
> Office: <a href="tel:212.556.7786" target="_blank">212.556.7786</a><br>
> iPhone: <a href="tel:914.330.5074" target="_blank">914.330.5074</a><br>
> E-mail: <a href="mailto:Raymond.Jennings@nytimes.com" target="_blank">Raymond.Jennings@nytimes.com</a><br>
> FaceTime: <a href="mailto:Raymond.Jennings@nytimes.com" target="_blank">Raymond.Jennings@nytimes.com</a><br>
><u></u><u></u></p>
</div>
</div>
<p class="MsoNormal">> _______________________________________________<br>
> varnish-misc mailing list<br>
> <a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a><br>
> <a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc" target="_blank">
https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
</blockquote></div><br></div>