<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <p>I agree but the reason being we have other applications like DB
      servers, backend server, cache server etc running on the same
      machine (as our scale is not that big). Hence, memory is a sought
      after resource and needs to be optimized as much as possible. </p>
    <p>So, if you suggest malloc would be a better storage still, I can
      change the storage to the same. <br>
    </p>
    <div class="moz-cite-prefix">On 07/02/18 7:09 pm, Guillaume Quintard
      wrote:<br>
    </div>
    <blockquote
cite="mid:CAJ6ZYQzC-dOp69kMNz3iRFTF_N9y4-ExeTgAW3WGW9kVWNhoxQ@mail.gmail.com"
      type="cite">
      <div dir="auto">So, it's probably not related to your issue, but
        it seems your cached data easily fits in memory, why use the
        file storage?<br>
        <br>
        <div data-smartmail="gmail_signature">-- <br>
          Guillaume Quintard </div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Feb 7, 2018 14:35, "Pinakee BIswas"
          <<a moz-do-not-send="true" href="mailto:pinakee@waltzz.com">pinakee@waltzz.com</a>>
          wrote:<br type="attribution">
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000">
              <p>Following is the data from varnishstat:</p>
              <p>SMA.Transient.g_bytes         <wbr>                              <wbr>                              
                15.76K        -2.19K          .           18.53K       
                15.50K        15.24K</p>
              <p>SMF.s0.g_bytes                <wbr>                              <wbr>                             
                673.26M        47.95K          .          672.87M      
                669.89M       668.90M<br>
              </p>
              <p><br>
              </p>
              <div class="m_-5598368564391915570moz-cite-prefix">On
                07/02/18 6:51 pm, Guillaume Quintard wrote:<br>
              </div>
              <blockquote type="cite">
                <div dir="auto">Amount of storage used is just the sum
                  of all the g_bytes fields<br>
                  <br>
                  <div data-smartmail="gmail_signature">-- <br>
                    Guillaume Quintard </div>
                </div>
                <div class="gmail_extra"><br>
                  <div class="gmail_quote">On Feb 7, 2018 14:12,
                    "Pinakee BIswas" <<a moz-do-not-send="true"
                      href="mailto:pinakee@waltzz.com" target="_blank">pinakee@waltzz.com</a>>
                    wrote:<br type="attribution">
                    <blockquote class="gmail_quote" style="margin:0 0 0
                      .8ex;border-left:1px #ccc solid;padding-left:1ex">
                      <div bgcolor="#FFFFFF" text="#000000">
                        <p>Hi Guillaume,</p>
                        <p>Thanks for your response and details.</p>
                        <p>Please find my comments inline:<br>
                        </p>
                        <br>
                        <div
                          class="m_-5598368564391915570m_-8343487515810236383moz-cite-prefix">On
                          07/02/18 6:21 pm, Guillaume Quintard wrote:<br>
                        </div>
                        <blockquote type="cite">
                          <div dir="ltr">Hi there,
                            <div><br>
                            </div>
                            <div>So, varnish memory usage will mostly
                              come from three directions:</div>
                            <div>- storage, include Transient, so check
                              the g_bytes fields in varnishstat. Passes
                              and shortlived objects will use Transient,
                              so you can either reduce those, or limit
                              the Transient storage (unbounded by
                              defaukt).</div>
                          </div>
                        </blockquote>
                        Checked the g_bytes for transient in
                        varnishstat. It's in Kbs. <br>
                        <blockquote type="cite">
                          <div dir="ltr">
                            <div>- thread workspaces, one thread
                              typically uses one workspace, so you can
                              limit the number of threads, or reduce the
                              workspace size</div>
                            <div>- memory fragmentation: jemalloc will
                              fragment up to 25%, not much you can do
                              here.</div>
                            <div><br>
                            </div>
                            <div>And no, no way to modify the mmap
                              without restarting varnish.</div>
                            <div><br>
                            </div>
                            <div>May I ask how much data you are
                              caching?</div>
                          </div>
                        </blockquote>
                        Could you please let me know how to figure out
                        the amount of data cached?<br>
                        <blockquote type="cite">
                          <div class="gmail_extra"><br clear="all">
                            <div>
                              <div
                                class="m_-5598368564391915570m_-8343487515810236383gmail_signature"
                                data-smartmail="gmail_signature">
                                <div dir="ltr">
                                  <div>-- <br>
                                  </div>
                                  Guillaume Quintard<br>
                                </div>
                              </div>
                            </div>
                            <br>
                            <div class="gmail_quote">On Wed, Feb 7, 2018
                              at 1:34 PM, Pinakee BIswas <span
                                dir="ltr"><<a moz-do-not-send="true"
                                  href="mailto:pinakee@waltzz.com"
                                  target="_blank">pinakee@waltzz.com</a>></span>
                              wrote:<br>
                              <blockquote class="gmail_quote"
                                style="margin:0 0 0 .8ex;border-left:1px
                                #ccc solid;padding-left:1ex">
                                <div bgcolor="#FFFFFF" text="#000000">
                                  <p>Hi,</p>
                                  <p>We have been using varnish since
                                    more than a year for our ecommerce
                                    site. <br>
                                  </p>
                                  <p>Current version is 4.1.8.</p>
                                  <p>OS is Linux. RAM is 8GB. <br>
                                  </p>
                                  <p>I am observing that the varnish
                                    memory usage is increasing (right
                                    now 7%) and so is resident memory
                                    usage increasing. <br>
                                  </p>
                                  <p>The storage being used is file:</p>
                                  <p>-s file,/tmp/varnish/,${storage}</p>
                                  <p>I am not sure about the reason for
                                    the increase in varnish memory
                                    usage:</p>
                                  <ul>
                                    <li>Is there a way to limit the
                                      varnish memory usage?</li>
                                    <li>How can I diagnose what is
                                      consuming memory?</li>
                                    <li>Most of our web pages have
                                      maximum 2 days of cache. Also,
                                      some of the pages might be least
                                      visited.</li>
                                    <li>Is there a way to manipulate
                                      varnish mmap (when file storage is
                                      used)?</li>
                                  </ul>
                                  <p>Would appreciate any help on the
                                    above for efficient use of varnish.</p>
                                  <p>Thanks,</p>
                                  <p>Pinakee<br>
                                  </p>
                                  <p><br>
                                  </p>
                                </div>
                                <br>
                                ______________________________<wbr>_________________<br>
                                varnish-misc mailing list<br>
                                <a moz-do-not-send="true"
                                  href="mailto:varnish-misc@varnish-cache.org"
                                  target="_blank">varnish-misc@varnish-cache.org</a><br>
                                <a moz-do-not-send="true"
                                  href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc"
                                  rel="noreferrer" target="_blank">https://www.varnish-cache.org/<wbr>lists/mailman/listinfo/varnish<wbr>-misc</a><br>
                              </blockquote>
                            </div>
                            <br>
                          </div>
                        </blockquote>
                        <br>
                      </div>
                    </blockquote>
                  </div>
                </div>
              </blockquote>
              <br>
            </div>
          </blockquote>
        </div>
      </div>
    </blockquote>
    <br>
  </body>
</html>