<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Interestingly we are seeing a lot of time in WaitingList before going to VCL Fetch<br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">-   VCL_return     hash<br>-   VCL_call       HASH<br>-   VCL_return     lookup<br>-   Timestamp      Waitinglist: 1537973412.501378 2.410131 2.409963<br>-   VCL_call       MISS<br>-   VCL_return     fetch<br>-   Link           bereq 22354816 fetch<br>-   Timestamp      Fetch: 1537973412.505995 2.414748 0.004617<br><br clear="all"></div><div><div dir="ltr" class="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Wed, Sep 26, 2018 at 9:31 AM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">I totally agree about that. <br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">what we have figured out is that during the steady periods of performance tests it run absolutely fine; but as soon as we spike up the traffic (double the normal peak) performance degrades dramatically. <br></div><br><div><div dir="ltr" class="m_-5183516178050472104gmail_signature" data-smartmail="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Sep 25, 2018 at 5:17 PM Guillaume Quintard <<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">without the vcl (and/or logs, but I'm assuming those are even more confidential), that's a tough cookie to debug<br clear="all"><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Mon, Sep 24, 2018 at 10:35 AM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Hi <br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Apologies but I am not allowed to share the VCL. If there's any other thing like stats etc that might be helpful then do let me know<br></div><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989gmail_signature" data-smartmail="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Sep 21, 2018 at 4:15 PM Guillaume Quintard <<a href="mailto:guillaume@varnish-software.com" target="_blank">guillaume@varnish-software.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">would you be able to share your vcl?<br clear="all"><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>-- <br></div>Guillaume Quintard<br></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Sep 21, 2018 at 4:54 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Any help guys; this is really getting to us..... <br></div><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229gmail_signature" data-smartmail="gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Sep 20, 2018 at 3:57 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><br><font size="2"><span style="font-family:verdana,sans-serif"></span></font></div><div class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><span class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">This is what we get in varnishhist</span></span></font></div><div class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><span class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></span></span></font></div><div class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><span class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"></span>280_<br></span></font></div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br><br><br>                                     |<br>230_                                 |<br>                                     |<br>                                     |<br>                                     |<br>                                     |<br>180_                                 |<br>                                    ||<br>                                    ||<br>                                    |||<br>                                    |||<br>130_                                |||<br>                                    |||<br>                                   ||||||<br>                                   ||||||<br>                                   ||||||<br>80_                                ||||||<br>                                   ||||||                                                               #<br>                                   ||||||                                                               ###<br>                                  |||||||                                                             # ###<br>                                  |||||||||                                                           ##### #<br>30_                               |||||||||                                                           ########<br>                                  |||||||||                                                           #########<br>                                  ||||||||||                                                        ###########<br>                                  ||||||||||||                                                ## # #############       #<br>+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------+---------------------<br>|1e-6                 |1e-5                 |1e-4                 |1e-3                 |1e-2                 |1e-1                 |1e0                  |1e1                  |1e2<br></span></font></div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif">--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div><br></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Sep 20, 2018 at 3:54 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">Below is the output; all of them are default except i was trying to up the threads_pool to 4 but didn't feel any imporvement in performance degradation<br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small">accept_filter              off [bool] (default)<br>acceptor_sleep_decay       0.9 (default)<br>acceptor_sleep_incr        0.000 [seconds] (default)<br>acceptor_sleep_max         0.050 [seconds] (default)<br>auto_restart               on [bool] (default)<br>backend_idle_timeout       60.000 [seconds] (default)<br>ban_dups                   on [bool] (default)<br>ban_lurker_age             60.000 [seconds] (default)<br>ban_lurker_batch           1000 (default)<br>ban_lurker_sleep           0.010 [seconds] (default)<br>between_bytes_timeout      60.000 [seconds] (default)<br>cc_command                 "exec gcc -std=gnu99  -O2 -g -Wp,-D_FORTIFY_SOURCE=0 -Wall -Werror -pthread -fpic -shared -Wl,-x -o %o %s" (default)<br>cli_buffer                 8k [bytes] (default)<br>cli_limit                  48k [bytes] (default)<br>cli_timeout                60.000 [seconds] (default)<br>clock_skew                 10 [seconds] (default)<br>clock_step                 1.000 [seconds] (default)<br>connect_timeout            3.500 [seconds] (default)<br>critbit_cooloff            180.000 [seconds] (default)<br>debug                      none (default)<br>default_grace              10.000 [seconds] (default)<br>default_keep               0.000 [seconds] (default)<br>default_ttl                120.000 [seconds] (default)<br>feature                    none (default)<br>fetch_chunksize            16k [bytes] (default)<br>fetch_maxchunksize         0.25G [bytes] (default)<br>first_byte_timeout         60.000 [seconds] (default)<br>gzip_buffer                32k [bytes] (default)<br>gzip_level                 6 (default)<br>gzip_memlevel              8 (default)<br>http_gzip_support          on [bool] (default)<br>http_max_hdr               64 [header lines] (default)<br>http_range_support         on [bool] (default)<br>http_req_hdr_len           8k [bytes] (default)<br>http_req_size              32k [bytes] (default)<br>http_resp_hdr_len          8k [bytes] (default)<br>http_resp_size             32k [bytes] (default)<br>idle_send_timeout          60.000 [seconds] (default)<br>listen_depth               1024 [connections] (default)<br>lru_interval               2.000 [seconds] (default)<br>max_esi_depth              5 [levels] (default)<br>max_restarts               4 [restarts] (default)<br>max_retries                4 [retries] (default)<br>nuke_limit                 50 [allocations] (default)<br>pcre_match_limit           10000 (default)<br>pcre_match_limit_recursion 20 (default)<br>ping_interval              3 [seconds] (default)<br>pipe_timeout               60.000 [seconds] (default)<br>pool_req                   10,100,10 (default)<br>pool_sess                  10,100,10 (default)<br>pool_vbo                   10,100,10 (default)<br>prefer_ipv6                off [bool] (default)<br>rush_exponent              3 [requests per request] (default)<br>send_timeout               600.000 [seconds] (default)<br>session_max                100000 [sessions] (default)<br>shm_reclen                 255b [bytes] (default)<br>shortlived                 10.000 [seconds] (default)<br>sigsegv_handler            on [bool] (default)<br>syslog_cli_traffic         on [bool] (default)<br>tcp_fastopen               off [bool] (default)<br>tcp_keepalive_intvl        75.000 [seconds] (default)<br>tcp_keepalive_probes       9 [probes] (default)<br>tcp_keepalive_time         7200.000 [seconds] (default)<br>thread_pool_add_delay      0.000 [seconds] (default)<br>thread_pool_destroy_delay  1.000 [seconds] (default)<br>thread_pool_fail_delay     0.200 [seconds] (default)<br>thread_pool_max            5000 [threads] (default)<br>thread_pool_min            100 [threads] (default)<br>thread_pool_reserve        0 [threads] (default)<br>thread_pool_stack          48k [bytes] (default)<br>thread_pool_timeout        300.000 [seconds] (default)<br>thread_pools               2 [pools] (default)<br>thread_queue_limit         20 (default)<br>thread_stats_rate          10 [requests] (default)<br>timeout_idle               5.000 [seconds] (default)<br>timeout_linger             0.050 [seconds] (default)<br>vcc_allow_inline_c         off [bool] (default)<br>vcc_err_unref              on [bool] (default)<br>vcc_unsafe_path            on [bool] (default)<br>vcl_cooldown               600.000 [seconds] (default)<br>vcl_dir                    /etc/varnish (default)<br>vmod_dir                   /usr/lib64/varnish/vmods (default)<br>vsl_buffer                 4k [bytes] (default)<br>vsl_mask                   -VCL_trace,-WorkThread,-Hash,-VfpAcct (default)<br>vsl_reclen                 255b [bytes] (default)<br>vsl_space                  80M [bytes] (default)<br>vsm_free_cooldown          60.000 [seconds] (default)<br>vsm_space                  1M [bytes] (default)<br>workspace_backend          64k [bytes] (default)<br>workspace_client           64k [bytes] (default)<br>workspace_session          0.50k [bytes] (default)<br>workspace_thread           2k [bytes] (default)<br><br clear="all"></div><div><div dir="ltr" class="m_-5183516178050472104m_5047070713852652681m_2112992832945753989m_7555200581029681930m_-4850563681973212229m_-5887073979918696485m_-5301226210362817593gmail_signature"><font size="2"><span style="font-family:verdana,sans-serif"><br>--------<br>Regards,</span><br style="font-family:verdana,sans-serif"><span style="font-family:verdana,sans-serif">Junaid</span></font><br></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Sep 20, 2018 at 3:37 PM Dridi Boukelmoune <dridi@varni.sh> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Thu, Sep 20, 2018 at 4:14 PM Junaid Mukhtar <<a href="mailto:junaid.mukhtar@gmail.com" target="_blank">junaid.mukhtar@gmail.com</a>> wrote:<br>
><br>
> Hi<br>
><br>
> we are in middle of upgrading from varnish 3.0.7 to varnish 4.1.10; but unfortunately all of the response times in the performance test are indicating an increase of at least 100%<br>
><br>
> We have analyzed the logs and everything but can't get around this; the issue is not only for the non-cached pages but it's also impacting the cached pages. We are also struggling to analyze it further as well, any guidenace as to what we can do in terms of putting debug logging in would be helpful.<br>
><br>
> One of the areas we are considering is to output response times, but it's proving difficult for me. Any suggestions<br>
<br>
Hello,<br>
<br>
What is the output of `varnishadm param.show` ?<br>
<br>
Dridi<br>
</blockquote></div>
</blockquote></div>
</blockquote></div>
_______________________________________________<br>
varnish-misc mailing list<br>
<a href="mailto:varnish-misc@varnish-cache.org" target="_blank">varnish-misc@varnish-cache.org</a><br>
<a href="https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc" rel="noreferrer" target="_blank">https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc</a><br>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>