[Varnish] #404: who use intel 82572EI PRO/1000 PT Desktop Adapter ? why it limit varnish capability??
Varnish
varnish-bugs at projects.linpro.no
Mon Dec 8 12:54:08 CET 2008
#404: who use intel 82572EI PRO/1000 PT Desktop Adapter ? why it limit varnish
capability??
--------------------+-------------------------------------------------------
Reporter: chenxy | Owner:
Type: defect | Status: closed
Priority: normal | Milestone:
Component: build | Version: trunk
Severity: normal | Resolution: invalid
Keywords: |
--------------------+-------------------------------------------------------
Changes (by tfheen):
* status: new => closed
* resolution: => invalid
Old description:
> It only support 2500requests/s and cpu with 8 cores 30% idle
>
> circumstance: freebsd 7.0-RELEASE-p6,amd64,16G memory
>
> sysctl -a | grep dev.em
>
> {{{
> dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 6.9.5
> dev.em.0.%driver: em
> dev.em.0.%location: slot=0 function=0
> dev.em.0.%pnpinfo: vendor=0x8086 device=0x10b9 subvendor=0x103c
> subdevice=0x704a class=0x020000
> dev.em.0.%parent: pci3
> dev.em.0.debug: -1
> dev.em.0.stats: -1
> dev.em.0.rx_int_delay: 0
> dev.em.0.tx_int_delay: 66
> dev.em.0.rx_abs_int_delay: 66
> dev.em.0.tx_abs_int_delay: 66
> dev.em.0.rx_processing_limit: 100
> dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 6.9.5
> dev.em.1.%driver: em
> dev.em.1.%location: slot=0 function=0
> dev.em.1.%pnpinfo: vendor=0x8086 device=0x105e subvendor=0x8086
> subdevice=0x135e class=0x020000
> dev.em.1.%parent: pci5
> dev.em.1.debug: -1
> dev.em.1.stats: -1
> dev.em.1.rx_int_delay: 0
> dev.em.1.tx_int_delay: 66
> dev.em.1.rx_abs_int_delay: 66
> dev.em.1.tx_abs_int_delay: 66
> dev.em.1.rx_processing_limit: 100
> dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 6.9.5
> dev.em.2.%driver: em
> dev.em.2.%location: slot=0 function=1
> dev.em.2.%pnpinfo: vendor=0x8086 device=0x105e subvendor=0x8086
> subdevice=0x135e class=0x020000
> dev.em.2.%parent: pci5
> dev.em.2.debug: -1
> dev.em.2.stats: -1
> dev.em.2.rx_int_delay: 0
> dev.em.2.tx_int_delay: 66
> dev.em.2.rx_abs_int_delay: 66
> dev.em.2.tx_abs_int_delay: 66
> dev.em.2.rx_processing_limit: 100
>
> }}}
>
> But I test another server with Broadcom NetXtreme II BCM5708 ,Varnish
> can support 5000Requests/s and cpu with 4 cores 60% idle
>
> sysctl -a | grep bce
> {{{
> hw.bce.msi_enable: 1
> hw.bce.tso_enable: 1
> dev.bce.0.%desc: Broadcom NetXtreme II BCM5708 1000Base-T (B2)
> dev.bce.0.%driver: bce
> dev.bce.0.%location: slot=0 function=0
> dev.bce.0.%pnpinfo: vendor=0x14e4 device=0x164c subvendor=0x103c
> subdevice=0x7038 class=0x020000
> dev.bce.0.%parent: pci3
> dev.bce.0.mbuf_alloc_failed: 0
> dev.bce.0.tx_dma_map_failures: 0
> dev.bce.0.stat_IfHcInOctets: 15909040362
> dev.bce.0.stat_IfHCInBadOctets: 131667110
> dev.bce.0.stat_IfHCOutOctets: 185212112207
> dev.bce.0.stat_IfHCOutBadOctets: 0
> dev.bce.0.stat_IfHCInUcastPkts: 161658777
> dev.bce.0.stat_IfHCInMulticastPkts: 438938
> dev.bce.0.stat_IfHCInBroadcastPkts: 477415
> dev.bce.0.stat_IfHCOutUcastPkts: 184433486
> dev.bce.0.stat_IfHCOutMulticastPkts: 0
> dev.bce.0.stat_IfHCOutBroadcastPkts: 1420
> dev.bce.0.stat_emac_tx_stat_dot3statsinternalmactransmiterrors: 0
> dev.bce.0.stat_Dot3StatsCarrierSenseErrors: 0
> dev.bce.0.stat_Dot3StatsFCSErrors: 0
> dev.bce.0.stat_Dot3StatsAlignmentErrors: 0
> dev.bce.0.stat_Dot3StatsSingleCollisionFrames: 0
> dev.bce.0.stat_Dot3StatsMultipleCollisionFrames: 0
> dev.bce.0.stat_Dot3StatsDeferredTransmissions: 0
> dev.bce.0.stat_Dot3StatsExcessiveCollisions: 0
> dev.bce.0.stat_Dot3StatsLateCollisions: 0
> dev.bce.0.stat_EtherStatsCollisions: 0
> dev.bce.0.stat_EtherStatsFragments: 0
> dev.bce.0.stat_EtherStatsJabbers: 0
> dev.bce.0.stat_EtherStatsUndersizePkts: 0
> dev.bce.0.stat_EtherStatsOverrsizePkts: 0
> dev.bce.0.stat_EtherStatsPktsRx64Octets: 2089470
> dev.bce.0.stat_EtherStatsPktsRx65Octetsto127Octets: 144899332
> dev.bce.0.stat_EtherStatsPktsRx128Octetsto255Octets: 13352557
> dev.bce.0.stat_EtherStatsPktsRx256Octetsto511Octets: 491736
> dev.bce.0.stat_EtherStatsPktsRx512Octetsto1023Octets: 129797
> dev.bce.0.stat_EtherStatsPktsRx1024Octetsto1522Octets: 1612238
> dev.bce.0.stat_EtherStatsPktsRx1523Octetsto9022Octets: 0
> dev.bce.0.stat_EtherStatsPktsTx64Octets: 2884585
> dev.bce.0.stat_EtherStatsPktsTx65Octetsto127Octets: 37504043
> dev.bce.0.stat_EtherStatsPktsTx128Octetsto255Octets: 16146437
> dev.bce.0.stat_EtherStatsPktsTx256Octetsto511Octets: 6290529
> dev.bce.0.stat_EtherStatsPktsTx512Octetsto1023Octets: 8170588
> dev.bce.0.stat_EtherStatsPktsTx1024Octetsto1522Octets: 113438724
> dev.bce.0.stat_EtherStatsPktsTx1523Octetsto9022Octets: 0
> dev.bce.0.stat_XonPauseFramesReceived: 0
> dev.bce.0.stat_XoffPauseFramesReceived: 0
> dev.bce.0.stat_OutXonSent: 0
> dev.bce.0.stat_OutXoffSent: 0
> dev.bce.0.stat_FlowControlDone: 0
> dev.bce.0.stat_MacControlFramesReceived: 0
> dev.bce.0.stat_XoffStateEntered: 0
> dev.bce.0.stat_IfInFramesL2FilterDiscards: 1370958
> dev.bce.0.stat_IfInRuleCheckerDiscards: 0
> dev.bce.0.stat_IfInFTQDiscards: 0
> dev.bce.0.stat_IfInMBUFDiscards: 0
> dev.bce.0.stat_IfInRuleCheckerP4Hit: 916351
> dev.bce.0.stat_CatchupInRuleCheckerDiscards: 0
> dev.bce.0.stat_CatchupInFTQDiscards: 0
> dev.bce.0.stat_CatchupInMBUFDiscards: 0
> dev.bce.0.stat_CatchupInRuleCheckerP4Hit: 0
> dev.bce.0.com_no_buffers: 0
> dev.bce.1.%desc: Broadcom NetXtreme II BCM5708 1000Base-T (B2)
> dev.bce.1.%driver: bce
> dev.bce.1.%location: slot=0 function=0
> dev.bce.1.%pnpinfo: vendor=0x14e4 device=0x164c subvendor=0x103c
> subdevice=0x7038 class=0x020000
> dev.bce.1.%parent: pci5
> dev.bce.1.mbuf_alloc_failed: 0
> dev.bce.1.tx_dma_map_failures: 0
> dev.bce.1.stat_IfHcInOctets: 4753538
> dev.bce.1.stat_IfHCInBadOctets: 170783904
> dev.bce.1.stat_IfHCOutOctets: 6144
> dev.bce.1.stat_IfHCOutBadOctets: 0
> dev.bce.1.stat_IfHCInUcastPkts: 1553
> dev.bce.1.stat_IfHCInMulticastPkts: 86
> dev.bce.1.stat_IfHCInBroadcastPkts: 71772
> dev.bce.1.stat_IfHCOutUcastPkts: 95
> dev.bce.1.stat_IfHCOutMulticastPkts: 0
> dev.bce.1.stat_IfHCOutBroadcastPkts: 1
> dev.bce.1.stat_emac_tx_stat_dot3statsinternalmactransmiterrors: 0
> dev.bce.1.stat_Dot3StatsCarrierSenseErrors: 0
> dev.bce.1.stat_Dot3StatsFCSErrors: 0
> dev.bce.1.stat_Dot3StatsAlignmentErrors: 0
> dev.bce.1.stat_Dot3StatsSingleCollisionFrames: 0
> dev.bce.1.stat_Dot3StatsMultipleCollisionFrames: 0
> dev.bce.1.stat_Dot3StatsDeferredTransmissions: 0
> dev.bce.1.stat_Dot3StatsExcessiveCollisions: 0
> dev.bce.1.stat_Dot3StatsLateCollisions: 0
> dev.bce.1.stat_EtherStatsCollisions: 0
> dev.bce.1.stat_EtherStatsFragments: 0
> dev.bce.1.stat_EtherStatsJabbers: 0
> dev.bce.1.stat_EtherStatsUndersizePkts: 0
> dev.bce.1.stat_EtherStatsOverrsizePkts: 0
> dev.bce.1.stat_EtherStatsPktsRx64Octets: 71912
> dev.bce.1.stat_EtherStatsPktsRx65Octetsto127Octets: 1499
> dev.bce.1.stat_EtherStatsPktsRx128Octetsto255Octets: 0
> dev.bce.1.stat_EtherStatsPktsRx256Octetsto511Octets: 0
> dev.bce.1.stat_EtherStatsPktsRx512Octetsto1023Octets: 0
> dev.bce.1.stat_EtherStatsPktsRx1024Octetsto1522Octets: 0
> dev.bce.1.stat_EtherStatsPktsRx1523Octetsto9022Octets: 0
> dev.bce.1.stat_EtherStatsPktsTx64Octets: 96
> dev.bce.1.stat_EtherStatsPktsTx65Octetsto127Octets: 0
> dev.bce.1.stat_EtherStatsPktsTx128Octetsto255Octets: 0
> dev.bce.1.stat_EtherStatsPktsTx256Octetsto511Octets: 0
> dev.bce.1.stat_EtherStatsPktsTx512Octetsto1023Octets: 0
> dev.bce.1.stat_EtherStatsPktsTx1024Octetsto1522Octets: 0
> dev.bce.1.stat_EtherStatsPktsTx1523Octetsto9022Octets: 0
> dev.bce.1.stat_XonPauseFramesReceived: 0
> dev.bce.1.stat_XoffPauseFramesReceived: 0
> dev.bce.1.stat_OutXonSent: 0
> dev.bce.1.stat_OutXoffSent: 0
> dev.bce.1.stat_FlowControlDone: 0
> dev.bce.1.stat_MacControlFramesReceived: 0
> dev.bce.1.stat_XoffStateEntered: 0
> dev.bce.1.stat_IfInFramesL2FilterDiscards: 1299564
> dev.bce.1.stat_IfInRuleCheckerDiscards: 0
> dev.bce.1.stat_IfInFTQDiscards: 0
> dev.bce.1.stat_IfInMBUFDiscards: 0
> dev.bce.1.stat_IfInRuleCheckerP4Hit: 71858
> dev.bce.1.stat_CatchupInRuleCheckerDiscards: 0
> dev.bce.1.stat_CatchupInFTQDiscards: 0
> dev.bce.1.stat_CatchupInMBUFDiscards: 0
> dev.bce.1.stat_CatchupInRuleCheckerP4Hit: 0
> dev.bce.1.com_no_buffers: 0
> dev.miibus.0.%parent: bce0
> dev.miibus.1.%parent: bce1
> }}}
New description:
It only support 2500requests/s and cpu with 8 cores 30% idle
circumstance: freebsd 7.0-RELEASE-p6,amd64,16G memory
sysctl -a | grep dev.em
{{{
dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 6.9.5
dev.em.0.%driver: em
dev.em.0.%location: slot=0 function=0
dev.em.0.%pnpinfo: vendor=0x8086 device=0x10b9 subvendor=0x103c
subdevice=0x704a class=0x020000
dev.em.0.%parent: pci3
dev.em.0.debug: -1
dev.em.0.stats: -1
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_delay: 66
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.rx_processing_limit: 100
dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 6.9.5
dev.em.1.%driver: em
dev.em.1.%location: slot=0 function=0
dev.em.1.%pnpinfo: vendor=0x8086 device=0x105e subvendor=0x8086
subdevice=0x135e class=0x020000
dev.em.1.%parent: pci5
dev.em.1.debug: -1
dev.em.1.stats: -1
dev.em.1.rx_int_delay: 0
dev.em.1.tx_int_delay: 66
dev.em.1.rx_abs_int_delay: 66
dev.em.1.tx_abs_int_delay: 66
dev.em.1.rx_processing_limit: 100
dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 6.9.5
dev.em.2.%driver: em
dev.em.2.%location: slot=0 function=1
dev.em.2.%pnpinfo: vendor=0x8086 device=0x105e subvendor=0x8086
subdevice=0x135e class=0x020000
dev.em.2.%parent: pci5
dev.em.2.debug: -1
dev.em.2.stats: -1
dev.em.2.rx_int_delay: 0
dev.em.2.tx_int_delay: 66
dev.em.2.rx_abs_int_delay: 66
dev.em.2.tx_abs_int_delay: 66
dev.em.2.rx_processing_limit: 100
}}}
But I test another server with Broadcom NetXtreme II BCM5708 ,Varnish can
support 5000Requests/s and cpu with 4 cores 60% idle
sysctl -a | grep bce
{{{
hw.bce.msi_enable: 1
hw.bce.tso_enable: 1
dev.bce.0.%desc: Broadcom NetXtreme II BCM5708 1000Base-T (B2)
dev.bce.0.%driver: bce
dev.bce.0.%location: slot=0 function=0
dev.bce.0.%pnpinfo: vendor=0x14e4 device=0x164c subvendor=0x103c
subdevice=0x7038 class=0x020000
dev.bce.0.%parent: pci3
dev.bce.0.mbuf_alloc_failed: 0
dev.bce.0.tx_dma_map_failures: 0
dev.bce.0.stat_IfHcInOctets: 15909040362
dev.bce.0.stat_IfHCInBadOctets: 131667110
dev.bce.0.stat_IfHCOutOctets: 185212112207
dev.bce.0.stat_IfHCOutBadOctets: 0
dev.bce.0.stat_IfHCInUcastPkts: 161658777
dev.bce.0.stat_IfHCInMulticastPkts: 438938
dev.bce.0.stat_IfHCInBroadcastPkts: 477415
dev.bce.0.stat_IfHCOutUcastPkts: 184433486
dev.bce.0.stat_IfHCOutMulticastPkts: 0
dev.bce.0.stat_IfHCOutBroadcastPkts: 1420
dev.bce.0.stat_emac_tx_stat_dot3statsinternalmactransmiterrors: 0
dev.bce.0.stat_Dot3StatsCarrierSenseErrors: 0
dev.bce.0.stat_Dot3StatsFCSErrors: 0
dev.bce.0.stat_Dot3StatsAlignmentErrors: 0
dev.bce.0.stat_Dot3StatsSingleCollisionFrames: 0
dev.bce.0.stat_Dot3StatsMultipleCollisionFrames: 0
dev.bce.0.stat_Dot3StatsDeferredTransmissions: 0
dev.bce.0.stat_Dot3StatsExcessiveCollisions: 0
dev.bce.0.stat_Dot3StatsLateCollisions: 0
dev.bce.0.stat_EtherStatsCollisions: 0
dev.bce.0.stat_EtherStatsFragments: 0
dev.bce.0.stat_EtherStatsJabbers: 0
dev.bce.0.stat_EtherStatsUndersizePkts: 0
dev.bce.0.stat_EtherStatsOverrsizePkts: 0
dev.bce.0.stat_EtherStatsPktsRx64Octets: 2089470
dev.bce.0.stat_EtherStatsPktsRx65Octetsto127Octets: 144899332
dev.bce.0.stat_EtherStatsPktsRx128Octetsto255Octets: 13352557
dev.bce.0.stat_EtherStatsPktsRx256Octetsto511Octets: 491736
dev.bce.0.stat_EtherStatsPktsRx512Octetsto1023Octets: 129797
dev.bce.0.stat_EtherStatsPktsRx1024Octetsto1522Octets: 1612238
dev.bce.0.stat_EtherStatsPktsRx1523Octetsto9022Octets: 0
dev.bce.0.stat_EtherStatsPktsTx64Octets: 2884585
dev.bce.0.stat_EtherStatsPktsTx65Octetsto127Octets: 37504043
dev.bce.0.stat_EtherStatsPktsTx128Octetsto255Octets: 16146437
dev.bce.0.stat_EtherStatsPktsTx256Octetsto511Octets: 6290529
dev.bce.0.stat_EtherStatsPktsTx512Octetsto1023Octets: 8170588
dev.bce.0.stat_EtherStatsPktsTx1024Octetsto1522Octets: 113438724
dev.bce.0.stat_EtherStatsPktsTx1523Octetsto9022Octets: 0
dev.bce.0.stat_XonPauseFramesReceived: 0
dev.bce.0.stat_XoffPauseFramesReceived: 0
dev.bce.0.stat_OutXonSent: 0
dev.bce.0.stat_OutXoffSent: 0
dev.bce.0.stat_FlowControlDone: 0
dev.bce.0.stat_MacControlFramesReceived: 0
dev.bce.0.stat_XoffStateEntered: 0
dev.bce.0.stat_IfInFramesL2FilterDiscards: 1370958
dev.bce.0.stat_IfInRuleCheckerDiscards: 0
dev.bce.0.stat_IfInFTQDiscards: 0
dev.bce.0.stat_IfInMBUFDiscards: 0
dev.bce.0.stat_IfInRuleCheckerP4Hit: 916351
dev.bce.0.stat_CatchupInRuleCheckerDiscards: 0
dev.bce.0.stat_CatchupInFTQDiscards: 0
dev.bce.0.stat_CatchupInMBUFDiscards: 0
dev.bce.0.stat_CatchupInRuleCheckerP4Hit: 0
dev.bce.0.com_no_buffers: 0
dev.bce.1.%desc: Broadcom NetXtreme II BCM5708 1000Base-T (B2)
dev.bce.1.%driver: bce
dev.bce.1.%location: slot=0 function=0
dev.bce.1.%pnpinfo: vendor=0x14e4 device=0x164c subvendor=0x103c
subdevice=0x7038 class=0x020000
dev.bce.1.%parent: pci5
dev.bce.1.mbuf_alloc_failed: 0
dev.bce.1.tx_dma_map_failures: 0
dev.bce.1.stat_IfHcInOctets: 4753538
dev.bce.1.stat_IfHCInBadOctets: 170783904
dev.bce.1.stat_IfHCOutOctets: 6144
dev.bce.1.stat_IfHCOutBadOctets: 0
dev.bce.1.stat_IfHCInUcastPkts: 1553
dev.bce.1.stat_IfHCInMulticastPkts: 86
dev.bce.1.stat_IfHCInBroadcastPkts: 71772
dev.bce.1.stat_IfHCOutUcastPkts: 95
dev.bce.1.stat_IfHCOutMulticastPkts: 0
dev.bce.1.stat_IfHCOutBroadcastPkts: 1
dev.bce.1.stat_emac_tx_stat_dot3statsinternalmactransmiterrors: 0
dev.bce.1.stat_Dot3StatsCarrierSenseErrors: 0
dev.bce.1.stat_Dot3StatsFCSErrors: 0
dev.bce.1.stat_Dot3StatsAlignmentErrors: 0
dev.bce.1.stat_Dot3StatsSingleCollisionFrames: 0
dev.bce.1.stat_Dot3StatsMultipleCollisionFrames: 0
dev.bce.1.stat_Dot3StatsDeferredTransmissions: 0
dev.bce.1.stat_Dot3StatsExcessiveCollisions: 0
dev.bce.1.stat_Dot3StatsLateCollisions: 0
dev.bce.1.stat_EtherStatsCollisions: 0
dev.bce.1.stat_EtherStatsFragments: 0
dev.bce.1.stat_EtherStatsJabbers: 0
dev.bce.1.stat_EtherStatsUndersizePkts: 0
dev.bce.1.stat_EtherStatsOverrsizePkts: 0
dev.bce.1.stat_EtherStatsPktsRx64Octets: 71912
dev.bce.1.stat_EtherStatsPktsRx65Octetsto127Octets: 1499
dev.bce.1.stat_EtherStatsPktsRx128Octetsto255Octets: 0
dev.bce.1.stat_EtherStatsPktsRx256Octetsto511Octets: 0
dev.bce.1.stat_EtherStatsPktsRx512Octetsto1023Octets: 0
dev.bce.1.stat_EtherStatsPktsRx1024Octetsto1522Octets: 0
dev.bce.1.stat_EtherStatsPktsRx1523Octetsto9022Octets: 0
dev.bce.1.stat_EtherStatsPktsTx64Octets: 96
dev.bce.1.stat_EtherStatsPktsTx65Octetsto127Octets: 0
dev.bce.1.stat_EtherStatsPktsTx128Octetsto255Octets: 0
dev.bce.1.stat_EtherStatsPktsTx256Octetsto511Octets: 0
dev.bce.1.stat_EtherStatsPktsTx512Octetsto1023Octets: 0
dev.bce.1.stat_EtherStatsPktsTx1024Octetsto1522Octets: 0
dev.bce.1.stat_EtherStatsPktsTx1523Octetsto9022Octets: 0
dev.bce.1.stat_XonPauseFramesReceived: 0
dev.bce.1.stat_XoffPauseFramesReceived: 0
dev.bce.1.stat_OutXonSent: 0
dev.bce.1.stat_OutXoffSent: 0
dev.bce.1.stat_FlowControlDone: 0
dev.bce.1.stat_MacControlFramesReceived: 0
dev.bce.1.stat_XoffStateEntered: 0
dev.bce.1.stat_IfInFramesL2FilterDiscards: 1299564
dev.bce.1.stat_IfInRuleCheckerDiscards: 0
dev.bce.1.stat_IfInFTQDiscards: 0
dev.bce.1.stat_IfInMBUFDiscards: 0
dev.bce.1.stat_IfInRuleCheckerP4Hit: 71858
dev.bce.1.stat_CatchupInRuleCheckerDiscards: 0
dev.bce.1.stat_CatchupInFTQDiscards: 0
dev.bce.1.stat_CatchupInMBUFDiscards: 0
dev.bce.1.stat_CatchupInRuleCheckerP4Hit: 0
dev.bce.1.com_no_buffers: 0
dev.miibus.0.%parent: bce0
dev.miibus.1.%parent: bce1
}}}
Comment:
If you have performance problems with your NIC, Varnish is probably not
the right place to file a bug. We just use the BSD sockets API, and
accept the performance we get from the kernel.
You might have more luck asking for help on a FreeBSD specific mailing
list.
--
Ticket URL: <http://varnish.projects.linpro.no/ticket/404#comment:1>
Varnish <http://varnish.projects.linpro.no/>
The Varnish HTTP Accelerator
More information about the varnish-bugs
mailing list