Eric Dumazet d26b3a7c4b ipv4: percpu nh_rth_output cache ... Input path is mostly run under RCU and doesnt touch dst refcnt But output path on forwarding or UDP workloads hits badly dst refcount, and we have lot of false sharing, for example in ipv4_mtu() when reading rt->rt_pmtu Using a percpu cache for nh_rth_output gives a nice performance increase at a small cost. 24 udpflood test on my 24 cpu machine (dummy0 output device) (each process sends 1.000.000 udp frames, 24 processes are started) before : 5.24 s after : 2.06 s For reference, time on linux-3.5 : 6.60 s Signed-off-by: Eric Dumazet <edumazet@google.com> Tested-by: Alexander Duyck <alexander.h.duyck@intel.com> Signed-off-by: David S. Miller <davem@davemloft.net>		2012-07-31 14:41:39 -07:00
..
netfilter	ipv4: Adjust semantics of rt->rt_gateway.	2012-07-20 13:31:20 -07:00
af_inet.c	net-tcp: Fast Open client - sendmsg(MSG_FASTOPEN)	2012-07-19 11:02:03 -07:00
ah4.c	ipv4: Add redirect support to all protocol icmp error handlers.	2012-07-11 21:27:49 -07:00
arp.c	ipv4: Fix input route performance regression.	2012-07-26 15:50:39 -07:00
cipso_ipv4.c	cipso: don't follow a NULL pointer when setsockopt() is called	2012-07-18 09:01:12 -07:00
datagram.c
devinet.c	ipv4: Add interface option to enable routing of 127.0.0.0/8	2012-06-12 15:25:46 -07:00
esp4.c	ipv4: Add redirect support to all protocol icmp error handlers.	2012-07-11 21:27:49 -07:00
fib_frontend.c	ipv4: Remove redundant assignment	2012-07-23 13:00:54 -07:00
fib_lookup.h
fib_rules.c	ipv4: Don't store a rule pointer in fib_result.	2012-07-13 08:21:29 -07:00
fib_semantics.c	ipv4: percpu nh_rth_output cache	2012-07-31 14:41:39 -07:00
fib_trie.c	ipv4: clean up put_child	2012-07-29 23:18:30 -07:00
gre.c
icmp.c	ipv4: Prepare for change of rt->rt_iif encoding.	2012-07-23 16:36:26 -07:00
igmp.c	ipv4: fix checkpatch errors	2012-04-15 12:37:19 -04:00
inet_connection_sock.c	ipv4: Kill FLOWI_FLAG_RT_NOCACHE and associated code.	2012-07-20 13:36:54 -07:00
inet_diag.c	net: make sock diag per-namespace	2012-07-16 22:31:34 -07:00
inet_fragment.c	inetpeer: add parameter net for inet_getpeer_v4,v6	2012-06-08 14:27:23 -07:00
inet_hashtables.c	ipv4: fix checkpatch errors	2012-04-15 12:37:19 -04:00
inet_lro.c
inet_timewait_sock.c	net: ipv4 and ipv6: Convert printk(KERN_DEBUG to pr_debug	2012-05-16 01:01:03 -04:00
inetpeer.c	ipv4: Maintain redirect and PMTU info in struct rtable again.	2012-07-10 22:40:14 -07:00
ip_forward.c	snmp: fix OutOctets counter to include forwarded datagrams	2012-06-07 14:50:56 -07:00
ip_fragment.c	ipv4: Fix input route performance regression.	2012-07-26 15:50:39 -07:00
ip_gre.c	ipv4: Adjust semantics of rt->rt_gateway.	2012-07-20 13:31:20 -07:00
ip_input.c	net: TCP early demux cleanup	2012-07-30 14:53:21 -07:00
ip_options.c	ipv4: optimize fib_compute_spec_dst call in ip_options_echo	2012-07-19 08:30:49 -07:00
ip_output.c	Merge branch 'kill_rtcache'	2012-07-22 17:04:15 -07:00
ip_sockglue.c	ipv4: Prepare for change of rt->rt_iif encoding.	2012-07-23 16:36:26 -07:00
ip_vti.c	net/ipv4/ip_vti.c: Fix __rcu warnings detected by sparse.	2012-07-23 13:00:54 -07:00
ipcomp.c	ipv4: Add redirect support to all protocol icmp error handlers.	2012-07-11 21:27:49 -07:00
ipconfig.c	net/ipv4/ipconfig: neaten __setup placement	2012-05-20 04:06:16 -04:00
ipip.c	ipv4: Adjust semantics of rt->rt_gateway.	2012-07-20 13:31:20 -07:00
ipmr.c	ipv4: Kill rt->rt_oif	2012-07-20 13:38:34 -07:00
Kconfig	net/ipv4: VTI support new module for ip_vti.	2012-07-18 09:36:12 -07:00
Makefile	net-tcp: Fast Open base	2012-07-19 10:55:36 -07:00
netfilter.c	net: Delete all remaining instances of ctl_path	2012-04-20 21:22:30 -04:00
ping.c	ipv4: Add redirect support to all protocol icmp error handlers.	2012-07-11 21:27:49 -07:00
proc.c	net-tcp: Fast Open client - sending SYN-data	2012-07-19 11:02:03 -07:00
protocol.c	inet: Sanitize inet{,6} protocol demux.	2012-06-19 18:56:21 -07:00
raw.c	ipv4: Add redirect support to all protocol icmp error handlers.	2012-07-11 21:27:49 -07:00
route.c	ipv4: percpu nh_rth_output cache	2012-07-31 14:41:39 -07:00
syncookies.c	net-tcp: Fast Open base	2012-07-19 10:55:36 -07:00
sysctl_net_ipv4.c	ipv4: remove rt_cache_rebuild_count	2012-07-30 14:53:22 -07:00
tcp.c	tcp: Add TCP_USER_TIMEOUT negative value check	2012-07-27 13:45:50 -07:00
tcp_bic.c
tcp_cong.c	tcp: fix ABC in tcp_slow_start()	2012-07-20 10:59:41 -07:00
tcp_cubic.c
tcp_diag.c
tcp_fastopen.c	net-tcp: Fast Open base	2012-07-19 10:55:36 -07:00
tcp_highspeed.c
tcp_htcp.c
tcp_hybla.c	tcp: bool conversions	2012-05-17 14:59:59 -04:00
tcp_illinois.c
tcp_input.c	net: ipv4: fix RCU races on dst refcounts	2012-07-30 14:53:22 -07:00
tcp_ipv4.c	net: ipv4: fix RCU races on dst refcounts	2012-07-30 14:53:22 -07:00
tcp_lp.c
tcp_memcontrol.c	memcg: decrement static keys at real destroy time	2012-05-29 16:22:28 -07:00
tcp_metrics.c	tcp: avoid oops in tcp_metrics and reset tcpm_stamp	2012-07-23 00:57:12 -07:00
tcp_minisocks.c	net: ipv4: fix RCU races on dst refcounts	2012-07-30 14:53:22 -07:00
tcp_output.c	tcp: dont drop MTU reduction indications	2012-07-23 00:58:46 -07:00
tcp_probe.c	net: cleanup unsigned to unsigned int	2012-04-15 12:44:40 -04:00
tcp_scalable.c
tcp_timer.c	tcp: improve latencies of timer triggered events	2012-07-20 10:59:41 -07:00
tcp_vegas.c
tcp_vegas.h
tcp_veno.c
tcp_westwood.c
tcp_yeah.c
tunnel4.c
udp.c	ipv4: Add redirect support to all protocol icmp error handlers.	2012-07-11 21:27:49 -07:00
udp_diag.c	net: make sock diag per-namespace	2012-07-16 22:31:34 -07:00
udp_impl.h	ipv4: fix checkpatch errors	2012-04-15 12:37:19 -04:00
udplite.c
xfrm4_input.c	ipv4: Fix input route performance regression.	2012-07-26 15:50:39 -07:00
xfrm4_mode_beet.c
xfrm4_mode_transport.c
xfrm4_mode_tunnel.c	net/ipv4: VTI support rx-path hook in xfrm4_mode_tunnel.	2012-07-18 09:36:12 -07:00
xfrm4_output.c
xfrm4_policy.c	ipv4: Turn rt->rt_route_iif into rt->rt_is_input.	2012-07-20 13:40:02 -07:00
xfrm4_state.c
xfrm4_tunnel.c