linux/crypto
Eric Dumazet 1abe267f17 net: add sk_wake_async_rcu() helper
While looking at UDP receive performance, I saw sk_wake_async()
was no longer inlined.

This matters at least on AMD Zen1-4 platforms (see SRSO)

This might be because rcu_read_lock() and rcu_read_unlock()
are no longer nops in recent kernels ?

Add sk_wake_async_rcu() variant, which must be called from
contexts already holding rcu lock.

As SOCK_FASYNC is deprecated in modern days, use unlikely()
to give a hint to the compiler.

sk_wake_async_rcu() is properly inlined from
__udp_enqueue_schedule_skb() and sock_def_readable().

Signed-off-by: Eric Dumazet <edumazet@google.com>
Link: https://lore.kernel.org/r/20240328144032.1864988-5-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
2024-03-29 15:03:11 -07:00
..
asymmetric_keys Revert "crypto: pkcs7 - remove sha1 support" 2024-03-22 19:42:20 +08:00
async_tx
842.c
acompress.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
adiantum.c
aead.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
aegis-neon.h
aegis.h
aegis128-core.c
aegis128-neon-inner.c
aegis128-neon.c
aes_generic.c
aes_ti.c
af_alg.c net: add sk_wake_async_rcu() helper 2024-03-29 15:03:11 -07:00
ahash.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
akcipher.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
algapi.c
algboss.c
algif_aead.c
algif_hash.c
algif_rng.c
algif_skcipher.c
ansi_cprng.c
anubis.c
api.c
arc4.c
aria_generic.c
authenc.c
authencesn.c
blake2b_generic.c
blowfish_common.c
blowfish_generic.c
camellia_generic.c
cast5_generic.c
cast6_generic.c
cast_common.c
cbc.c
ccm.c
chacha20poly1305.c
chacha_generic.c
cipher.c
cmac.c
compress.c
compress.h Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
crc32_generic.c
crc32c_generic.c
crc64_rocksoft_generic.c
crct10dif_common.c
crct10dif_generic.c
cryptd.c
crypto_engine.c
crypto_null.c
crypto_user_base.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
crypto_user_stat.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
ctr.c
cts.c
curve25519-generic.c
deflate.c
des_generic.c
dh.c
dh_helper.c
drbg.c
ecb.c
ecc.c
ecc_curve_defs.h
ecdh.c
ecdh_helper.c
ecdsa.c
ecdsasignature.asn1
echainiv.c
ecrdsa.c
ecrdsa_defs.h
ecrdsa_params.asn1
ecrdsa_pub_key.asn1
essiv.c
fcrypt.c
fips.c
gcm.c
geniv.c
ghash-generic.c
hash.h Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
hash_info.c
hctr2.c
hmac.c
internal.h
jitterentropy-kcapi.c
jitterentropy-testing.c
jitterentropy.c
jitterentropy.h
Kconfig RISC-V Patches for the 6.9 Merge Window 2024-03-22 10:41:13 -07:00
kdf_sp800108.c
keywrap.c
khazad.c
kpp.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
lrw.c
lskcipher.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
lz4.c
lz4hc.c
lzo-rle.c
lzo.c
Makefile Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
md4.c
md5.c
michael_mic.c
nhpoly1305.c
pcbc.c
pcrypt.c
poly1305_generic.c
polyval-generic.c
proc.c
ripemd.h
rmd160.c
rng.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
rsa-pkcs1pad.c
rsa.c
rsa_helper.c
rsaprivkey.asn1
rsapubkey.asn1
scatterwalk.c
scompress.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
seed.c
seqiv.c
serpent_generic.c
sha1_generic.c
sha3_generic.c
sha256_generic.c
sha512_generic.c
shash.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
sig.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
simd.c
skcipher.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
skcipher.h Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
sm2.c
sm2signature.asn1
sm3.c
sm3_generic.c
sm4.c
sm4_generic.c
streebog_generic.c
tcrypt.c
tcrypt.h
tea.c
testmgr.c
testmgr.h Revert "crypto: pkcs7 - remove sha1 support" 2024-03-22 19:42:20 +08:00
twofish_common.c
twofish_generic.c
vmac.c
wp512.c
xcbc.c
xctr.c
xor.c
xts.c
xxhash_generic.c
zstd.c