Vlastimil Babka 7612921f23 mm, page_alloc: move draining pcplists to page isolation users ... Currently, pcplists are drained during set_migratetype_isolate() which means once per pageblock processed start_isolate_page_range(). This is somewhat wasteful. Moreover, the callers might need different guarantees, and the draining is currently prone to races and does not guarantee that no page from isolated pageblock will end up on the pcplist after the drain. Better guarantees are added by later patches and require explicit actions by page isolation users that need them. Thus it makes sense to move the current imperfect draining to the callers also as a preparation step. Link: https://lkml.kernel.org/r/20201111092812.11329-7-vbabka@suse.cz Suggested-by: David Hildenbrand <david@redhat.com> Suggested-by: Pavel Tatashin <pasha.tatashin@soleen.com> Signed-off-by: Vlastimil Babka <vbabka@suse.cz> Reviewed-by: David Hildenbrand <david@redhat.com> Reviewed-by: Oscar Salvador <osalvador@suse.de> Acked-by: Michal Hocko <mhocko@suse.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2020-12-15 12:13:43 -08:00
..
kasan	kasan: print workqueue stack	2020-12-15 12:13:42 -08:00
backing-dev.c
balloon_compaction.c
cleancache.c
cma.c
cma.h
cma_debug.c
compaction.c	mm/compaction: stop isolation if too many pages are isolated and we have pages to migrate	2020-11-14 11:26:03 -08:00
debug.c
debug_page_ref.c
debug_vm_pgtable.c	mm/debug_vm_pgtable: avoid doing memory allocation with pgtable_t mapped.	2020-10-16 11:11:14 -07:00
dmapool.c
early_ioremap.c
fadvise.c
failslab.c
filemap.c	mm: memcontrol: add file_thp, shmem_thp to memory.stat	2020-12-15 12:13:39 -08:00
frame_vector.c
frontswap.c
gup.c	mm/gup: combine put_compound_head() and unpin_user_page()	2020-12-15 12:13:39 -08:00
gup_test.c	mm/gup_test.c: mark gup_test_init as __init function	2020-12-15 12:13:38 -08:00
gup_test.h	selftests/vm: gup_test: introduce the dump_pages() sub-test	2020-12-15 12:13:38 -08:00
highmem.c	mm/highmem.c: clean up endif comments	2020-10-16 11:11:18 -07:00
hmm.c
huge_memory.c	mm/rmap: always do TTU_IGNORE_ACCESS	2020-12-15 12:13:39 -08:00
hugetlb.c	vm_ops: rename .split() callback to .may_split()	2020-12-15 12:13:41 -08:00
hugetlb_cgroup.c	hugetlb_cgroup: fix offline of hugetlb cgroup with reservations	2020-12-06 10:19:07 -08:00
hwpoison-inject.c	mm,hwpoison-inject: don't pin for hwpoison_filter	2020-10-16 11:11:16 -07:00
init-mm.c	mm/gup: prevent gup_fast from racing with COW during fork	2020-12-15 12:13:39 -08:00
internal.h	mm: move free_unref_page to mm/internal.h	2020-12-15 12:13:41 -08:00
interval_tree.c
ioremap.c
Kconfig	mm/gup_test: GUP_TEST depends on DEBUG_FS	2020-12-15 12:13:38 -08:00
Kconfig.debug
khugepaged.c	mm: memcontrol: add file_thp, shmem_thp to memory.stat	2020-12-15 12:13:39 -08:00
kmemleak.c
ksm.c
list_lru.c	mm: list_lru: set shrinker map bit when child nr_items is not zero	2020-12-06 10:19:07 -08:00
maccess.c
madvise.c	mm/madvise: remove racy mm ownership check	2020-12-08 20:57:18 -08:00
Makefile	mm: mmap_lock: add tracepoints around lock acquisition	2020-12-15 12:13:41 -08:00
mapping_dirty_helpers.c	mm/mapping_dirty_helpers: enhance the kernel-doc markups	2020-12-15 12:13:41 -08:00
memblock.c	arm, arm64: move free_unused_memmap() to generic mm	2020-12-15 12:13:42 -08:00
memcontrol.c	mm: memcontrol: account pagetables per node	2020-12-15 12:13:40 -08:00
memfd.c
memory-failure.c	mm/rmap: always do TTU_IGNORE_ACCESS	2020-12-15 12:13:39 -08:00
memory.c	mm: cleanup: remove unused tsk arg from __access_remote_vm	2020-12-15 12:13:40 -08:00
memory_hotplug.c	mm, page_alloc: move draining pcplists to page isolation users	2020-12-15 12:13:43 -08:00
mempolicy.c	mm: mempolicy: fix potential pte_unmap_unlock pte error	2020-11-02 12:14:19 -08:00
mempool.c
memremap.c	mm/mremap_pages: fix static key devmap_managed_key updates	2020-11-02 12:14:18 -08:00
memtest.c
migrate.c	mm/rmap: always do TTU_IGNORE_ACCESS	2020-12-15 12:13:39 -08:00
mincore.c
mlock.c
mm_init.c
mmap.c	mm: forbid splitting special mappings	2020-12-15 12:13:41 -08:00
mmap_lock.c	mm: mmap_lock: add tracepoints around lock acquisition	2020-12-15 12:13:41 -08:00
mmu_gather.c
mmu_notifier.c	mm: track mmu notifiers in fs_reclaim_acquire/release	2020-12-15 12:13:41 -08:00
mmzone.c	arm: remove CONFIG_ARCH_HAS_HOLES_MEMORYMODEL	2020-12-15 12:13:42 -08:00
mprotect.c
mremap.c	mremap: check if it's possible to split original vma	2020-12-15 12:13:41 -08:00
msync.c
nommu.c	mm: cleanup: remove unused tsk arg from __access_remote_vm	2020-12-15 12:13:40 -08:00
oom_kill.c
page-writeback.c	mm: fix VM_BUG_ON(PageTail) and BUG_ON(PageWriteback)	2020-11-24 15:23:19 -08:00
page_alloc.c	mm, page_alloc: move draining pcplists to page isolation users	2020-12-15 12:13:43 -08:00
page_counter.c	mm/page_counter: use page_counter_read in page_counter_set_max	2020-12-15 12:13:40 -08:00
page_ext.c	mm: fix page_owner initializing issue for arm32	2020-12-15 12:13:38 -08:00
page_idle.c
page_io.c
page_isolation.c	mm, page_alloc: move draining pcplists to page isolation users	2020-12-15 12:13:43 -08:00
page_owner.c	mm/page_owner: record timestamp and pid	2020-12-15 12:13:38 -08:00
page_poison.c	mm/page_poison.c: replace bool variable with static key	2020-10-16 11:11:17 -07:00
page_reporting.c	mm: rename page_order() to buddy_order()	2020-10-16 11:11:19 -07:00
page_reporting.h
page_vma_mapped.c	mm/page_vma_mapped.c: add colon to fix kernel-doc markups error for check_pte	2020-12-15 12:13:41 -08:00
pagewalk.c
percpu-internal.h
percpu-km.c
percpu-stats.c
percpu-vm.c
percpu.c	percpu: convert flexible array initializers to use struct_size()	2020-10-30 23:02:28 +00:00
pgalloc-track.h
pgtable-generic.c
process_vm_access.c	mm/process_vm_access: Add missing #include <linux/compat.h>	2020-10-27 12:41:29 -07:00
ptdump.c
readahead.c	mm: use limited read-ahead to satisfy read	2020-10-17 13:49:08 -06:00
rmap.c	mm/rmap: always do TTU_IGNORE_ACCESS	2020-12-15 12:13:39 -08:00
rodata_test.c
shmem.c	mm: memcontrol: add file_thp, shmem_thp to memory.stat	2020-12-15 12:13:39 -08:00
shuffle.c	mm: rename page_order() to buddy_order()	2020-10-16 11:11:19 -07:00
shuffle.h
slab.c	mm: introduce debug_pagealloc_{map,unmap}_pages() helpers	2020-12-15 12:13:43 -08:00
slab.h	mm: extract might_alloc() debug check	2020-12-15 12:13:41 -08:00
slab_common.c	mm: slab: clarify krealloc()'s behavior with __GFP_ZERO	2020-12-15 12:13:37 -08:00
slob.c	mm: extract might_alloc() debug check	2020-12-15 12:13:41 -08:00
slub.c	mm/slub: let number of online CPUs determine the slub page order	2020-12-15 12:13:38 -08:00
sparse-vmemmap.c
sparse.c	mm/memory_hotplug: guard more declarations by CONFIG_MEMORY_HOTPLUG	2020-10-16 11:11:18 -07:00
swap.c	mm: remove pagevec_lookup_range_nr_tag()	2020-12-15 12:13:39 -08:00
swap_cgroup.c
swap_slots.c
swap_state.c	mm/swap_state: skip meaningless swap cache readahead when ra_info.win == 0	2020-12-15 12:13:39 -08:00
swapfile.c	mm/swapfile.c: use memset to fill the swap_map with SWAP_HAS_CACHE	2020-12-15 12:13:39 -08:00
truncate.c	mm/truncate: add parameter explanation for invalidate_mapping_pagevec	2020-12-15 12:13:38 -08:00
usercopy.c
userfaultfd.c
util.c	mm/util.c: update the kerneldoc for kstrdup_const()	2020-10-16 11:11:17 -07:00
vmacache.c
vmalloc.c	mm/vmalloc.c: fix kasan shadow poisoning size	2020-12-15 12:13:42 -08:00
vmpressure.c
vmscan.c	mm/rmap: always do TTU_IGNORE_ACCESS	2020-12-15 12:13:39 -08:00
vmstat.c	arm: remove CONFIG_ARCH_HAS_HOLES_MEMORYMODEL	2020-12-15 12:13:42 -08:00
workingset.c	mm: memcg/slab: rename *_lruvec_slab_state to *_lruvec_kmem_state	2020-12-15 12:13:40 -08:00
z3fold.c
zbud.c
zpool.c
zsmalloc.c	mm/zsmalloc.c: drop ZSMALLOC_PGTABLE_MAPPING	2020-12-06 10:19:07 -08:00
zswap.c