Shaohua Li 61c77326d1 x86, mm: Avoid unnecessary TLB flush ... In x86, access and dirty bits are set automatically by CPU when CPU accesses memory. When we go into the code path of below flush_tlb_fix_spurious_fault(), we already set dirty bit for pte and don't need flush tlb. This might mean tlb entry in some CPUs hasn't dirty bit set, but this doesn't matter. When the CPUs do page write, they will automatically check the bit and no software involved. On the other hand, flush tlb in below position is harmful. Test creates CPU number of threads, each thread writes to a same but random address in same vma range and we measure the total time. Under a 4 socket system, original time is 1.96s, while with the patch, the time is 0.8s. Under a 2 socket system, there is 20% time cut too. perf shows a lot of time are taking to send ipi/handle ipi for tlb flush. Signed-off-by: Shaohua Li <shaohua.li@intel.com> LKML-Reference: <20100816011655.GA362@sli10-desk.sh.intel.com> Acked-by: Suresh Siddha <suresh.b.siddha@intel.com> Cc: Andrea Archangeli <aarcange@redhat.com> Signed-off-by: H. Peter Anvin <hpa@zytor.com>		2010-08-23 10:04:57 -07:00
..
Kconfig	lmb: rename to memblock	2010-07-14 17:14:00 +10:00
Kconfig.debug	trivial: improve help text for mm debug config options	2009-09-21 15:14:57 +02:00
Makefile	lmb: rename to memblock	2010-07-14 17:14:00 +10:00
backing-dev.c	writeback: avoid unnecessary calculation of bdi dirty thresholds	2010-08-12 08:43:29 -07:00
bootmem.c	x86,nobootmem: make alloc_bootmem_node fall back to other node when 32bit numa is used	2010-07-20 16:25:40 -07:00
bounce.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
compaction.c	mm: compaction: add a tunable that decides when memory should be compacted and when it should be reclaimed	2010-05-25 08:06:59 -07:00
debug-pagealloc.c	generic debug pagealloc	2009-04-01 08:59:13 -07:00
dmapool.c	dmapools: protect page_list walk in show_pools()	2009-06-30 18:56:00 -07:00
fadvise.c	readahead: introduce FMODE_RANDOM for POSIX_FADV_RANDOM	2010-03-06 11:26:25 -08:00
failslab.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
filemap.c	gcc-4.6: mm: fix unused but set warnings	2010-08-09 20:44:58 -07:00
filemap_xip.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
fremap.c	mm: clean up mm_counter	2010-03-06 11:26:23 -08:00
highmem.c	mm,kdb,kgdb: Add a debug reference for the kdb kmap usage	2010-08-05 09:22:24 -05:00
hugetlb.c	Merge branch 'hwpoison' of git://git.kernel.org/pub/scm/linux/kernel/git/ak/linux-mce-2.6	2010-08-12 10:15:10 -07:00
hwpoison-inject.c	HWPOISON, hugetlb: support hwpoison injection for hugepage	2010-08-11 09:23:11 +02:00
init-mm.c	mm: provide init_mm mm_context initializer	2010-08-09 20:44:54 -07:00
internal.h	HWPOISON: add an interface to switch off/on all the page filters	2009-12-16 12:19:59 +01:00
kmemcheck.c	kmemcheck: Fix build errors due to missing slab.h	2010-03-30 22:02:32 +09:00
kmemleak-test.c	percpu: clean up percpu variable definitions	2009-06-24 15:13:48 +09:00
kmemleak.c	kmemleak: Fix typo in the comment	2010-08-08 21:57:23 +01:00
ksm.c	ksm: cleanup for mm_slots_hash	2010-08-09 20:45:03 -07:00
maccess.c	maccess,probe_kernel: Allow arch specific override probe_kernel_(read|write)	2010-01-07 11:58:36 -06:00
madvise.c	HWPOISON: Add a madvise() injector for soft page offlining	2009-12-16 12:20:00 +01:00
memblock.c	memblock: Fix memblock_is_region_reserved() to return a boolean	2010-08-09 11:21:38 +10:00
memcontrol.c	memcg: convert to use zone_to_nid() from bare zone->zone_pgdat->node_id	2010-08-11 08:59:19 -07:00
memory-failure.c	Merge branch 'hwpoison' of git://git.kernel.org/pub/scm/linux/kernel/git/ak/linux-mce-2.6	2010-08-12 10:15:10 -07:00
memory.c	x86, mm: Avoid unnecessary TLB flush	2010-08-23 10:04:57 -07:00
memory_hotplug.c	mem-hotplug: fix potential race while building zonelist for new populated zone	2010-05-25 08:07:02 -07:00
mempolicy.c	mempolicy: reduce stack size of migrate_pages()	2010-08-09 20:44:58 -07:00
mempool.c	mm: remove broken 'kzalloc' mempool	2009-09-22 07:17:35 -07:00
migrate.c	mm: extend KSM refcounts to the anon_vma root	2010-08-09 20:44:55 -07:00
mincore.c	mincore: do nested page table walks	2010-05-25 08:06:58 -07:00
mlock.c	mm: make the mlock() stack guard page checks stricter	2010-08-21 08:49:50 -07:00
mm_init.c	mm: mminit_loglevel cannot be __meminitdata anymore	2008-08-20 15:40:30 -07:00
mmap.c	mm: make the vma list be doubly linked	2010-08-21 08:49:21 -07:00
mmu_context.c	exit: fix oops in sync_mm_rss	2010-03-24 16:31:21 -07:00
mmu_notifier.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mmzone.c	[ARM] Double check memmap is actually valid with a memmap has unexpected holes V2	2009-05-18 11:22:24 +01:00
mprotect.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mremap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
msync.c	sanitize vfs_fsync calling conventions	2010-05-21 18:31:21 -04:00
nommu.c	mm: make the vma list be doubly linked	2010-08-21 08:49:21 -07:00
oom_kill.c	oom: __task_cred() need rcu_read_lock()	2010-08-20 09:34:55 -07:00
page-writeback.c	lib/radix-tree.c: fix overflow in radix_tree_range_tag_if_tagged()	2010-08-20 09:34:55 -07:00
page_alloc.c	vmscan: kill prev_priority completely	2010-08-09 20:45:00 -07:00
page_cgroup.c	kmemleak: Annotate false positive in init_section_page_cgroup()	2010-07-19 11:54:14 +01:00
page_io.c	block: unify flags for struct bio and struct request	2010-08-07 18:20:39 +02:00
page_isolation.c	memory hotplug: fix page_zone() calculation in test_pages_isolated()	2008-11-06 15:41:19 -08:00
pagewalk.c	pagemap: fix pfn calculation for hugepage	2010-04-07 08:38:04 -07:00
percpu-km.c	percpu: implement kernel memory based chunk allocation	2010-05-01 08:30:50 +02:00
percpu-vm.c	percpu: move vmalloc based chunk management into percpu-vm.c	2010-05-01 08:30:50 +02:00
percpu.c	percpu: allow limited allocation before slab is online	2010-06-27 18:50:00 +02:00
percpu_up.c	percpu: don't implicitly include slab.h from percpu.h	2010-03-30 22:02:32 +09:00
prio_tree.c	…
quicklist.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
readahead.c	readahead.c: fix comment	2010-05-25 08:07:00 -07:00
rmap.c	Merge branch 'hwpoison' of git://git.kernel.org/pub/scm/linux/kernel/git/ak/linux-mce-2.6	2010-08-12 10:15:10 -07:00
shmem.c	shmem: put_super must percpu_counter_destroy	2010-08-17 18:33:11 -07:00
slab.c	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6	2010-08-22 10:08:52 -07:00
slob.c	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6	2010-08-06 11:44:08 -07:00
slub.c	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6	2010-08-06 11:44:08 -07:00
sparse-vmemmap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
sparse.c	sparsemem: on no vmemmap path put mem_map on node high too	2010-05-25 08:06:56 -07:00
swap.c	mm: export lru_cache_add_*() to modules	2010-05-25 15:06:06 +02:00
swap_state.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
swapfile.c	hibernation: freeze swap at hibernation	2010-08-09 20:45:04 -07:00
thrash.c	mm: pass mm to grab_swap_token	2009-06-23 12:50:05 -07:00
truncate.c	check ATTR_SIZE contraints in inode_change_ok	2010-08-09 16:47:39 -04:00
util.c	mm: use memdup_user	2010-08-09 20:44:54 -07:00
vmalloc.c	Merge branch 'stable/xen-swiotlb-0.8.6' of git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen	2010-08-12 09:09:41 -07:00
vmscan.c	memcg: remove nid and zid argument from mem_cgroup_soft_limit_reclaim()	2010-08-11 08:59:19 -07:00
vmstat.c	vmscan: kill prev_priority completely	2010-08-09 20:45:00 -07:00