Waiman Long dd9439ce61 locking/rwsem: Make rwsem->owner an atomic_long_t ...

The rwsem->owner contains not just the task structure pointer, it also
holds some flags for storing the current state of the rwsem. Some of
the flags may have to be atomically updated. To reflect the new reality,
the owner is now changed to an atomic_long_t type.

New helper functions are added to properly separate out the task
structure pointer and the embedded flags.

Suggested-by: Peter Zijlstra <peterz@infradead.org>
Signed-off-by: Waiman Long <longman@redhat.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Cc: Borislav Petkov <bp@alien8.de>
Cc: Davidlohr Bueso <dave@stgolabs.net>
Cc: H. Peter Anvin <hpa@zytor.com>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Thomas Gleixner <tglx@linutronix.de>
Cc: Tim Chen <tim.c.chen@linux.intel.com>
Cc: Will Deacon <will.deacon@arm.com>
Cc: huang ying <huang.ying.caritas@gmail.com>
Link: https://lkml.kernel.org/r/20190520205918.22251-14-longman@redhat.com
Signed-off-by: Ingo Molnar <mingo@kernel.org>
Signed-off-by: Danny Lin <danny@kdrag0n.dev>

2022-04-03 15:29:11 +00:00

..

lockdep_internals.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

lockdep_proc.c

locking/lockdep: Fix overflow in presentation of average lock-time

2020-09-03 11:22:27 +02:00

lockdep_states.h

locking/lockdep: Rework FS_RECLAIM annotation

2017-08-10 12:29:03 +02:00

lockdep.c

rcu: Squash backport from v5.4

2022-01-22 14:28:43 +00:00

locktorture.c

rcu: Squash backport from v5.4

2022-01-22 14:28:43 +00:00

Makefile

locking/rwsem: Merge rwsem.h and rwsem-xadd.c into rwsem.c

2022-04-03 15:29:10 +00:00

mcs_spinlock.h

locking/mcs: Use smp_cond_load_acquire() in MCS spin loop

2021-11-21 12:43:02 +00:00

mutex-debug.c

…

mutex-debug.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

mutex.c

locking/mutex: Don't hog RCU read lock while optimistically spinning

2021-04-12 08:32:11 +00:00

mutex.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

osq_lock.c

locking/osq: Use optimized spinning loop for arm64

2021-11-21 12:43:03 +00:00

percpu-rwsem.c

locking/rwsem: Remove arch specific rwsem files

2022-04-03 15:29:07 +00:00

qrwlock.c

locking/qrwlock: Cleanup queued_write_lock_slowpath()

2021-11-21 12:43:03 +00:00

qspinlock_paravirt.h

Merge branch 'qspinlock'

2021-08-16 13:11:54 +00:00

qspinlock_stat.h

Merge branch 'qspinlock'

2021-08-16 13:11:54 +00:00

qspinlock.c

Revert "locking/qspinlock, x86: Provide liveness guarantee"

2022-04-03 15:28:47 +00:00

rtmutex_common.h

rtmutex: Remove unused argument from rt_mutex_proxy_unlock()

2021-01-30 13:31:16 +01:00

rtmutex-debug.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

rtmutex-debug.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

rtmutex.c

rtmutex: Remove unused argument from rt_mutex_proxy_unlock()

2021-01-30 13:31:16 +01:00

rtmutex.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

rwsem.c

locking/rwsem: Make rwsem->owner an atomic_long_t

2022-04-03 15:29:11 +00:00

rwsem.h

locking/rwsem: Merge rwsem.h and rwsem-xadd.c into rwsem.c

2022-04-03 15:29:10 +00:00

semaphore.c

sched/headers: Prepare for new header dependencies before moving code to <linux/sched/debug.h>

2017-03-02 08:42:34 +01:00

spinlock_debug.c

Merge android-4.14.164 (d2905c6) into msm-4.14

2020-05-15 16:20:21 +05:30

spinlock.c

Mark spinlocks noinline when inline spinlocks are disabled

2022-01-19 09:40:37 +00:00

test-ww_mutex.c

locking/ww_mutex: Fix runtime warning in the WW mutex selftest

2018-11-04 14:52:41 +01:00