2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:06 +02:00
|
|
|
|
2026-02-27 07:44:36 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2026-02-27 07:44:36 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2026-02-27 07:44:38 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-03-25 08:40:06 +02:00
|
|
|
|
2024-03-25 08:40:05 +02:00
|
|
|
|
|
|
|
|
|
2024-04-09 09:26:39 +03:00
|
|
|
|
2024-03-25 08:40:05 +02:00
|
|
|
|
2024-03-25 08:40:06 +02:00
|
|
|
|
2019-06-26 12:02:00 +02:00
|
|
|
|
|
|
|
|
|
2024-03-25 08:40:11 +02:00
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2024-03-25 08:40:11 +02:00
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2024-03-25 08:40:11 +02:00
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2024-03-25 08:40:11 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
lib/vdso: Allow architectures to override the ns shift operation
On powerpc/32, GCC (8.1) generates pretty bad code for the ns >>= vd->shift
operation taking into account that the shift is always <= 32 and the upper
part of the result is likely to be zero. GCC makes reversed assumptions
considering the shift to be likely >= 32 and the upper part to be like not
zero.
unsigned long long shift(unsigned long long x, unsigned char s)
{
return x >> s;
}
results in:
00000018 <shift>:
18: 35 25 ff e0 addic. r9,r5,-32
1c: 41 80 00 10 blt 2c <shift+0x14>
20: 7c 64 4c 30 srw r4,r3,r9
24: 38 60 00 00 li r3,0
28: 4e 80 00 20 blr
2c: 54 69 08 3c rlwinm r9,r3,1,0,30
30: 21 45 00 1f subfic r10,r5,31
34: 7c 84 2c 30 srw r4,r4,r5
38: 7d 29 50 30 slw r9,r9,r10
3c: 7c 63 2c 30 srw r3,r3,r5
40: 7d 24 23 78 or r4,r9,r4
44: 4e 80 00 20 blr
Even when forcing the shift to be smaller than 32 with an &= 31, it still
considers the shift as likely >= 32.
Move the default shift implementation into an inline which can be redefined
in architecture code via a macro.
[ tglx: Made the shift argument u32 and removed the __arch prefix ]
Signed-off-by: Christophe Leroy <christophe.leroy@c-s.fr>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Tested-by: Vincenzo Frascino <vincenzo.frascino@arm.com>
Reviewed-by: Vincenzo Frascino <vincenzo.frascino@arm.com>
Link: https://lore.kernel.org/r/b3d449de856982ed060a71e6ace8eeca4654e685.1580399657.git.christophe.leroy@c-s.fr
Link: https://lkml.kernel.org/r/20200207124403.857649978@linutronix.de
2020-02-07 13:39:03 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-03-25 08:40:06 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2024-03-25 08:40:06 +02:00
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2024-03-25 08:40:06 +02:00
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
|
|
|
|
|
2024-03-25 08:40:11 +02:00
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2024-03-25 08:40:06 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-02-07 13:38:50 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-02-07 13:39:02 +01:00
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2020-02-07 13:39:02 +01:00
|
|
|
|
2025-03-03 12:11:13 +01:00
|
|
|
|
2020-02-07 13:39:02 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-06-06 23:51:16 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:01 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:06 +02:00
|
|
|
|
2025-07-01 10:58:01 +02:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:02 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:10 +01:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
|
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2025-03-03 12:11:10 +01:00
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:03 +02:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:10 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2025-03-03 12:11:10 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:10 +01:00
|
|
|
|
2020-02-07 13:38:59 +01:00
|
|
|
|
2025-07-01 10:58:03 +02:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2026-02-27 07:43:23 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:02 +02:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:09 +01:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:58:03 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2020-02-07 13:38:50 +01:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2020-02-07 13:38:50 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2026-02-27 07:43:21 +01:00
|
|
|
|
|
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2025-07-01 10:58:03 +02:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2026-02-27 07:43:23 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:58:02 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:12 +01:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
|
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2025-03-03 12:11:12 +01:00
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2025-03-03 12:11:12 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:12 +01:00
|
|
|
|
|
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2025-03-03 12:11:12 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
2026-02-27 07:43:23 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:02 +02:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:11 +01:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-03-03 12:11:11 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-27 07:43:21 +01:00
|
|
|
|
|
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2026-02-27 07:43:23 +01:00
|
|
|
|
2019-12-23 14:31:07 +00:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:06 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-04-22 11:42:32 +02:00
|
|
|
|
|
|
|
|
|
2026-02-27 07:43:21 +01:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:06 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-27 07:43:23 +01:00
|
|
|
|
2025-07-01 10:58:06 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:01 +02:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-12-23 14:31:07 +00:00
|
|
|
|
2025-03-03 12:11:08 +01:00
|
|
|
|
2019-12-23 14:31:07 +00:00
|
|
|
|
2025-03-03 12:11:11 +01:00
|
|
|
|
2019-12-23 14:31:07 +00:00
|
|
|
|
2025-03-03 12:11:08 +01:00
|
|
|
|
2025-07-01 10:58:06 +02:00
|
|
|
|
|
|
|
|
|
2019-11-12 01:26:51 +00:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-12-23 14:31:07 +00:00
|
|
|
|
2025-03-03 12:11:09 +01:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2026-02-27 07:43:20 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
2019-08-30 14:58:56 +01:00
|
|
|
|
2026-02-27 07:43:20 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-07-30 11:38:50 +02:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-08-30 14:58:59 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-08-30 14:58:56 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2026-02-27 07:43:20 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:00 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-27 07:43:22 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2026-02-27 07:43:20 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
|
|
|
|
|
2026-02-27 07:43:22 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2025-03-03 12:11:08 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2025-03-03 12:11:08 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-01-23 08:35:41 +01:00
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:58:01 +02:00
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2026-02-27 07:43:22 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2019-11-12 01:27:09 +00:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-12-23 14:31:09 +00:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-03-03 12:11:21 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:58:06 +02:00
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2019-10-21 12:07:15 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2026-02-27 07:43:20 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-07-28 15:12:53 +02:00
|
|
|
|
|
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
2019-08-30 14:58:56 +01:00
|
|
|
|
2026-02-27 07:43:20 +01:00
|
|
|
|
2025-02-04 13:05:50 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-07-30 11:38:50 +02:00
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-07-30 11:38:50 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2019-08-30 14:58:59 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 10:57:59 +02:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-04 13:05:37 +01:00
|
|
|
|
2020-02-07 13:39:04 +01:00
|
|
|
|
|
|
|
|
|
2019-08-30 14:58:56 +01:00
|
|
|
|
2019-06-21 10:52:29 +01:00
|
|
|
|