2019-02-18 09:36:08 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2014-03-24 10:11:22 -04:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2020-07-09 11:43:33 -07:00
|
|
|
|
2018-04-27 13:42:52 -06:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2021-09-20 14:33:27 +02:00
|
|
|
|
2017-04-20 13:37:55 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-24 22:28:12 +01:00
|
|
|
|
2022-02-16 15:31:36 +11:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2015-11-26 12:21:29 +01:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
2017-09-15 13:05:38 -04:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
NVMe: Metadata format support
Adds support for NVMe metadata formats and exposes block devices for
all namespaces regardless of their format. Namespace formats that are
unusable will have disk capacity set to 0, but a handle to the block
device is created to simplify device management. A namespace is not
usable when the format requires host interleave block and metadata in
single buffer, has no provisioned storage, or has better data but failed
to register with blk integrity.
The namespace has to be scanned in two phases to support separate
metadata formats. The first establishes the sector size and capacity
prior to invoking add_disk. If metadata is required, the capacity will
be temporarilly set to 0 until it can be revalidated and registered with
the integrity extenstions after add_disk completes.
The driver relies on the integrity extensions to provide the metadata
buffer. NVMe requires this be a single physically contiguous region,
so only one integrity segment is allowed per command. If the metadata
is used for T10 PI, the driver provides mappings to save and restore
the reftag physical block translation. The driver provides no-op
functions for generate and verify if metadata is not used for protection
information. This way the setup is always provided by the block layer.
If a request does not supply a required metadata buffer, the command
is failed with bad address. This could only happen if a user manually
disables verify/generate on such a disk. The only exception to where
this is okay is if the controller is capable of stripping/generating
the metadata, which is possible on some types of formats.
The metadata scatter gather list now occupies the spot in the nvme_iod
that used to be used to link retryable IOD's, but we don't do that
anymore, so the field was unused.
Signed-off-by: Keith Busch <keith.busch@intel.com>
2015-02-19 13:39:03 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2015-08-28 09:27:14 +02:00
|
|
|
|
2021-01-15 07:30:46 +01:00
|
|
|
|
2017-02-03 12:50:32 -07:00
|
|
|
|
2012-02-07 11:45:33 +09:00
|
|
|
|
2018-12-18 17:59:53 +01:00
|
|
|
|
2015-10-03 15:46:41 +02:00
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:20 +10:00
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2016-12-16 11:54:50 -07:00
|
|
|
|
2025-05-12 17:17:27 +02:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2025-06-25 13:35:04 +02:00
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2025-06-25 13:35:04 +02:00
|
|
|
|
2025-05-10 05:49:41 +02:00
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2025-05-13 09:06:49 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2025-05-13 09:06:49 +02:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-05-13 09:06:49 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2025-06-25 13:35:05 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-04 11:55:55 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-02-06 07:28:06 -05:00
|
|
|
|
2022-03-22 10:35:12 +08:00
|
|
|
|
2011-02-06 07:28:06 -05:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2018-06-06 08:13:09 -06:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-03-02 18:37:18 -05:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-06-16 14:19:34 -07:00
|
|
|
|
|
|
|
|
|
2017-07-10 16:46:59 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-06-17 10:05:13 +02:00
|
|
|
|
2017-07-10 16:46:59 +08:00
|
|
|
|
|
|
|
|
|
2020-06-17 10:05:13 +02:00
|
|
|
|
2017-07-10 16:46:59 +08:00
|
|
|
|
2021-06-16 14:19:34 -07:00
|
|
|
|
2017-07-10 16:46:59 +08:00
|
|
|
|
2026-02-04 11:55:55 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-11 17:30:28 +01:00
|
|
|
|
2026-02-04 11:55:55 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-05-09 14:22:08 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-17 15:43:25 +02:00
|
|
|
|
2020-05-09 14:22:08 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-12-07 01:51:54 +09:00
|
|
|
|
2020-05-09 14:22:08 +08:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-12-07 01:51:54 +09:00
|
|
|
|
2020-05-09 14:22:08 +08:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
2020-07-09 11:43:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
|
|
|
|
|
2015-02-03 11:21:42 -07:00
|
|
|
|
2016-01-12 14:41:18 -07:00
|
|
|
|
2022-11-16 09:07:48 +01:00
|
|
|
|
2023-02-16 08:44:03 -08:00
|
|
|
|
2013-12-10 13:10:37 -07:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:16 +01:00
|
|
|
|
2018-04-12 09:16:10 -06:00
|
|
|
|
nvme-pci: Use u32 for nvme_dev.q_depth and nvme_queue.q_depth
Recently nvme_dev.q_depth was changed from an int to u16 type.
This falls over for the queue depth calculation in nvme_pci_enable(),
where NVME_CAP_MQES(dev->ctrl.cap) + 1 may overflow as a u16, as
NVME_CAP_MQES() is a 16b number also. That happens for me, and this is the
result:
root@ubuntu:/home/john# [148.272996] Unable to handle kernel NULL pointer
dereference at virtual address 0000000000000010
Mem abort info:
ESR = 0x96000004
EC = 0x25: DABT (current EL), IL = 32 bits
SET = 0, FnV = 0
EA = 0, S1PTW = 0
Data abort info:
ISV = 0, ISS = 0x00000004
CM = 0, WnR = 0
user pgtable: 4k pages, 48-bit VAs, pgdp=00000a27bf3c9000
[0000000000000010] pgd=0000000000000000, p4d=0000000000000000
Internal error: Oops: 96000004 [#1] PREEMPT SMP
Modules linked in: nvme nvme_core
CPU: 56 PID: 256 Comm: kworker/u195:0 Not tainted
5.8.0-next-20200812 #27
Hardware name: Huawei D06 /D06, BIOS Hisilicon D06 UEFI RC0 -
V1.16.01 03/15/2019
Workqueue: nvme-reset-wq nvme_reset_work [nvme]
pstate: 80c00009 (Nzcv daif +PAN +UAO BTYPE=--)
pc : __sg_alloc_table_from_pages+0xec/0x238
lr : __sg_alloc_table_from_pages+0xc8/0x238
sp : ffff800013ccbad0
x29: ffff800013ccbad0 x28: ffff0a27b3d380a8
x27: 0000000000000000 x26: 0000000000002dc2
x25: 0000000000000dc0 x24: 0000000000000000
x23: 0000000000000000 x22: ffff800013ccbbe8
x21: 0000000000000010 x20: 0000000000000000
x19: 00000000fffff000 x18: ffffffffffffffff
x17: 00000000000000c0 x16: fffffe289eaf6380
x15: ffff800011b59948 x14: ffff002bc8fe98f8
x13: ff00000000000000 x12: ffff8000114ca000
x11: 0000000000000000 x10: ffffffffffffffff
x9 : ffffffffffffffc0 x8 : ffff0a27b5f9b6a0
x7 : 0000000000000000 x6 : 0000000000000001
x5 : ffff0a27b5f9b680 x4 : 0000000000000000
x3 : ffff0a27b5f9b680 x2 : 0000000000000000
x1 : 0000000000000001 x0 : 0000000000000000
Call trace:
__sg_alloc_table_from_pages+0xec/0x238
sg_alloc_table_from_pages+0x18/0x28
iommu_dma_alloc+0x474/0x678
dma_alloc_attrs+0xd8/0xf0
nvme_alloc_queue+0x114/0x160 [nvme]
nvme_reset_work+0xb34/0x14b4 [nvme]
process_one_work+0x1e8/0x360
worker_thread+0x44/0x478
kthread+0x150/0x158
ret_from_fork+0x10/0x34
Code: f94002c3 6b01017f 540007c2 11000486 (f8645aa5)
---[ end trace 89bb2b72d59bf925 ]---
Fix by making onto a u32.
Also use u32 for nvme_dev.q_depth, as we assign this value from
nvme_dev.q_depth, and nvme_dev.q_depth will possibly hold 65536 - this
avoids the same crash as above.
Fixes: 61f3b8963097 ("nvme-pci: use unsigned for io queue depth")
Signed-off-by: John Garry <john.garry@huawei.com>
Reviewed-by: Keith Busch <kbusch@kernel.org>
Signed-off-by: Sagi Grimberg <sagi@grimberg.me>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2020-08-14 23:34:25 +08:00
|
|
|
|
2019-08-07 17:51:20 +10:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
|
|
|
|
|
2017-05-24 16:39:55 +08:00
|
|
|
|
2015-11-26 12:21:29 +01:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
|
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2016-10-05 20:01:12 -06:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
2021-07-27 09:40:43 -07:00
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2022-12-13 09:58:07 +01:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
2022-12-13 09:58:07 +01:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:04 +01:00
|
|
|
|
2017-08-28 10:47:18 +02:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2013-12-10 13:10:40 -07:00
|
|
|
|
2011-03-02 18:37:18 -05:00
|
|
|
|
2017-07-10 16:46:59 +08:00
|
|
|
|
|
|
|
|
|
2021-06-16 14:19:34 -07:00
|
|
|
|
|
|
|
|
|
2017-07-10 16:46:59 +08:00
|
|
|
|
|
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-02-10 09:56:01 -05:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2018-05-17 18:31:51 +02:00
|
|
|
|
2019-08-07 17:51:20 +10:00
|
|
|
|
2018-12-02 17:46:23 +01:00
|
|
|
|
|
|
|
|
|
2020-04-28 07:21:56 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
nvme-pci: Use u32 for nvme_dev.q_depth and nvme_queue.q_depth
Recently nvme_dev.q_depth was changed from an int to u16 type.
This falls over for the queue depth calculation in nvme_pci_enable(),
where NVME_CAP_MQES(dev->ctrl.cap) + 1 may overflow as a u16, as
NVME_CAP_MQES() is a 16b number also. That happens for me, and this is the
result:
root@ubuntu:/home/john# [148.272996] Unable to handle kernel NULL pointer
dereference at virtual address 0000000000000010
Mem abort info:
ESR = 0x96000004
EC = 0x25: DABT (current EL), IL = 32 bits
SET = 0, FnV = 0
EA = 0, S1PTW = 0
Data abort info:
ISV = 0, ISS = 0x00000004
CM = 0, WnR = 0
user pgtable: 4k pages, 48-bit VAs, pgdp=00000a27bf3c9000
[0000000000000010] pgd=0000000000000000, p4d=0000000000000000
Internal error: Oops: 96000004 [#1] PREEMPT SMP
Modules linked in: nvme nvme_core
CPU: 56 PID: 256 Comm: kworker/u195:0 Not tainted
5.8.0-next-20200812 #27
Hardware name: Huawei D06 /D06, BIOS Hisilicon D06 UEFI RC0 -
V1.16.01 03/15/2019
Workqueue: nvme-reset-wq nvme_reset_work [nvme]
pstate: 80c00009 (Nzcv daif +PAN +UAO BTYPE=--)
pc : __sg_alloc_table_from_pages+0xec/0x238
lr : __sg_alloc_table_from_pages+0xc8/0x238
sp : ffff800013ccbad0
x29: ffff800013ccbad0 x28: ffff0a27b3d380a8
x27: 0000000000000000 x26: 0000000000002dc2
x25: 0000000000000dc0 x24: 0000000000000000
x23: 0000000000000000 x22: ffff800013ccbbe8
x21: 0000000000000010 x20: 0000000000000000
x19: 00000000fffff000 x18: ffffffffffffffff
x17: 00000000000000c0 x16: fffffe289eaf6380
x15: ffff800011b59948 x14: ffff002bc8fe98f8
x13: ff00000000000000 x12: ffff8000114ca000
x11: 0000000000000000 x10: ffffffffffffffff
x9 : ffffffffffffffc0 x8 : ffff0a27b5f9b6a0
x7 : 0000000000000000 x6 : 0000000000000001
x5 : ffff0a27b5f9b680 x4 : 0000000000000000
x3 : ffff0a27b5f9b680 x2 : 0000000000000000
x1 : 0000000000000001 x0 : 0000000000000000
Call trace:
__sg_alloc_table_from_pages+0xec/0x238
sg_alloc_table_from_pages+0x18/0x28
iommu_dma_alloc+0x474/0x678
dma_alloc_attrs+0xd8/0xf0
nvme_alloc_queue+0x114/0x160 [nvme]
nvme_reset_work+0xb34/0x14b4 [nvme]
process_one_work+0x1e8/0x360
worker_thread+0x44/0x478
kthread+0x150/0x158
ret_from_fork+0x10/0x34
Code: f94002c3 6b01017f 540007c2 11000486 (f8645aa5)
---[ end trace 89bb2b72d59bf925 ]---
Fix by making onto a u32.
Also use u32 for nvme_dev.q_depth, as we assign this value from
nvme_dev.q_depth, and nvme_dev.q_depth will possibly hold 65536 - this
avoids the same crash as above.
Fixes: 61f3b8963097 ("nvme-pci: use unsigned for io queue depth")
Signed-off-by: John Garry <john.garry@huawei.com>
Reviewed-by: Keith Busch <kbusch@kernel.org>
Signed-off-by: Sagi Grimberg <sagi@grimberg.me>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2020-08-14 23:34:25 +08:00
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2020-10-30 10:28:54 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
2013-06-24 11:47:34 -04:00
|
|
|
|
2019-08-07 17:51:20 +10:00
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:18 +01:00
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2022-12-13 09:58:07 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2025-05-10 05:47:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:47 -07:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2023-01-05 12:28:32 -08:00
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-01-05 12:28:32 -08:00
|
|
|
|
|
|
|
|
|
2015-10-16 07:58:32 +02:00
|
|
|
|
2019-03-03 08:04:01 -07:00
|
|
|
|
2015-10-16 07:58:32 +02:00
|
|
|
|
|
|
|
|
|
2016-11-10 07:32:33 -08:00
|
|
|
|
2021-03-17 13:37:02 -07:00
|
|
|
|
2025-05-10 05:47:03 +02:00
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-12-17 11:41:23 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2019-03-03 08:19:18 -07:00
|
|
|
|
2025-12-17 11:41:23 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2025-05-10 05:49:41 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
2022-11-08 10:56:49 +01:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
2022-11-08 10:56:49 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-10-14 09:45:42 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 10:56:49 +01:00
|
|
|
|
2021-10-14 09:45:42 -07:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 10:56:49 +01:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 10:56:49 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
2022-11-08 10:56:49 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-11-05 23:28:47 +09:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2020-11-05 23:28:47 +09:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-20 15:14:43 +02:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
2020-11-05 23:28:47 +09:00
|
|
|
|
2026-03-08 14:20:59 -04:00
|
|
|
|
2020-11-05 23:28:47 +09:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-12-13 09:58:07 +01:00
|
|
|
|
|
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
2022-12-13 09:58:07 +01:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-12-13 09:58:07 +01:00
|
|
|
|
|
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
2018-08-15 15:51:57 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-12-08 13:34:32 +02:00
|
|
|
|
2018-08-15 15:51:57 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-12-13 09:58:07 +01:00
|
|
|
|
|
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2026-05-23 08:28:16 +00:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
2026-05-23 08:28:16 +00:00
|
|
|
|
2025-05-12 17:17:27 +02:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
2026-05-23 08:28:16 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
|
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:17:27 +02:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
|
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-04-25 20:06:35 -06:00
|
|
|
|
|
|
|
|
|
2011-02-06 18:30:16 -05:00
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
2025-04-25 20:06:35 -06:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2025-04-25 20:06:35 -06:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2025-04-25 20:06:35 -06:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-06-01 09:29:54 -06:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
|
|
|
|
|
2011-02-06 18:30:16 -05:00
|
|
|
|
|
|
|
|
|
2025-04-25 20:06:35 -06:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2025-04-25 20:06:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2025-04-25 20:06:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2022-03-15 15:53:59 +01:00
|
|
|
|
|
|
|
|
|
2026-05-23 12:52:35 +00:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2015-11-28 15:43:10 +01:00
|
|
|
|
2018-06-29 16:50:00 -06:00
|
|
|
|
2023-05-12 03:05:37 -03:00
|
|
|
|
2021-03-17 13:37:03 -07:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-08-15 10:00:43 -07:00
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:16 +01:00
|
|
|
|
2018-12-17 12:16:27 +01:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2019-05-21 10:56:43 -06:00
|
|
|
|
2024-12-02 15:00:14 +01:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
|
|
|
|
|
2020-10-30 10:28:54 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-11-29 10:02:29 -07:00
|
|
|
|
2020-10-30 10:28:54 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-11-29 10:02:29 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-10-30 10:28:54 -07:00
|
|
|
|
2018-11-29 10:02:29 -07:00
|
|
|
|
|
|
|
|
|
2021-10-29 14:32:44 -06:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2019-08-07 17:51:20 +10:00
|
|
|
|
2021-10-29 14:32:44 -06:00
|
|
|
|
2018-05-26 13:45:55 +02:00
|
|
|
|
|
|
|
|
|
2018-11-29 10:02:29 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-10-30 10:28:54 -07:00
|
|
|
|
|
|
|
|
|
2018-05-26 13:45:55 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
|
|
|
|
|
2024-11-08 15:41:08 -08:00
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
|
|
|
|
|
2017-12-20 16:30:50 +09:00
|
|
|
|
2022-09-06 09:07:35 -07:00
|
|
|
|
2017-12-20 16:30:50 +09:00
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
2025-10-14 08:04:56 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-12-20 16:30:50 +09:00
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-12-20 16:30:50 +09:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-10 05:49:41 +02:00
|
|
|
|
|
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
|
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
2019-03-03 08:15:19 -07:00
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
|
|
|
|
|
2025-11-14 11:07:03 +02:00
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2025-11-14 11:07:03 +02:00
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:52 -07:00
|
|
|
|
2025-11-14 11:07:03 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:52 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-08-13 08:31:52 -07:00
|
|
|
|
2025-11-14 11:07:03 +02:00
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:52 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-08-13 08:31:52 -07:00
|
|
|
|
|
|
|
|
|
2025-11-14 11:07:03 +02:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2025-11-14 11:07:03 +02:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-01-20 09:33:52 +01:00
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
2015-01-22 12:07:58 -07:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2026-01-27 20:59:06 +01:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
2017-09-15 13:05:38 -04:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-15 13:05:38 -04:00
|
|
|
|
|
|
|
|
|
2026-02-04 06:29:11 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-05-19 18:03:44 -07:00
|
|
|
|
|
|
|
|
|
2026-02-04 06:29:11 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
|
|
|
|
|
2011-01-26 10:02:29 -05:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
|
|
|
|
|
2026-01-12 20:08:08 +05:30
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2026-02-04 06:29:11 -08:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
|
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2011-01-26 10:02:29 -05:00
|
|
|
|
2015-11-28 15:43:10 +01:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
2011-01-26 10:02:29 -05:00
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
|
|
|
|
|
2026-02-04 06:29:11 -08:00
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2017-08-27 15:56:37 +02:00
|
|
|
|
2011-01-26 10:02:29 -05:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2011-01-26 10:02:29 -05:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2025-05-12 17:17:27 +02:00
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2011-02-10 10:30:34 -05:00
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-10 05:49:41 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2011-03-16 16:43:40 -04:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2011-03-16 16:43:40 -04:00
|
|
|
|
2011-02-10 08:51:24 -05:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-01-20 09:35:01 +01:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
2017-07-12 15:59:07 -04:00
|
|
|
|
2011-01-26 10:02:29 -05:00
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-01-05 12:28:30 -08:00
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-12 17:17:27 +02:00
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
|
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
|
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
|
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2017-10-16 18:24:20 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2026-01-12 20:08:08 +05:30
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2025-07-29 11:12:47 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:01 +02:00
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:01 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:01 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:01 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:01 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-05 05:54:18 -07:00
|
|
|
|
2020-07-03 10:49:24 +08:00
|
|
|
|
2019-03-05 05:54:18 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
2015-11-28 15:43:10 +01:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
2025-06-25 13:35:01 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-05 05:49:34 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
2015-10-16 07:58:38 +02:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:00 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-01-20 09:35:01 +01:00
|
|
|
|
2025-10-21 08:15:05 -07:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-11-14 11:07:04 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-09-03 12:33:17 -07:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-10-21 08:15:05 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2025-10-21 08:15:05 -07:00
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
|
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2026-05-19 13:01:57 -07:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-05-10 05:49:41 +02:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2019-03-03 09:46:28 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2024-05-27 17:40:10 +02:00
|
|
|
|
2019-03-03 09:46:28 -07:00
|
|
|
|
2025-10-21 08:15:05 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
|
|
|
|
|
2019-03-03 09:46:28 -07:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2020-07-03 10:49:24 +08:00
|
|
|
|
2019-03-03 09:46:28 -07:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-05-11 06:04:27 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2025-10-21 08:15:05 -07:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-10 05:47:03 +02:00
|
|
|
|
2025-05-12 17:16:04 +02:00
|
|
|
|
2025-06-25 13:35:03 +02:00
|
|
|
|
2025-08-13 08:31:53 -07:00
|
|
|
|
2026-02-04 06:29:11 -08:00
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-10-03 12:43:43 +03:00
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
|
|
|
|
|
2024-07-24 13:31:14 +03:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-06-03 09:38:05 +02:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2014-04-03 16:45:23 -06:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2019-03-03 08:04:01 -07:00
|
|
|
|
2017-06-12 18:36:32 +02:00
|
|
|
|
NVMe: Metadata format support
Adds support for NVMe metadata formats and exposes block devices for
all namespaces regardless of their format. Namespace formats that are
unusable will have disk capacity set to 0, but a handle to the block
device is created to simplify device management. A namespace is not
usable when the format requires host interleave block and metadata in
single buffer, has no provisioned storage, or has better data but failed
to register with blk integrity.
The namespace has to be scanned in two phases to support separate
metadata formats. The first establishes the sector size and capacity
prior to invoking add_disk. If metadata is required, the capacity will
be temporarilly set to 0 until it can be revalidated and registered with
the integrity extenstions after add_disk completes.
The driver relies on the integrity extensions to provide the metadata
buffer. NVMe requires this be a single physically contiguous region,
so only one integrity segment is allowed per command. If the metadata
is used for T10 PI, the driver provides mappings to save and restore
the reftag physical block translation. The driver provides no-op
functions for generate and verify if metadata is not used for protection
information. This way the setup is always provided by the block layer.
If a request does not supply a required metadata buffer, the command
is failed with bad address. This could only happen if a user manually
disables verify/generate on such a disk. The only exception to where
this is okay is if the controller is capable of stripping/generating
the metadata, which is possible on some types of formats.
The metadata scatter gather list now occupies the spot in the nvme_iod
that used to be used to link retryable IOD's, but we don't do that
anymore, so the field was unused.
Signed-off-by: Keith Busch <keith.busch@intel.com>
2015-02-19 13:39:03 -07:00
|
|
|
|
2018-05-17 18:31:49 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
2018-05-17 18:31:49 +02:00
|
|
|
|
|
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
nvme-pci: fix controller reset hang when racing with nvme_timeout
reset_work() in nvme-pci may hang forever in the following scenario:
1) A reset caused by a command timeout occurs due to a controller being
temporarily irresponsive.
2) nvme_reset_work() restarts admin queue at nvme_alloc_admin_tags(). At
the same time, a user-submitted admin command is queued and waiting
for completion. Then, reset_work() changes its state to CONNECTING,
and submits an identify command.
3) However, the controller does still not respond to any command,
causing a timeout being fired at the user-submitted command.
Unfortunately, nvme_timeout() does not see the completion on cq, and
any timeout that takes place under CONNECTING state causes a
controller shutdown.
4) Normally, the identify command in reset_work() would be canceled with
SC_HOST_ABORTED by nvme_dev_disable(), then reset_work can tear down
the controller accordingly. But the controller happens to return
online and respond the identify command before nvme_dev_disable()
should have been reaped it off.
5) reset_work() continues to setup_io_queues() as it observes no error
in init_identify(). However, the admin queue has already been
quiesced in dev_disable(). Thus, any following commands would be
blocked forever in blk_execute_rq().
This can be fixed by restricting usercmd commands when controller is not
in a LIVE state in nvme_queue_rq(), as what has been done previously in
fabrics.
```
nvme_reset_work(): |
nvme_alloc_admin_tags() |
| nvme_submit_user_cmd():
nvme_init_identify(): | ...
__nvme_submit_sync_cmd(): |
... | ...
---------------------------------------> nvme_timeout():
(Controller starts reponding commands) | nvme_dev_disable(, true):
nvme_setup_io_queues(): |
__nvme_submit_sync_cmd(): |
(hung in blk_execute_rq |
since run_hw_queue sees |
queue quiesced) |
```
Signed-off-by: Tao Chiu <taochiu@synology.com>
Signed-off-by: Cody Wong <codywong@synology.com>
Reviewed-by: Leon Chien <leonchien@synology.com>
Reviewed-by: Keith Busch <kbusch@kernel.org>
Signed-off-by: Christoph Hellwig <hch@lst.de>
2021-04-26 10:53:55 +08:00
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-10-29 14:34:11 -06:00
|
|
|
|
2015-11-28 15:43:10 +01:00
|
|
|
|
2021-10-29 14:32:44 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-06-03 09:38:05 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2024-11-13 16:20:44 +01:00
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
2024-11-13 16:20:41 +01:00
|
|
|
|
|
|
|
|
|
2025-03-31 18:28:59 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
2024-11-13 16:20:41 +01:00
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
|
|
|
|
|
2024-11-13 16:20:44 +01:00
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
2024-11-13 16:20:44 +01:00
|
|
|
|
|
|
|
|
|
2024-11-13 16:20:41 +01:00
|
|
|
|
|
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
2024-11-13 16:20:41 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
2024-11-13 16:20:41 +01:00
|
|
|
|
2024-11-13 16:20:45 +01:00
|
|
|
|
2024-11-13 16:20:41 +01:00
|
|
|
|
2024-11-13 16:20:44 +01:00
|
|
|
|
2022-01-05 09:05:18 -08:00
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
2024-11-13 16:20:41 +01:00
|
|
|
|
|
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
2015-11-26 13:03:13 +01:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2019-03-03 08:52:21 -07:00
|
|
|
|
2025-06-25 13:35:02 +02:00
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-03-30 13:41:32 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-03-22 16:02:06 +01:00
|
|
|
|
2018-05-18 08:37:04 -06:00
|
|
|
|
2016-03-22 16:02:06 +01:00
|
|
|
|
2020-04-28 07:21:56 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-03-22 16:02:06 +01:00
|
|
|
|
|
|
|
|
|
2017-06-18 17:28:07 +03:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2017-06-18 17:28:07 +03:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-06-06 08:13:05 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-06-18 17:28:07 +03:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2020-01-30 19:40:24 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
|
|
|
|
|
2017-06-18 17:28:08 +03:00
|
|
|
|
2020-04-28 07:21:56 -07:00
|
|
|
|
2020-12-23 14:09:00 -08:00
|
|
|
|
2017-06-18 17:28:08 +03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-12-23 14:09:00 -08:00
|
|
|
|
2017-06-18 17:28:08 +03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-06-16 14:19:36 -07:00
|
|
|
|
2020-09-22 14:25:17 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-12-23 14:09:00 -08:00
|
|
|
|
2020-09-22 14:25:17 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-18 17:59:53 +01:00
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
block: change blk_mq_add_to_batch() third argument type to bool
Commit 1f47ed294a2b ("block: cleanup and fix batch completion adding
conditions") modified the evaluation criteria for the third argument,
'ioerror', in the blk_mq_add_to_batch() function. Initially, the
function had checked if 'ioerror' equals zero. Following the commit, it
started checking for negative error values, with the presumption that
such values, for instance -EIO, would be passed in.
However, blk_mq_add_to_batch() callers do not pass negative error
values. Instead, they pass status codes defined in various ways:
- NVMe PCI and Apple drivers pass NVMe status code
- virtio_blk driver passes the virtblk request header status byte
- null_blk driver passes blk_status_t
These codes are either zero or positive, therefore the revised check
fails to function as intended. Specifically, with the NVMe PCI driver,
this modification led to the failure of the blktests test case nvme/039.
In this test scenario, errors are artificially injected to the NVMe
driver, resulting in positive NVMe status codes passed to
blk_mq_add_to_batch(), which unexpectedly processes the failed I/O in a
batch. Hence the failure.
To correct the ioerror check within blk_mq_add_to_batch(), make all
callers to uniformly pass the argument as boolean. Modify the callers to
check their specific status codes and pass the boolean value 'is_error'.
Also describe the arguments of blK_mq_add_to_batch as kerneldoc.
Fixes: 1f47ed294a2b ("block: cleanup and fix batch completion adding conditions")
Signed-off-by: Shin'ichiro Kawasaki <shinichiro.kawasaki@wdc.com>
Link: https://lore.kernel.org/r/20250311104359.1767728-3-shinichiro.kawasaki@wdc.com
[axboe: fold in documentation update]
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2025-03-11 19:43:59 +09:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-06-11 08:44:52 +02:00
|
|
|
|
2017-06-18 17:28:08 +03:00
|
|
|
|
|
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
2015-11-03 20:37:26 -07:00
|
|
|
|
2021-06-17 15:02:17 +09:00
|
|
|
|
2020-05-07 23:07:04 +03:00
|
|
|
|
|
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
2020-02-28 21:45:19 +03:00
|
|
|
|
2020-05-07 23:07:04 +03:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2024-12-23 01:05:17 +00:00
|
|
|
|
|
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
2024-12-23 01:05:17 +00:00
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
2018-11-26 08:21:49 -07:00
|
|
|
|
2024-12-23 01:05:17 +00:00
|
|
|
|
2020-05-08 13:04:06 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-03-02 08:56:53 -08:00
|
|
|
|
2017-06-18 17:28:09 +03:00
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-02-06 07:28:06 -05:00
|
|
|
|
|
|
|
|
|
nvme: wire up completion batching for the IRQ path
Trivial to do now, just need our own io_comp_batch on the stack and pass
that in to the usual command completion handling.
I pondered making this dependent on how many entries we had to process,
but even for a single entry there's no discernable difference in
performance or latency. Running a sync workload over io_uring:
t/io_uring -b512 -d1 -s1 -c1 -p0 -F1 -B1 -n2 /dev/nvme1n1 /dev/nvme2n1
yields the below performance before the patch:
IOPS=254820, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251174, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=250806, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
and the following after:
IOPS=255972, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251920, BW=123MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251794, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
which definitely isn't slower, about the same if you factor in a bit of
variance. For peak performance workloads, benchmarking shows a 2%
improvement.
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2021-10-18 08:45:39 -06:00
|
|
|
|
2018-05-17 18:31:50 +02:00
|
|
|
|
nvme: wire up completion batching for the IRQ path
Trivial to do now, just need our own io_comp_batch on the stack and pass
that in to the usual command completion handling.
I pondered making this dependent on how many entries we had to process,
but even for a single entry there's no discernable difference in
performance or latency. Running a sync workload over io_uring:
t/io_uring -b512 -d1 -s1 -c1 -p0 -F1 -B1 -n2 /dev/nvme1n1 /dev/nvme2n1
yields the below performance before the patch:
IOPS=254820, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251174, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=250806, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
and the following after:
IOPS=255972, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251920, BW=123MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251794, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
which definitely isn't slower, about the same if you factor in a bit of
variance. For peak performance workloads, benchmarking shows a 2%
improvement.
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2021-10-18 08:45:39 -06:00
|
|
|
|
2024-11-13 16:20:44 +01:00
|
|
|
|
nvme: wire up completion batching for the IRQ path
Trivial to do now, just need our own io_comp_batch on the stack and pass
that in to the usual command completion handling.
I pondered making this dependent on how many entries we had to process,
but even for a single entry there's no discernable difference in
performance or latency. Running a sync workload over io_uring:
t/io_uring -b512 -d1 -s1 -c1 -p0 -F1 -B1 -n2 /dev/nvme1n1 /dev/nvme2n1
yields the below performance before the patch:
IOPS=254820, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251174, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=250806, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
and the following after:
IOPS=255972, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251920, BW=123MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251794, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
which definitely isn't slower, about the same if you factor in a bit of
variance. For peak performance workloads, benchmarking shows a 2%
improvement.
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2021-10-18 08:45:39 -06:00
|
|
|
|
2021-02-23 12:47:41 -08:00
|
|
|
|
nvme: wire up completion batching for the IRQ path
Trivial to do now, just need our own io_comp_batch on the stack and pass
that in to the usual command completion handling.
I pondered making this dependent on how many entries we had to process,
but even for a single entry there's no discernable difference in
performance or latency. Running a sync workload over io_uring:
t/io_uring -b512 -d1 -s1 -c1 -p0 -F1 -B1 -n2 /dev/nvme1n1 /dev/nvme2n1
yields the below performance before the patch:
IOPS=254820, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251174, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=250806, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
and the following after:
IOPS=255972, BW=124MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251920, BW=123MiB/s, IOS/call=1/1, inflight=(1 1)
IOPS=251794, BW=122MiB/s, IOS/call=1/1, inflight=(1 1)
which definitely isn't slower, about the same if you factor in a bit of
variance. For peak performance workloads, benchmarking shows a 2%
improvement.
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2021-10-18 08:45:39 -06:00
|
|
|
|
2021-02-23 12:47:41 -08:00
|
|
|
|
2011-02-06 07:28:06 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-03 10:49:21 +08:00
|
|
|
|
2018-05-18 08:37:04 -06:00
|
|
|
|
2016-03-22 16:02:06 +01:00
|
|
|
|
|
|
|
|
|
2011-02-06 07:28:06 -05:00
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:20 +01:00
|
|
|
|
2020-03-04 09:17:01 -08:00
|
|
|
|
2018-12-02 17:46:20 +01:00
|
|
|
|
|
|
|
|
|
2020-03-04 09:17:01 -08:00
|
|
|
|
2015-11-03 20:37:26 -07:00
|
|
|
|
2018-12-02 17:46:23 +01:00
|
|
|
|
nvme-pci: Fix race bug in nvme_poll_irqdisable()
In the following scenario, pdev can be disabled between (1) and (3) by
(2). This sets pdev->msix_enabled = 0. Then, pci_irq_vector() will
return MSI-X IRQ(>15) for (1) whereas return INTx IRQ(<=15) for (2).
This causes IRQ warning because it tries to enable INTx IRQ that has
never been disabled before.
To fix this, save IRQ number into a local variable and ensure
disable_irq() and enable_irq() operate on the same IRQ number. Even if
pci_free_irq_vectors() frees the IRQ concurrently, disable_irq() and
enable_irq() on a stale IRQ number is still valid and safe, and the
depth accounting reamins balanced.
task 1:
nvme_poll_irqdisable()
disable_irq(pci_irq_vector(pdev, nvmeq->cq_vector)) ...(1)
enable_irq(pci_irq_vector(pdev, nvmeq->cq_vector)) ...(3)
task 2:
nvme_reset_work()
nvme_dev_disable()
pdev->msix_enable = 0; ...(2)
crash log:
------------[ cut here ]------------
Unbalanced enable for IRQ 10
WARNING: kernel/irq/manage.c:753 at __enable_irq+0x102/0x190 kernel/irq/manage.c:753, CPU#1: kworker/1:0H/26
Modules linked in:
CPU: 1 UID: 0 PID: 26 Comm: kworker/1:0H Not tainted 6.19.0-dirty #9 PREEMPT(voluntary)
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
Workqueue: kblockd blk_mq_timeout_work
RIP: 0010:__enable_irq+0x107/0x190 kernel/irq/manage.c:753
Code: ff df 48 89 fa 48 c1 ea 03 0f b6 14 02 48 89 f8 83 e0 07 83 c0 03 38 d0 7c 04 84 d2 75 79 48 8d 3d 2e 7a 3f 05 41 8b 74 24 2c <67> 48 0f b9 3a e8 ef b9 21 00 5b 41 5c 5d e9 46 54 66 03 e8 e1 b9
RSP: 0018:ffffc900001bf550 EFLAGS: 00010046
RAX: 0000000000000007 RBX: 0000000000000000 RCX: ffffffffb20c0e90
RDX: 0000000000000000 RSI: 000000000000000a RDI: ffffffffb74b88f0
RBP: ffffc900001bf560 R08: ffff88800197cf00 R09: 0000000000000001
R10: 0000000000000003 R11: 0000000000000003 R12: ffff8880012a6000
R13: 1ffff92000037eae R14: 000000000000000a R15: 0000000000000293
FS: 0000000000000000(0000) GS:ffff8880b49f7000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000555da4a25fa8 CR3: 00000000208e8000 CR4: 00000000000006f0
Call Trace:
<TASK>
enable_irq+0x121/0x1e0 kernel/irq/manage.c:797
nvme_poll_irqdisable+0x162/0x1c0 drivers/nvme/host/pci.c:1494
nvme_timeout+0x965/0x14b0 drivers/nvme/host/pci.c:1744
blk_mq_rq_timed_out block/blk-mq.c:1653 [inline]
blk_mq_handle_expired+0x227/0x2d0 block/blk-mq.c:1721
bt_iter+0x2fc/0x3a0 block/blk-mq-tag.c:292
__sbitmap_for_each_set include/linux/sbitmap.h:269 [inline]
sbitmap_for_each_set include/linux/sbitmap.h:290 [inline]
bt_for_each block/blk-mq-tag.c:324 [inline]
blk_mq_queue_tag_busy_iter+0x969/0x1e80 block/blk-mq-tag.c:536
blk_mq_timeout_work+0x627/0x870 block/blk-mq.c:1763
process_one_work+0x956/0x1aa0 kernel/workqueue.c:3257
process_scheduled_works kernel/workqueue.c:3340 [inline]
worker_thread+0x65c/0xe60 kernel/workqueue.c:3421
kthread+0x41a/0x930 kernel/kthread.c:463
ret_from_fork+0x6f8/0x8c0 arch/x86/kernel/process.c:158
ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:246
</TASK>
irq event stamp: 74478
hardirqs last enabled at (74477): [<ffffffffb5720a9c>] __raw_spin_unlock_irq include/linux/spinlock_api_smp.h:159 [inline]
hardirqs last enabled at (74477): [<ffffffffb5720a9c>] _raw_spin_unlock_irq+0x2c/0x60 kernel/locking/spinlock.c:202
hardirqs last disabled at (74478): [<ffffffffb57207b5>] __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:108 [inline]
hardirqs last disabled at (74478): [<ffffffffb57207b5>] _raw_spin_lock_irqsave+0x85/0xa0 kernel/locking/spinlock.c:162
softirqs last enabled at (74304): [<ffffffffb1e9466c>] __do_softirq kernel/softirq.c:656 [inline]
softirqs last enabled at (74304): [<ffffffffb1e9466c>] invoke_softirq kernel/softirq.c:496 [inline]
softirqs last enabled at (74304): [<ffffffffb1e9466c>] __irq_exit_rcu+0xdc/0x120 kernel/softirq.c:723
softirqs last disabled at (74287): [<ffffffffb1e9466c>] __do_softirq kernel/softirq.c:656 [inline]
softirqs last disabled at (74287): [<ffffffffb1e9466c>] invoke_softirq kernel/softirq.c:496 [inline]
softirqs last disabled at (74287): [<ffffffffb1e9466c>] __irq_exit_rcu+0xdc/0x120 kernel/softirq.c:723
---[ end trace 0000000000000000 ]---
Fixes: fa059b856a59 (nvme-pci: Simplify nvme_poll_irqdisable)
Acked-by: Chao Shi <cshi008@fiu.edu>
Acked-by: Weidong Zhu <weizhu@fiu.edu>
Acked-by: Dave Tian <daveti@purdue.edu>
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Sungwoo Kim <iam@sung-woo.kim>
Signed-off-by: Keith Busch <kbusch@kernel.org>
2026-03-07 14:46:36 -05:00
|
|
|
|
2015-11-03 20:37:26 -07:00
|
|
|
|
2020-03-04 09:17:01 -08:00
|
|
|
|
2017-06-18 17:28:10 +03:00
|
|
|
|
nvme-pci: Fix race bug in nvme_poll_irqdisable()
In the following scenario, pdev can be disabled between (1) and (3) by
(2). This sets pdev->msix_enabled = 0. Then, pci_irq_vector() will
return MSI-X IRQ(>15) for (1) whereas return INTx IRQ(<=15) for (2).
This causes IRQ warning because it tries to enable INTx IRQ that has
never been disabled before.
To fix this, save IRQ number into a local variable and ensure
disable_irq() and enable_irq() operate on the same IRQ number. Even if
pci_free_irq_vectors() frees the IRQ concurrently, disable_irq() and
enable_irq() on a stale IRQ number is still valid and safe, and the
depth accounting reamins balanced.
task 1:
nvme_poll_irqdisable()
disable_irq(pci_irq_vector(pdev, nvmeq->cq_vector)) ...(1)
enable_irq(pci_irq_vector(pdev, nvmeq->cq_vector)) ...(3)
task 2:
nvme_reset_work()
nvme_dev_disable()
pdev->msix_enable = 0; ...(2)
crash log:
------------[ cut here ]------------
Unbalanced enable for IRQ 10
WARNING: kernel/irq/manage.c:753 at __enable_irq+0x102/0x190 kernel/irq/manage.c:753, CPU#1: kworker/1:0H/26
Modules linked in:
CPU: 1 UID: 0 PID: 26 Comm: kworker/1:0H Not tainted 6.19.0-dirty #9 PREEMPT(voluntary)
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
Workqueue: kblockd blk_mq_timeout_work
RIP: 0010:__enable_irq+0x107/0x190 kernel/irq/manage.c:753
Code: ff df 48 89 fa 48 c1 ea 03 0f b6 14 02 48 89 f8 83 e0 07 83 c0 03 38 d0 7c 04 84 d2 75 79 48 8d 3d 2e 7a 3f 05 41 8b 74 24 2c <67> 48 0f b9 3a e8 ef b9 21 00 5b 41 5c 5d e9 46 54 66 03 e8 e1 b9
RSP: 0018:ffffc900001bf550 EFLAGS: 00010046
RAX: 0000000000000007 RBX: 0000000000000000 RCX: ffffffffb20c0e90
RDX: 0000000000000000 RSI: 000000000000000a RDI: ffffffffb74b88f0
RBP: ffffc900001bf560 R08: ffff88800197cf00 R09: 0000000000000001
R10: 0000000000000003 R11: 0000000000000003 R12: ffff8880012a6000
R13: 1ffff92000037eae R14: 000000000000000a R15: 0000000000000293
FS: 0000000000000000(0000) GS:ffff8880b49f7000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000555da4a25fa8 CR3: 00000000208e8000 CR4: 00000000000006f0
Call Trace:
<TASK>
enable_irq+0x121/0x1e0 kernel/irq/manage.c:797
nvme_poll_irqdisable+0x162/0x1c0 drivers/nvme/host/pci.c:1494
nvme_timeout+0x965/0x14b0 drivers/nvme/host/pci.c:1744
blk_mq_rq_timed_out block/blk-mq.c:1653 [inline]
blk_mq_handle_expired+0x227/0x2d0 block/blk-mq.c:1721
bt_iter+0x2fc/0x3a0 block/blk-mq-tag.c:292
__sbitmap_for_each_set include/linux/sbitmap.h:269 [inline]
sbitmap_for_each_set include/linux/sbitmap.h:290 [inline]
bt_for_each block/blk-mq-tag.c:324 [inline]
blk_mq_queue_tag_busy_iter+0x969/0x1e80 block/blk-mq-tag.c:536
blk_mq_timeout_work+0x627/0x870 block/blk-mq.c:1763
process_one_work+0x956/0x1aa0 kernel/workqueue.c:3257
process_scheduled_works kernel/workqueue.c:3340 [inline]
worker_thread+0x65c/0xe60 kernel/workqueue.c:3421
kthread+0x41a/0x930 kernel/kthread.c:463
ret_from_fork+0x6f8/0x8c0 arch/x86/kernel/process.c:158
ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:246
</TASK>
irq event stamp: 74478
hardirqs last enabled at (74477): [<ffffffffb5720a9c>] __raw_spin_unlock_irq include/linux/spinlock_api_smp.h:159 [inline]
hardirqs last enabled at (74477): [<ffffffffb5720a9c>] _raw_spin_unlock_irq+0x2c/0x60 kernel/locking/spinlock.c:202
hardirqs last disabled at (74478): [<ffffffffb57207b5>] __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:108 [inline]
hardirqs last disabled at (74478): [<ffffffffb57207b5>] _raw_spin_lock_irqsave+0x85/0xa0 kernel/locking/spinlock.c:162
softirqs last enabled at (74304): [<ffffffffb1e9466c>] __do_softirq kernel/softirq.c:656 [inline]
softirqs last enabled at (74304): [<ffffffffb1e9466c>] invoke_softirq kernel/softirq.c:496 [inline]
softirqs last enabled at (74304): [<ffffffffb1e9466c>] __irq_exit_rcu+0xdc/0x120 kernel/softirq.c:723
softirqs last disabled at (74287): [<ffffffffb1e9466c>] __do_softirq kernel/softirq.c:656 [inline]
softirqs last disabled at (74287): [<ffffffffb1e9466c>] invoke_softirq kernel/softirq.c:496 [inline]
softirqs last disabled at (74287): [<ffffffffb1e9466c>] __irq_exit_rcu+0xdc/0x120 kernel/softirq.c:723
---[ end trace 0000000000000000 ]---
Fixes: fa059b856a59 (nvme-pci: Simplify nvme_poll_irqdisable)
Acked-by: Chao Shi <cshi008@fiu.edu>
Acked-by: Weidong Zhu <weizhu@fiu.edu>
Acked-by: Dave Tian <daveti@purdue.edu>
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Sungwoo Kim <iam@sung-woo.kim>
Signed-off-by: Keith Busch <kbusch@kernel.org>
2026-03-07 14:46:36 -05:00
|
|
|
|
|
|
|
|
|
2025-05-08 16:57:06 +02:00
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
2025-05-08 16:57:06 +02:00
|
|
|
|
nvme-pci: Fix race bug in nvme_poll_irqdisable()
In the following scenario, pdev can be disabled between (1) and (3) by
(2). This sets pdev->msix_enabled = 0. Then, pci_irq_vector() will
return MSI-X IRQ(>15) for (1) whereas return INTx IRQ(<=15) for (2).
This causes IRQ warning because it tries to enable INTx IRQ that has
never been disabled before.
To fix this, save IRQ number into a local variable and ensure
disable_irq() and enable_irq() operate on the same IRQ number. Even if
pci_free_irq_vectors() frees the IRQ concurrently, disable_irq() and
enable_irq() on a stale IRQ number is still valid and safe, and the
depth accounting reamins balanced.
task 1:
nvme_poll_irqdisable()
disable_irq(pci_irq_vector(pdev, nvmeq->cq_vector)) ...(1)
enable_irq(pci_irq_vector(pdev, nvmeq->cq_vector)) ...(3)
task 2:
nvme_reset_work()
nvme_dev_disable()
pdev->msix_enable = 0; ...(2)
crash log:
------------[ cut here ]------------
Unbalanced enable for IRQ 10
WARNING: kernel/irq/manage.c:753 at __enable_irq+0x102/0x190 kernel/irq/manage.c:753, CPU#1: kworker/1:0H/26
Modules linked in:
CPU: 1 UID: 0 PID: 26 Comm: kworker/1:0H Not tainted 6.19.0-dirty #9 PREEMPT(voluntary)
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
Workqueue: kblockd blk_mq_timeout_work
RIP: 0010:__enable_irq+0x107/0x190 kernel/irq/manage.c:753
Code: ff df 48 89 fa 48 c1 ea 03 0f b6 14 02 48 89 f8 83 e0 07 83 c0 03 38 d0 7c 04 84 d2 75 79 48 8d 3d 2e 7a 3f 05 41 8b 74 24 2c <67> 48 0f b9 3a e8 ef b9 21 00 5b 41 5c 5d e9 46 54 66 03 e8 e1 b9
RSP: 0018:ffffc900001bf550 EFLAGS: 00010046
RAX: 0000000000000007 RBX: 0000000000000000 RCX: ffffffffb20c0e90
RDX: 0000000000000000 RSI: 000000000000000a RDI: ffffffffb74b88f0
RBP: ffffc900001bf560 R08: ffff88800197cf00 R09: 0000000000000001
R10: 0000000000000003 R11: 0000000000000003 R12: ffff8880012a6000
R13: 1ffff92000037eae R14: 000000000000000a R15: 0000000000000293
FS: 0000000000000000(0000) GS:ffff8880b49f7000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000555da4a25fa8 CR3: 00000000208e8000 CR4: 00000000000006f0
Call Trace:
<TASK>
enable_irq+0x121/0x1e0 kernel/irq/manage.c:797
nvme_poll_irqdisable+0x162/0x1c0 drivers/nvme/host/pci.c:1494
nvme_timeout+0x965/0x14b0 drivers/nvme/host/pci.c:1744
blk_mq_rq_timed_out block/blk-mq.c:1653 [inline]
blk_mq_handle_expired+0x227/0x2d0 block/blk-mq.c:1721
bt_iter+0x2fc/0x3a0 block/blk-mq-tag.c:292
__sbitmap_for_each_set include/linux/sbitmap.h:269 [inline]
sbitmap_for_each_set include/linux/sbitmap.h:290 [inline]
bt_for_each block/blk-mq-tag.c:324 [inline]
blk_mq_queue_tag_busy_iter+0x969/0x1e80 block/blk-mq-tag.c:536
blk_mq_timeout_work+0x627/0x870 block/blk-mq.c:1763
process_one_work+0x956/0x1aa0 kernel/workqueue.c:3257
process_scheduled_works kernel/workqueue.c:3340 [inline]
worker_thread+0x65c/0xe60 kernel/workqueue.c:3421
kthread+0x41a/0x930 kernel/kthread.c:463
ret_from_fork+0x6f8/0x8c0 arch/x86/kernel/process.c:158
ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:246
</TASK>
irq event stamp: 74478
hardirqs last enabled at (74477): [<ffffffffb5720a9c>] __raw_spin_unlock_irq include/linux/spinlock_api_smp.h:159 [inline]
hardirqs last enabled at (74477): [<ffffffffb5720a9c>] _raw_spin_unlock_irq+0x2c/0x60 kernel/locking/spinlock.c:202
hardirqs last disabled at (74478): [<ffffffffb57207b5>] __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:108 [inline]
hardirqs last disabled at (74478): [<ffffffffb57207b5>] _raw_spin_lock_irqsave+0x85/0xa0 kernel/locking/spinlock.c:162
softirqs last enabled at (74304): [<ffffffffb1e9466c>] __do_softirq kernel/softirq.c:656 [inline]
softirqs last enabled at (74304): [<ffffffffb1e9466c>] invoke_softirq kernel/softirq.c:496 [inline]
softirqs last enabled at (74304): [<ffffffffb1e9466c>] __irq_exit_rcu+0xdc/0x120 kernel/softirq.c:723
softirqs last disabled at (74287): [<ffffffffb1e9466c>] __do_softirq kernel/softirq.c:656 [inline]
softirqs last disabled at (74287): [<ffffffffb1e9466c>] invoke_softirq kernel/softirq.c:496 [inline]
softirqs last disabled at (74287): [<ffffffffb1e9466c>] __irq_exit_rcu+0xdc/0x120 kernel/softirq.c:723
---[ end trace 0000000000000000 ]---
Fixes: fa059b856a59 (nvme-pci: Simplify nvme_poll_irqdisable)
Acked-by: Chao Shi <cshi008@fiu.edu>
Acked-by: Weidong Zhu <weizhu@fiu.edu>
Acked-by: Dave Tian <daveti@purdue.edu>
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Sungwoo Kim <iam@sung-woo.kim>
Signed-off-by: Keith Busch <kbusch@kernel.org>
2026-03-07 14:46:36 -05:00
|
|
|
|
2015-11-03 20:37:26 -07:00
|
|
|
|
|
|
|
|
|
2021-10-12 09:24:29 -06:00
|
|
|
|
2018-11-14 09:38:28 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-10 09:26:54 -08:00
|
|
|
|
|
|
|
|
|
2018-11-14 09:38:28 -07:00
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:23 +01:00
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
2018-12-02 17:46:23 +01:00
|
|
|
|
2018-11-14 09:38:28 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-11-07 15:13:12 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2016-04-26 13:52:00 +02:00
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
|
|
|
|
|
2017-11-07 15:13:12 -07:00
|
|
|
|
2021-10-29 14:32:44 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2013-12-10 13:10:40 -07:00
|
|
|
|
|
|
|
|
|
2024-06-24 08:56:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-01-14 12:54:13 +05:30
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-06-24 08:56:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-05-24 17:51:33 +08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
2017-10-18 22:56:09 +09:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-05-08 10:25:15 -06:00
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2017-04-04 18:18:12 -04:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-05-08 10:25:15 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
2017-10-18 22:56:09 +09:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-01-16 15:46:37 +08:00
|
|
|
|
|
|
|
|
|
2011-09-19 17:08:14 -04:00
|
|
|
|
2022-09-06 09:07:35 -07:00
|
|
|
|
2011-09-19 17:08:14 -04:00
|
|
|
|
2017-04-20 16:02:57 +02:00
|
|
|
|
|
|
|
|
|
2015-11-16 10:39:48 +01:00
|
|
|
|
|
|
|
|
|
2022-09-21 15:19:54 -06:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
|
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-01-22 22:03:16 +08:00
|
|
|
|
2023-10-27 10:58:12 -07:00
|
|
|
|
2018-01-22 22:03:16 +08:00
|
|
|
|
2018-01-31 18:31:24 +02:00
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
2018-01-22 22:03:16 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-06-06 09:53:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-07-11 15:59:52 -07:00
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
|
|
|
|
|
2022-07-06 20:03:51 +08:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
2015-11-28 15:43:10 +01:00
|
|
|
|
2022-09-06 09:07:35 -07:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2025-03-06 14:25:57 -08:00
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
2023-12-06 10:48:30 -08:00
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
2025-03-06 14:25:57 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-04-25 19:33:00 +05:30
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-02-15 14:05:10 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-03-06 14:25:57 -08:00
|
|
|
|
2018-02-15 14:05:10 -06:00
|
|
|
|
|
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-07-12 08:36:47 -07:00
|
|
|
|
2017-06-07 20:32:50 +02:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
2017-02-24 17:59:28 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-03-04 09:17:01 -08:00
|
|
|
|
2021-10-12 09:24:29 -06:00
|
|
|
|
2020-03-04 09:17:01 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-01-18 08:44:16 -08:00
|
|
|
|
2017-02-24 17:59:28 -05:00
|
|
|
|
2023-12-06 10:48:30 -08:00
|
|
|
|
|
|
|
|
|
2018-05-29 15:52:30 +02:00
|
|
|
|
2017-02-24 17:59:28 -05:00
|
|
|
|
|
|
|
|
|
2015-10-22 14:03:35 +02:00
|
|
|
|
2015-11-26 12:42:26 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-05-29 15:52:30 +02:00
|
|
|
|
2015-11-26 12:42:26 +01:00
|
|
|
|
2023-10-27 10:58:12 -07:00
|
|
|
|
2018-02-08 08:55:34 -07:00
|
|
|
|
2019-05-14 14:27:53 -06:00
|
|
|
|
2020-08-23 17:36:59 -05:00
|
|
|
|
2019-05-14 14:27:53 -06:00
|
|
|
|
2018-05-24 14:34:55 -06:00
|
|
|
|
2023-12-06 10:48:30 -08:00
|
|
|
|
|
|
|
|
|
2017-04-20 16:02:57 +02:00
|
|
|
|
2020-08-28 10:17:08 -04:00
|
|
|
|
2018-05-29 15:52:30 +02:00
|
|
|
|
2019-05-14 14:10:41 -06:00
|
|
|
|
|
|
|
|
|
2018-02-08 08:55:34 -07:00
|
|
|
|
|
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
|
|
|
|
|
2015-11-26 12:42:26 +01:00
|
|
|
|
2020-07-03 10:49:20 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-10-22 14:03:35 +02:00
|
|
|
|
2023-12-06 10:48:30 -08:00
|
|
|
|
2025-05-10 05:47:03 +02:00
|
|
|
|
2016-02-10 08:51:15 -07:00
|
|
|
|
2023-12-06 10:48:30 -08:00
|
|
|
|
|
|
|
|
|
2024-01-31 09:43:14 -07:00
|
|
|
|
2020-08-28 10:17:08 -04:00
|
|
|
|
2023-07-12 08:36:47 -07:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
|
|
|
|
|
2015-11-16 10:39:48 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-05-10 05:47:03 +02:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
2021-10-06 23:50:31 -07:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
|
|
|
|
|
2016-02-10 08:51:15 -07:00
|
|
|
|
2023-12-06 10:48:30 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
2022-03-15 15:53:59 +01:00
|
|
|
|
|
|
|
|
|
2015-11-20 09:36:44 +01:00
|
|
|
|
|
|
|
|
|
2015-10-22 14:03:35 +02:00
|
|
|
|
2015-11-20 09:36:44 +01:00
|
|
|
|
2022-03-15 15:53:59 +01:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
2022-05-24 14:15:30 +02:00
|
|
|
|
2015-11-16 10:39:48 +01:00
|
|
|
|
2022-05-24 14:15:30 +02:00
|
|
|
|
2015-02-19 10:34:48 -07:00
|
|
|
|
2015-01-07 18:55:53 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-02-19 10:34:48 -07:00
|
|
|
|
2023-07-12 08:36:47 -07:00
|
|
|
|
|
|
|
|
|
2024-04-25 19:33:00 +05:30
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-07-12 08:36:47 -07:00
|
|
|
|
2024-04-25 19:33:00 +05:30
|
|
|
|
2023-07-12 08:36:47 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2012-08-07 15:56:23 -04:00
|
|
|
|
|
|
|
|
|
2014-07-07 09:14:42 -06:00
|
|
|
|
2012-08-03 13:55:56 -04:00
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2012-08-03 13:55:56 -04:00
|
|
|
|
2018-12-02 17:46:18 +01:00
|
|
|
|
|
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
2018-12-02 17:46:18 +01:00
|
|
|
|
2019-03-08 10:43:11 -07:00
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2018-12-02 17:46:18 +01:00
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2018-12-02 17:46:18 +01:00
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
2012-08-03 13:55:56 -04:00
|
|
|
|
|
|
|
|
|
2013-12-16 13:50:00 -05:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-04-24 10:58:29 +03:00
|
|
|
|
|
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2015-01-14 21:01:58 -07:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
|
|
|
|
|
2022-11-29 10:51:05 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2022-11-29 10:51:05 +01:00
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
2022-11-29 10:51:05 +01:00
|
|
|
|
2012-08-07 15:56:23 -04:00
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
2018-05-17 18:31:49 +02:00
|
|
|
|
2012-08-07 15:56:23 -04:00
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2022-11-29 10:51:05 +01:00
|
|
|
|
2013-12-10 13:10:40 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2019-01-04 15:04:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-29 10:51:05 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2020-02-13 01:41:05 +09:00
|
|
|
|
|
|
|
|
|
2020-05-27 09:13:52 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-02-13 01:41:05 +09:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-05-27 09:13:52 -07:00
|
|
|
|
|
|
|
|
|
2021-10-08 05:59:37 -06:00
|
|
|
|
2020-05-27 09:13:52 -07:00
|
|
|
|
|
|
|
|
|
2020-02-13 01:41:05 +09:00
|
|
|
|
|
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-28 15:03:49 +01:00
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
2015-07-21 15:08:13 -06:00
|
|
|
|
2020-07-03 10:49:21 +08:00
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2015-07-21 15:08:13 -06:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2019-07-08 10:05:11 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2018-12-02 17:46:18 +01:00
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2018-12-02 17:46:18 +01:00
|
|
|
|
2018-02-13 05:44:44 -07:00
|
|
|
|
|
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-04-12 09:16:09 -06:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-01-23 09:16:19 -07:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2019-08-07 17:51:20 +10:00
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
|
|
|
|
|
cross-tree: phase out dma_zalloc_coherent()
We already need to zero out memory for dma_alloc_coherent(), as such
using dma_zalloc_coherent() is superflous. Phase it out.
This change was generated with the following Coccinelle SmPL patch:
@ replace_dma_zalloc_coherent @
expression dev, size, data, handle, flags;
@@
-dma_zalloc_coherent(dev, size, handle, flags)
+dma_alloc_coherent(dev, size, handle, flags)
Suggested-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Luis Chamberlain <mcgrof@kernel.org>
[hch: re-ran the script on the latest tree]
Signed-off-by: Christoph Hellwig <hch@lst.de>
2019-01-04 09:23:09 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2011-02-10 09:56:01 -05:00
|
|
|
|
2018-05-17 18:31:51 +02:00
|
|
|
|
2018-12-02 17:46:23 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2011-01-20 13:24:06 -05:00
|
|
|
|
2013-09-10 11:25:37 +08:00
|
|
|
|
2013-12-10 13:10:38 -07:00
|
|
|
|
2017-04-24 10:58:29 +03:00
|
|
|
|
2015-05-27 12:26:23 -06:00
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
2011-01-20 09:10:15 -05:00
|
|
|
|
2017-04-13 09:06:43 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 09:10:15 -05:00
|
|
|
|
|
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
2020-10-30 10:28:54 -07:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
|
|
|
|
|
2013-09-10 11:25:37 +08:00
|
|
|
|
2019-08-07 17:51:19 +10:00
|
|
|
|
2017-04-10 12:51:07 -03:00
|
|
|
|
2014-03-24 10:46:25 -06:00
|
|
|
|
2018-12-02 17:46:23 +01:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
|
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-10-27 10:58:12 -07:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2011-02-01 08:39:04 -05:00
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
|
|
|
|
|
2018-04-12 09:16:10 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
2018-05-24 17:51:33 +08:00
|
|
|
|
2018-06-06 08:13:06 -06:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-06-06 08:13:06 -06:00
|
|
|
|
2019-11-25 09:06:12 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2018-05-24 17:51:33 +08:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-05-24 17:51:33 +08:00
|
|
|
|
2018-02-15 19:13:41 +08:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-05-24 17:51:33 +08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2017-03-30 13:39:16 -07:00
|
|
|
|
2015-05-22 11:12:46 +02:00
|
|
|
|
2017-03-30 13:41:32 +02:00
|
|
|
|
2026-04-21 09:14:02 -07:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2022-03-15 15:53:59 +01:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-03-30 13:39:16 -07:00
|
|
|
|
2018-12-02 17:46:27 +01:00
|
|
|
|
2021-11-18 08:37:30 -07:00
|
|
|
|
2018-12-02 17:46:27 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-03-15 15:53:59 +01:00
|
|
|
|
2018-12-02 17:46:27 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-11-14 09:38:28 -07:00
|
|
|
|
|
|
|
|
|
2015-01-07 18:55:49 -07:00
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2016-02-24 09:15:56 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
2015-01-07 18:55:49 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-24 16:39:55 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-01 00:27:17 +03:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2013-05-04 06:43:16 -04:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2014-06-23 11:34:01 -06:00
|
|
|
|
2017-05-24 16:39:55 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-10-19 09:51:05 -06:00
|
|
|
|
2017-06-27 22:16:38 +03:00
|
|
|
|
2015-08-10 15:20:40 -06:00
|
|
|
|
2015-11-20 08:58:10 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-08-10 15:20:40 -06:00
|
|
|
|
2022-11-08 11:20:12 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-15 12:16:27 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-04-12 09:16:09 -06:00
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2020-06-16 12:34:22 +03:00
|
|
|
|
|
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-20 08:58:10 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2014-06-23 11:34:01 -06:00
|
|
|
|
2019-07-22 17:06:53 -07:00
|
|
|
|
2013-05-01 13:07:51 -06:00
|
|
|
|
2016-11-15 15:56:26 -05:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2014-12-22 12:59:04 -07:00
|
|
|
|
2017-09-14 13:54:39 -04:00
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
2015-06-30 11:22:52 -06:00
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2016-11-15 15:56:26 -05:00
|
|
|
|
2015-06-30 11:22:52 -06:00
|
|
|
|
2013-05-01 13:07:51 -06:00
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 11:46:39 +01:00
|
|
|
|
2014-03-24 10:46:25 -06:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
2015-11-26 11:46:39 +01:00
|
|
|
|
2014-03-24 10:46:25 -06:00
|
|
|
|
2017-04-24 10:58:29 +03:00
|
|
|
|
2018-04-12 09:16:09 -06:00
|
|
|
|
2015-11-26 11:46:39 +01:00
|
|
|
|
2014-03-24 10:46:25 -06:00
|
|
|
|
2015-11-26 11:46:39 +01:00
|
|
|
|
|
|
|
|
|
2014-03-24 10:46:25 -06:00
|
|
|
|
2017-04-24 10:58:29 +03:00
|
|
|
|
2018-12-02 17:46:16 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-12-17 17:08:15 -07:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-11-15 15:56:26 -05:00
|
|
|
|
2014-03-24 10:46:25 -06:00
|
|
|
|
2014-04-11 11:58:45 -04:00
|
|
|
|
2015-11-26 11:46:39 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-01-14 16:14:27 +09:00
|
|
|
|
|
|
|
|
|
2015-11-26 11:46:39 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2017-12-20 14:50:00 +01:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2017-12-20 14:50:00 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-12-20 14:25:11 +01:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2017-12-20 14:50:00 +01:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
2017-10-01 09:37:35 +02:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2018-10-31 13:15:29 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-01-15 07:30:46 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-20 08:58:10 +01:00
|
|
|
|
2017-12-20 14:25:11 +01:00
|
|
|
|
|
|
|
|
|
2016-10-05 20:01:12 -06:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2017-12-20 14:50:00 +01:00
|
|
|
|
|
|
|
|
|
2017-10-01 09:37:35 +02:00
|
|
|
|
|
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
2017-12-20 14:25:11 +01:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2025-02-13 01:04:44 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-01-15 07:30:46 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-02-13 01:04:43 +08:00
|
|
|
|
2017-12-20 14:25:11 +01:00
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
|
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2013-07-15 15:02:24 -06:00
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2017-08-28 10:47:18 +02:00
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-27 09:40:43 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2018-12-29 17:23:43 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-04-29 16:11:16 +08:00
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
|
|
|
|
|
2026-04-29 16:11:16 +08:00
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
2026-04-29 16:11:16 +08:00
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
2024-11-01 05:40:04 +01:00
|
|
|
|
2017-08-28 10:47:18 +02:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2024-11-01 05:40:04 +01:00
|
|
|
|
2017-11-25 03:03:00 +09:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-01-10 05:21:37 +05:30
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:04 +01:00
|
|
|
|
2017-08-28 10:47:18 +02:00
|
|
|
|
2017-07-06 12:26:52 +03:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2017-12-05 05:23:54 +09:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-11 12:09:28 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-21 16:37:42 -08:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-11-17 01:34:24 +09:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
2017-07-25 17:39:07 +02:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-16 17:51:37 -07:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-08-28 10:47:18 +02:00
|
|
|
|
2024-11-01 05:40:04 +01:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:04 +01:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
|
|
|
|
|
2024-12-04 09:42:40 +09:00
|
|
|
|
2020-06-01 19:41:14 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-12-04 09:42:40 +09:00
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
2020-06-01 19:41:14 -07:00
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-06 12:19:57 +02:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-12-05 05:23:54 +09:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2022-11-13 12:05:58 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-06 12:19:57 +02:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-09-06 12:19:57 +02:00
|
|
|
|
2017-09-11 12:08:43 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-01 05:40:05 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
|
|
|
|
|
2017-09-06 12:19:57 +02:00
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2017-09-06 12:19:57 +02:00
|
|
|
|
2013-07-15 15:02:24 -06:00
|
|
|
|
|
|
|
|
|
2021-07-14 14:02:37 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-24 21:16:30 -07:00
|
|
|
|
2021-07-14 14:02:37 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-16 09:22:49 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-27 09:40:43 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-24 22:28:12 +01:00
|
|
|
|
2021-07-27 09:40:43 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-14 14:02:37 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-16 09:22:49 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-27 09:40:43 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-14 14:02:37 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-16 09:22:49 +02:00
|
|
|
|
|
|
|
|
|
2021-07-27 09:40:43 -07:00
|
|
|
|
2021-07-14 14:02:37 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-10-27 02:34:13 -07:00
|
|
|
|
2021-07-14 14:02:37 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-10-27 02:34:13 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-05-17 00:06:48 +05:30
|
|
|
|
2022-10-27 02:34:13 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-02-16 08:44:03 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2019-01-03 09:34:39 +08:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2020-07-03 10:49:20 +08:00
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
2018-12-09 11:21:45 -07:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
genirq/affinity: Store interrupt sets size in struct irq_affinity
The interrupt affinity spreading mechanism supports to spread out
affinities for one or more interrupt sets. A interrupt set contains one
or more interrupts. Each set is mapped to a specific functionality of a
device, e.g. general I/O queues and read I/O queus of multiqueue block
devices.
The number of interrupts per set is defined by the driver. It depends on
the total number of available interrupts for the device, which is
determined by the PCI capabilites and the availability of underlying CPU
resources, and the number of queues which the device provides and the
driver wants to instantiate.
The driver passes initial configuration for the interrupt allocation via
a pointer to struct irq_affinity.
Right now the allocation mechanism is complex as it requires to have a
loop in the driver to determine the maximum number of interrupts which
are provided by the PCI capabilities and the underlying CPU resources.
This loop would have to be replicated in every driver which wants to
utilize this mechanism. That's unwanted code duplication and error
prone.
In order to move this into generic facilities it is required to have a
mechanism, which allows the recalculation of the interrupt sets and
their size, in the core code. As the core code does not have any
knowledge about the underlying device, a driver specific callback will
be added to struct affinity_desc, which will be invoked by the core
code. The callback will get the number of available interupts as an
argument, so the driver can calculate the corresponding number and size
of interrupt sets.
To support this, two modifications for the handling of struct irq_affinity
are required:
1) The (optional) interrupt sets size information is contained in a
separate array of integers and struct irq_affinity contains a
pointer to it.
This is cumbersome and as the maximum number of interrupt sets is small,
there is no reason to have separate storage. Moving the size array into
struct affinity_desc avoids indirections and makes the code simpler.
2) At the moment the struct irq_affinity pointer which is handed in from
the driver and passed through to several core functions is marked
'const'.
With the upcoming callback to recalculate the number and size of
interrupt sets, it's necessary to remove the 'const'
qualifier. Otherwise the callback would not be able to update the data.
Implement #1 and store the interrupt sets size in 'struct irq_affinity'.
No functional change.
[ tglx: Fixed the memcpy() size so it won't copy beyond the size of the
source. Fixed the kernel doc comments for struct irq_affinity and
de-'This patch'-ed the changelog ]
Signed-off-by: Ming Lei <ming.lei@redhat.com>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Acked-by: Marc Zyngier <marc.zyngier@arm.com>
Cc: Christoph Hellwig <hch@lst.de>
Cc: Bjorn Helgaas <helgaas@kernel.org>
Cc: Jens Axboe <axboe@kernel.dk>
Cc: linux-block@vger.kernel.org
Cc: Sagi Grimberg <sagi@grimberg.me>
Cc: linux-nvme@lists.infradead.org
Cc: linux-pci@vger.kernel.org
Cc: Keith Busch <keith.busch@intel.com>
Cc: Sumit Saxena <sumit.saxena@broadcom.com>
Cc: Kashyap Desai <kashyap.desai@broadcom.com>
Cc: Shivasharan Srikanteshwara <shivasharan.srikanteshwara@broadcom.com>
Link: https://lkml.kernel.org/r/20190216172228.423723127@linutronix.de
2019-02-16 18:13:08 +01:00
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2020-09-24 09:01:22 +02:00
|
|
|
|
2024-04-22 12:28:23 -04:00
|
|
|
|
2018-12-09 11:21:45 -07:00
|
|
|
|
|
|
|
|
|
2020-09-24 09:01:22 +02:00
|
|
|
|
|
|
|
|
|
2018-12-09 11:21:45 -07:00
|
|
|
|
2020-09-24 09:01:22 +02:00
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2020-09-24 09:01:22 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2019-08-07 17:51:21 +10:00
|
|
|
|
2020-09-24 09:01:22 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:21 +10:00
|
|
|
|
2020-09-24 09:01:22 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-04-22 12:28:23 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
|
|
|
|
|
2020-11-12 09:23:02 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-17 15:43:25 +02:00
|
|
|
|
|
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
|
|
|
|
|
2012-12-21 15:13:49 -08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2015-05-22 11:12:39 +02:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2017-05-24 16:39:55 +08:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:22 +10:00
|
|
|
|
2026-02-10 10:38:09 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-10 11:00:12 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 11:09:06 +01:00
|
|
|
|
|
|
|
|
|
2011-01-20 13:01:49 -05:00
|
|
|
|
2015-11-26 11:09:06 +01:00
|
|
|
|
2016-06-06 23:20:50 +02:00
|
|
|
|
2016-04-08 16:09:10 -06:00
|
|
|
|
2021-04-10 20:15:43 +00:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
2022-12-25 11:32:32 +01:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
2022-12-25 11:32:32 +01:00
|
|
|
|
|
|
|
|
|
2018-10-04 15:27:43 -06:00
|
|
|
|
2022-12-25 11:32:32 +01:00
|
|
|
|
2015-07-20 10:14:09 -06:00
|
|
|
|
|
|
|
|
|
2017-05-24 16:39:55 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-24 16:39:55 +08:00
|
|
|
|
|
|
|
|
|
2011-10-20 17:00:41 -04:00
|
|
|
|
2019-01-04 15:04:33 -07:00
|
|
|
|
2013-07-15 15:02:24 -06:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
2013-07-15 15:02:24 -06:00
|
|
|
|
2014-11-14 09:49:26 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
|
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-10-31 08:36:31 -06:00
|
|
|
|
2018-04-12 09:16:10 -06:00
|
|
|
|
2018-11-05 12:44:33 -07:00
|
|
|
|
2018-12-02 17:46:16 +01:00
|
|
|
|
2011-01-20 13:01:49 -05:00
|
|
|
|
2013-06-20 10:53:48 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
2019-03-08 10:43:06 -07:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
2018-12-02 17:46:17 +01:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
2019-01-04 15:04:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-16 09:07:48 +01:00
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-01-04 15:04:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-07-07 14:14:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2022-09-21 15:19:54 -06:00
|
|
|
|
2026-01-16 15:46:37 +08:00
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
2022-09-21 15:19:54 -06:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
2022-09-21 15:19:54 -06:00
|
|
|
|
2026-01-16 15:46:37 +08:00
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
2026-01-16 15:46:37 +08:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-06-16 15:15:53 -07:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-03-15 15:53:59 +01:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
2022-03-15 15:53:59 +01:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
2022-05-24 14:15:30 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
2022-05-24 14:15:30 +02:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-16 09:07:48 +01:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
2018-12-02 17:46:21 +01:00
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-05-14 10:32:51 +02:00
|
|
|
|
2018-12-02 17:46:21 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:21 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:22 +01:00
|
|
|
|
|
|
|
|
|
2018-12-02 17:46:21 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:17 -07:00
|
|
|
|
|
|
|
|
|
2022-11-16 09:07:48 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2022-11-16 09:07:48 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-01-06 08:01:58 +08:00
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2022-07-21 08:13:23 +02:00
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-07-21 08:13:23 +02:00
|
|
|
|
2015-12-17 17:08:15 -07:00
|
|
|
|
2024-10-15 13:21:00 +02:00
|
|
|
|
2022-07-21 08:13:23 +02:00
|
|
|
|
2024-08-26 11:20:57 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-10-15 13:21:00 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-08-26 11:20:57 -07:00
|
|
|
|
|
|
|
|
|
2022-07-21 08:13:23 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-10-15 13:21:00 +02:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
2013-07-15 15:02:19 -06:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
2015-05-22 11:12:39 +02:00
|
|
|
|
2024-04-22 12:28:23 -04:00
|
|
|
|
2013-07-15 15:02:19 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-20 08:58:10 +01:00
|
|
|
|
2025-10-24 13:05:32 +02:00
|
|
|
|
2013-12-10 13:10:39 -07:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
2013-12-10 13:10:39 -07:00
|
|
|
|
2014-11-14 09:49:26 -07:00
|
|
|
|
|
|
|
|
|
2016-04-08 16:09:10 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2014-11-14 09:49:26 -07:00
|
|
|
|
2024-04-22 12:28:23 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-09-14 16:18:57 +02:00
|
|
|
|
2022-12-29 10:37:31 -08:00
|
|
|
|
2014-11-14 09:49:26 -07:00
|
|
|
|
2017-06-27 22:16:38 +03:00
|
|
|
|
2015-11-20 08:58:10 +01:00
|
|
|
|
nvme-pci: Use u32 for nvme_dev.q_depth and nvme_queue.q_depth
Recently nvme_dev.q_depth was changed from an int to u16 type.
This falls over for the queue depth calculation in nvme_pci_enable(),
where NVME_CAP_MQES(dev->ctrl.cap) + 1 may overflow as a u16, as
NVME_CAP_MQES() is a 16b number also. That happens for me, and this is the
result:
root@ubuntu:/home/john# [148.272996] Unable to handle kernel NULL pointer
dereference at virtual address 0000000000000010
Mem abort info:
ESR = 0x96000004
EC = 0x25: DABT (current EL), IL = 32 bits
SET = 0, FnV = 0
EA = 0, S1PTW = 0
Data abort info:
ISV = 0, ISS = 0x00000004
CM = 0, WnR = 0
user pgtable: 4k pages, 48-bit VAs, pgdp=00000a27bf3c9000
[0000000000000010] pgd=0000000000000000, p4d=0000000000000000
Internal error: Oops: 96000004 [#1] PREEMPT SMP
Modules linked in: nvme nvme_core
CPU: 56 PID: 256 Comm: kworker/u195:0 Not tainted
5.8.0-next-20200812 #27
Hardware name: Huawei D06 /D06, BIOS Hisilicon D06 UEFI RC0 -
V1.16.01 03/15/2019
Workqueue: nvme-reset-wq nvme_reset_work [nvme]
pstate: 80c00009 (Nzcv daif +PAN +UAO BTYPE=--)
pc : __sg_alloc_table_from_pages+0xec/0x238
lr : __sg_alloc_table_from_pages+0xc8/0x238
sp : ffff800013ccbad0
x29: ffff800013ccbad0 x28: ffff0a27b3d380a8
x27: 0000000000000000 x26: 0000000000002dc2
x25: 0000000000000dc0 x24: 0000000000000000
x23: 0000000000000000 x22: ffff800013ccbbe8
x21: 0000000000000010 x20: 0000000000000000
x19: 00000000fffff000 x18: ffffffffffffffff
x17: 00000000000000c0 x16: fffffe289eaf6380
x15: ffff800011b59948 x14: ffff002bc8fe98f8
x13: ff00000000000000 x12: ffff8000114ca000
x11: 0000000000000000 x10: ffffffffffffffff
x9 : ffffffffffffffc0 x8 : ffff0a27b5f9b6a0
x7 : 0000000000000000 x6 : 0000000000000001
x5 : ffff0a27b5f9b680 x4 : 0000000000000000
x3 : ffff0a27b5f9b680 x2 : 0000000000000000
x1 : 0000000000000001 x0 : 0000000000000000
Call trace:
__sg_alloc_table_from_pages+0xec/0x238
sg_alloc_table_from_pages+0x18/0x28
iommu_dma_alloc+0x474/0x678
dma_alloc_attrs+0xd8/0xf0
nvme_alloc_queue+0x114/0x160 [nvme]
nvme_reset_work+0xb34/0x14b4 [nvme]
process_one_work+0x1e8/0x360
worker_thread+0x44/0x478
kthread+0x150/0x158
ret_from_fork+0x10/0x34
Code: f94002c3 6b01017f 540007c2 11000486 (f8645aa5)
---[ end trace 89bb2b72d59bf925 ]---
Fix by making onto a u32.
Also use u32 for nvme_dev.q_depth, as we assign this value from
nvme_dev.q_depth, and nvme_dev.q_depth will possibly hold 65536 - this
avoids the same crash as above.
Fixes: 61f3b8963097 ("nvme-pci: use unsigned for io queue depth")
Signed-off-by: John Garry <john.garry@huawei.com>
Reviewed-by: Keith Busch <kbusch@kernel.org>
Signed-off-by: Sagi Grimberg <sagi@grimberg.me>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
2020-08-14 23:34:25 +08:00
|
|
|
|
2017-07-10 16:46:59 +08:00
|
|
|
|
2017-06-27 22:16:38 +03:00
|
|
|
|
2015-11-20 08:58:10 +01:00
|
|
|
|
2015-12-01 13:23:22 -07:00
|
|
|
|
2019-08-07 17:51:21 +10:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-12-01 13:23:22 -07:00
|
|
|
|
2024-09-11 10:39:59 -07:00
|
|
|
|
2015-12-01 13:23:22 -07:00
|
|
|
|
2017-06-27 22:27:57 -04:00
|
|
|
|
|
|
|
|
|
2017-06-27 22:16:38 +03:00
|
|
|
|
2017-06-27 22:27:57 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-12-01 13:23:22 -07:00
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:22 +10:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-12-25 11:32:32 +01:00
|
|
|
|
2019-08-07 17:51:22 +10:00
|
|
|
|
2017-12-20 14:25:11 +01:00
|
|
|
|
2016-10-05 20:01:12 -06:00
|
|
|
|
2015-12-07 15:30:31 -07:00
|
|
|
|
2022-10-27 03:28:16 -07:00
|
|
|
|
2022-12-29 10:37:31 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2013-07-15 15:02:19 -06:00
|
|
|
|
2022-12-29 10:37:31 -08:00
|
|
|
|
|
|
|
|
|
2013-07-15 15:02:19 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-06-07 09:44:02 +02:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
|
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
2013-07-15 15:02:19 -06:00
|
|
|
|
2015-05-22 11:12:39 +02:00
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
2015-05-22 11:12:39 +02:00
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2013-07-15 15:02:19 -06:00
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
|
|
|
|
|
2013-12-10 13:10:40 -07:00
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:18 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2023-10-27 10:58:12 -07:00
|
|
|
|
2017-03-01 14:22:12 -05:00
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
2013-07-15 15:02:20 -06:00
|
|
|
|
2015-11-26 12:21:29 +01:00
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
2023-10-27 10:58:12 -07:00
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
2017-03-01 14:22:12 -05:00
|
|
|
|
2022-11-16 09:09:48 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-05-14 10:32:50 +02:00
|
|
|
|
2015-01-07 18:55:52 -07:00
|
|
|
|
2016-08-11 09:35:57 -06:00
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2018-02-12 20:57:24 +08:00
|
|
|
|
2018-04-12 09:16:08 -06:00
|
|
|
|
2022-11-16 09:07:48 +01:00
|
|
|
|
2022-11-16 08:59:55 +01:00
|
|
|
|
|
|
|
|
|
2013-12-10 13:10:40 -07:00
|
|
|
|
2019-01-04 15:04:33 -07:00
|
|
|
|
2022-11-29 10:51:05 +01:00
|
|
|
|
2022-11-16 09:01:30 +01:00
|
|
|
|
2023-03-07 14:32:43 -06:00
|
|
|
|
2022-11-16 09:01:30 +01:00
|
|
|
|
2020-02-13 01:41:05 +09:00
|
|
|
|
2015-02-19 10:34:48 -07:00
|
|
|
|
2022-07-08 11:04:37 +08:00
|
|
|
|
|
|
|
|
|
2017-03-01 14:22:12 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-04-30 09:33:41 -06:00
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2019-04-30 09:33:41 -06:00
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2019-04-30 09:33:41 -06:00
|
|
|
|
2015-11-26 12:21:29 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 09:41:41 +01:00
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2022-11-08 09:41:41 +01:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2022-11-08 09:41:41 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2022-11-08 09:41:41 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-09-05 07:52:33 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
2019-09-05 07:52:33 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2015-11-26 10:54:19 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2015-11-26 10:54:19 +01:00
|
|
|
|
2014-01-31 16:53:39 -07:00
|
|
|
|
2019-09-05 07:52:33 -06:00
|
|
|
|
2020-03-24 17:29:40 +02:00
|
|
|
|
|
|
|
|
|
2013-02-19 10:17:58 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 12:42:26 +01:00
|
|
|
|
2013-02-19 10:17:58 -07:00
|
|
|
|
2017-06-15 15:41:08 +02:00
|
|
|
|
|
|
|
|
|
2017-02-03 12:50:32 -07:00
|
|
|
|
2019-06-08 13:01:02 -07:00
|
|
|
|
2013-07-15 15:02:21 -06:00
|
|
|
|
2023-10-27 10:58:12 -07:00
|
|
|
|
2021-07-05 21:38:29 +08:00
|
|
|
|
|
|
|
|
|
2023-06-28 07:51:02 -07:00
|
|
|
|
|
|
|
|
|
2019-06-08 13:01:02 -07:00
|
|
|
|
2015-11-26 12:42:26 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
2016-01-12 14:41:18 -07:00
|
|
|
|
2019-05-14 14:46:09 -06:00
|
|
|
|
2015-11-26 12:42:26 +01:00
|
|
|
|
2019-01-23 18:46:11 -07:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
2013-07-15 15:02:21 -06:00
|
|
|
|
2019-02-11 09:23:50 -07:00
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2019-01-23 18:46:11 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-06-09 03:35:20 +09:00
|
|
|
|
2019-01-23 18:46:11 -07:00
|
|
|
|
|
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2022-11-08 15:48:27 +01:00
|
|
|
|
2015-10-16 07:58:46 +02:00
|
|
|
|
2016-02-24 09:15:55 -07:00
|
|
|
|
2015-10-16 07:58:46 +02:00
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 10:56:49 +01:00
|
|
|
|
2017-02-03 12:50:32 -07:00
|
|
|
|
2022-11-13 12:05:58 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2025-06-13 16:21:01 -03:00
|
|
|
|
|
|
|
|
|
2013-07-15 15:02:21 -06:00
|
|
|
|
2014-06-23 14:25:35 -06:00
|
|
|
|
2016-02-24 09:15:55 -07:00
|
|
|
|
2013-07-15 15:02:21 -06:00
|
|
|
|
2015-10-02 18:51:31 +02:00
|
|
|
|
2025-04-25 06:01:07 -04:00
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
2015-10-02 18:51:31 +02:00
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
2024-01-10 18:28:55 +00:00
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2017-03-01 14:22:12 -05:00
|
|
|
|
2024-10-15 13:21:00 +02:00
|
|
|
|
|
|
|
|
|
2017-03-01 14:22:12 -05:00
|
|
|
|
2022-11-01 16:00:38 +01:00
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
2022-11-15 11:22:14 +01:00
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
2015-10-03 09:49:23 +02:00
|
|
|
|
|
|
|
|
|
2018-01-06 08:01:58 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-09-03 09:22:24 -06:00
|
|
|
|
2018-01-06 08:01:58 +08:00
|
|
|
|
2019-09-03 09:22:24 -06:00
|
|
|
|
2019-06-08 13:01:02 -07:00
|
|
|
|
2016-04-26 13:51:57 +02:00
|
|
|
|
|
|
|
|
|
2016-04-26 13:51:58 +02:00
|
|
|
|
2017-07-02 10:56:43 +03:00
|
|
|
|
2015-10-03 09:49:23 +02:00
|
|
|
|
2013-07-15 15:02:21 -06:00
|
|
|
|
2019-02-11 09:23:50 -07:00
|
|
|
|
|
|
|
|
|
2015-10-03 09:49:23 +02:00
|
|
|
|
2022-11-08 15:42:57 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-06-28 07:48:15 -07:00
|
|
|
|
2022-11-08 15:42:57 +01:00
|
|
|
|
2023-06-28 07:46:56 -07:00
|
|
|
|
2022-11-08 15:42:57 +01:00
|
|
|
|
2013-12-10 13:10:36 -07:00
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2015-06-05 10:30:08 -06:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
|
|
|
|
|
2015-06-05 10:30:08 -06:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2015-11-28 15:03:49 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-28 15:37:52 +01:00
|
|
|
|
|
|
|
|
|
nvme: retain split access workaround for capability reads
Commit 7fd8930f26be4
"nvme: add a common helper to read Identify Controller data"
has re-introduced an issue that we have attempted to work around in the
past, in commit a310acd7a7ea ("NVMe: use split lo_hi_{read,write}q").
The problem is that some PCIe NVMe controllers do not implement 64-bit
outbound accesses correctly, which is why the commit above switched
to using lo_hi_[read|write]q for all 64-bit BAR accesses occuring in
the code.
In the mean time, the NVMe subsystem has been refactored, and now calls
into the PCIe support layer for NVMe via a .reg_read64() method, which
fails to use lo_hi_readq(), and thus reintroduces the problem that the
workaround above aimed to address.
Given that, at the moment, .reg_read64() is only used to read the
capability register [which is known to tolerate split reads], let's
switch .reg_read64() to lo_hi_readq() as well.
This fixes a boot issue on some ARM boxes with NVMe behind a Synopsys
DesignWare PCIe host controller.
Fixes: 7fd8930f26be4 ("nvme: add a common helper to read Identify Controller data")
Signed-off-by: Ard Biesheuvel <ard.biesheuvel@linaro.org>
Signed-off-by: Sagi Grimberg <sagi@grimberg.me>
2019-10-03 13:57:29 +02:00
|
|
|
|
2015-11-28 15:37:52 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-03-08 14:50:32 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-03-09 17:04:12 +02:00
|
|
|
|
2018-03-08 14:50:32 -07:00
|
|
|
|
|
|
|
|
|
2022-06-07 08:30:29 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-07-08 10:51:00 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-10-14 08:04:56 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2016-06-13 16:45:24 +02:00
|
|
|
|
2016-02-10 10:03:29 -08:00
|
|
|
|
2022-07-08 10:51:00 -06:00
|
|
|
|
2022-10-27 02:34:13 -07:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2015-11-28 15:03:49 +01:00
|
|
|
|
2015-11-28 15:37:52 +01:00
|
|
|
|
2015-11-26 10:54:19 +01:00
|
|
|
|
2016-04-26 13:52:00 +02:00
|
|
|
|
2024-06-24 08:56:17 -07:00
|
|
|
|
2018-03-08 14:50:32 -07:00
|
|
|
|
2022-06-07 08:30:29 -07:00
|
|
|
|
2022-07-08 10:51:00 -06:00
|
|
|
|
2025-10-14 08:04:56 -07:00
|
|
|
|
2015-11-26 10:06:56 +01:00
|
|
|
|
2015-06-05 10:30:08 -06:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-06-07 09:44:02 +02:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
|
|
|
|
|
2017-05-24 16:39:55 +08:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
|
|
|
|
|
2016-12-19 16:18:24 +02:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
2016-12-19 16:18:24 +02:00
|
|
|
|
|
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
|
|
|
|
|
2017-11-09 01:12:03 -05:00
|
|
|
|
2017-04-20 13:37:55 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-11-09 01:12:03 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-03-11 19:51:56 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-11-09 01:12:03 -05:00
|
|
|
|
|
|
|
|
|
2018-03-11 19:51:56 +01:00
|
|
|
|
|
|
|
|
|
2017-11-09 01:12:03 -05:00
|
|
|
|
2020-02-06 13:17:25 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-09-20 10:52:10 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-04-25 06:01:07 -04:00
|
|
|
|
2023-09-20 10:52:10 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-08-27 12:41:33 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-01 22:55:49 +02:00
|
|
|
|
2024-08-27 12:41:33 +02:00
|
|
|
|
2024-12-16 23:28:03 +01:00
|
|
|
|
|
|
|
|
|
2024-12-16 23:28:04 +01:00
|
|
|
|
2025-07-01 22:55:49 +02:00
|
|
|
|
2024-08-27 12:41:33 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-04-20 13:37:55 -07:00
|
|
|
|
|
|
|
|
|
2024-07-15 17:31:44 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-04-20 13:37:55 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-04 11:55:55 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
|
|
|
|
|
2018-04-27 13:42:52 -06:00
|
|
|
|
2017-04-20 13:37:55 -07:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
|
|
|
|
|
2026-02-04 11:55:55 +01:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2025-05-12 17:20:44 +02:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2023-02-09 17:43:57 -03:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
|
|
|
|
|
2018-01-14 12:39:01 +02:00
|
|
|
|
2020-05-02 15:29:41 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2015-05-22 11:12:39 +02:00
|
|
|
|
2015-11-28 15:40:19 +01:00
|
|
|
|
2017-11-09 01:12:03 -05:00
|
|
|
|
2023-09-20 10:52:10 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-09 11:43:33 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-04 11:55:55 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-02-13 06:58:33 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 09:48:43 +01:00
|
|
|
|
|
|
|
|
|
2020-07-09 11:43:33 -07:00
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2022-11-08 09:48:43 +01:00
|
|
|
|
|
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2022-11-08 09:48:43 +01:00
|
|
|
|
2025-06-25 13:35:04 +02:00
|
|
|
|
|
|
|
|
|
2022-11-08 09:48:43 +01:00
|
|
|
|
|
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2018-06-21 09:49:37 -06:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-02-09 17:43:57 -03:00
|
|
|
|
|
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2024-06-04 11:59:08 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2018-07-11 16:44:44 -06:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
|
|
|
|
|
2022-11-08 09:41:41 +01:00
|
|
|
|
|
|
|
|
|
2025-05-12 15:50:40 +02:00
|
|
|
|
2018-07-11 16:44:44 -06:00
|
|
|
|
2016-02-10 08:51:15 -07:00
|
|
|
|
|
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-12-31 14:01:19 +02:00
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
|
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-11-15 13:41:21 -08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-06-13 16:21:01 -03:00
|
|
|
|
|
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
|
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-30 17:26:25 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2016-02-10 08:51:15 -07:00
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
2023-01-24 09:17:38 -08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
2017-07-16 10:39:03 +02:00
|
|
|
|
2022-11-08 09:44:00 +01:00
|
|
|
|
|
|
|
|
|
2024-06-04 11:59:08 -07:00
|
|
|
|
2023-03-08 18:05:08 -03:00
|
|
|
|
2025-10-24 13:05:31 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-06-01 13:10:38 +02:00
|
|
|
|
2014-05-02 10:40:43 -06:00
|
|
|
|
2014-06-23 16:03:21 -06:00
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-06-01 13:10:38 +02:00
|
|
|
|
2014-05-02 10:40:43 -06:00
|
|
|
|
2017-06-01 13:10:38 +02:00
|
|
|
|
|
|
|
|
|
2017-07-08 15:51:57 -07:00
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2014-05-02 10:40:43 -06:00
|
|
|
|
|
|
|
|
|
2014-01-27 11:29:40 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-03 10:49:21 +08:00
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
2014-01-27 11:29:40 -05:00
|
|
|
|
|
|
|
|
|
2016-02-24 09:15:55 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2012-12-21 15:13:49 -08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2013-12-10 13:10:36 -07:00
|
|
|
|
2016-04-26 13:51:57 +02:00
|
|
|
|
2013-12-10 13:10:36 -07:00
|
|
|
|
2016-05-12 08:37:14 -06:00
|
|
|
|
2017-02-10 18:15:49 -05:00
|
|
|
|
2016-05-12 08:37:14 -06:00
|
|
|
|
2018-06-06 08:13:08 -06:00
|
|
|
|
2017-02-10 18:15:49 -05:00
|
|
|
|
2016-05-12 08:37:14 -06:00
|
|
|
|
2017-06-15 15:41:08 +02:00
|
|
|
|
2017-07-02 10:56:43 +03:00
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:18 -07:00
|
|
|
|
2017-05-12 17:02:58 +02:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2022-11-08 09:11:13 +01:00
|
|
|
|
2014-11-04 08:20:14 -07:00
|
|
|
|
2025-07-07 14:52:23 +02:00
|
|
|
|
2025-05-12 17:13:33 +02:00
|
|
|
|
2016-02-24 09:15:52 -07:00
|
|
|
|
2020-03-24 17:29:42 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2014-02-13 11:19:14 +09:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
nvme-pci: Allow PCI bus-level PM to be used if ASPM is disabled
One of the modifications made by commit d916b1be94b6 ("nvme-pci: use
host managed power state for suspend") was adding a pci_save_state()
call to nvme_suspend() so as to instruct the PCI bus type to leave
devices handled by the nvme driver in D0 during suspend-to-idle.
That was done with the assumption that ASPM would transition the
device's PCIe link into a low-power state when the device became
inactive. However, if ASPM is disabled for the device, its PCIe
link will stay in L0 and in that case commit d916b1be94b6 is likely
to cause the energy used by the system while suspended to increase.
Namely, if the device in question works in accordance with the PCIe
specification, putting it into D3hot causes its PCIe link to go to
L1 or L2/L3 Ready, which is lower-power than L0. Since the energy
used by the system while suspended depends on the state of its PCIe
link (as a general rule, the lower-power the state of the link, the
less energy the system will use), putting the device into D3hot
during suspend-to-idle should be more energy-efficient that leaving
it in D0 with disabled ASPM.
For this reason, avoid leaving NVMe devices with disabled ASPM in D0
during suspend-to-idle. Instead, shut them down entirely and let
the PCI bus type put them into D3.
Fixes: d916b1be94b6 ("nvme-pci: use host managed power state for suspend")
Link: https://lore.kernel.org/linux-pm/2763495.NmdaWeg79L@kreacher/T/#t
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
Reviewed-by: Keith Busch <keith.busch@intel.com>
2019-08-08 23:58:38 +02:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
2021-07-27 09:40:44 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
2021-07-27 09:40:44 -07:00
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
2013-07-15 15:02:23 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
nvme-pci: Allow PCI bus-level PM to be used if ASPM is disabled
One of the modifications made by commit d916b1be94b6 ("nvme-pci: use
host managed power state for suspend") was adding a pci_save_state()
call to nvme_suspend() so as to instruct the PCI bus type to leave
devices handled by the nvme driver in D0 during suspend-to-idle.
That was done with the assumption that ASPM would transition the
device's PCIe link into a low-power state when the device became
inactive. However, if ASPM is disabled for the device, its PCIe
link will stay in L0 and in that case commit d916b1be94b6 is likely
to cause the energy used by the system while suspended to increase.
Namely, if the device in question works in accordance with the PCIe
specification, putting it into D3hot causes its PCIe link to go to
L1 or L2/L3 Ready, which is lower-power than L0. Since the energy
used by the system while suspended depends on the state of its PCIe
link (as a general rule, the lower-power the state of the link, the
less energy the system will use), putting the device into D3hot
during suspend-to-idle should be more energy-efficient that leaving
it in D0 with disabled ASPM.
For this reason, avoid leaving NVMe devices with disabled ASPM in D0
during suspend-to-idle. Instead, shut them down entirely and let
the PCI bus type put them into D3.
Fixes: d916b1be94b6 ("nvme-pci: use host managed power state for suspend")
Link: https://lore.kernel.org/linux-pm/2763495.NmdaWeg79L@kreacher/T/#t
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
Reviewed-by: Keith Busch <keith.busch@intel.com>
2019-08-08 23:58:38 +02:00
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-05-19 13:41:23 +05:30
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
nvme-pci: Allow PCI bus-level PM to be used if ASPM is disabled
One of the modifications made by commit d916b1be94b6 ("nvme-pci: use
host managed power state for suspend") was adding a pci_save_state()
call to nvme_suspend() so as to instruct the PCI bus type to leave
devices handled by the nvme driver in D0 during suspend-to-idle.
That was done with the assumption that ASPM would transition the
device's PCIe link into a low-power state when the device became
inactive. However, if ASPM is disabled for the device, its PCIe
link will stay in L0 and in that case commit d916b1be94b6 is likely
to cause the energy used by the system while suspended to increase.
Namely, if the device in question works in accordance with the PCIe
specification, putting it into D3hot causes its PCIe link to go to
L1 or L2/L3 Ready, which is lower-power than L0. Since the energy
used by the system while suspended depends on the state of its PCIe
link (as a general rule, the lower-power the state of the link, the
less energy the system will use), putting the device into D3hot
during suspend-to-idle should be more energy-efficient that leaving
it in D0 with disabled ASPM.
For this reason, avoid leaving NVMe devices with disabled ASPM in D0
during suspend-to-idle. Instead, shut them down entirely and let
the PCI bus type put them into D3.
Fixes: d916b1be94b6 ("nvme-pci: use host managed power state for suspend")
Link: https://lore.kernel.org/linux-pm/2763495.NmdaWeg79L@kreacher/T/#t
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
Reviewed-by: Keith Busch <keith.busch@intel.com>
2019-08-08 23:58:38 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
2026-05-19 13:41:23 +05:30
|
|
|
|
2019-08-16 15:16:19 -05:00
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-10-27 10:58:12 -07:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
2021-07-27 09:40:44 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-09-18 13:15:55 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-09-18 13:15:55 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
2019-10-24 17:24:00 +02:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-03 10:49:21 +08:00
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
2013-07-15 15:02:23 -06:00
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
2013-07-15 15:02:23 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-09-04 10:06:11 -06:00
|
|
|
|
2013-07-15 15:02:23 -06:00
|
|
|
|
|
|
|
|
|
2019-06-26 10:09:02 +08:00
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2015-12-07 15:30:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-04-04 15:07:41 -06:00
|
|
|
|
|
|
|
|
|
2023-07-12 08:36:47 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-01-12 14:41:18 -07:00
|
|
|
|
2015-12-07 15:30:31 -07:00
|
|
|
|
|
|
|
|
|
2016-04-04 15:07:41 -06:00
|
|
|
|
|
|
|
|
|
2015-12-07 15:30:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016-02-10 08:51:15 -07:00
|
|
|
|
2015-12-07 15:30:31 -07:00
|
|
|
|
2025-04-24 10:18:01 -07:00
|
|
|
|
2023-07-12 08:36:47 -07:00
|
|
|
|
2015-12-07 15:30:31 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2018-05-24 16:16:04 -06:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-12-07 15:30:31 -07:00
|
|
|
|
|
|
|
|
|
2012-09-07 09:33:17 -07:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-06-01 13:10:38 +02:00
|
|
|
|
|
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
2014-03-24 10:11:22 -04:00
|
|
|
|
2020-07-02 15:31:22 -06:00
|
|
|
|
2016-03-04 13:15:17 -07:00
|
|
|
|
2017-04-05 19:21:13 +02:00
|
|
|
|
2020-07-02 15:31:22 -06:00
|
|
|
|
2016-05-02 15:14:24 -06:00
|
|
|
|
2017-04-05 19:21:13 +02:00
|
|
|
|
2020-07-02 15:31:22 -06:00
|
|
|
|
2016-05-02 15:14:24 -06:00
|
|
|
|
2023-10-12 11:13:51 -07:00
|
|
|
|
|
|
|
|
|
2020-07-02 15:31:22 -06:00
|
|
|
|
2024-12-02 09:45:48 -08:00
|
|
|
|
2017-05-24 15:06:31 -07:00
|
|
|
|
2018-05-08 10:25:15 -06:00
|
|
|
|
2019-11-15 00:40:01 +09:00
|
|
|
|
2020-09-10 16:18:50 -05:00
|
|
|
|
|
|
|
|
|
2019-01-08 10:20:51 -07:00
|
|
|
|
|
|
|
|
|
2015-10-22 15:45:06 -06:00
|
|
|
|
2019-03-13 18:55:05 +01:00
|
|
|
|
2022-04-12 07:07:56 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-09-11 10:39:59 -07:00
|
|
|
|
2024-11-12 19:50:00 +00:00
|
|
|
|
2025-04-22 20:17:25 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-03-16 03:27:49 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-07-28 13:09:03 +02:00
|
|
|
|
2022-06-13 07:45:48 -07:00
|
|
|
|
|
|
|
|
|
2018-04-12 13:25:25 -06:00
|
|
|
|
2021-02-16 13:25:43 +01:00
|
|
|
|
|
|
|
|
|
2016-06-14 18:22:41 -03:00
|
|
|
|
|
|
|
|
|
2017-11-21 10:44:37 -06:00
|
|
|
|
|
|
|
|
|
2016-09-08 12:12:11 -04:00
|
|
|
|
|
|
|
|
|
2026-04-16 01:27:15 +08:00
|
|
|
|
|
|
|
|
|
2017-06-27 22:27:57 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-12-04 21:46:57 +05:30
|
|
|
|
nvme-pci: add the DISABLE_WRITE_ZEROES quirk for a Samsung PM1725a
This adds a quirk for Samsung PM1725a drive which fixes timeouts and
I/O errors due to the fact that the controller does not properly
handle the Write Zeroes command, dmesg log:
nvme nvme0: I/O 528 QID 10 timeout, aborting
nvme nvme0: I/O 529 QID 10 timeout, aborting
nvme nvme0: I/O 530 QID 10 timeout, aborting
nvme nvme0: I/O 531 QID 10 timeout, aborting
nvme nvme0: I/O 532 QID 10 timeout, aborting
nvme nvme0: I/O 533 QID 10 timeout, aborting
nvme nvme0: I/O 534 QID 10 timeout, aborting
nvme nvme0: I/O 535 QID 10 timeout, aborting
nvme nvme0: Abort status: 0x0
nvme nvme0: Abort status: 0x0
nvme nvme0: Abort status: 0x0
nvme nvme0: Abort status: 0x0
nvme nvme0: Abort status: 0x0
nvme nvme0: Abort status: 0x0
nvme nvme0: Abort status: 0x0
nvme nvme0: Abort status: 0x0
nvme nvme0: I/O 528 QID 10 timeout, reset controller
nvme nvme0: controller is down; will reset: CSTS=0x3, PCI_STATUS=0x10
nvme nvme0: Device not ready; aborting reset, CSTS=0x3
nvme nvme0: Device not ready; aborting reset, CSTS=0x3
nvme nvme0: Removing after probe failure status: -19
nvme0n1: detected capacity change from 6251233968 to 0
blk_update_request: I/O error, dev nvme0n1, sector 32776 op 0x1:(WRITE) flags 0x3000 phys_seg 6 prio class 0
blk_update_request: I/O error, dev nvme0n1, sector 113319936 op 0x9:(WRITE_ZEROES) flags 0x800 phys_seg 0 prio class 0
Buffer I/O error on dev nvme0n1p2, logical block 1, lost async page write
blk_update_request: I/O error, dev nvme0n1, sector 113319680 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
Buffer I/O error on dev nvme0n1p2, logical block 2, lost async page write
blk_update_request: I/O error, dev nvme0n1, sector 113319424 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
Buffer I/O error on dev nvme0n1p2, logical block 3, lost async page write
blk_update_request: I/O error, dev nvme0n1, sector 113319168 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
Buffer I/O error on dev nvme0n1p2, logical block 4, lost async page write
blk_update_request: I/O error, dev nvme0n1, sector 113318912 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
Buffer I/O error on dev nvme0n1p2, logical block 5, lost async page write
blk_update_request: I/O error, dev nvme0n1, sector 113318656 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
Buffer I/O error on dev nvme0n1p2, logical block 6, lost async page write
blk_update_request: I/O error, dev nvme0n1, sector 113318400 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
blk_update_request: I/O error, dev nvme0n1, sector 113318144 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
blk_update_request: I/O error, dev nvme0n1, sector 113317888 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
Signed-off-by: Dmitry Monakhov <dmtrmonakhov@yandex-team.ru>
Signed-off-by: Christoph Hellwig <hch@lst.de>
2021-03-10 12:06:41 +00:00
|
|
|
|
2020-12-04 21:46:57 +05:30
|
|
|
|
2024-04-22 12:28:23 -04:00
|
|
|
|
|
|
|
|
|
nvme-pci: add quirks for WDC Blue SN550 15b7:5009
Add two quirks for the WDC Blue SN550 (PCI ID 15b7:5009) based on user
reports and hardware analysis:
- NVME_QUIRK_NO_DEEPEST_PS:
liaozw talked to me the problem and solved with
nvme_core.default_ps_max_latency_us=0, so add the quirk.
I also found some reports in the following link.
- NVME_QUIRK_BROKEN_MSI:
after get the lspci from Jack Rio.
I think that the disk also have NVME_QUIRK_BROKEN_MSI.
described in commit d5887dc6b6c0 ("nvme-pci: Add quirk for broken MSIs")
as sean said in link which match the MSI 1/32 and MSI-X 17.
Log:
lspci -nn | grep -i memory
03:00.0 Non-Volatile memory controller [0108]: Sandisk Corp SanDisk Ultra 3D / WD PC SN530, IX SN530, Blue SN550 NVMe SSD (DRAM-less) [15b7:5009] (rev 01)
lspci -v -d 15b7:5009
03:00.0 Non-Volatile memory controller: Sandisk Corp SanDisk Ultra 3D / WD PC SN530, IX SN530, Blue SN550 NVMe SSD (DRAM-less) (rev 01) (prog-if 02 [NVM Express])
Subsystem: Sandisk Corp WD Blue SN550 NVMe SSD
Flags: bus master, fast devsel, latency 0, IRQ 35, IOMMU group 10
Memory at fe800000 (64-bit, non-prefetchable) [size=16K]
Memory at fe804000 (64-bit, non-prefetchable) [size=256]
Capabilities: [80] Power Management version 3
Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
Capabilities: [b0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [c0] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [150] Device Serial Number 00-00-00-00-00-00-00-00
Capabilities: [1b8] Latency Tolerance Reporting
Capabilities: [300] Secondary PCI Express
Capabilities: [900] L1 PM Substates
Kernel driver in use: nvme
dmesg | grep nvme
[ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-6.12.20-amd64-desktop-rolling root=UUID= ro splash quiet nvme_core.default_ps_max_latency_us=0 DEEPIN_GFXMODE=
[ 0.059301] Kernel command line: BOOT_IMAGE=/vmlinuz-6.12.20-amd64-desktop-rolling root=UUID= ro splash quiet nvme_core.default_ps_max_latency_us=0 DEEPIN_GFXMODE=
[ 0.542430] nvme nvme0: pci function 0000:03:00.0
[ 0.560426] nvme nvme0: allocated 32 MiB host memory buffer.
[ 0.562491] nvme nvme0: 16/0/0 default/read/poll queues
[ 0.567764] nvme0n1: p1 p2 p3 p4 p5 p6 p7 p8 p9
[ 6.388726] EXT4-fs (nvme0n1p7): mounted filesystem ro with ordered data mode. Quota mode: none.
[ 6.893421] EXT4-fs (nvme0n1p7): re-mounted r/w. Quota mode: none.
[ 7.125419] Adding 16777212k swap on /dev/nvme0n1p8. Priority:-2 extents:1 across:16777212k SS
[ 7.157588] EXT4-fs (nvme0n1p6): mounted filesystem r/w with ordered data mode. Quota mode: none.
[ 7.165021] EXT4-fs (nvme0n1p9): mounted filesystem r/w with ordered data mode. Quota mode: none.
[ 8.036932] nvme nvme0: using unchecked data buffer
[ 8.096023] block nvme0n1: No UUID available providing old NGUID
Link: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d5887dc6b6c054d0da3cd053afc15b7be1f45ff6
Link: https://lore.kernel.org/all/20240422162822.3539156-1-sean.anderson@linux.dev/
Reported-by: liaozw <hedgehog-002@163.com>
Closes: https://bbs.deepin.org.cn/post/286300
Reported-by: rugk <rugk+github@posteo.de>
Closes: https://bugzilla.kernel.org/show_bug.cgi?id=208123
Signed-off-by: Wentao Guan <guanwentao@uniontech.com>
Signed-off-by: Christoph Hellwig <hch@lst.de>
2025-04-24 10:40:10 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-06-13 07:45:47 -07:00
|
|
|
|
|
|
|
|
|
2021-02-01 22:08:22 +01:00
|
|
|
|
2022-07-05 10:21:02 -07:00
|
|
|
|
|
|
|
|
|
2022-09-22 14:16:30 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-02-23 22:10:46 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-06-29 21:30:53 -03:00
|
|
|
|
|
|
|
|
|
2019-07-15 00:11:49 -07:00
|
|
|
|
2022-06-25 09:15:02 -03:00
|
|
|
|
|
|
|
|
|
2023-02-08 17:14:35 +01:00
|
|
|
|
|
|
|
|
|
2019-09-23 20:22:56 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2022-06-22 12:19:21 +02:00
|
|
|
|
|
|
|
|
|
2022-11-14 14:48:52 +01:00
|
|
|
|
|
|
|
|
|
2020-07-24 01:29:10 +08:00
|
|
|
|
|
|
|
|
|
2022-06-13 07:45:49 -07:00
|
|
|
|
|
|
|
|
|
2023-11-28 10:57:37 +08:00
|
|
|
|
|
|
|
|
|
2020-10-13 16:34:45 +08:00
|
|
|
|
|
|
|
|
|
nvme-pci: add the DISABLE_WRITE_ZEROES quirk for a SPCC device
This adds a quirk for SPCC 256GB NVMe 1.3 drive which fixes timeouts and
I/O errors due to the fact that the controller does not properly
handle the Write Zeroes command:
[ 2745.659527] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G E 5.10.6-BET #1
[ 2745.659528] Hardware name: System manufacturer System Product Name/PRIME X570-P, BIOS 3001 12/04/2020
[ 2776.138874] nvme nvme1: I/O 414 QID 3 timeout, aborting
[ 2776.138886] nvme nvme1: I/O 415 QID 3 timeout, aborting
[ 2776.138891] nvme nvme1: I/O 416 QID 3 timeout, aborting
[ 2776.138895] nvme nvme1: I/O 417 QID 3 timeout, aborting
[ 2776.138912] nvme nvme1: Abort status: 0x0
[ 2776.138921] nvme nvme1: I/O 428 QID 3 timeout, aborting
[ 2776.138922] nvme nvme1: Abort status: 0x0
[ 2776.138925] nvme nvme1: Abort status: 0x0
[ 2776.138974] nvme nvme1: Abort status: 0x0
[ 2776.138977] nvme nvme1: Abort status: 0x0
[ 2806.346792] nvme nvme1: I/O 414 QID 3 timeout, reset controller
[ 2806.363566] nvme nvme1: 15/0/0 default/read/poll queues
[ 2836.554298] nvme nvme1: I/O 415 QID 3 timeout, disable controller
[ 2836.672064] blk_update_request: I/O error, dev nvme1n1, sector 16350 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672072] blk_update_request: I/O error, dev nvme1n1, sector 16093 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672074] blk_update_request: I/O error, dev nvme1n1, sector 15836 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672076] blk_update_request: I/O error, dev nvme1n1, sector 15579 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672078] blk_update_request: I/O error, dev nvme1n1, sector 15322 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672080] blk_update_request: I/O error, dev nvme1n1, sector 15065 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672082] blk_update_request: I/O error, dev nvme1n1, sector 14808 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672083] blk_update_request: I/O error, dev nvme1n1, sector 14551 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672085] blk_update_request: I/O error, dev nvme1n1, sector 14294 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672087] blk_update_request: I/O error, dev nvme1n1, sector 14037 op 0x9:(WRITE_ZEROES) flags 0x0 phys_seg 0 prio class 0
[ 2836.672121] nvme nvme1: failed to mark controller live state
[ 2836.672123] nvme nvme1: Removing after probe failure status: -19
[ 2836.689016] Aborting journal on device dm-0-8.
[ 2836.689024] Buffer I/O error on dev dm-0, logical block 25198592, lost sync page write
[ 2836.689027] JBD2: Error -5 detected when updating journal superblock for dm-0-8.
Reported-by: Bradley Chapman <chapman6235@comcast.net>
Signed-off-by: Chaitanya Kulkarni <chaitanya.kulkarni@wdc.com>
Tested-by: Bradley Chapman <chapman6235@comcast.net>
Reviewed-by: Keith Busch <kbusch@kernel.org>
Signed-off-by: Christoph Hellwig <hch@lst.de>
2021-01-25 21:19:16 -08:00
|
|
|
|
|
|
|
|
|
2022-06-10 14:27:34 +08:00
|
|
|
|
2022-11-16 18:17:27 +01:00
|
|
|
|
|
|
|
|
|
2022-06-10 14:27:34 +08:00
|
|
|
|
|
|
|
|
|
2023-07-04 09:36:56 +02:00
|
|
|
|
|
|
|
|
|
2022-06-10 14:27:34 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-02-21 06:12:16 +01:00
|
|
|
|
|
|
|
|
|
2021-01-29 06:24:42 +01:00
|
|
|
|
|
|
|
|
|
2023-04-25 22:58:54 +03:00
|
|
|
|
|
|
|
|
|
2022-10-11 04:06:42 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-03-20 19:22:09 +00:00
|
|
|
|
|
|
|
|
|
2023-03-08 19:19:29 +03:00
|
|
|
|
|
|
|
|
|
2022-11-16 00:17:56 -03:00
|
|
|
|
|
|
|
|
|
2022-05-27 07:32:08 +02:00
|
|
|
|
|
|
|
|
|
2022-04-11 08:05:27 +02:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2023-05-20 21:23:50 +09:00
|
|
|
|
|
|
|
|
|
2022-06-06 13:01:29 +00:00
|
|
|
|
|
|
|
|
|
nvme-pci: quirk Acer FA100 for non-uniqueue identifiers
In order for two Acer FA100 SSDs to work in one PC (in the case of
myself, a Lenovo Legion T5 28IMB05), and not show one drive and not
the other, and sometimes mix up what drive shows up (randomly), these
two lines of code need to be added, and then both of the SSDs will
show up and not conflict when booting off of one of them. If you boot
up your computer with both SSDs installed without this patch, you may
also randomly get into a kernel panic (if the initrd is not set up) or
stuck in the initrd "/init" process, it is set up, however, if you do
apply this patch, there should not be problems with booting or seeing
both contents of the drive. Tested with the btrfs filesystem with a
RAID configuration of having the root drive '/' combined to make two
256GB Acer FA100 SSDs become 512GB in total storage.
Kernel Logs with patch applied (`dmesg -t | grep -i nvm`):
```
...
nvme 0000:04:00.0: platform quirk: setting simple suspend
nvme nvme0: pci function 0000:04:00.0
nvme 0000:05:00.0: platform quirk: setting simple suspend
nvme nvme1: pci function 0000:05:00.0
nvme nvme1: missing or invalid SUBNQN field.
nvme nvme1: allocated 64 MiB host memory buffer.
nvme nvme0: missing or invalid SUBNQN field.
nvme nvme0: allocated 64 MiB host memory buffer.
nvme nvme1: 8/0/0 default/read/poll queues
nvme nvme1: Ignoring bogus Namespace Identifiers
nvme nvme0: 8/0/0 default/read/poll queues
nvme nvme0: Ignoring bogus Namespace Identifiers
nvme0n1: p1 p2
...
```
Kernel Logs with patch not applied (`dmesg -t | grep -i nvm`):
```
...
nvme 0000:04:00.0: platform quirk: setting simple suspend
nvme nvme0: pci function 0000:04:00.0
nvme 0000:05:00.0: platform quirk: setting simple suspend
nvme nvme1: pci function 0000:05:00.0
nvme nvme0: missing or invalid SUBNQN field.
nvme nvme1: missing or invalid SUBNQN field.
nvme nvme0: allocated 64 MiB host memory buffer.
nvme nvme1: allocated 64 MiB host memory buffer.
nvme nvme0: 8/0/0 default/read/poll queues
nvme nvme1: 8/0/0 default/read/poll queues
nvme nvme1: globally duplicate IDs for nsid 1
nvme nvme1: VID:DID 1dbe:5216 model:Acer SSD FA100 256GB firmware:1.Z.J.2X
nvme0n1: p1 p2
...
```
Signed-off-by: Christopher Lentocha <christopherericlentocha@gmail.com>
Reviewed-by: Christoph Hellwig <hch@lst.de>
Signed-off-by: Keith Busch <kbusch@kernel.org>
2025-02-18 08:59:29 -05:00
|
|
|
|
|
|
|
|
|
2022-08-11 12:56:57 +02:00
|
|
|
|
|
|
|
|
|
2022-09-28 17:39:13 +08:00
|
|
|
|
|
|
|
|
|
2022-06-05 20:36:48 +00:00
|
|
|
|
|
|
|
|
|
2025-12-08 21:23:40 +08:00
|
|
|
|
|
|
|
|
|
2025-05-10 19:21:30 +09:00
|
|
|
|
|
|
|
|
|
2022-07-22 19:05:57 +02:00
|
|
|
|
|
|
|
|
|
2022-08-26 09:51:40 -07:00
|
|
|
|
|
|
|
|
|
2023-03-13 11:11:50 +01:00
|
|
|
|
|
|
|
|
|
2022-10-10 10:30:05 +02:00
|
|
|
|
2023-03-26 11:29:49 +02:00
|
|
|
|
|
|
|
|
|
2023-04-13 17:55:48 -07:00
|
|
|
|
|
|
|
|
|
2023-05-03 18:57:33 +03:00
|
|
|
|
|
|
|
|
|
2023-05-17 14:32:32 -07:00
|
|
|
|
|
|
|
|
|
2021-02-10 01:39:42 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-02-12 12:32:18 +02:00
|
|
|
|
2024-09-11 10:39:59 -07:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2017-02-22 15:17:29 -07:00
|
|
|
|
2019-08-07 17:51:21 +10:00
|
|
|
|
|
|
|
|
|
2019-08-07 17:51:22 +10:00
|
|
|
|
2021-09-27 08:43:06 -07:00
|
|
|
|
2023-01-04 19:16:42 +09:00
|
|
|
|
|
|
|
|
|
2020-08-18 11:35:30 +03:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2012-12-21 15:13:49 -08:00
|
|
|
|
2014-01-27 11:29:40 -05:00
|
|
|
|
2013-07-15 15:02:23 -06:00
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-05-23 09:27:35 -06:00
|
|
|
|
2022-11-13 12:07:04 +01:00
|
|
|
|
2018-04-24 16:47:27 -05:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-04-30 11:36:52 -04:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2019-02-16 18:13:10 +01:00
|
|
|
|
2019-12-07 01:16:59 +09:00
|
|
|
|
2017-06-07 20:31:55 +02:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2026-02-04 11:55:55 +01:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
2017-11-09 19:32:07 +08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2014-11-21 15:16:32 -07:00
|
|
|
|
2024-01-23 14:13:40 -08:00
|
|
|
|
2011-01-20 12:50:14 -05:00
|
|
|
|
|
|
|
|
|