svcrdma: Allocate recv_ctxt's on CPU handling Receives

Browse source

There is a significant latency penalty when processing an ingress
Receive if the Receive buffer resides in memory that is not on the
same NUMA node as the the CPU handling completions for a CQ.

The system administrator and the device driver determine which CPU
handles completions. This CPU does not change during life of the CQ.
Further the Upper Layer does not have any visibility of which CPU it
is.

Allocating Receive buffers in the Receive completion handler
guarantees that Receive buffers are allocated on the preferred NUMA
node for that CQ.

Signed-off-by: Chuck Lever <chuck.lever@oracle.com>
Signed-off-by: J. Bruce Fields <bfields@redhat.com>

...

This commit is contained in:

Chuck Lever 2018-05-07 15:27:48 -04:00 • committed by J. Bruce Fields

parent 3316f06311

commit eb5d7a622e

2 changed files with 37 additions and 16 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

1

include/linux/sunrpc/svc_rdma.h

View file

52

net/sunrpc/xprtrdma/svc_rdma_recvfrom.c

View file