drm/amd/display: Fix the delta clamping for shaper LUT

Browse source

The shaper LUT requires a 10-bit value of the delta between segments. We
were using dc_fixpt_clamp_u0d10() to do that but it doesn't do what we
want it to do. It will preserve 10-bit precision after the decimal
point, but that's not quite what we want. We want 14-bit precision and
discard the 4 most-significant bytes.

To do that we'll do dc_fixpt_clamp_u0d14() & 0x3ff instead.

Tested-by: Daniel Wheeler <daniel.wheeler@amd.com>
Reviewed-by: Krunoslav Kovac <krunoslav.kovac@amd.com>
Acked-by: Rodrigo Siqueira <rodrigo.siqueira@amd.com>
Signed-off-by: Harry Wentland <harry.wentland@amd.com>
Signed-off-by: Alex Deucher <alexander.deucher@amd.com>

...

This commit is contained in:

Harry Wentland 2023-04-06 18:06:27 -04:00 • committed by Alex Deucher

parent a28eb4871a

commit 27fc10d109

7 changed files with 25 additions and 13 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

19

drivers/gpu/drm/amd/display/dc/dcn10/dcn10_cm_common.c

View file

1

drivers/gpu/drm/amd/display/dc/dcn10/dcn10_cm_common.h

View file

2

drivers/gpu/drm/amd/display/dc/dcn10/dcn10_hw_sequencer.c

View file

6

drivers/gpu/drm/amd/display/dc/dcn20/dcn20_hwseq.c

View file

2

drivers/gpu/drm/amd/display/dc/dcn30/dcn30_dwb_cm.c

View file

2

drivers/gpu/drm/amd/display/dc/dcn30/dcn30_hwseq.c

View file

6

drivers/gpu/drm/amd/display/dc/dcn32/dcn32_hwseq.c

View file