Hi Felix,
Sorry for my late reply. I was busy this week.
I just did some more tests using next-20240202 branch. Testing using
blender 4.0.2, when only one HIP render task is running, there's no problem.
However, when two tasks run together, software always crashes, but not
crashes the whole system. Dmesg reports gpu reset in most cases, for
example:
[ 176.071823] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx_0.0.0
timeout, signaled seq=32608, emitted seq=32610
[ 176.072000] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process
information: process blender pid 4256 thread blender:cs0 pid 4297
[ 176.072143] amdgpu 0000:03:00.0: amdgpu: GPU reset begin!
[ 176.073571] amdgpu 0000:03:00.0: amdgpu: Guilty job already signaled,
skipping HW reset
[ 176.073593] amdgpu 0000:03:00.0: amdgpu: GPU reset(4) succeeded!
And in some rare cases, there would be a page fault report, see dmesg.log.
Do you have any idea? Can I make it print more detailed diagnostic
information?
Best regards,
Shengyu
在 2024/1/30 01:47, Felix Kuehling 写道:
On 2024-01-29 10:24, Shengyu Qu wrote:
Hello Felix,
I think you are right. This problem has existed for years(just look
at the
issue creation time in my link), and is thought caused by OpenGL-ROCM
interop(that's why I think this patch might help). It is very easy to
trigger this problem in blender(method is also mentioned in the link).
This doesn't help you, but it's unlikely that this has been the same
issue for two years for everybody who chimed into this bug report.
Different kernel versions, GPUs, user mode ROCm and Mesa versions etc.
Case in point, it's possible that you're seeing an issue specific to
RDNA3, which hasn't even been around for that long.
Do
you have any idea about this?
Not without seeing a lot more diagnostic information. A full backtrace
from your kernel log would be a good start.
Regards,
Felix
Best regards,
Shengyu
在 2024/1/29 22:51, Felix Kuehling 写道:
On 2024-01-29 8:58, Shengyu Qu wrote:
Hi,
Seems rocm-opengl interop hang problem still exists[1]. Btw have you
discovered into this problem?
Best regards,
Shengyu
[1]
https://projects.blender.org/blender/blender/issues/100353#issuecomment-1111599
Maybe you're having a different problem. Do you see this issue also
without any version of the "Relocate TBA/TMA ..." patch?
Regards,
Felix
在 2024/1/27 03:15, Shengyu Qu 写道:
Hello Felix,
This patch seems working on my system, also it seems fixes the
ROCM/OpenGL
interop problem.
Is this intended to happen or not? Maybe we need more users to
test it.
Besides,
Tested-by: Shengyu Qu <wiagn233@xxxxxxxxxxx>
Best Regards,
Shengyu
在 2024/1/26 06:27, Felix Kuehling 写道:
The TBA and TMA, along with an unused IB allocation, reside at low
addresses in the VM address space. A stray VM fault which hits these
pages must be serviced by making their page table entries invalid.
The scheduler depends upon these pages being resident and fails,
preventing a debugger from inspecting the failure state.
By relocating these pages above 47 bits in the VM address space they
can only be reached when bits [63:48] are set to 1. This makes it
much
less likely for a misbehaving program to generate accesses to them.
The current placement at VA (PAGE_SIZE*2) is readily hit by a NULL
access with a small offset.
v2:
- Move it to the reserved space to avoid concflicts with Mesa
- Add macros to make reserved space management easier
Cc: Arunpravin Paneer Selvam <Arunpravin.PaneerSelvam@xxxxxxx>
Cc: Christian Koenig <christian.koenig@xxxxxxx>
Signed-off-by: Jay Cornwall <jay.cornwall@xxxxxxx>
Signed-off-by: Felix Kuehling <felix.kuehling@xxxxxxx>
---
drivers/gpu/drm/amd/amdgpu/amdgpu_csa.c | 4 +--
drivers/gpu/drm/amd/amdgpu/amdgpu_seq64.c | 7 ++---
drivers/gpu/drm/amd/amdgpu/amdgpu_vm.h | 12 ++++++--
drivers/gpu/drm/amd/amdkfd/kfd_flat_memory.c | 30
+++++++++++---------
4 files changed, 30 insertions(+), 23 deletions(-)
diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_csa.c
b/drivers/gpu/drm/amd/amdgpu/amdgpu_csa.c
index 823d31f4a2a3..53d0a458d78e 100644
--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_csa.c
+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_csa.c
@@ -28,9 +28,9 @@
uint64_t amdgpu_csa_vaddr(struct amdgpu_device *adev)
{
- uint64_t addr = adev->vm_manager.max_pfn <<
AMDGPU_GPU_PAGE_SHIFT;
+ uint64_t addr = AMDGPU_VA_RESERVED_CSA_START(
+ adev->vm_manager.max_pfn << AMDGPU_GPU_PAGE_SHIFT);
- addr -= AMDGPU_VA_RESERVED_CSA_SIZE;
addr = amdgpu_gmc_sign_extend(addr);
return addr;
diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_seq64.c
b/drivers/gpu/drm/amd/amdgpu/amdgpu_seq64.c
index 3d0d56087d41..9e769ef50f2e 100644
--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_seq64.c
+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_seq64.c
@@ -45,11 +45,8 @@
*/
static inline u64 amdgpu_seq64_get_va_base(struct amdgpu_device
*adev)
{
- u64 addr = adev->vm_manager.max_pfn << AMDGPU_GPU_PAGE_SHIFT;
-
- addr -= AMDGPU_VA_RESERVED_TOP;
-
- return addr;
+ return AMDGPU_VA_RESERVED_SEQ64_START(
+ adev->vm_manager.max_pfn << AMDGPU_GPU_PAGE_SHIFT);
}
/**
diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_vm.h
b/drivers/gpu/drm/amd/amdgpu/amdgpu_vm.h
index 666698a57192..f23b6153d310 100644
--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_vm.h
+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_vm.h
@@ -135,11 +135,19 @@ struct amdgpu_mem_stats;
#define AMDGPU_IS_MMHUB0(x) ((x) >= AMDGPU_MMHUB0_START && (x)
< AMDGPU_MMHUB1_START)
#define AMDGPU_IS_MMHUB1(x) ((x) >= AMDGPU_MMHUB1_START && (x)
< AMDGPU_MAX_VMHUBS)
-/* Reserve 2MB at top/bottom of address space for kernel use */
+/* Reserve space at top/bottom of address space for kernel use */
#define AMDGPU_VA_RESERVED_CSA_SIZE (2ULL << 20)
+#define AMDGPU_VA_RESERVED_CSA_START(top) ((top) \
+ - AMDGPU_VA_RESERVED_CSA_SIZE)
#define AMDGPU_VA_RESERVED_SEQ64_SIZE (2ULL << 20)
+#define AMDGPU_VA_RESERVED_SEQ64_START(top)
(AMDGPU_VA_RESERVED_CSA_START(top) \
+ - AMDGPU_VA_RESERVED_SEQ64_SIZE)
+#define AMDGPU_VA_RESERVED_TRAP_SIZE (2ULL << 12)
+#define AMDGPU_VA_RESERVED_TRAP_START(top)
(AMDGPU_VA_RESERVED_SEQ64_START(top) \
+ - AMDGPU_VA_RESERVED_TRAP_SIZE)
#define AMDGPU_VA_RESERVED_BOTTOM (2ULL << 20)
-#define AMDGPU_VA_RESERVED_TOP (AMDGPU_VA_RESERVED_SEQ64_SIZE + \
+#define AMDGPU_VA_RESERVED_TOP (AMDGPU_VA_RESERVED_TRAP_SIZE + \
+ AMDGPU_VA_RESERVED_SEQ64_SIZE + \
AMDGPU_VA_RESERVED_CSA_SIZE)
/* See vm_update_mode */
diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_flat_memory.c
b/drivers/gpu/drm/amd/amdkfd/kfd_flat_memory.c
index 6604a3f99c5e..f899cce25b2a 100644
--- a/drivers/gpu/drm/amd/amdkfd/kfd_flat_memory.c
+++ b/drivers/gpu/drm/amd/amdkfd/kfd_flat_memory.c
@@ -36,6 +36,7 @@
#include <linux/mm.h>
#include <linux/mman.h>
#include <linux/processor.h>
+#include "amdgpu_vm.h"
/*
* The primary memory I/O features being added for revisions of
gfxip
@@ -326,10 +327,16 @@ static void kfd_init_apertures_vi(struct
kfd_process_device *pdd, uint8_t id)
* with small reserved space for kernel.
* Set them to CANONICAL addresses.
*/
- pdd->gpuvm_base = SVM_USER_BASE;
+ pdd->gpuvm_base = max(SVM_USER_BASE,
AMDGPU_VA_RESERVED_BOTTOM);
pdd->gpuvm_limit =
pdd->dev->kfd->shared_resources.gpuvm_size - 1;
+ /* dGPUs: the reserved space for kernel
+ * before SVM
+ */
+ pdd->qpd.cwsr_base = SVM_CWSR_BASE;
+ pdd->qpd.ib_base = SVM_IB_BASE;
+
pdd->scratch_base = MAKE_SCRATCH_APP_BASE_VI();
pdd->scratch_limit =
MAKE_SCRATCH_APP_LIMIT(pdd->scratch_base);
}
@@ -339,18 +346,19 @@ static void kfd_init_apertures_v9(struct
kfd_process_device *pdd, uint8_t id)
pdd->lds_base = MAKE_LDS_APP_BASE_V9();
pdd->lds_limit = MAKE_LDS_APP_LIMIT(pdd->lds_base);
- /* Raven needs SVM to support graphic handle, etc.
Leave the small
- * reserved space before SVM on Raven as well, even
though we don't
- * have to.
- * Set gpuvm_base and gpuvm_limit to CANONICAL addresses
so that they
- * are used in Thunk to reserve SVM.
- */
- pdd->gpuvm_base = SVM_USER_BASE;
+ pdd->gpuvm_base = AMDGPU_VA_RESERVED_BOTTOM;
pdd->gpuvm_limit =
pdd->dev->kfd->shared_resources.gpuvm_size - 1;
pdd->scratch_base = MAKE_SCRATCH_APP_BASE_V9();
pdd->scratch_limit =
MAKE_SCRATCH_APP_LIMIT(pdd->scratch_base);
+
+ /*
+ * Place TBA/TMA on opposite side of VM hole to prevent
+ * stray faults from triggering SVM on these pages.
+ */
+ pdd->qpd.cwsr_base = AMDGPU_VA_RESERVED_TRAP_START(
+ pdd->dev->adev->vm_manager.max_pfn <<
AMDGPU_GPU_PAGE_SHIFT);
}
int kfd_init_apertures(struct kfd_process *process)
@@ -407,12 +415,6 @@ int kfd_init_apertures(struct kfd_process
*process)
return -EINVAL;
}
}
-
- /* dGPUs: the reserved space for kernel
- * before SVM
- */
- pdd->qpd.cwsr_base = SVM_CWSR_BASE;
- pdd->qpd.ib_base = SVM_IB_BASE;
}
dev_dbg(kfd_device, "node id %u\n", id);
[ 442.321071] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 442.321075] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003c0801000 from client 10
[ 442.321077] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 442.321078] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 442.321079] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 442.321080] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 442.321081] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 442.321082] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 442.321083] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 451.480481] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 451.480487] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003c0801000 from client 10
[ 451.480489] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 451.480491] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 451.480493] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 451.480494] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 451.480495] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 451.480497] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 451.480498] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 451.486799] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 451.486802] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003c0801000 from client 10
[ 451.486803] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 451.486804] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 451.486805] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 451.486806] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 451.486806] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 451.486807] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 451.486808] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 451.596471] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 451.596475] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003c0801000 from client 10
[ 451.596477] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 451.596478] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 451.596479] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 451.596480] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 451.596480] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 451.596481] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 451.596482] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 516.424573] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 516.424578] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003f5001000 from client 10
[ 516.424579] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 516.424581] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 516.424582] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 516.424583] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 516.424584] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 516.424584] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 516.424585] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 557.711634] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 557.711641] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 557.711643] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 557.711645] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 557.711647] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 557.711648] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 557.711649] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 557.711651] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 557.711652] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 560.292705] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 560.292710] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 560.292712] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 560.292713] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 560.292714] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 560.292715] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 560.292716] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 560.292717] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 560.292717] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 562.394199] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 562.394204] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 562.394206] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 562.394207] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 562.394208] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 562.394209] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 562.394210] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 562.394211] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 562.394212] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 577.278056] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 577.278063] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 577.278065] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 577.278067] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 577.278068] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 577.278070] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 577.278071] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 577.278072] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 577.278074] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 577.312517] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 577.312520] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 577.312522] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 577.312523] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 577.312524] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 577.312525] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 577.312525] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 577.312526] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 577.312527] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 577.319631] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 577.319633] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 577.319634] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 577.319635] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 577.319636] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 577.319636] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 577.319637] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 577.319638] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 577.319638] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 688.873664] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 688.873668] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 688.873670] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 688.873671] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 688.873672] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 688.873673] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 688.873673] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 688.873674] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 688.873675] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 688.914091] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 688.914095] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 688.914097] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 688.914098] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 688.914100] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 688.914101] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 688.914102] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 688.914103] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 688.914104] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 690.854876] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 690.854882] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 690.854885] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 690.854886] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 690.854888] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 690.854889] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 690.854891] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 690.854892] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 690.854893] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 703.607133] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 703.607140] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 703.607142] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 703.607143] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 703.607145] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 703.607146] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 703.607147] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 703.607148] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 703.607149] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 736.209925] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 736.209930] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 736.209932] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 736.209933] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 736.209934] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 736.209935] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 736.209936] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 736.209937] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 736.209937] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 760.807476] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 760.807481] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 760.807483] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 760.807484] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 760.807485] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 760.807486] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 760.807487] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 760.807488] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 760.807488] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 766.535845] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 766.535850] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 766.535852] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 766.535853] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 766.535854] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 766.535855] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 766.535856] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 766.535857] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 766.535858] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 770.330169] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 770.330173] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 770.330175] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 770.330176] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 770.330177] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 770.330178] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 770.330179] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 770.330180] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 770.330180] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 774.538022] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 774.538027] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003fd401000 from client 10
[ 774.538029] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 774.538030] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 774.538031] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 774.538032] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 774.538033] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 774.538034] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 774.538034] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 790.751210] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 790.751217] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003a6401000 from client 10
[ 790.751219] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 790.751221] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 790.751222] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 790.751224] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 790.751225] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 790.751226] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 790.751227] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 793.227366] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 793.227371] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003a6401000 from client 10
[ 793.227373] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 793.227374] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 793.227375] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 793.227376] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 793.227377] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 793.227377] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 793.227378] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 797.228775] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 797.228779] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003a6401000 from client 10
[ 797.228781] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 797.228782] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 797.228783] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 797.228784] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 797.228785] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 797.228786] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 797.228787] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 799.469739] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 799.469745] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003a6401000 from client 10
[ 799.469747] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 799.469748] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 799.469750] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 799.469751] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 799.469752] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 799.469753] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 799.469754] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 799.483424] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 799.483427] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003a6401000 from client 10
[ 799.483429] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 799.483429] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 799.483430] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 799.483431] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 799.483432] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 799.483433] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 799.483434] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 812.610979] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 812.610985] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa401000 from client 10
[ 812.610988] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 812.610989] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 812.610991] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 812.610992] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 812.610993] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 812.610994] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 812.610995] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 821.653461] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 821.653468] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003a6401000 from client 10
[ 821.653471] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 821.653472] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 821.653474] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 821.653475] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 821.653476] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 821.653478] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 821.653479] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 821.657965] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 821.657967] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003a6401000 from client 10
[ 821.657968] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 821.657969] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 821.657970] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 821.657971] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 821.657971] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 821.657972] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 821.657973] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 825.659682] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 825.659688] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aac01000 from client 10
[ 825.659691] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 825.659693] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 825.659694] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 825.659696] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 825.659697] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 825.659698] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 825.659699] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 829.663279] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 829.663283] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aac01000 from client 10
[ 829.663284] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 829.663285] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 829.663286] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 829.663287] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 829.663288] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 829.663288] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 829.663289] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 832.057504] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 832.057507] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aac01000 from client 10
[ 832.057509] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 832.057510] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 832.057511] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 832.057512] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 832.057512] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 832.057513] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 832.057514] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 833.664308] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 833.664312] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038fc01000 from client 10
[ 833.664313] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 833.664314] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 833.664315] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 833.664316] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 833.664317] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 833.664317] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 833.664318] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 834.461586] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 834.461590] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038fc01000 from client 10
[ 834.461592] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 834.461593] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 834.461594] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 834.461595] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 834.461595] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 834.461596] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 834.461597] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 836.058649] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 836.058655] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038fc01000 from client 10
[ 836.058657] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 836.058658] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 836.058660] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 836.058662] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 836.058663] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 836.058664] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 836.058665] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 837.664154] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 837.664159] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa601000 from client 10
[ 837.664162] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 837.664163] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 837.664165] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 837.664166] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 837.664167] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 837.664169] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 837.664170] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 840.496864] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 840.496868] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa601000 from client 10
[ 840.496870] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 840.496871] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 840.496872] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 840.496873] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 840.496874] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 840.496874] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 840.496875] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 844.498957] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 844.498964] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa601000 from client 10
[ 844.498966] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 844.498968] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 844.498969] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 844.498971] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 844.498972] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 844.498973] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 844.498974] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 846.464111] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 846.464116] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa601000 from client 10
[ 846.464117] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 846.464118] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 846.464119] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 846.464120] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 846.464121] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 846.464122] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 846.464122] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 848.498146] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 848.498151] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa601000 from client 10
[ 848.498152] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 848.498153] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 848.498154] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 848.498155] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 848.498156] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 848.498157] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 848.498157] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 853.615973] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 853.615976] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa601000 from client 10
[ 853.615978] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 853.615979] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 853.615980] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 853.615981] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 853.615982] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 853.615983] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 853.615984] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 857.083035] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 857.083041] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003aa601000 from client 10
[ 857.083043] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 857.083044] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 857.083045] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 857.083047] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 857.083048] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 857.083049] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 857.083050] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 857.618765] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 857.618771] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 857.618773] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 857.618775] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 857.618777] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 857.618778] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 857.618780] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 857.618781] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 857.618782] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 857.806565] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 857.806569] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ee01000 from client 10
[ 857.806570] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 857.806571] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 857.806572] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 857.806573] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 857.806574] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 857.806574] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 857.806575] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 857.968901] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 857.968907] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ee01000 from client 10
[ 857.968909] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 857.968910] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 857.968911] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 857.968912] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 857.968913] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 857.968914] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 857.968915] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 858.087228] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 858.087232] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ee01000 from client 10
[ 858.087234] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 858.087235] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 858.087237] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 858.087238] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 858.087239] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 858.087240] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 858.087240] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 860.905442] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 860.905447] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 860.905448] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 860.905449] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 860.905451] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 860.905452] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 860.905453] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 860.905454] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 860.905454] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 861.615184] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 861.615189] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 861.615190] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 861.615191] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 861.615193] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 861.615194] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 861.615195] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 861.615196] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 861.615196] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 861.620935] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 861.620937] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 861.620938] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 861.620939] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 861.620940] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 861.620941] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 861.620942] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 861.620943] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 861.620944] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 863.173036] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 863.173042] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ee01000 from client 10
[ 863.173043] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 863.173045] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 863.173046] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 863.173047] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 863.173048] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 863.173049] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 863.173050] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 863.471057] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 863.471062] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 863.471064] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 863.471065] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 863.471067] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 863.471068] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 863.471069] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 863.471070] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 863.471071] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 863.591861] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 863.591866] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 863.591867] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 863.591868] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 863.591870] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 863.591871] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 863.591872] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 863.591872] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 863.591873] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 863.702350] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 863.702353] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 863.702355] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 863.702356] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 863.702357] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 863.702358] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 863.702359] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 863.702360] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 863.702361] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 863.932249] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 863.932254] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 863.932255] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 863.932256] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 863.932258] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 863.932259] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 863.932260] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 863.932261] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 863.932262] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 863.946088] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 863.946091] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 863.946093] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 863.946094] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 863.946095] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 863.946096] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 863.946097] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 863.946098] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 863.946099] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 864.863386] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 864.863391] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 864.863392] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 864.863393] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 864.863395] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 864.863396] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 864.863397] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 864.863398] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 864.863398] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 867.945509] gmc_v11_0_process_interrupt: 4 callbacks suppressed
[ 867.945512] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 867.945515] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 867.945517] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 867.945518] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 867.945519] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 867.945520] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 867.945520] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 867.945521] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 867.945522] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 868.907578] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 868.907583] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 868.907584] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 868.907585] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 868.907586] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 868.907587] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 868.907588] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 868.907588] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 868.907589] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 869.625721] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 869.625727] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 869.625729] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 869.625731] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 869.625733] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 869.625734] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 869.625735] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 869.625736] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 869.625738] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 871.945403] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 871.945408] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 871.945409] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 871.945410] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 871.945411] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 871.945412] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 871.945413] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 871.945414] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 871.945414] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 873.616874] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 873.616878] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 873.616880] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 873.616881] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 873.616882] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 873.616883] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 873.616884] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 873.616885] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 873.616885] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 873.624302] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 873.624304] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 873.624306] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 873.624307] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 873.624308] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 873.624310] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 873.624311] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 873.624312] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 873.624313] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 873.763468] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 873.763472] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 873.763473] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 873.763475] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 873.763476] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 873.763477] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 873.763477] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 873.763478] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 873.763479] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 873.770193] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 873.770196] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 873.770198] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 873.770199] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 873.770200] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 873.770202] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 873.770203] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 873.770204] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 873.770205] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 875.948152] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 875.948157] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038ac01000 from client 10
[ 875.948158] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 875.948159] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 875.948160] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 875.948161] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 875.948162] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 875.948163] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 875.948164] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 877.771015] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 877.771021] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 877.771023] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 877.771025] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 877.771027] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 877.771028] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 877.771029] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 877.771030] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 877.771031] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 879.947529] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 879.947533] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038fe01000 from client 10
[ 879.947535] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 879.947536] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 879.947537] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 879.947538] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 879.947539] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 879.947540] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 879.947540] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 881.771782] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 881.771789] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038fe01000 from client 10
[ 881.771792] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 881.771793] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 881.771795] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 881.771796] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 881.771798] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 881.771799] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 881.771800] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 885.773320] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 885.773327] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x000000038fe01000 from client 10
[ 885.773330] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 885.773331] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 885.773333] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 885.773334] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 885.773335] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 885.773336] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 885.773337] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 889.774110] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 889.774115] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000396c01000 from client 10
[ 889.774116] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 889.774117] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 889.774119] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 889.774120] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 889.774121] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 889.774121] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 889.774122] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 890.746777] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 890.746781] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000396c01000 from client 10
[ 890.746783] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 890.746784] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 890.746785] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 890.746786] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 890.746787] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 890.746788] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 890.746789] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 894.844168] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 894.844175] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000396c01000 from client 10
[ 894.844177] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 894.844179] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 894.844180] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 894.844182] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 894.844183] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 894.844184] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 894.844185] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 894.872892] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 894.872896] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000396c01000 from client 10
[ 894.872898] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 894.872899] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 894.872901] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 894.872902] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 894.872903] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 894.872904] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 894.872905] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 896.415301] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 896.415306] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 896.415308] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 896.415309] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 896.415310] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 896.415311] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 896.415312] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 896.415313] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 896.415314] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 897.238277] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 897.238283] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 897.238286] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 897.238287] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 897.238289] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 897.238290] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 897.238292] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 897.238293] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 897.238294] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 901.239112] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 901.239117] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 901.239118] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 901.239119] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 901.239121] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 901.239121] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 901.239122] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 901.239123] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 901.239124] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 901.819225] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 901.819230] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 901.819232] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 901.819233] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 901.819234] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 901.819235] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 901.819236] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 901.819237] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 901.819237] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 909.135306] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 909.135311] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 909.135313] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 909.135314] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 909.135315] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 909.135316] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 909.135317] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 909.135318] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 909.135318] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 913.279179] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 913.279183] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 913.279185] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 913.279186] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 913.279187] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 913.279188] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 913.279189] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 913.279190] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 913.279191] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 917.259576] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 917.259581] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 917.259584] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 917.259585] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 917.259587] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 917.259589] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 917.259590] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 917.259591] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 917.259592] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 917.536913] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 917.536916] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 917.536917] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 917.536918] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 917.536919] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 917.536920] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 917.536921] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 917.536922] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 917.536922] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 919.463012] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 919.463016] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 919.463017] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 919.463018] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 919.463019] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 919.463020] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 919.463021] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 919.463021] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 919.463022] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 921.260456] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 921.260459] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x00000003ab001000 from client 10
[ 921.260461] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 921.260462] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 921.260463] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 921.260464] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 921.260464] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 921.260465] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 921.260466] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
[ 931.771272] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx_0.0.0 timeout, signaled seq=1048759, emitted seq=1048762
[ 931.771433] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process blender pid 5190 thread blender:cs0 pid 5231
[ 931.771551] amdgpu 0000:03:00.0: amdgpu: GPU reset begin!
[ 931.773408] amdgpu 0000:03:00.0: amdgpu: Guilty job already signaled, skipping HW reset
[ 931.773418] amdgpu 0000:03:00.0: amdgpu: GPU reset(4) succeeded!
[ 931.773614] [drm] Skip scheduling IBs!
[ 931.773618] [drm] Skip scheduling IBs!
[ 931.773621] [drm] Skip scheduling IBs!
[ 931.773804] [drm] Skip scheduling IBs!
[ 931.795010] kwin_wayland[1900]: segfault at 0 ip 00007f0adefd7740 sp 00007fffae1d2548 error 6 in libkwineffects.so.5.27.10[7f0adefc5000+29000] likely on CPU 17 (core 1, socket 0)
[ 931.795020] Code: d2 74 30 4c 8b 07 31 c0 4d 03 40 10 66 0f 1f 44 00 00 48 63 c8 48 89 c7 48 83 c0 01 48 c1 e1 04 48 c1 e7 04 f3 41 0f 6f 04 08 <0f> 11 04 3e 48 39 d0 75 df c3 66 0f 1f 44 00 00 f3 0f 1e fa 55 66
[ 932.332448] amdgpu 0000:03:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:153 vmid:0 pasid:0, for process pid 0 thread pid 0)
[ 932.332452] amdgpu 0000:03:00.0: amdgpu: in page starting at address 0x0000000000c01000 from client 10
[ 932.332453] amdgpu 0000:03:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000B32
[ 932.332454] amdgpu 0000:03:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
[ 932.332455] amdgpu 0000:03:00.0: amdgpu: MORE_FAULTS: 0x0
[ 932.332455] amdgpu 0000:03:00.0: amdgpu: WALKER_ERROR: 0x1
[ 932.332456] amdgpu 0000:03:00.0: amdgpu: PERMISSION_FAULTS: 0x3
[ 932.332457] amdgpu 0000:03:00.0: amdgpu: MAPPING_ERROR: 0x1
[ 932.332457] amdgpu 0000:03:00.0: amdgpu: RW: 0x0
