As the title says, I'm using a Raspberry PI 4 (8gb ram) with the Steam Link App.
I was having stuttering issues whenever I used certain abilities in games or got knocked down.

Host PC: AMD Ryzen 5900 CPU, Nvidia RTX 3060
Client: Raspberry PI 4 (8gb ram, Raspbian - Debian 10 (Buster))

I thought there was many various issues such as latency on the network, or trouble encoding during more intense moments and I tried all of the changes I could imagine to the network and streaming options.

Eventually I noticed that the controller would vibrate at each time it had a connection issue, which I thought was due to it responding to an issue. And then I remembered the rumble emulation on the Steam Controller was experimental.

After turning it off I didn't have the issue any more.

Just posting this up here because it was such a big issue to me, I spent months reattempting to solve it, and finally having it click and finding the fix I needed to put it up in case anyone else has had a similar problem.

Best of luck to anyone dealing with remote play issues <3

p.s. tried this streaming from my android phone too, it didn't have an issue then, only from the RPI4. No other machines nor further desire to test any more lol.