Raspberry pi 3, using Raspbian Buster. PC is connected via Wifi 7 with link speed 5764/5764 (Mbps), pi is wired ethernet to router. Using Xbox Elite 2 connected via USB.

Everything runs great, looks amazing, but every minute or two, my controller inputs don't register, and my last input gets stuck (i.e. if I was turning left, my character will continue turning left). This will last anywhere from 3-5 seconds, and during this time the game runs normally and I see no other issues, graphical, audio, or otherwise. Any ideas?