Xbox one x controller drift?

The pack-in controller that came with my Xbox one x is frequently “drifting”, making it very difficult to navigate the xbox menu to launch games, let alone play them.

The controller looks okay and I haven’t put it through any major trauma beyond a couple falls off the table (onto carpet) over the years.

Are there any fixes that I can do?

Is the secret ingredient tissue paper? I have other controllers that don’t have this problem but instead had their charging ports bent just enough that the USB cable doesn’t fit in any more.