Figured out the problem, was not a problem with the keyboard other than it being really fast at pressing shift and remote desktop could not keep up with it. Which I did not even realize it was doing until I looked a little deeper using the keyboard viewer while trying to figure out the cause.
Eventually put it together that I was only having the issue while using a double hop with the first hop to VDI then from there another hop using Microsoft Remote Desktop. On that 2nd hop was where the problem was is occurring.
Its all in the Keyboard Settings, and where the Windows key combinations are applied:
On the remote computer --> You will see the the crazy output random output when pressing {
On this computer --> Fixes the issues, but you loose keyboard shortcuts on the remote system…
Found the fix here https://superuser.com/questions/219461/shift-and-control-keys-out-of-sync-with-normal-keys-over-rdp