I replaced the shift lever bushings when I rebuilt my transmission and that solved my vibration noise. There's a plastic cup the shift lever sit in and mine was either gone of the wrong one. It was a huge pain to release the cap which holds the shift lever in place and I ended up laying down under the transmission so I could get both hands around it.
The bushings look like this but there may be different sizes.
View attachment 118603