The governor shaft doesn’t rotate much. At 3100rpm it will be a dog. I like mine without the governor and can’t over rev with a belt installed. All you have to add is a return spring
The idle sounds like it is way too high. If you can get the idle down to the point you do not grind them when changing gears that will be much better. Also with the idle that high you would have to have the brakes on with it in gear (forward with sticks forward) to keep from moving. It should idle in gear (forward with sticks forward) on flat level ground and not move. Try adjusting the idle to 1400 rpm with a single carb and red spring. That rpm number comes from the B&S manual that came with my 16hp Max II.