Hey Crusty,
With a potentiometer, only one terminal is for the -ve and the other two as follows:
1) Fixed resistance value, typically full rating of the potentiometer, so in your case 5kohm. Usually end terminal.
2) Variable range, 0-5kohm. Usually middle terminal.
If your speed is going flat...