Slow Spin

My Maytag single belt washer spins very slowly. It never gets up to speed. I’m aware of the thrust bearing issue with these but that does not appear to be the problem.
Agitate is fine. Timer works properly. The belt is fine. Pump is fine. Nothing stuck in the drum. When I turn the belt pulley (bottom of tranny) by hand one way it will agitate. When I turn it the other way the bearing does move up and release the break and the drum will turn freely.

The weird part (I think) is I can turn the main pulley by hand in the spin direction with brake now released AND hold the tranny from moving quite easily by hand while still turning the pulley.
Any ideas anyone?