Different batches of grain have different grain sizes. If the gap is too narrow for your current grain size, the driven roller just sits there spinning and doesn't drag any grain into the gap. The non driven roller is lazy, so it doesn't do any spinning or work until there is a few grains actually being crushed.
I found that by only popping a 100ml of grain in the mill, pushing a few grains to start the mill working, then when it was actually crushing rather than spinning fill the hopper.
The knurling on my mill has lost its sharpness after 5 years of use. This means the grains are less likely to be dragged in at the start.
After each use, I do use an old paint brush to remove any dust from the knurling.
Also, make sure your lazy roller is freely spinning on its bearings. Sometimes the bearing may bind a bit, meaning that it doesn't spin.