Every decent "stepper" [0] I've used allows you to both place the cursor within the bounds of the widget and spin the mousewheel [1] to rapidly change the value, and click the value displayed in widget in order to type in a new value.

[0] I've always heard them called "spinners".

[1] You could probably emulate this with something like a two-fingered horizontal swipe starting in the widget