Actually it does. If you track the movement of an individual dust mote, for example (the iconic example of Brownian motion) and plot the distance from its point of origin over time, the distance will increase.
Variation and selection present a special case, in which some changes are favored. If you study a system in which small random motions occur, and a ratchet mechanism blocks retrograde motion, you get effective motion away from the point of origin.
Maxwell; methinks thou art demon posessed!