I agree, but it's a weird concept and almost counter intuitive (as are most things golf).
Some swings you feel you can really move the club head fast but it's almost as if the swing carries no 'power', a pure 'swish' if you like. Other swings you feel like you really put some 'ooompf' into it and you'd think the ball would go further,,, chances are it was actually a slower swing