How do you properly use a hand knife-sharpener?

The kind that looks like a long wand/rod with a handle that comes with cutlery sets. It has ridges that run vertically along the rod and I'm not sure which direction I should sharpen my blade against. I've use it to run down the blade perpendicularly but with no results.