That is the biggest thing with rollers. You want to have good clean circles. The smother you can get on rollers the better you will be on the track.
If you want to get a good set of rollers this would be the ones that I would recommend.
Minoura Rollers