Ask for more than just rates. Bad loan officers will tell you anything to keep you on the phone -- then change the details to suit them later. Instead, make them get real with you! Ask how long they've been in the industry. Probe them about their experience in the industry. Also, ask what their opinion is on the current market and where it's going.
If your new mortgage rate seems too good to be true then it probably is. Check for hidden fees in your mortgage that will make up that suspicious difference.
If you know that you will be moving in 3 to 5 years, you might want to consider refinancing to a 3 or 5 year ARM (adjustable rate mortgage). These loans typically have a much lower rate that a traditional fixed rate loan such as a 30 year fixed, but they do have a fixed rate for the first 3 or 5 years of the loan. This will enable you to benefit from the lower rate, but you won't ever have to worry about the risk of a rate adjustment because you will be selling the home before the fixed-rate period ends.
When refinancing, don't take the first offer that comes around. Instead you should actively compare both interest rates and lenders.