Refinancing may not be that useful if you have already used up 90% or more of your home value in taking out a mortgage or any home equity loan. You won't be able to get the best rates available in the market as when you refinance a 90% LTV loan, you will probably require a loan of that value or higher. This will be quite closer to being a 100% financing option and hence mortgage refinance rates will be comparatively higher. Moreover, 100% loans are hardly available in times of mortgage market crisis.
If you know that you will be moving in 3 to 5 years, you might want to consider refinancing to a 3 or 5 year ARM (adjustable rate mortgage). These loans typically have a much lower rate that a traditional fixed rate loan such as a 30 year fixed, but they do have a fixed rate for the first 3 or 5 years of the loan. This will enable you to benefit from the lower rate, but you won't ever have to worry about the risk of a rate adjustment because you will be selling the home before the fixed-rate period ends.
If there is a big difference between the initial interest rate and the APR listed in the ad, it may mean that there are high fees associated with the loan.
The length of time that you expect to keep the mortgage helps you determine whether it is worthwhile to pay points up front to reduce your interest rate. Unlike points paid on your original mortgage, points paid to refinance may not be fully deductible on your income taxes in the year they are paid.