If you are making payments on a long term loan, say, 30 year mortgage for the past 10 to 20 years, then refinancing to another 30 year loan will not be a good option as it may increase your overall payment.
The length of time that you expect to keep the mortgage helps you determine whether it is worthwhile to pay points up front to reduce your interest rate. Unlike points paid on your original mortgage, points paid to refinance may not be fully deductible on your income taxes in the year they are paid.
Give yourself plenty of time to close. With most refinancings, your file is turned over to a closing or title company, which dictates the closing details. Like the lenders themselves, these firms are swamped when interest rates are low. Moreover, appraisers get backed up and can be difficult to schedule. So don't expect the closing to happen as quickly as anyone promises.
There is a refinancing myth that says you should not refinance your mortgage unless your interest rate will be at least two points less. This myth is not necessarily true if there are other benefits to the refinance or other reasons behind it.