Give yourself plenty of time to close. With most refinancings, your file is turned over to a closing or title company, which dictates the closing details. Like the lenders themselves, these firms are swamped when interest rates are low. Moreover, appraisers get backed up and can be difficult to schedule. So don't expect the closing to happen as quickly as anyone promises.
If you are refinancing from one ARM to another, check the initial rate and the fully-indexed rate. Also ask about the rate adjustments you might face over the term of the loan.
The length of time that you expect to keep the mortgage helps you determine whether it is worthwhile to pay points up front to reduce your interest rate. Unlike points paid on your original mortgage, points paid to refinance may not be fully deductible on your income taxes in the year they are paid.
If you are paying private insurance on your current mortgage, refinancing may allow you to do away with this unnecessary expense.