Know your credit score before you begin looking for a loan. If you can, try to remove any blemishes from your credit report before applying for a refinance.
Ask for more than just rates. Bad loan officers will tell you anything to keep you on the phone -- then change the details to suit them later. Instead, make them get real with you! Ask how long they've been in the industry. Probe them about their experience in the industry. Also, ask what their opinion is on the current market and where it's going.
If you have bad credit, find a lender who is willing to work with you and offer you reasonable loan terms.
The length of time that you expect to keep the mortgage helps you determine whether it is worthwhile to pay points up front to reduce your interest rate. Unlike points paid on your original mortgage, points paid to refinance may not be fully deductible on your income taxes in the year they are paid.