Weigh the costs carefully of how long you will be staying in your home vs. how much of a savings you will be getting in a refinance. Make sure you include closing costs in your decision.
You have a legal right to a good faith estimate. Get a copy of this document and go over it with a fine tooth comb, it will reveal where there is a real problem.
Before you refinance a loan, make sure that you carefully analyze any fees that your lender is including on the loan. The Department of Housing and Urban Development can provide you with a list of standard fees. Use it to make sure that your lender isn't tacking on anything extravagant. And by all means, compare their fees with other lenders in the market.
When lenders offer a "no-cost" loan, they may include a prepayment penalty to discourage you from refinancing within the first few years of the loan. Ask the lender offering a no-cost loan to explain all the fees and penalties before you agree to these terms.