Pull your credit report from the bureaus and review it for any negative items (late pays, collections etc) and inaccurate detail. Try to dispute negative items and remove them from the report. If required pay off any unpaid debt. Otherwise, you won't get a low rate and may not even qualify. Of course there are lenders in the subprime market who may offer you a bad credit refinance loan, but it's better to avoid them as they'll possible charge higher rates and fees.
If you are able to get a lower rate that what you currently have, you can save tens of thousands of dollars over the life of your loan. Also, most lenders don't charge as many fees to refinance a mortgage and depending on how much equity you have in your home you may be able to roll the closing costs into your new loan, still have a lower balance than your original loan, a lower rate, and a lower payment.
Make sure that your original mortgage does not have a pre-payment penalty or early payoff penalty of any kind. Sometimes people will get into their mortgage with the mortgage having a pre-payment penalty and they will not even know about it. Pre-payment penalties usually range from 6 months to 3 years with a penalty for an early payoff. The penalty is usually about the amount of 6 months worth of your mortgage loan interest, but this varies. You would have to be able to have some significant payment and interest savings on your refinance loan to justify refinancing a mortgage loan with a pre-payment penalty.
When refinancing, don't take the first offer that comes around. Instead you should actively compare both interest rates and lenders.