When it comes to lowering your rates you will need to weight the benefits of having a lower rate vs. paying points up front. You may end up paying a lot more depending on your choice and how long you plan on keeping your mortgage.
Many companies in this industry will do what ever they can to get away with charging you as much as they possibly can. Some of the ways they do this is not disclosing all the third party fees involved in a loan such as title insurance, appraisals, pre-paid tax and insurance escrows etc. It is important that you ask the loan officer you're speaking with about third party fees. If you don't they may not tell you and give you a good faith estimate that sounds fair, but at closing you'll find out that you have to pay a couple of thousand dollars more in fees you were unaware of. A good loan officer at a reputable company should have no problem disclosing all fees that pertain to your loan and should also make sure you understand what the fees are for.
Start with your current lender. If you're a good customer-you hold a sizable mortgage, pay on time, and maintain good credit-your existing lender will probably do everything in its power to keep your business. The company may cut you a break on fees for things like appraisals, surveys, and inspections if the information is current and you meet other requirements.
Be Patient. Processing all of the paperwork that's required for a new loan takes time. Be patient while your loan moves through the system. Protect your credit score by paying your bills and making your mortgage payments on time and not taking on any more new debt than you absolutely have to.