Even when interest rates have dropped, chances are you'll not qualify for the lower fee because of your reduced credit score rating.