Considering refinancing your mortgage? As a general rule of thumb, refinancing may be worthwhile if your current mortgage rate is at least two points higher than the prevailing market rate. There are other considerations, too, such as how long you plan to stay in the house. Most sources say that it takes at least three years to fully realize the savings from a lower interest rate, given the costs of refinancing.