Buyers in swing states have seen mortgage payments practically double in the last four years due to rising home prices and mortgage rates.