Depending on the objective of the borrower, Closing Cost can vary in cost. If the borrower decides to buy down the rate with points, this will drive up the closing cost. On the other hand, if the borrower decides to receive lender credit in exchange for a higher rate, this will offset some or all of their Closing Cost. However, the majority of the time, the high Closing Cost is due to taxes and escrow.