Should you buy points on your mortgage? It depends if you’re buying or refinancing. And it’s a different answer for each one.I have no psychic