The first step in calculating how much house you can afford is determining the size of your down payment on the house. The required down payment amount will depend on various factors, including the terms your mortgage lender mandates, the type of mortgage loan you get, and how much money you have saved up.