Using a 401(k) or IRA for a Down Payment on a Florida Home: Loans, Withdrawals, Penalties and Lender Rules

If you want to use 401k for down payment money on a Florida home, you have three main paths: a plan loan, a hardship withdrawal or, for IRA savers, the first-time homebuyer exception. Each one has a different cost. A loan has to be paid back, while a withdrawal can bring income tax plus a 10 percent additional tax. This guide walks through the IRS rules, a worked example at a typical Palm Beach County starter price, and what your lender will ask to see. It also compares retirement money with down payment assistance and gift funds, which can cost you less.

Key takeaways

• A 401(k) loan lets you borrow the lesser of $50,000 or the greater of $10,000 or half your vested balance. You pay yourself back with interest.
• Plan loans usually run 5 years, but a loan to buy your main home may get a longer term if your plan allows it.
• A 401(k) hardship withdrawal for a home purchase is taxable and may face the 10 percent additional tax. It cannot be rolled back in.
• The $10,000 first-time homebuyer exception applies to IRAs, not 401(k) plans.
• Fannie Mae does not require lenders to count a 401(k) loan payment in your debt-to-income ratio, as long as the lender gets the loan paperwork.

Can you use 401k for down payment funds at all?

Yes. Fannie Mae's Selling Guide lists vested funds from 401(k) plans and IRAs as acceptable sources for a down payment, closing costs and reserves. The lender will verify that you own the account, that the funds are vested and that you can actually withdraw them.

However, "acceptable to the lender" does not mean free. The real question is which route costs you the least. That depends on your age, your tax bracket, your job security and whether you have other options. So start with the rules for each path.

Option 1: use 401k loan money for a down payment

Many employer plans let you borrow from your own balance. According to the IRS, the most you can borrow is the lesser of $50,000 or the greater of $10,000 or 50 percent of your vested balance. For example, a saver with $40,000 vested could borrow up to $20,000.

Loans generally must be repaid within 5 years in roughly equal payments that include interest. Still, the IRS notes that a loan used to buy your principal residence may be paid back over a longer period. Your plan sets the exact term, so ask your plan administrator for its loan rules.

The upside is clear. You pay no income tax and no 10 percent additional tax as long as you repay on time. In addition, the interest goes back into your own account.

The risk is your job. If you leave your employer, many plans offset the unpaid balance against your account. That offset becomes a taxable distribution unless you roll the amount over by your tax filing deadline, including extensions, for that year. So a loan works best when your job feels stable.

Option 2: a hardship withdrawal

The IRS lists costs tied to buying a principal residence as a safe harbor reason for a hardship distribution. In plain terms, your plan can let you take money out for a home purchase if it offers hardship withdrawals.

The cost is higher, though. Hardship distributions count as income unless they come from Roth contributions. They may also face the 10 percent additional tax if you are under 59 and a half. On top of that, you cannot roll a hardship distribution back into a plan or an IRA. Once the money is out, it stays out.

Because of that, a hardship withdrawal is usually the last choice. It shrinks your retirement savings and your take-home cash at the same time.

Option 3: the IRA first-time homebuyer exception

IRAs have a special rule that 401(k) plans do not. The IRS lets a qualified first-time homebuyer take up to $10,000 from an IRA without the 10 percent additional tax. That $10,000 is a lifetime limit.

"First-time" is broader than it sounds. Under IRS Publication 590-B, you count as a first-time buyer if you did not own a main home in the 2 years before the purchase. The money can also help a spouse, child, grandchild or parent buy a first home. You must use the funds within 120 days.

Keep in mind that the exception removes only the additional tax. A withdrawal from a traditional IRA still counts as income. Also, if your savings sit in a 401(k), rolling them to an IRA first may or may not be possible while you still work there. Ask your plan before you count on it.

A worked example: how to use 401k for down payment on a starter home

Here is a simple example. Palm Beach County's median condo and townhouse sale price was $300,000 in August 2026, according to Miami Realtors. Meanwhile, Pure Equity's MLS data as of October 1, 2026 shows a median list price of $252,450 for active listings in Greenacres, a popular starter-home area.

Say you buy a $300,000 condo with 3 percent down. That is a $9,000 down payment, before closing costs. Now compare three ways to cover it.

• 401(k) loan of $9,000: no tax if you repay on time. At an example plan rate of 7 percent over 5 years, the payment is about $178 a month.
• 401(k) hardship withdrawal: to net $9,000, you would need to take out more than $9,000. If you are under 59 and a half, the additional tax alone is 10 percent of what you withdraw, before income tax.
• IRA first-home exception: up to $10,000 with no additional tax, but a traditional IRA withdrawal still adds to your taxable income for the year.

The numbers above are an illustration only. Your plan rate, tax bracket and loan terms will differ, so run your own figures with a tax advisor.

How lenders treat a 401(k) loan

This part surprises many buyers in a good way. Fannie Mae says a lender does not have to count payments on a loan secured by your own financial assets, such as a 401(k) loan, in your debt-to-income ratio. The lender just needs a copy of the loan document.

There is a catch. If the same account also counts toward your reserves, the lender reduces its value by the loan balance. So borrowing heavily from your 401(k) can leave you short on reserves for some loan types.

Expect your lender to ask for:

• Your most recent retirement account statement.
• Your plan's terms showing that you can borrow or withdraw.
• The signed loan agreement or proof of the withdrawal.
• Proof that the money landed in your bank account before closing.

Timing matters, too. Plan loans and withdrawals can take a week or more to process, so start early. If you are still in the pre-approval stage, tell your loan officer which route you plan to use.

Cheaper ways to fund a Florida down payment

Before you use 401k for down payment money, check whether other help fits. Florida Housing and several local governments offer down payment and closing cost assistance for eligible buyers. Our guide to Florida down payment assistance programs covers the main options and their income limits.

Gift funds are another route. Most loan programs let a relative give you money toward the purchase with a signed gift letter. Unlike a hardship withdrawal, a gift does not cost you any tax as the buyer. See our guide to gift funds for a down payment for the paperwork.

Finally, look at the loan itself. Some programs allow a smaller down payment, which can shrink how much you need from savings. A combination often works best, for example a modest 401(k) loan plus assistance, rather than draining one account.

Should you use 401k for down payment savings?

A 401(k) loan can make sense when your job is steady, the amount is modest and you can handle the payment alongside your new mortgage. It also helps when you need the cash fast and have no other source.

On the other hand, a hardship withdrawal is hard to justify unless you have no other choice. The tax hit and the lost growth can follow you for decades. And if you have IRA savings and qualify as a first-time buyer, the $10,000 exception may be the cleanest option.

Either way, money you take today stops growing for retirement. So borrow only what you need, and keep an emergency fund after closing. Florida homes come with real carrying costs, including insurance and, in many communities, HOA dues.

Frequently asked questions

Can I use 401k for down payment money without a penalty?

Yes, with a 401(k) loan that you repay on time. A hardship withdrawal is different. It is taxable and may face the 10 percent additional tax if you are under 59 and a half.

Does the $10,000 first-time buyer exception apply to a 401(k)?

No. The IRS applies that exception to IRAs only. A 401(k) hardship withdrawal for a home purchase does not get the same break.

Will a 401(k) loan hurt my mortgage approval?

Usually not for Fannie Mae loans. The lender does not have to count the payment in your debt-to-income ratio if it has the loan document. However, the loan can reduce the reserves you can show.

What happens if I quit my job with a 401(k) loan?

Many plans offset the unpaid balance against your account. You can avoid tax on that amount by rolling it over by your tax filing deadline, including extensions, for that year.

How long do I have to use IRA money for a first home?

Under IRS rules, the funds must go toward qualified acquisition costs within 120 days of the distribution.

Sources

• IRS, Exceptions to tax on early distributions
• IRS, Retirement plans FAQs regarding loans
• IRS, Retirement plans FAQs regarding hardship distributions
• IRS Publication 590-B, Distributions from IRAs
• Fannie Mae Selling Guide B3-4.3-03, Retirement accounts
• Fannie Mae Selling Guide B3-6-05, Monthly debt obligations
• Miami Realtors, Palm Beach County August 2026 market report

This article is general information, not legal, tax or financial advice. Retirement plan rules vary by employer, so talk with your plan administrator, a tax advisor and your lender before you borrow or withdraw.

Selling a home in Palm Beach County first? Your equity may cover the next down payment without touching retirement savings. Check what your home is worth or talk with a listing agent. Buying your first home? Schedule a buyer strategy call and we will map out your funding plan with your lender.