Is $4 Million Enough to Retire Comfortably?

Steve is 57 years old, an orthopedic surgeon in Morristown, New Jersey. He's been practicing for 26 years, earning $550,000–$700,000 annually for the past decade. His wife Emily, 55, left her nursing career eight years ago to manage the household and their three children's schedules. Together, they've accumulated $4 million in retirement savings.

The breakdown: $2.8 million in Steve's 401(k) and a cash-balance pension plan, $600,000 in two Traditional IRAs rolled over from previous partnerships, and $600,000 in a taxable brokerage account. Nearly 85% of their retirement savings sits in tax-deferred accounts.

Steve wants to retire at 62. His body is telling him it's time — decades of standing in operating rooms have taken a toll on his back and knees. Emily fully supports the decision. They've saved aggressively, lived below their means relative to his income, and figured $4 million would mean a worry-free retirement.

Then Steve met with a tax advisor.

"She pulled up a spreadsheet showing my projected RMDs and my jaw dropped," Steve said. "By 80, the IRS could force me to withdraw over $250,000 a year whether I need it or not. And because almost everything is in tax-deferred accounts, every dollar gets taxed as ordinary income."

Steve's $4 million is more than enough to retire on. The question isn't sufficiency — it's efficiency. Without proactive tax planning, Steve and Emily could lose $600,000 or more to avoidable taxes over the course of their retirement.

When $4 million creates a tax problem

This sounds counterintuitive. How can having $4 million be a problem?

It's not the amount — it's the account type. Steve spent decades maximizing his 401(k) contributions, funding a cash-balance pension, and pouring income into tax-deferred vehicles. Every dollar he contributed reduced his taxable income during his peak earning years, saving him 32–37 cents on every dollar in federal taxes alone.

Smart strategy during accumulation. But those tax savings were a loan, not a gift. Every dollar that went into tax-deferred accounts — plus all the growth — will eventually be taxed as ordinary income when it comes out.

At $3.4 million in tax-deferred accounts and a conservative 5% growth rate, Steve's balances could exceed $4.5 million by the time RMDs begin at 73. The IRS doesn't care that Steve doesn't need the money. The rules say it must come out.

If Steve were working with a smaller portfolio, this tax concentration wouldn't matter as much. The withdrawals would land in lower brackets. But at $4 million — heavily concentrated in tax-deferred accounts — the forced withdrawals create a cascade of tax consequences.

What the 4% rule looks like at $4 million

Four percent of $4 million is $160,000 per year. Add Steve's projected Social Security of $42,000 (claiming at 67) and Emily's spousal benefit of about $21,000, and gross income reaches $223,000.

At $223,000 in gross income, 85% of Social Security becomes taxable. After the standard deduction, taxable income is approximately $185,000–$190,000. That places Steve and Emily in the 24% federal bracket, and potentially knocking on the door of the 32% bracket.

New Jersey's state income tax adds another painful layer. At this income level, they'd owe approximately $9,000–$12,000 in state taxes. Combined federal and state taxes could reach $38,000–$45,000 per year.

Net spendable income: roughly $178,000–$185,000 out of $223,000 gross.

Still a comfortable retirement by any standard. But Steve isn't just losing money to current taxes — he's heading toward a much larger problem.

The RMD time bomb

This is where Steve's situation gets genuinely alarming.

At 73, the IRS requires Steve to start withdrawing from his tax-deferred accounts based on a life expectancy table. The percentage starts at roughly 3.8% and increases every year. By 80, it's over 5%. By 85, it's approaching 6.8%.

Here's what Steve's RMDs could look like if he doesn't take action:

At $258,000–$278,000 in combined income, Steve and Emily would face the 24% federal bracket with significant income in the 32% bracket. New Jersey state taxes would add $12,000–$15,000. And that's not even the worst part.

The worst part is IRMAA.

How IRMAA punishes high earners

Medicare's Income-Related Monthly Adjustment Amount is a surcharge on Part B and Part D premiums for higher-income retirees. It uses your income from two years prior, and the thresholds are lower than most people expect.

For married couples filing jointly, IRMAA surcharges begin at $206,000 in modified adjusted gross income. Steve and Emily would blow past that threshold in nearly every year of retirement if they don't manage their income carefully.

At the first IRMAA tier, the surcharge is roughly $2,000–$3,000 per year for the couple. But at higher tiers — which Steve could hit as RMDs grow — surcharges reach $8,000–$12,000 per year. Over a 20-year period on Medicare, that's $40,000–$240,000 in additional healthcare costs directly caused by high taxable income.

The IRMAA trap is particularly cruel for people like Steve because it uses a two-year lookback. Income in 2026 determines 2028 premiums. A large Roth conversion that saves taxes long-term could trigger IRMAA surcharges in the short term. Every move has ripple effects.

"I had no idea Medicare premiums were income-based," Emily said. "We just assumed Medicare was Medicare — same cost for everyone. Finding out we'd pay thousands more per year because of Steve's retirement account structure was a wake-up call."

The Roth conversion window

The single most impactful strategy for Steve and Emily is aggressive Roth conversions between now and age 73. This is their window — and it's narrower than they think.

Here's the logic: Steve retires at 62. From 62 to 72, he has no earned income. Social Security hasn't started (if he delays). His taxable income is whatever he chooses to withdraw or convert.

If Steve converts $150,000–$200,000 per year from his Traditional accounts to a Roth IRA, he'll pay taxes at the 22–24% bracket. That's $33,000–$48,000 per year in conversion taxes — real money. But every dollar converted is permanently removed from the RMD calculation.

Over 10 years, Steve could convert $1.5–$2 million to Roth. The impact:

• His tax-deferred balance at 73 drops from $4.5 million to roughly $2.5–$3 million
• First-year RMDs drop from $170,000 to $95,000–$115,000
• Combined income stays below or near IRMAA thresholds
• Roth withdrawals in later years are completely tax-free
• No RMDs ever on Roth accounts
• Heirs inherit Roth money tax-free (within the 10-year distribution window)

The tax savings over 30 years: conservatively $300,000–$500,000 in federal taxes, plus $80,000–$150,000 in state taxes, plus $40,000–$100,000 in avoided IRMAA surcharges. Total potential savings: $420,000–$750,000.

Where does $160,000 a year go?

Even with significant taxes, Steve and Emily's spendable income of $178,000–$185,000 supports a very comfortable lifestyle. Here's a realistic budget for a couple in suburban New Jersey:

With $178,000–$185,000 in after-tax income and $93,000 in core expenses, Steve and Emily have roughly $85,000–$92,000 in annual surplus. That's money that can absorb home renovations, car replacements, helping adult children, long-term care insurance premiums, or additional savings.

The lifestyle risk isn't running out of money. It's lifestyle inflation — expanding spending to match income rather than maintaining the surplus as a buffer. At $4 million, the temptation to upgrade the house, buy a vacation property, or take lavish trips is real. None of those are wrong, but each one narrows the margin of safety.

Strategies to protect your $4 million

Beyond Roth conversions, several strategies compound Steve and Emily's advantage.

Asset location matters enormously. Move bonds and high-yield investments into tax-deferred accounts where interest is sheltered. Keep equity index funds in the taxable brokerage where long-term gains are taxed at preferential rates. This single move can reduce taxes by $3,000–$5,000 annually.

Consider state relocation seriously. Steve loves New Jersey, but New Jersey doesn't love retirees. Between income taxes and the highest property taxes in the nation, relocating to a tax-friendlier state could save $20,000–$25,000 per year. Even moving to nearby Pennsylvania — with its flat 3.07% income tax and lower property taxes — would help.

Use Qualified Charitable Distributions after 70½. If Steve and Emily donate to charity (which they do — about $10,000 per year), QCDs allow them to send money directly from IRAs to charities. The distribution counts toward their RMD but doesn't appear as taxable income. That's $10,000 per year that reduces their RMD tax impact without costing them anything extra.

Plan for long-term care proactively. With $4 million, Steve and Emily can likely self-insure for long-term care needs. But a hybrid life insurance/long-term care policy, funded with a portion of their taxable account, provides leverage — turning $200,000 into $500,000+ of long-term care coverage while keeping the rest of the portfolio intact.

Coordinate the Social Security claiming decision. Steve's benefit at 70 would be roughly $52,000 — significantly more than at 67. With a large portfolio to bridge the gap, delaying maximizes the inflation-adjusted guaranteed income that protects Emily as a survivor.

The bottom line on $4 million

Four million dollars is unquestionably enough to retire comfortably. Steve and Emily will never worry about affording groceries or paying the electric bill. That baseline security is real and shouldn't be dismissed.

But $4 million concentrated in tax-deferred accounts creates a tax problem that, left unaddressed, costs hundreds of thousands of dollars over a retirement. The difference between a reactive approach (waiting for RMDs and paying whatever the IRS demands) and a proactive approach (converting strategically, managing brackets, optimizing location and charitable giving) is the difference between keeping $4 million working for you and handing $600,000+ to the government.

Steve puts it bluntly: "I spent 26 years building this nest egg. The idea that I'd lose a quarter of it to taxes I could have avoided — that's not something I'm willing to accept."

He shouldn't have to. The tools exist. The strategies are proven. The math works decisively in favor of planning.

The hardest part, for someone like Steve, is accepting that the skills that built the wealth — discipline, hard work, maximizing tax-deferred contributions — aren't the same skills needed to preserve it. Saving and spending are different games, and $4 million is too much money to play the spending game without a strategy.

With $4 million at stake, the right tax strategy can save hundreds of thousands. Talk to a retirement advisor who specializes in high-net-worth withdrawal planning, Roth conversions, and RMD optimization.