A relaxing, enjoyable, worry-free retirement is possible. But even for high net worth families, it is not guaranteed for the duration of your retirement. And while most people know they need to do ‘retirement planning’, how many actually know how to do it?
We’re proud to say that we wrote the about protecting wealth and retirement. To learn more about asset allocation and risk management strategies for ultra-high net worth investors, order a free hardcover of our book, The Art of Protecting Ultra-High Net Worth Portfolios and Estates – Strategies For Families Worth $25 Million To $500 Million.
What you’re about to read will walk you through all the most critical questions and tasks you must answer and complete if you want to experience the retirement of your dreams. And let’s just come out and say this in case there is any doubt:
Retirement planning may be the single most important thing you can do for yourself – especially if you’re over 50 – regardless of your net worth. We suggest you read our guide on how to find an ultra-high net worth financial advisor for individuals having over $10 million in investable assets.
As for us, Pillar Wealth Management and co-owners Hutch Ashoo and Christopher Snyder create retirement plans for high net worth and ultra-high net worth families who have between $5 million and $500 million in liquid investable assets. But even if you fall outside that range, you can still use this retirement planning guide to its fullest value. The quality of your future may well depend on it. We know how hard it can be to find an investment advisor that complements your investment vision and helps you achieve your goals. If you are looking for effective investment and wealth management solutions, then schedule a free consultation with us.
If you’re looking for more personalized assistance creating your own customized retirement plan, we’ve created another ultimate guide – one that will help you find the very best financial advisor or wealth manager for your situation. Get your Ultimate Guide to Choosing a Financial Advisor right here.
Defining Your Retirement Goals
History is replete with famous people who have retired and then died within a year, such as Andy Rooney, Joe Paterno, Bear Bryant, and Charles Shultz. We bring this up not to be morbid, but to simply point out that planning your retirement needs to begin before you retire, not after.To learn more about click here to read our guide on the 5 critical shifts that help maximize portfolio performance.
It is distressingly common to read stories about people who finally leave their jobs only to find themselves sitting around watching TV all day, wondering what to do with their lives. Depression and disillusionment are high among new retirees.
Now, if lounging around all day sounds like paradise to you, then more power to you. In other words – if your primary retirement goal is to be able to just relax in your recliner all day with an open schedule and enjoy at-home leisure, sports, movies, music, food, and entertainment, then you can plan for that.
However, many people who are drawn even to that very simple form of retirement fail to fully take advantage of the opportunity once it arrives. If you have assets worth $5 million and above, then we can help you out. Click here to arrange a free consultation with us.
Planning how you want to use your time and money in retirement is your first and most critical step. Some questions to get you thinking:
- Are there any places I’ve always wanted to travel?
- Where do my relatives live, and how often do I want to see them?
- What life experiences on my ‘bucket list’ remain undone?
- Is there a hobby I’ve always wanted to work on but never had time?
- What local, national, or global issues do I care about enough to give time and money to them?
- Are there any organizations I’ve wanted to get more involved in, like churches, boards, clubs?
- Should I consider mentoring or coaching young people in my areas of expertise?
- What expenses am I anticipating? Are there any I’m not anticipating that could happen?
- Do I have relatives I’ll need or want to take care of financially?
- What is the status of my real estate holdings, and do I want them to change?
- Any large purchases or home improvement projects on my mind?
Do you see how, when you really start thinking about it, there is an almost endless list of things you could do once you retire? Some activities take more money; some take less.
It’s your time. These are your relationships. This is what matters to you. Define your retirement goals on these terms, and from there you can continue planning out your retirement. For more detail, use this 3-step retirement planning guide for high net worth families.
How Do I Know if My Retirement Income Will Be Enough?
Planning for what you want is one thing. But planning for what you might end up with is another. Not everything will go your way in retirement. And some things can happen that drain your retirement savings and investments faster than you expected. If you also live longer than expected, even wealthy retirees can run out of money too early without careful planning.
Some income drainers are external. Think recessions, market volatility, pandemics. Some are internal to your life and family, like divorce, unplanned medical costs for you or for relatives, lawsuits, and poor investment planning.
To ensure you have enough money throughout your retirement, you must plan for both scenarios – the things you want to do, and the things you might have to do.
For instance, divorce may feel extremely unlikely. But what if it happens to a close relative? You might have to step in. And stranger things have happened. To learn more about our portfolio planning techniques, click here to read our guide on improving portfolio performance for high net worth investors.
Did you know there are ways to protect your retirement accounts during a divorce? One step is to get a QDRO (qualified domestic relations order), which spells out who gets what from which accounts. There are also tax consequences that can eat you alive in a divorce. See 7 ways to protect your retirement accounts in a divorce.
To secure your income in retirement and be sure you have enough, it all boils down to having the very best and most customized portfolio and investment plan.
This is something only a private, independent wealth manager can create for high net worth families. Big banks and large investment firms don’t do this sort of work – not at the level you will need if you want a secure retirement income for life that supports the way you hope to live.
What makes a good investment plan? A good plan will do much more than simply presume an average annual rate of return and build the rest around that. This is what almost every large firm and even many independent financial advisors and wealth managers do.
Why doesn’t this work? Because averages are largely meaningless. If the market goes up 1% one year and 19% the next year, the “average” is 10%. But so what? You only made 1% one year, and that means the retirement income you took out in that year is gone, and has imperiled your long-term financial security. Make sense? You don’t ‘get it back’ just because you earned 19% the next year.
The point is, average rates of return don’t protect your retirement income. See some smart tips for maximizing investment performance while minimizing losses.
If you have high net worth and are committed to optimizing your investment performance, we strongly recommend this free eBook, Improving Portfolio Performance, the Shifts Multi-Millionaires Must Make to Achieve Financial Security and Serenity.
Generating Income in Retirement
So how do you determine your income in retirement?
Even if you have 25 retirements accounts sprinkled around – 401k, IRA, pension, Social Security, Roth IRA, 403b, company stock, and any other type of investment – the ‘holy grail’ of retirement income is to get just a single deposit each month, correctly formulated. This is the most requested retirement income experience from our high net worth retired clients.
The problem is, properly managing all your accounts so you can producea single monthly income amount is really hard, as you’ll see in a bit. That’s one of the main reasons people come to wealth managers like us. Our team at Pillar Wealth Management has developed a crisp process that delivers the income certainty in retirement our clients want. We do all the work, and you get what you want – a single monthly deposit. Find out more – schedule a quick opening call with a founding wealth manager from Pillar Wealth Management.
If you try to do this yourself, it gets very complicated, very quickly.
Why? Because you have two powerful adversaries working against you. And the older you get, the more fierce they become. These two adversaries are required minimum distributions (RMDs) and taxes.
What is a required minimum distribution?
Congress has changed the ages for this and may do so again, but right now at age 72, you are required to start withdrawing moneyfrom many of your retirement accounts. If you fail to make withdrawals of the proper amount, the IRS will hit you with a 50% tax penalty on whatever else should have been withdrawn. Yes – 50%. They’ll take half.
The complicating factor here is your other adversary – taxes. If you are interested in learning more about these hidden costs of investment and wealth management, click here to chat with one of ourultra-high net worth financial advisors.
If you make too much money in retirement, you bump into a higher tax bracket. That’s why you can find an endless trove of strategies for how, when, and how much to withdraw from all your various retirement accounts in the years leading up to when RMDs kick in, and afterward.
It’s a mess.
If you want to jump into that mess, a key step is to decide on a withdrawal strategy from your various accounts. Here are four common withdrawal strategies people use:
In this approach, you withdraw the income generated in your investment portfolio, including interest and dividends. So, suppose you have $1 million in a particular IRA and it produces $80,000 growth in one year. Doing systematic withdrawals, you would withdraw all or part of that $80,000 but no more. The next year, it might make $90,000, and just $50,000 the following year. You would adjust your withdrawals accordingly.
Here, you choose a percentage for how much of your total portfolio you will withdraw each year. The idea here is to withdraw less than the expected rate of return so your accounts continue to grow in value. If your account seems to grow by at least 5% each year, you might withdraw 4.5%.
The 4% Rule
The 4% rule is a particular example of the fixed-percentage approach. But this one caught on some time back and became a general recommendation that many financial advisors and retirees use. Its advantage is that you stick to it no matter what your accounts are doing, because over time it seems to maintain overall portfolio net worth values pretty well.
In other words, retirees using this approach often find that the 4% they take out each year comes back through continued growth, so their overall account values don’t drop.
Unlike a percentage, now you’re withdrawing a certain dollar amount each time period. This is a simpler approach because you don’t have to do as much math, and taxes can be withheld automatically, much like a paycheck. So, you might just take $20,000 per month, flat, no matter what your accounts are doing.
All of these withdrawal strategies have their advocates and their critics. We’re not here to get into the details of those debates.
Why None of TheseAre Simple
The larger point remains – doing all this yourself will be difficult. For example:
Suppose you’re 60, and you want to use the ‘simple’ 4% rule. You have a Roth IRA, two traditional IRAs, a pension, Social Security, and a 401k, all with various amounts of money in them.
The RMD rule will kick in at age 72 for all those accounts except the Roth and Social Security. That means you have 12 years until you’ll be forced to withdraw a certain amount of money as income.
Are you going to just withdraw 4% from all the accounts starting at age 60?
The problem with that is, you might deplete your Roth IRA early, but still have large amounts in your other accounts when you reach 72. And now that you have to withdraw what the government says, you might reach a higher tax bracket and have to pay more taxes.
This is why you’ll sometimes hear recommendations to deplete the RMD-vulnerable accounts first and leave the Roth alone. We’ll talk about pros and cons of these types of accounts in a bit.
You’ll also hear about rollovers. What’s a rollover? It’s when you take an account like a 401k and transfer all the money into a Roth IRA, or some other type of retirement account. We’ll discuss rollovers more in a moment too.
But consider some of the factors that affect the decision to rollover a retirement account:
- Which accounts are you transferring from and to, and why those?
- Is there a time limit on when you have to complete the rollover, and what happens if you miss it?
- What if you inherit the retirement account from a spouse, parent, or other relative?
- Does the money come to you first, or go straight into the new account? Does it matter?
- Can you do the rollover while still employed? Does it matter?
Feeling suddenly overwhelmed?
Guess what – ALL of those issues matter. The answers are not simple. They vary for each person, each situation. We won’t even attempt to discuss them here.
The point of all this is simply this: Generating your income in retirement is not simple, clear, or straightforward. Do it wrong, and you can get fined, penalized, and taxed.
Is that the retirement experience you’re hoping for?
What Can I Do to Plan for Retirement at a Younger Age?
Let’s get to some more specific questions related to retirement.
With high enough income and net worth, you may feel like retiring earlier so you can enjoy more of your life. And plenty have achieved this, retiring in their 40s or even 30s in some cases. But even retiring at age 50 requires some extra smart financial planning.
Consider that if you lived to 90, you would be retired for 40 years. That’s more years of your adult life than you worked. Can you sustain your income in retirement for 40 years? Even for someone with over $10 million in savings, that is far from an easy task.
For anyone planning retirement, we created this 29-point retirement checklist. It walks you through four areas:
- What you have
- What you owe
- Your plans and goals
- What you should be doing NOW – strategies for retirement planning
No matter what age you plan to retire, working through that checklist will set you up for the enjoyable, secure, fulfilling, and worry-free retirement you want.
Only 5 Things Under Your Control in Retirement
The next part of planning for a younger retirement (or any retirement) is to have a clear picture of what you can and cannot control. You cannot control the market, the economy, the government, your spouse, your favorite sports team, your hedge fund, your IRA performance, or your medical situation. And there are many more things. In fact, you can control almost nothing.
That’s important, because if you plan your retirement presuming more control than you actually have, this is how so many set themselves up for disappointment and downsizing.
The only five things you can control are:
- What you choose to spend
- What you choose to save
- The timing of when you make big purchases
- Your risk tolerance
- Your estate and legacy plans
Do you see why defining your goals is the first step in the retirement planning process?
Your goals determine what you will spend and when you will spend it.
Starting a hobby, adding a room to your house, starting a foundation, buying a second home – these things cost money. But it is money you are choosing to spend. You have control of that.
Your goals also determine how much you save, and where you save it. How much money you want to leave to your heirs – that too depends on your goals.
What are you saving your money for? For steady retirement income? A particular big purchase you plan on making? How much do you want to leave to your children, grandchildren, charities, and perhaps others? This too affects your savings and investment choices. All of this is within your control.
You can also choose the nature of your investments. You can sock all your money in low-interest but secure certificates of deposit. You won’t make much more than 2-3%, but your money will be secure. You can also blend your secure investments with higher performing ones. Your risk tolerance lies behind these decisions, and that too is up to you.
Retirement planning – and in particular the investment planning component of your wealth management plan – can only be done right if you start here – knowing what is within your control.
Responding to the Unexpected
Why does it matter to know what’s in your control? Because when things happen outside your control, adjusting these five areas is how you must respond to it so you can maintain the security of your retirement.
An easy example:
Suppose you have three kids and plan to leave $2 million to each of them in various trust accounts after you die. Then a recession hits when you turn 75, and your spouse has a medical crisis that costs tons of money. Your retirement accounts are decimated.
One possible response to this is to lower that $2 million number down to $1 million per child. Now, just like that, you have $3 million more to work with in response to these unplanned challenges – without affecting your own lifestyle at all.
The Most Important Question
The question that determines your retirement security is – how will you know in that moment what move to make in response?How can you know how it will affect your long-term security?
Retirement life will not go as planned. How will you respond without jeopardizing your future?
That is why working with Pillar Wealth Management is something you should strongly consider if you meet our required minimum. We have created a proprietary, 100% customized retirement planning process that answers questions like this – definitively, precisely, and with clear numerical projections and hard data.
To learn more about how we do this for families with $5 million to $500 million in liquid assets, reach out to us today for a free opening call.
If you know you need help from a financial professional but aren’t ready to talk to a live person, again we recommend The Ultimate Guide to Choosing the Best Financial Advisor, for Investors With $5 Million to $500 Million in Liquid Assets.
More Investment Performance Secrets
One component of investment performance – a key to retirement security for everyone, but especially younger retirees – is avoiding risky bets and unwise investments. For the most secure retirement income, here are a few investment opportunities to generally avoid:
- Annuities – almost always rife with fees and poison pills
- Stocks in individual companies – don’t stake your retirement on one company
- Highfee and highrisk mutual funds and ETFs
- Angel investment, hedge funds, venture capital – the returns for most people are abysmal
- Any financial advisor or wealth manager who tries to push you toward a risky asset allocation
Should I Rollover My 401k Before Retirement?
If it hasn’t happened already, you will probably be encouraged at some point to rollover a 401k, 403b, traditional IRA, and sometimes even pensions, into other types of retirement accounts.
And sometimes it’s a smart move to make. But if you recall back to the section on retirement income, you have taxes and required minimum distributions to consider in all these sorts of decisions.
Taxes are one of the primary motivations for doing a rollover.
In a 401k, or a traditional individual retirement account (IRA), the money you’ve put there has not yet been taxed. It was deposited there from your paycheck before taxes were withheld. So that money, and all the investment growth it has accrued, will be taxed when you withdraw it.
- Wealth Management Nevada – Wealth management Nevada for high net worth and ultra-high net worth individuals is tricky business…
- Wealth Management Louisiana – The best experts offering solutions for Wealth Management Louisiana focus on improving your portfolio performance…
- Wealth Management Colorado – For high net worth and ultra-high net worth individuals, wealth management encompasses various aspects…
- Wealth Management Hawaii – What sets high net worth and ultra-high net worth investors apart…