We're all aging quickly, and in a blink of an eye, it's eternity.
You didn't say how old you are, if you know you're going to be retiring soon, then forget it and retire now, if you can't retire yet then you need to stick with your job, they need you and you need them.
Starting a business is also very risky, it could eat up your retirement nest egg only to file for bankruptcy later, then everything is gone, and your wife might be gone too!
About 20% of all businesses that start fail in the first year, another 60 or so percent fail between the 2nd and the 3rd year, the odds are not in your favor, you would have far better odds at the blackjack table! The odds I quoted are all over the table, depending on what you read, a couple sites said that about 25% of new upstarts are around 15 years later, that's a bit better odds than others I've read, I remember when I was in college back in the late 70's and early 80's a professor told us that only about 12% of all new upstarts are around after 15 years, not sure if things changed since then or people are just throwing out numbers. Regardless, there are significant risks involved with starting a business. You also have to be prepared for low personal income, something you don't have to worry about right now, so it could be a real burden to suffer personally for X number of years. It could take you 15 to 20 years to get up to the kind of income you're making now, then you can't leave the business to go on a bike tour because the business needs you 10 hours a day 7 days a week. Been there done that!
If you go the starting your own business route, make sure you isolate your retirement from the business, in other words, do NOT use your retirement nest egg to start, or keep your business running, or give you income to live on. Also do not take a second on your house to start a business because you are putting your home at risk of losing it. You will need a business plan laid out professionally, and get a business loan if that's what you need to do. Make sure the business is put into an LLC, then if you default on the loan the collectors can't come after your personal assets as long as they're not connected.