Someone can clone your voice from a few seconds of recorded audio. They can then ring your finance director, or your mother, and sound exactly like you.

That is the whole of the AI voice cloning problem. The old reassurance — you would know if it were not really them — no longer holds. The tools are cheap, the results are convincing, and the calls land on people who trust the voice they hear.

If you run a business or sit behind a family office, you are exposed on two fronts at once. Here is how these scams work, and what you can put in place this week to stop them.

How AI voice cloning scams actually work

How little audio a voice clone needs

Voice cloning used to be a research project. Now it is a consumer subscription, and the workflow is short:

An attacker collects a sample of your voice. Social media video, a podcast appearance, a conference recording, your voicemail greeting, or a short call where they pose as a recruiter all work.
A model trains on that sample and reproduces your tone, pace, accent, and speech habits.
The clone speaks live on a phone call, or generates a voice note that arrives while you are asleep.

You will not spot the fake by listening harder. Assume the voice can be copied, and put your defences somewhere else.

Recognise the four calls that catch people out

The family emergency. A call from a child or grandchild, in trouble, needing money right now. The voice is right and the panic is real. This one hits high-net-worth families hardest, because the sums requested are plausible.

The CEO payment. Someone in your finance team takes a call from what sounds like you, asking for an urgent transfer. A matching email often follows to close the loop. A familiar voice plus a paper trail is very hard to argue with in the moment.

The changed bank details. A supplier your team already knows rings to say their account has moved. The voice matches the person they dealt with last quarter.

The private banker. For family offices, attackers clone a known wealth manager or banker and call to move money or pitch an investment.

Every one of them relies on urgency. That is the tell, not the audio.

Why scammers target high-net-worth families first

Several things make high-net-worth families a better target than most, and none of them is easy to change:

Your voice is public. Interviews, charity events, panels, and social media all supply training material.
The payoff is large. One successful call can be worth six figures.
Your household has authority. Assistants, household staff, and family office employees can act on your behalf, and rarely get the security training a corporate finance team gets.
Family beats process. A perceived emergency involving your child will override any policy you have written.
Your money sits in many places. Several banks, platforms, and advisers mean several routes in.

Protecting your family from a cloned voice

Agree a family code word this week

Pick a word or phrase that anyone must use when they ask for money urgently by phone. Make it:

Known only inside the family
Impossible to guess from anything you have posted
Changed from time to time
Spoken, never stored in a note or a chat

If the caller cannot give you the code word, the call is fraudulent. It does not matter how much they sound like your son.

Limit the voice recordings you leave in public

Take ten minutes and look at how much of your voice is downloadable:

Video on Instagram, TikTok, LinkedIn, and YouTube
Podcast appearances
Conference and event recordings
Voicemail greetings, which should say a number and nothing else

You do not need to disappear. You do need to decide, deliberately, what you hand over.

Brief your household and family office

Anyone who can move money or act for you needs this conversation. Cover:

How voice cloning works, with an example they can hear
The family code word and when to use it
The verification steps for any financial instruction by phone
Who to tell when a call feels wrong

Verify every urgent request before you act

Make it a house rule. Any call asking for money, account changes, or personal information gets verified on a second channel. Hang up. Ring back on a number you already had. That one habit stops almost every voice cloning scam before it costs you anything.

Protecting your business from voice cloning fraud

Require a callback before you release any payment

Set a threshold. Above it, no payment moves on the strength of a phone call, whoever appears to be calling. Your team rings a pre-registered number back first. Write it into the process rather than the induction pack.

Sensitive instructions on channels you can verify

Push financial conversations onto authenticated channels. A Microsoft Teams call from a verified corporate account is far harder to fake than an inbound phone call with a spoofed number.

Training on voice scams, not just email phishing

General phishing awareness will not cover this. Run security awareness training that deals with voice specifically:

Play them real examples of cloned voices
Run simulated voice phishing calls
Rehearse the callback rule until it is automatic
Make reporting a near miss safe, and thank people who do it

The executive audio anyone can download

Look at what your own marketing has published. Conference recordings, results calls, and video profiles all feed the same models. Decide which ones need to stay online forever, and take the rest down.

Act fast if a cloned voice targets you

Send nothing and say nothing. Hang up.
Call the real person on a number you already trust, and confirm.
Report it to Action Fraud on 0300 123 2040 or at actionfraud.police.uk.
Tell your bank if any account detail was shared.
Tell your IT provider, so they can check whether anything else has been compromised.
Write down everything you remember about the call while it is fresh.

Defending against a voice your people trust

We work with business leaders and family offices to cover the corporate and the personal attack surface together. That means secure communication, awareness training pitched for a household rather than an office, and a response plan for the day a call gets through.

Contact Nerdster for a free IT assessment. We will show you where your voice is already exposed, and what to change first.

AI Voice Cloning Scams: How to Protect Yourself