AI and network security

How do I protect my account from AI attacks?

Protect your account from AI attacks with sign-in that cannot be phished, such as passkeys or security keys, plus a unique password for every account and a habit of verifying any urgent request through a channel you already trust. AI makes fake emails, websites and voices cheap and convincing, so defences that depend on spotting a fake matter less than ones that do not need you to.

TL;DR

AI makes phishing emails, fake login pages and cloned voices cheap and convincing, so rely on sign-in that cannot be phished, such as passkeys or security keys. Give every account a long unique password from a password manager and lock down recovery. Verify any urgent request for money or codes by calling back on a number you already have.

Learning objectives

After reading this article you will be able to:

  • Describe how attackers use AI for phishing, voice cloning and password attacks
  • Secure an account with phishing-resistant sign-in, unique passwords and recovery that cannot be talked into a reset
  • Verify urgent requests through a channel the attacker does not control

AI-powered account attacks

Attackers use AI to make the old attacks more convincing and cheaper to run at scale. The FBI warned in December 2024 that criminals use generative AI to write believable messages and build fake profiles and websites in volume, to generate fake identity documents and photos, and to clone the voice of a relative or an official from a short clip so a call sounds real.

For accounts, that adds up to three main threats:

  • Phishing that looks right. Well-written emails and pixel-perfect login pages, tailored to you, that collect a password and the one-time code you type next.
  • Voice and video impersonation. A call that sounds like your manager, your bank or a family member, asking you to approve a payment, read out a code or reset access.
  • Password attacks at scale. Automated tools that try passwords leaked from other sites against your accounts, and keep trying.

All three depend on you handing over something reusable: a password, a code or an approval. The best defences remove that something.

Phishing-resistant sign-in with passkeys

The strongest protection for an account is sign-in that cannot be phished. CISA’s guidance calls phishing-resistant MFA, meaning FIDO or WebAuthn authenticators such as passkeys and hardware security keys, the gold standard, and urges organisations to make migrating to it a high priority.

Passkeys resist phishing because of how they work. Your device holds a private key, the site holds the matching public key, and at sign-in the device signs a challenge from that exact site. The private key never leaves your device, and the signature is bound to the real site’s address, so a look-alike page cannot get anything it could replay. There is no code to read out and no password to type into the wrong box.

Any second factor is far better than none. Microsoft reported that MFA can block over 99.9 percent of account compromise attacks. But CISA notes that weaker forms can be beaten: codes sent by text are exposed to SIM swaps and phone network attacks, one-time codes can be typed into a phishing page, and push approvals can be spammed until someone taps Accept. Turn on passkeys or a security key wherever an account offers them, starting with email, because whoever controls your email can reset everything else.

NIST password guidelines

Every password should be long, unique and stored in a password manager. NIST’s current guidelines require at least 15 characters for a password used on its own, tell services to check new passwords against lists of commonly used, expected or compromised values, and say services shall not force periodic changes, only a change when there is evidence of compromise. A unique password per account means a leak at one site does not open the others.

AI voice and message scam prevention

The defence against AI voice and message scams is to verify through a channel the attacker does not control. The FBI’s advice is to hang up, look up the organisation’s contact details yourself and call the number directly, and to agree a secret word or phrase with family that a caller has to know.

  • Treat urgency as a warning sign. Requests to act now, keep it quiet or skip the usual process are how these scams work.
  • Never read out a one-time code or approve a sign-in you did not start.
  • Lock down account recovery. Use recovery codes or a second passkey rather than SMS, and ask your mobile carrier about a port-out or SIM lock.

Device-held keys for account security

Device-held keys leave nothing to steal from the conversation. A password, a code or a bearer token is a secret that works for whoever holds it, so a convincing fake only has to get you to hand it over once. A key that stays on your device and proves itself by signing a fresh challenge gives a fake page or voice nothing reusable.

Offline Protocol applies the same principle to devices. Every device generates its own Ed25519 identity key and keeps the private half; its address is derived from the public key, so other devices verify it directly with no lookup and no shared secret. When an app binds a device to an account, the server issues a fresh nonce, the device signs it, and the server verifies the signature. Nothing a phishing page or a cloned voice could capture would let anyone sign as that device.

Frequently asked questions

Can AI guess my password?

AI does not need to guess. Most password attacks reuse passwords leaked from other sites or try common ones, which is why NIST tells services to check new passwords against lists of compromised and common values. A long, unique password for each account defeats both.

Are passkeys safe from AI phishing?

Yes. A passkey's private key stays on your device and is bound to the real site, so a fake page, however convincing, has nothing it can collect or replay. CISA lists FIDO and WebAuthn as the phishing-resistant form of MFA.

Is SMS two-factor authentication still worth using?

It is better than no second factor, but CISA warns that codes sent by text can be stolen through SIM swaps and phone network flaws. Move to an authenticator app, and to passkeys or security keys where the account offers them.

How do I tell if a voice call is a deepfake?

Often you cannot, so do not try. Hang up and call back on a number you already have, or ask for a code word agreed in advance, as the FBI recommends for families.

Should I change my passwords regularly?

Not on a schedule. NIST's current guidance says services shall not force periodic changes, and shall force a change when there is evidence a password was compromised. Change a password when it may have leaked.

What is push bombing?

An attacker who has your password sends sign-in approval requests to your phone over and over until you tap Accept. CISA lists it among the threats to MFA. Never approve a sign-in you did not start.

Sources

Build it with Offline Protocol

The device identity guide shows how Offline Protocol gives every device its own Ed25519 key that never leaves it, and how to bind that key to an account by verifying a signature over a fresh nonce.

Read the device identity guide