Musician’s Voice and Face Used in
AI Deepfake Romance Scam

A deepfake is a fake video, image or audio clip made with AI to make someone appear real when they are not. Deepfakes can be used in romance scams to trick someone into believing they are speaking to a real person on video or hearing their real voice, when in fact the scammer has used AI to create a false identity in order to build trust.

Authorised Push Payment (APP) fraud happens when a scammer uses social engineering to persuade, manipulate or pressure someone into sending money from their bank account, usually through the Faster Payments Service (FPS), the system behind many near-instant online and telephone bank transfers.

The payment is described as “authorised” because the victim makes the transfer themselves, believing the request is genuine. This might involve sending money to someone they believe they are in a relationship with, paying into what they think is a legitimate investment, or transferring funds for another convincing but false reason.

APP fraud takes many forms, and scammers are using increasingly sophisticated tactics to make their stories seem believable, such as AI technology and deepfakes.

Romance scams happen largely on online dating sites and apps, where people meet online and develop what one person thinks is a romantic relationship, but is in fact a scam. Scammers are highly manipulative as they take advantage of trust that is developed over weeks, and sometimes even months or years, whilst pretending to be someone they are not.

Romance scammers often ask for money under the guise of an emergency or important life event. Common excuses include:

• A medical emergency that has resulted in a bill
• Travel costs so they can come and meet you
• Problems with their bank account
• Visa, passport or immigration fees
• A family emergency
• Business troubles
• Legal fees

The aim is usually to create emotional pressure and make the request seem genuine. Once the victim has transferred the money, it is often swiftly transferred to an overseas account before the scammer vanishes. By the time the victim realises they have been scammed, it may be too late to recover their funds.

Sarah Spruce, Legal Director at TLW Solicitors, says:

“Romance scams don’t just cause financial damage; they take an emotional toll on the victim, who has been manipulated and deceived by someone they believed to be in a relationship with. What happened in the case of Becky Baldwin’s fan is increasingly common, as scammers are now taking full advantage of AI technology to create convincing deepfakes.

To the untrained eye, deepfakes can be very realistic, and so it’s important not to feel ashamed or embarrassed if this has happened to you. As romance scams have become increasingly complex, with funds moving rapidly from UK-based accounts to overseas accounts, there is no guarantee that the money can be recovered. However, user rights have been strengthened in recent years with the introduction of the APP Fraud Reimbursement Scheme, forcing banking and financial institutions to reimburse APP fraud victims more quickly.

If your bank refuses to refund the money, or you disagree with their decision, it may be possible to escalate the matter to the Financial Ombudsman Service. FOS is an independent, government-backed body that can investigate and rule on disputes between financial institutions and their customers. It can ask banks to refund money lost through fraud and pay compensation for the trouble and upset caused.

Alternatively, in England and Wales, APP fraud victims may want to consider private prosecution. If the police, HMRC or Crown Prosecution Service decide not to bring a criminal case, a private individual, usually through their solicitor, can start criminal proceedings themselves.

If you or a loved one has lost money to a romance scam or any other form of APP fraud, please get in touch with our team of specialist lawyers for a free, no-obligation discussion to explore your options and next steps.”