Education
Deepfake technology brings murdered grime artist 'back to life' to fight knife crime
Deepfake technology brings murdered grime artist 'back to life' to fight knife crime
A young grime performer from Birmingham has been brought ‘back to life’ with deepfake technology in a bid to raise awareness of knife crime after he was murdered.
British 18-year-old, Joshua Ribera was stabbed outside a nightclub in 2003. His mum, Alison Cope now is an anti-knife campaigner. In a bid to make the teaching of youth violence compulsory in schools, she worked with various artists to create a deepfake AI video of ‘Depzman’ rapping about the effects knife-crime has on families.
Depzman toured with grime star Skepta where he built up a huge following in that scene. The high quality deepfake video cleverly uses AI technology to talk about heartbreak, destroyed families and tells kids to think twice before packing a knife. The video, released on SBTV, has spread on social media gaining more than a million views on TikTok and shared by rappers Jaykae, JME and Skepta. It was played on 65 prison TVs around the UK.
Who created the deepfake?
Alison Cope
Jamal Edwards
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Voice cloning software
Lip syncing software
Year :
2022
Deepfake art demonstrates time and resources required when data isn't 'free'
Deepfake art demonstrates time and resources required when data isn't 'free'
Close
Two artists have used deepfake videos in a bid to encourage conversations about AV manipulation.
Soft Evidence shows events that never happened by machines trained to lie. An erotic love scene between two women uses face-swapping to depict a moment of consensual queer intimacy.
An original data set was created aligned with their message that "open data sets are not inherently free of problematic issues". To demonstrate the time, labour and resources required when data isn't "free and just there for the taking", a source subject was shot over five days in Mexico City, art directed scenes with a body double and captured facial data.
Who created the deepfake?
Artists Dejha Ti and Ania Catherine
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
AI
Computer Vision
Machine Learning
Deep Learning
Year :
2022
Deepfake technology allows anyone to dance like a pro
Deepfake technology allows anyone to dance like a pro
Researches created a program that copies dance moves of one person and 'gifts' them to another by making it look as if they can dance using neural-networking software.
It took several months for the team to map the face of one person to the entire body of another. The video shows the original source performing and then various other shots of people never actually doing what they have done but performing perfectly thanks to deepfake technology. The process captures two neural (generative adversarial) networks, videos of one person dancing and another video of someone moving. The first movement is mimicked by the second dancer and additional software is then used to refine the routine and ensure the face appears clear.
The UC Berkley researchers created a paper on "do as I do" motion transfer. They say the project 'hit a nerve with folks', especially disabled people, for example quadriplegics, who wanted to visually watch themselves move in ways they were unable to do physically. Due to a simple method producing compelling results, the researchers were motivated to provide a forensics tool for reliable synthetic content detection. Additionally they also released an open-source dataset of videos available to the public interested in motion transfer.
Who created the deepfake?
UC Berkeley researchers
Caroline Chan
Shiry Ginosar
Tinghui Zhou
Alexei Efros
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
File Footage
Motion transfer
Target subject performing
Spatio-temporal smoothing
Realistic face synthesis
Year :
2018
Obama warns people to not believe everything they see online via deepfake
Obama warns people to not believe everything they see online via deepfake
Close
Barack Obama has featured in a fake public service announcement made at the White House.
His message to viewers was not to believe everything seen and read on the internet. In it, he also bad-mouths Donald Trump.
BuzzFeed was the chosen PSA platform due to their extensive past reporting on fake news.
Who created the deepfake?
Jordan Peele
BuzzFeed CEO, Jonah Peretti
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Unknown
How was the deepfake created?
Deepfake Software
Video Editing
Adobe After Effects
FakeApp
Rendering over 56 hours of automatic processing
Year :
2018
.gif)
American journalist, Bill Whitaker, has explored the power of synthetic media as he watched himself transform to his younger self, 30 years prior.
Using video from the CBS news archives, a computer was trained to learn every aspect of the newsreader's face and wipe away the decades, even altering key aspects such as his moustache.
Who created the deepfake?
Chris Umé
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Visual Effects
Video Editing
Year :
2022
Documentary uses AI to mask faces of vulnerable subjects
Documentary uses AI to mask faces of vulnerable subjects
Close
A film about persecuted gay and lesbian Chechens has used digital manipulation to guard identities, whilst telling their story inside the Russian republic’s deadly war on their community.
Welcome to Chechnya is a Public Square Films production, directed by David France. Visual effects guru, Ryan Laney, digitally masked subjects using deepfake techniques but rather than manipulating someone to say something they didn't, victims could speak openly while borrowing someone else’s face. The filming took five days and nine Panasonic Lumix GH5 cameras with people performing a series of predetermined motions to capture lip shapes in various emotions.
France, who is concerned about the ethics of deepfakes said they would not deceive the audience or subjects and that all those involved had agreed and approved of the method used to tell their stories. The film made history by becoming the first documentary to make the Oscars’ visual effects shortlist. It was also selected to debut in competition at Sundance 2020. AI-generated media was used to allow viewers an insight into the raw emotion of the subjects, while still protecting their identities as well as revealing their vulnerability.
Who created the deepfake?
Ryan Laney
Public Square
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Visual Effects
Subtle Face Transfer Function
Year :
2020
Close
You’ve heard David Beckham speak in English — but have you ever heard him speak in Spanish? What about Kinyarwanda, Arabic, French, Hindi, Mandarin, Kiswahili and Yoruba? In a series of AI-generated videos, the soccer superstar speaks nine languages in a public appeal to end malaria.
Synthesia created the consensual video using synthesis technology to make Beckham appear multilingual. His speech begins in English, then transitions to eight other languages with convincing dubbing. The viewer hears the voices of real men and women from around the world.
The charity Malaria No More’s video seamlessly brings Beckham to life and reaches a major global audience, with the aim to educate and prevent the spread of the world's deadliest disease.
Who created the deepfake?
Synthesia
RG/A
Ridley Scott Associates
Malaria No More
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Special Effects
Synthesia
Year :
2019
American Journalist Bill Whitaker has demonstrated the reality of synthetic media during a 60 Minutes segment.
With eight minutes of script reading in front of a camera, the team at Synthesia captured Whitaker’s synthetic head and mannerisms whilst Descript used AI to create his synthetic voice.
The head, eyebrows, mouth and movement could trick anyone watching the clip. The segment explores various uses of artificial media, highlighting AI for good, as well as the magic of reality in the computerised clips.
Who created the deepfake?
Synthesia
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Descript
Synthesia
Year :
2021
Close
The parents of mass school shooting victim Joaquin Oliver launched an AI campaign, bringing him 'back to life' to encourage youth to vote and end gun violence.
Using deepfake technology, the video captures the spirit of Joaquin, who was murdered in the Parkland massacre. He speaks passionately and says despite being gone for two years, nothing has changed – people are still being killed by guns and Americans need to vote for change.
The Unfinished Votes Initiative calls for people to vote for those who were killed by gun violence, advocates for gun safety regulations and exposes the effects of mass shootings. Joe Biden responded saying his heart goes out to the Oliver family and that what they're doing matters. He urges people to defeat gun violence before it defeats us. The video had 2,200,000 views in 24 hours and in 2020 there were 1,290 gun sense politicians elected.
Who created the deepfake?
McCann Health and Oliver's family
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Year :
2020
Close
A group of Holocaust survivors have been able to live on to share their experiences during the war using deepfake technology.
The USC Shoah Foundation used cutting-edge solutions to preserve Holocaust testimonies. More than 2,000 questions were asked over a week of filming in order to provide answers for future generations.
Despite pushback from the project the 20 plus survivors aged 80 and above were keen to sign up and share their memories.
Who created the deepfake?
USC Shoah Foundation
Partnership on AI
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Year :
2021
Dutch police score leads in murder case with deepfake video
Dutch police score leads in murder case with deepfake video
Close
Dutch police used deepfake technology to bring a teenager back to life nearly two decades after his murder in the hope of gaining new leads.
With the consent of Sedar Soares’ family, the video shows the 13-year-old grab a football and ask the public to help solve the cold-case crime. He is seen walking through a guard of honour, passing relatives, former teachers and friends.
In what Dutch police said was a world first, deepfake technology has been used to help solve the 2003 shooting. They have received dozens of leads after sharing the video.
Who created the deepfake?
Dutch National Investigation Communication Team 'engaged one of the best deepfake makers in the world'
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Year :
2022
Close
Bloomberg has aired Tom Mackenzie’s avatar to introduce the news segment in English and fluent Spanish, a language he is yet to learn.
Sitting behind a breaking news screen, the realistic avatar welcomes his audience to the European market open on Friday morning. The only thing giving away Mackenzie's digital anchor is his co-host giggling about his voice, which was described as “smoother” than usual.
The segment explores the future of synthetic media, while showcasing Mackenzie’s English and Spanish-speaking skills.
Who created the deepfake?
Synthesia
Bloomberg
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Synthesia
Video Editing
Year :
2022
Close
Actor Michael York has had his voice cloned for an educational video to promote awareness of amyloidosis, a disease he suffers from.
The animated film helps people understand the rare condition but needed to be updated. About 10 years ago, York’s health condition impaired his iconic voice so the new audio wasn’t an effective match with the original narration, tone and cadence. Respeecher created an AI model to match the source voice with York’s target voice, using raw data from the animated film’s original recording session. The project has since been of wide-reaching service among conferences, universities, clinics, meetings, and communities worldwide.
The video shows that people who are no longer able to communicate will be able to do so using a voice synthesiser, which could even be controlled by their minds.
Who created the deepfake?
Respeecher
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Voice cloning
Year :
2014
Close
Mexican journalist Javier Valdez Cárdenas has been brought back to life with synthetic media three years after his death.
The deepfake was created by an organisation that supports threatened journalists and their families in Mexico, where speaking out about certain subjects puts a target on your head. Agencias Publicis carried out the project based on an old interview with Valdez using an AI technique based on synthesizing the human image by superimposing computer-generated images.
The video was part of a larger campaign called #SeguimosHablando, a call for an end to state-backed violence against the press. Valdez was reanimated with consent from his widow, a fellow journalist, in order to demand justice about press freedoms.
Who created the deepfake?
Propuesta Civica
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Year :
2020
Dove has released a hard-hitting film using deepfake technology to demonstrate the toxic beauty advice that teens come across on social media.
‘Toxic Influence’ features various mother-daughter duos engaging in conversations about the beauty advice that is prevalent on apps such as Instagram. The film uses face-mapping tech to make the mothers say what some influencers say about botox and dieting. The mothers become distressed as they watch themselves say something that never happened whilst the young women admit they see this content often online.
Immediately the film went viral on three continents. In 10 days the campaign achieved 13.6 million views. It's currently on pace to become Dove’s most viewed and most successful purpose-led campaign in history. It won gold at Cannes Lions International Festival of Creativity.
Who created the deepfake?
Dove
Hogarth Worldwide
Synthesia
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Synthesia
Video Editing
Year :
2022