Art
Deepfake technology allows anyone to dance like a pro
Researches created a program that copies dance moves of one person and 'gifts' them to another by making it look as if they can dance using neural-networking software.
It took several months for the team to map the face of one person to the entire body of another. The video shows the original source performing and then various other shots of people never actually doing what they have done but performing perfectly thanks to deepfake technology. The process captures two neural (generative adversarial) networks, videos of one person dancing and another video of someone moving. The first movement is mimicked by the second dancer and additional software is then used to refine the routine and ensure the face appears clear.
The UC Berkley researchers created a paper on "do as I do" motion transfer. They say the project 'hit a nerve with folks', especially disabled people, for example quadriplegics, who wanted to visually watch themselves move in ways they were unable to do physically. Due to a simple method producing compelling results, the researchers were motivated to provide a forensics tool for reliable synthetic content detection. Additionally they also released an open-source dataset of videos available to the public interested in motion transfer.
Who created the deepfake?
UC Berkeley researchers
Caroline Chan
Shiry Ginosar
Tinghui Zhou
Alexei Efros
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
File Footage
Motion transfer
Target subject performing
Spatio-temporal smoothing
Realistic face synthesis
Year :
2018
World's first fully AI-generated multiplot film
— SALT (@SALT_VERSE) June 14, 2022
A fully AI-generated filmverse, Salt, is a web6 internet adventure where community choices drive a multi-plot story to create a 1970s lo-fi sci-fi universe.
The science-fiction film complete with 35mm footage of space freighters and moody alien landscapes relies largely on artificial intelligence tools to create the series of short films released often on Twitter. A unique twist to the plot is the need for audience participation. Viewers can vote on what happens next, where the results are created with just a few clicks, quicker than any Hollywood filmmaker could muster.
The film is built using image-generation tools such as Stable Diffusion, Midjourney and DALL-E 2 as well as AI voice generation tools such as Synthesia and Murf. As time is of the essence, text-generator GPT-3 helps write the script.
Who created the deepfake?
Fabian Stelzer
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Special Effects
Midjourney
Synthesia
GPT-3
Stable Diffusion
Murf
DALL-E 2
Year :
2022
Keanu Reeves stops a robbery in extreme deepfake
Keanu Reeves has been caught on camera bravely stopping a robbery 'killing them with kindness' in a deepfake video.
The video has been watched nearly 17,000,000 times. The amount of effort put into creating this deepfake, or as the team called it "'digitising Keanu's essence" was immense. So much so the team behind it decided to showcase a behind the scenes clip which alone scored more than 3,000,000 views.
The entire production was filmed like it was "found footage" on a cellphone. They needed a Keanu Reeves impersonator but decided to try and use a cheapfake - meaning no artificial intelligence but instead very basic editing and recontextualising, so just a mask of Reeve's face was worn here. More than 200,030 iterations were used and over $250 dollars spent on this elaborate deepfake.
Who created the deepfake?
Corridor
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
No
How was the deepfake created?
Deepfake Software
Video Editing
Special Effects
Acting Cast
Impersonator
Faceswap
After Effects
Year :
2019
Keanu Reeves ‘deepfake’ fools millions online
@unreal_keanu Dressing up like a cool guy #reeves #keanu #dressup ♬ original sound - Unreal Keanu Reeves
A Keanu Reeves deepfake account on TikTok has gained more than 438 million views and six million followers but the account is totally comprised of deepfake videos of the Matrix star.
The videos of fake Keanu show him taking part in trends such as popular dances, odd tips and silly jokes and all clips exceed over one million views with some reaching up to nearly 40 million. Several social media users admit to not truly knowing the validity of the clip with one person saying: “POV: you’re checking the comments to figure out if it’s a look alike guy or some kind of face swap filter.”
Reeves has reportedly not had an active TikTok account since 2020 when it was deleted. The superstar has been quoted telling media that ‘privacy is important to him’. Celebrity lookalikes are very common when it comes to deepfake technology with a major increase when it comes to TikTok trends as we've recently seen with Margot Robbie and Tom Cruise.
Who created the deepfake?
@unreal_keanu
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Unknown
How was the deepfake created?
Deepfake Software
Video Editing
Year :
2022
Elvis 'brought back to life' in deepfake performance
The latest season of America's Got Talent saw Elvis Presley reborn back to the stage.
In a two-part finale, AI performance duo, Chris Ume and Tom Graham, deepfaked the King of Rock with judge Simon Cowell, who sung "You're The Devil In Disguise" and "Hound Dog" alongside a real-time deepfake with backup singers model, Heidi Klum and actress, Sofia Vergara. Elvis tribute singer, Emilio Santoro, donned an unbuttoned black shirt and golden suit jacket decked out in rhinestones fit for the King of Rock n’ Roll.
Metaphysic took to Instagram to showcase their gratitude. “What an absolute honor to have brought back The King, Elvis Presley, to sing once again,” the duo wrote via Instagram. The co-founders added, “We’re feeling very thankful that we were able to show so many of you the power of our super advanced AI tech tonight, and the tremendous joy it brings.” The YouTube video has gained more than one million views.
Who created the deepfake?
Metaphysic
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
No
How was the deepfake created?
Real-Time Artificial Intelligence
Impersonator
Deepfake Software
Year :
2022
A Paddington Bear sketch, celebrating the Platinum Jubilee, has left viewers baffled as they question whether the Queen was acting or if it was a deepfake.
The clip shows a clumsy Paddington bear join the Queen for afternoon tea. He offers her a marmalade sandwich from his iconic red hat but Her Majesty surprisingly pulls one from her own handbag where she keeps them saved for later.
The video has over 12 million views on YouTube where comments are disabled. Many took to social media to debate if the performance was fake. One Twitter user said: "Hope everyone realises that Paddington and The Queen video is CGI? Clearly a much younger woman, they should at least use an older actress as the basis to make it more believable. It’s fun and all, but not remotely plausible really." Another person commented saying: “I don’t know what’s more incredible: the CGI for Paddington Bear, or the deep fake of the Queen.”
Screenwriter Frank Cottrell-Boyce co-wrote the Paddington sketches as well as 007 and believes conspiracy theorists believed the clip was a deepfake and the monarch didn't star in it at all. He said he was 'grateful' for how her Majesty who reminded people 'we share something good'.
I know we give them a lot of grief on the TL but credit where credit is due: the UK has really nailed the whole resurrection by CGI trend based on the recent footage of the Queen I’ve seen. Hope Lucasfilm poaches whoever is responsible!
— 🏜🔋, fka ☕️ (@coopercooperco) June 4, 2022
the CGI here is crazy good cause on one side of the table you’ve got an undeniably real and not CGI, alive and fully functioning being, and on the other side is the queen https://t.co/nZ9FzrnqQ1
— Luke (@qLxke_) June 4, 2022
Year :
2022
AI turns black Ariel white in Little Mermaid causing outrage online
Gotta be honest, I figured our dystopian future would include horrors like deepfake revenge porn and AI bot catfishing, but I was not expecting "using AI to whitewash diverse movie characters."
— Max Kennerly (@MaxKennerly) September 13, 2022
I regret the error and I promise to be even more pessimistic going forward. pic.twitter.com/2cZi1fBfaB
An AI-generated video on the internet has transformed Halle Bailey into a white woman for The Little Mermaid.
Shortly after the trailer for the Disney film was released, a Twitter user claimed the clip had been “fixed” by transforming the black actress into a white person using AI software.
One user acknowledged artificial Intelligence scientist @TenGazillionIQ for ‘fixing’ The Little Mermaid, and turning the 'woke actor into a ginger white girl’. He also boasted that the whole movie could be ‘fixed’ with 4x A6000 in 24 hours. This came alongside claims it was ‘purely for educational purposes’ and not to be misinterpreted in a racist way. But the wider public strongly disagreed.
Twitter has since removed the tweet from social media after it caused outrage online with one person commenting "so you prefer the CGI uncanny valley. I prefer the woman with talent."
Welp, as it turns out, both @TenGazillionIQ and @vandalibm got suspended for the whole Little Mermaid 2023 'turned the woke actor into a ginger white girl' fiasco.
— 🏳️⚧️ PanzerThiefZero @ KR GEATS SPOILERS (@PanzerThiefZer0) September 13, 2022
You know guys, you were kinda asking to be suspended at this point for basically whitewashing a real human being. pic.twitter.com/1KOw3qttZj
Who created the deepfake?
TenGazillionIQ
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
No
How was the deepfake created?
Artificial Intelligence
Deepfake Software
Year :
2022
Emilia Clarke deepfaked as Rhaenyra Targaryen
Emilia Clarke has been deepfaked into House of the Dragon‘s Rhaenyra Targaryen.
The video face swaps the former Mother of Dragons with actress Milly Alcock and has gained close to 37,000 views and several comments of praise. It gives a sneak preview into what it would look like if Daenaryes Targaryen played the part of her six-generations-off grandmother through artificial technology. Rumours have suggested this may happen.
Who created the deepfake?
Stryder HD
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Unknown
How was the deepfake created?
Visual Effects
Deepfake Software
Video Editing
Year :
2022
Deepfake art demonstrates time and resources required when data isn't 'free'
Close
Two artists have used deepfake videos in a bid to encourage conversations about AV manipulation.
Soft Evidence shows events that never happened by machines trained to lie. An erotic love scene between two women uses face-swapping to depict a moment of consensual queer intimacy.
An original data set was created aligned with their message that "open data sets are not inherently free of problematic issues". To demonstrate the time, labour and resources required when data isn't "free and just there for the taking", a source subject was shot over five days in Mexico City, art directed scenes with a body double and captured facial data.
Who created the deepfake?
Artists Dejha Ti and Ania Catherine
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
AI
Computer Vision
Machine Learning
Deep Learning
Year :
2022
Kids deepfaked doing Donald Trump impressions
A group of various children have been deepfaked into Donald Trump.
In a very comical rendition, the kids impersonate the businessman by either saying or doing things Trump would.
The original footage is from Jimmy Kimmel Live as the segment explored the US president's popularity amongst kids after his first year in office.
Who created the deepfake?
DrFakenstein
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
No
How was the deepfake created?
Deepfake Software
Video Editing
VFX
Year :
2019
A man successfully convinced the world he was an AI creation when he is in fact a human being pretending to be fake.
People have been left baffled by artificial intelligence after a TikTok went viral claiming the user of a CGI-heavy account was actually an elaborate deepfake himself, played by an actor.
In the video, uploaded by Curt Skelton, he poses the question: "Will artificial intelligence replace the role of visual effects artists?" Shortly after he claims “it has,” then he is deepfaked into a woman who explains Skelton is a 'fake character' she made whilst convincingly detailing the procedure which included software such as DALL-E, DeepMotion.com and Deepfake Lab.
The hoax certainly caused chaos online with the video viewed nearly 18 million times and thousands of people commenting about their confusion and disbelief.
Year :
2022
Kendrick Lamar's music clip deepfakes Kanye and Will Smith
Close
Kendrick Lamar’s new music video for The Heart Part 5 has used deepfake technology in a powerful way to express his lyrics.
Throughout the video clip, he morphs into numerous celebrities when thematically appropriate. Whilst rapping about a “bulletproof rover”, he turns into OJ Simpson. On mentioning “bipolar disorder,” he transcends into Kanye West. Talking about “a land where hurt people hurt more people” Will Smith’s face appears.
The video gained 12 million views overnight and scored top spot on YouTube’s trending for music. It was created by South Park creators Matt Stone and Trey Parker, who enjoy exploring manipulated media as an art form.
Who created the deepfake?
Deep Voodoo
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
No
How was the deepfake created?
Deepfake Software
Video Editing
Year :
2022
Controversial deepfake on America's Got Talent gets thumbs up from Simon Cowell
A real-time, AI-generated performance of Simon Cowell, Howie Mandel and Terry Crews singing Nessun Dorma was shown on America's Got Talent.
Three professional singers stood in front of cameras which seamlessly swapped their faces out for the judges' faces.
Chris Ume wants to commercialise deepfake technology and make it readily available to anyone in the Metaverse. Some critics say that popularising deepfakes is dangerous, as they worry bad actors will use technology to spread lies and disinformation. Currently AI technology is minimally regulated, leaving it open to manipulation and exploitation by those with bad intent.
Who created the deepfake?
Metaphysic
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Real-Time Artificial Intelligence
Impersonator
Deepfake Software
Year :
2022
BBC drama uses deepfakes to explore future threats
Series two of BBC’s The Capture cleverly uses deepfake videos to highlight the reality of hacked news feeds, manipulated media, and interference in politics.
One episode of the disinformation drama shows hackers replacing a security minister with a deepfake clone during his live Newsnight interview - speaking deceptively and harmfully to the public. The producers highlight the threat to democracy from deepfake technology as well as the use of AI-generated video clones that can mislead or sway public opinion, after their increasing use in election campaigns and conflicts.
Producers worked alongside a counter-terrorism advisor to show the real manipulation of hacking camera feeds and live deepfakes on TV.
Who created the deepfake?
The BBC
Framestore
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Visual Effects
Deepfake Software
Video Editing
Digital Representation
Year :
2022
Digital recreation for Princess Leia in Star Wars Rogue One
Close
Ingvild Deila’s short performance as Princess Leia in Rogue One: A Star Wars Story has been recognised as iconic thanks to the power of synthetic media.
The actress was the human double playing 19-year-old Carrie Fisher as Princess Leia. Deila spent months studying Fisher’s facial expressions, analysed interviews and read her autobiography. The production took three days in a studio, including getting scanned by CGI experts from Industrial Light and Magic. To create her avatar, Deila had to mimic Fisher during the high-tech scan.
Ghost acting is a popular new art that allows younger people to “transform” their faces into that of another. Helping young actors build careers and improve storytelling through artificial intelligence in Hollywood is cost-effective and scalable.
Who created the deepfake?
Lucasfilm
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Video Editing
Visual Effects
Year :
2018
Dove highlights toxic beauty advice with deepfake
Dove has released a hard-hitting film using deepfake technology to demonstrate the toxic beauty advice that teens come across on social media.
‘Toxic Influence’ features various mother-daughter duos engaging in conversations about the beauty advice that is prevalent on apps such as Instagram. The film uses face-mapping tech to make the mothers say what some influencers say about botox and dieting. The mothers become distressed as they watch themselves say something that never happened whilst the young women admit they see this content often online.
Immediately the film went viral on three continents. In 10 days the campaign achieved 13.6 million views. It's currently on pace to become Dove’s most viewed and most successful purpose-led campaign in history. It won gold at Cannes Lions International Festival of Creativity.
Who created the deepfake?
Dove
Hogarth Worldwide
Synthesia
Was the content disclosed as a deepfake?
Yes
Was the deepfake consensual?
Yes
How was the deepfake created?
Deepfake Software
Synthesia
Video Editing
Year :
2022