Some deepfake videos present a convincing pulse Alamy Stock Photo
Deepfake videos that feature digital manipulations of people鈥檚 facial expressions and voices can also depict realistic heartbeats, making them even harder to spot.
鈥淲e now know that just because a person in a video has a measurable pulse, it doesn鈥檛 mean that we can assume they are real,鈥 says at the University of California, Berkeley, who was not involved in the research.
Advertisement
This development comes as deepfakes that have been digitally altered or generated by artificial intelligence are ensnaring celebrities and ordinary people alike in convincing but false pornography, financial scams and political propaganda. Previously, researchers had experimented with spotting deepfakes by identifying changes in skin colour related to blood flow and heart rate, but this research shows that some deepfake videos can still present a passable pulse.
at the Fraunhofer Institute for Telecommunications in Germany and his colleagues developed a deepfake detector that could analyse the pulses of people in genuine and deepfake videos. They also filmed a new set of genuine videos featuring a dozen people鈥檚 facial expressions, while simultaneously recording participants’ heart rates so that they could verify the accuracy of their detector.
Then, the researchers inserted digitally altered faces into their genuine videos 鈥 a move that should have alerted their deepfake detector. Instead, they found that the detector perceived realistic pulses in both the fakes and the original videos.
Free newsletter
Sign up to The Weekly
The best of New 女生小视频, including long-reads, culture, podcasts and news, each week.

鈥淛ust because one or a few deepfake generators can reproduce this physiological signal, it doesn鈥檛 mean that all deepfake generators can,鈥 says Farid.
The team has already begun experimenting with new ways to spot deepfakes, such as identifying local blood flow patterns in people鈥檚 faces. But such methods may have a 鈥渓imited shelf life鈥, says of the University at Buffalo in New York who was not involved in the work. That鈥檚 because new generative AI tools can more convincingly mimic realistic heartbeats and other physiological signals, and it can be difficult to extract a heart rate signal from low-quality videos.
Instead, the most effective detection techniques attempt to identify more subtle differences between genuine and deepfake videos, such as image pixel brightness, that are 鈥渘on-intuitive to human viewers鈥, says Lyu.
Journal reference:
Frontiers in Imaging
Topics:



