Researchers from the Max Planck Institute for Informatics have defeated facial recognition on big social media platforms – by removing faces from photos and replacing them with automatically-painted replicas.
As the team of six researchers explained in their arXiv paper this month, people who want to stay private often blur their photos, not knowing that this is “surprisingly ineffective against state-of-the-art person recognisers.”
AI can beat blurring, but not the inpainting adversarial model
The researchers went a step further by constructing a realistic “fake face” that replaced the original image, but was perturbed enough to beat the AI while still looking “right” to a friend perusing the image.
As outlined in the paper, the researchers had to “factor the head inpainting task into two stages: landmark detection/generation and head inpainting conditioned on body context and landmarks”.
The result, the boffins claimed, is that their model can provide a realistic-looking result, even when it's faced with “challenging poses and scenarios” including different lighting conditions, such that the “fake” face “blends naturally into the context”.
In common with modern facial recognition systems, Sun's software builds a point cloud of landmarks captured from someone's face; its adversarial attack against recognition perturbed those points.
Pairs of points from the original landmarks (real) and the generated landmarks (fake) are fed into the “head generator and discriminator” software to create the inpainted face. ®