Police deny Notting Hill Carnival face recog tech led to wrongful arrest

Do we believe their PR or an anti-spytech activist?


The Metropolitan Police has denied that use of its dubious facial recognition technology at the Notting Hill Carnival in London led to someone being wrongfully arrested.

The Brit force's denial contradicts an observer who spoke to constables operating the facial recognition system on the day.

News reports suggested that police use of facial recognition technology during the event led to at least one mistaken arrest and a slew of false matches.

The Liberty pressure group, which has long campaigned against police surveillance tactics, secured access to the police facial recognition van during the controversial West London festival, which has become notorious in recent years thanks to violence and illegal drugs.

A blog post by the pressure group's policy officer for technology, Silkie Carlo, said that the Met had assembled a list of 500 people it was hoping to catch with its facial recognition system. Constables operating the system told her it had recorded around 35 false positives, with five of those people being stopped.

One person was arrested, according to Carlo, on the basis that there was an arrest warrant out for them – though they were released when constables realised that the suspect had already been arrested and released and was no longer wanted on a warrant. This appears to be a policing admin problem rather than a problem with the facial recognition system itself.

"Between the construction of their watch list and Carnival, that individual had already been arrested... So they were sent on their way, after an unnecessary but seriously hi-tech arrest," wrote Carlo.

The Met would only admit to The Register that one person was "identified" and "spoken to" but denied they were arrested.

"We have always maintained that it was a continued trial to test the technology and assess if it could assist police in identifying known offenders in large events, in order to protect the wider public," said a Met public relations operative who gave her name only as "Camilla".

"Whilst we are trialling this technology we have engaged with the Surveillance Camera Commissioner, the Information Commissioner, the Biometrics Commissioners, and Big Brother Watch. Liberty were invited to observe its use at the Carnival this year," added "Camilla".

Liberty's Carlo also noted that the cameras for the facial recognition system had been concealed from the public, so as not to draw attention to the fact that the system was in use. Regarding how one of the people who was flagged up as a false positive could find that out, she wrote: "How that could be possible, given the 'strategic' concealment of the cameras and the fact she was not informed of the false match or that her photo was taken, is baffling."

The Data Protection Act 1998 gives people a legal right to demand copies of information held about them, including CCTV images and related data. It is estimated that around two million people enter the general area of the annual carnival.

As we reported before the carnival, privacy activists and human rights campaign groups had written to Met Commissioner Cressida Dick, urging her not to use the controversial technology. Research has previously revealed the inaccuracy of facial recognition technology. Hundreds of thousands of mugshots, mostly of innocent people not convicted of any criminal offence, are used to feed the Met's face-matching database. ®

Similar topics


Other stories you might like

  • Clearview AI promises not to sell face-recognition database to most US businesses
    Caveats apply, your privacy may vary

    Clearview AI has promised to stop selling its controversial face-recognizing tech to most private US companies in a settlement proposed this week with the ACLU.

    The New-York-based startup made headlines in 2020 for scraping billions of images from people's public social media pages. These photographs were used to build a facial-recognition database system, allowing the biz to link future snaps of people to their past and current online profiles.

    Clearview's software can, for example, be shown a face from a CCTV still, and if it recognizes the person from its database, it can return not only the URLs to that person's social networking pages, from where they were first seen, but also copies that allow that person to be identified, traced, and contacted.

    Continue reading
  • Research finds data poisoning can't defeat facial recognition
    Someone can just code an antidote and you're back to square one

    If there was ever a reason to think data poisoning could fool facial-recognition software, a recently published paper showed that reasoning is bunk.

    Data poisoning software alters images by manipulating individual pixels to trick machine-learning systems. These changes are invisible to the naked eye, but if effective they make the tweaked pictures useless to facial-recognition tools – whatever is in the image can't be recognized. This could be useful for photos uploaded to the web, for example, to avoid recognition. It turns out, this code may not be that effective.

    Researchers at Stanford University, Oregon State University, and Google teamed up for a paper in which they single out two particular reasons why data poisoning won't keep people safe. First, the applications written to "poison" photographs are typically freely available online and can be studied to find ways to defeat them. Second, there's no reason to assume a poisoned photo will be effective against future recognition models.

    Continue reading
  • 1,000-plus AI-generated LinkedIn faces uncovered
    More than 70 businesses created fake profiles to close sales

    Two Stanford researchers have fallen down a LinkedIn rabbit hole, finding over 1,000 fake profiles using AI-generated faces at the bottom.

    Renée DiResta and Josh Goldstein from the Stanford Internet Observatory made the discovery after DiResta was messaged by a profile reported to belong to a "Keenan Ramsey". It looked like a normal software sales pitch at first glance, but upon further investigation, it became apparent that Ramsey was an entirely fictitious person.

    While the picture appeared to be a standard corporate headshot, it also included multiple red flags that point to it being an AI-generated face like those generated by websites like This Person Does Not Exist. DiResta was specifically tipped off by the alignment of Ramsey's eyes (the dead center of the photo), her earrings (she was only wearing one) and her hair, several bits of which blurred into the background. 

    Continue reading
  • Ukraine uses Clearview AI facial-recognition technology
    Controversial search engine being used to identify dead and Russian operatives

    The Ukrainian government is using facial recognition technology from startup Clearview AI to help them identify the dead, reveal Russian assailants, and combat misinformation from the Russian government and its allies.

    Reuters reported yesterday that the country's Ministry of Defense began using Clearview's search engine for faces over the weekend.

    The vendor offered free access to the search engine, which Ukraine is using for such tasks as identifying people of interest at checkpoints and identifying people killed during Russia's invasion, the news organization wrote, citing Lee Wolosky, who currently advises Clearview and formerly worked as a US diplomat under Presidents Barack Obama and Joe Biden.

    Continue reading
  • Face Off: IRS kills plan to verify taxpayers with facial recognition database
    Uncle Sam takes security, privacy concerns seriously, it says here

    Updated The Internal Revenue Service has abandoned its plan to verify the identities of US taxpayers using a private contractor's facial recognition technology after both Democrats and Republicans actively opposed the deal.

    US Senator Ron Wyden (D-OR) on Monday said Treasury Department officials informed his office that the agency has decided to move away from using the private facial recognition service ID.me to verify IRS.gov accounts.

    "The Treasury Department has made the smart decision to direct the IRS to transition away from using the controversial ID.me verification service, as I requested earlier today," Wyden said in a statement. "I understand the transition process may take time, but I appreciate that the administration recognizes that privacy and security are not mutually exclusive and no one should be forced to submit to facial recognition to access critical government services."

    Continue reading
  • IRS doesn't completely scrap facial recognition, just makes it optional
    But hey, new rules on deleting your selfies

    America's Internal Revenue Service has confirmed taxpayers will not be forced to use facial recognition to verify their identity. The agency also set out rules for which images will be deleted.

    Folks setting up an online IRS account will be given the choice of providing biometric data to an automated system, or speaking with a human agent in a video call, to authenticate. Those who are comfortable with facial recognition tech can upload a copy of their photo ID and then be authenticated by their selfie, and those who aren't can talk to someone to prove they are who they say they are. An online IRS account can be used to view tax documents and the status of payments among other things.

    "Taxpayers will have the option of verifying their identity during a live, virtual interview with agents; no biometric data – including facial recognition – will be required if taxpayers choose to authenticate their identity through a virtual interview," the IRS said in a statement on Monday.

    Continue reading
  • Sri Lanka to adopt India’s Aadhaar digital identity scheme
    Biometric IDs for all, cross-border interoperability not on the table

    Sri Lanka has decided to adopt a national digital identity framework based on biometric data and will ask India if it can implement that nation’s Aadhaar scheme.

    The island nation had previous indicated it would work with the Modular Open Source Identity Platform (MOSIP), an organisation based in India that offers tools governments can use to create and manage digital identities.

    But a list of Cabinet decisions published on Tuesday, Sri Lanka’s government announced its intention to ask India for a grant of its scheme, which has been widely interpreted as meaning India share Aadhaar technology.

    Continue reading

Biting the hand that feeds IT © 1998–2022