UK.gov must sort out its crap data and legacy IT, warns spending watchdog

Never mind the robotics and AI bullsh*t


Government plans to throw money at automation and AI to develop public services risk "magnifying" problems around data quality residing in its own legacy systems, the National Audit Office has warned.

In its report today, Challenges of Using Data Across Government (PDF), the spending watchdog noted the government uses data to make millions of decisions every day, from checking border crossings to paying benefits and pensions.

Approximately three billion transactions take place each year, with the British government receiving or paying out at least £900bn through these interactions, it said.

However, it said the quality and availability of data in informing decisions remains a serious issue. In March, the Public Accounts Committee found the Home Office is making life-changing decisions using "incorrect data from systems that are not fit for purpose" and has not fixed the "appalling defects" identified during the Windrush scandal.

The report noted UK.gov is exploring the use of new technology such as robotic process automation and "artificial intelligence" in developing public services.

"However, layering new technology on top of existing data carries a significant risk of magnifying rather than overcoming the problems associated with data quality, for example if calculations cannot be adequately tested," it said.

Most of the government's data resides in its legacy systems, it noted.

"Departments have historically developed IT to support specific policy objectives. Even within the same department, data cannot be extracted or shared easily."

Some government departments have not always prioritised replacing older technology, it said, adding that "until they do so there will be ongoing costs and inefficiencies in decision-making."

The NAO previously found the Department for Work and Pensions had to use manual intervention when using data matching tools to help detect incorrect payments of Carer's Allowance.

"The newer systems provide more timely and accurate data matches, but the underlying data does not provide all the information that DWP needs, such as length of employment or allowable expenses. Officials looking at these matches therefore need to validate the carer’s circumstances manually and a shortage of staff to do this led to significant backlogs of cases."

It said often departments will produce a new customer interface, for example rolling out the online application for the state pension, without fundamentally reconsidering what data their department needs and whether their current data remains fit for purpose.

"In our report, Digital transformation in government, we reported that 17 of the government's 'Exemplar' programmes largely redesigned the user interface online and linked it to a pre-existing system."

Gareth Davies, head of the NAO, said in the issue is systemic across departments. "Government has lacked clear and sustained strategic leadership on data, and individual departments have not made enough effort to manage and improve the data they hold." ®

Similar topics


Other stories you might like

  • Heart FM's borkfast show – a fine way to start your day

    Jamie and Amanda have a new co-presenter to contend with

    There can be few things worse than Microsoft Windows elbowing itself into a presenting partnership, as seen in this digital signage for the Heart breakfast show.

    For those unfamiliar with the station, Heart is a UK national broadcaster with Global as its parent. It currently consists of a dozen or so regional stations with a number of shows broadcast nationally. Including a perky breakfast show featuring former Live and Kicking presenter Jamie Theakston and Britain's Got Talent judge, Amanda Holden.

    Continue reading
  • Think your phone is snooping on you? Hold my beer, says basic physics

    Information wants to be free, and it's making its escape

    Opinion Forget the Singularity. That modern myth where AI learns to improve itself in an exponential feedback loop towards evil godhood ain't gonna happen. Spacetime itself sets hard limits on how fast information can be gathered and processed, no matter how clever you are.

    What we should expect in its place is the robot panopticon, a relatively dumb system with near-divine powers of perception. That's something the same laws of physics that prevent the Godbot practically guarantee. The latest foreshadowing of mankind's fate? The Ethernet cable.

    By itself, last week's story of a researcher picking up and decoding the unintended wireless emissions of an Ethernet cable is mildly interesting. It was the most labby of lab-based demos, with every possible tweak applied to maximise the chances of it working. It's not even as if it's a new discovery. The effect and its security implications have been known since the Second World War, when Bell Labs demonstrated to the US Army that a wired teleprinter encoder called SIGTOT was vulnerable. It could be monitored at a distance and the unencrypted messages extracted by the radio pulses it gave off in operation.

    Continue reading
  • What do you mean you gave the boss THAT version of the report? Oh, ****ing ****balls

    Say what you mean

    NSFW Who, Me? Ever written that angry email and accidentally hit send instead of delete? Take a trip back to the 1990s equivalent with a slightly NSFW Who, Me?

    Our story, from "Matt", flings us back the best part of 30 years to an era when mobile telephones were the preserve of the young, upwardly mobile professionals and fixed lines ruled the roost for more than just your senior relatives.

    Back then, Matt was working for a UK-based fixed-line telephone operator. He was dealing with a telephone exchange which served a relatively large town. "I ran a reasonably ordinary, read-only command to interrogate a specific setting," he told us.

    Continue reading

Biting the hand that feeds IT © 1998–2021