Google previews Document AI for parsing forms: Just a catch-up with AWS and Azure?

Convert a jumble of documents into neatly structured data - if you are lucky


Google Cloud Platform is previewing Document AI, a new service for automatic extraction of data from documents, such as key/value pairs in forms, with a choice of parsers and an option to use a custom model.

The thinking behind Document AI is that businesses handle thousands of documents, many of which contain structured or semi-structured data but in different formats, and that there is benefit in extracting structured data from them so it can be processed and analysed.

This includes converting data into a standard form, so that synonyms like “last name” “surname” and “family name” are treated as representing the same thing. “We take your unstructured documents across a variety of formats and turn them into cleanly structured data,” is the pitch.

Parsing an invoice in Document AI: what happened to the invoice line called Package? The service is not so good with this kind of elaborate layout.

Parsing an invoice in Document AI: what happened to the invoice line called Package? The service is not so good with this kind of elaborate layout

Parts of this have already been previewed, but the new piece – introduced yesterday – is a unified API that enables developers to process documents using a variety of different parsers or “processors”. The API is REST or gRPC, wrapped by client libraries for Java, Node.js or Python.

Available processors cover OCR (optical character recognition), generic forms, generic tables, and document splitter which “uses machine learning to separate documents on logical boundaries,” such as breaking a collection of scanned documents into logical paragraphs and pages. There are also special parsers for invoices, receipts, lending documents, a US Uniform Residential Loan application, and several US federal tax forms.

Developers and data scientists can also build their own custom Auto ML Natural Language model to parse and analyse documents. This approach is the most powerful, enabling such things as identifying entities and assessing attitudes within documents.

AutoML Natural Language models are not new, but the integration into Document API is the part that is now in beta. That said, both table parsing and AutoML are marked with a no entry sign in the docs, indicating a closed beta, and some other features, including document splitter, are “limited access” which means pre-approval by Google is required.

How well does it work?

The design of the document makes a big difference. If it is plain and straightforward in its layout the chances of accurate parsing are good, but if it has a more elaborate layout, the parser can get confused. We tried the invoice parser on an old invoice with fair results, but the parser did for some reason ignore one of the invoice lines, and also decided that a couple of lines of marketing on the invoice were structured data to be extracted, extracting a key called “Cheaper calls to friends,” for example.

The service did better on a plainer invoice, where it successfully read a line called VAT Registration No and parsed it as supplier_tax_id, exactly the kind of intelligent parsing that is useful.

Document AI could save a huge amount of manual effort, but some human checking also looks necessary. This is especially true for scanned documents which might be smudged or dirty.

Google is sensitive to worries about confidentiality and said that after processing on its service “the stored document is typically deleted right after the processing is done.”

The company added that “Google also temporarily logs some metadata about your Document AI API requests …to improve our service and combat abuse.” The data, said Google, is not used to train and improve the Document AI machine learning model.

Prices vary, but the form parser for example costs $65 per 1,000 pages, and the Document OCR processor costs £1.50 per 1,000 pages.

Finally, note that AWS has a similar service called Textract, while Microsoft Azure has an “AI-powered document extraction service” called Form Recognizer, so it looks like there is an element of catch-up in Google Cloud’s latest move. ®

Similar topics

Broader topics


Other stories you might like

  • Google has more reasons why it doesn't like antitrust law that affects Google
    It'll ruin Gmail, claims web ads giant

    Google has a fresh list of reasons why it opposes tech antitrust legislation making its way through Congress but, like others who've expressed discontent, the ad giant's complaints leave out mention of portions of the proposed law that address said gripes.

    The law bill in question is S.2992, the Senate version of the American Innovation and Choice Online Act (AICOA), which is closer than ever to getting votes in the House and Senate, which could see it advanced to President Biden's desk.

    AICOA prohibits tech companies above a certain size from favoring their own products and services over their competitors. It applies to businesses considered "critical trading partners," meaning the company controls access to a platform through which business users reach their customers. Google, Apple, Amazon, and Meta in one way or another seemingly fall under the scope of this US legislation. 

    Continue reading
  • Makers of ad blockers and browser privacy extensions fear the end is near
    Overhaul of Chrome add-ons set for January, Google says it's for all our own good

    Special report Seven months from now, assuming all goes as planned, Google Chrome will drop support for its legacy extension platform, known as Manifest v2 (Mv2). This is significant if you use a browser extension to, for instance, filter out certain kinds of content and safeguard your privacy.

    Google's Chrome Web Store is supposed to stop accepting Mv2 extension submissions sometime this month. As of January 2023, Chrome will stop running extensions created using Mv2, with limited exceptions for enterprise versions of Chrome operating under corporate policy. And by June 2023, even enterprise versions of Chrome will prevent Mv2 extensions from running.

    The anticipated result will be fewer extensions and less innovation, according to several extension developers.

    Continue reading
  • I was fired for blowing the whistle on cult's status in Google unit, says contractor
    The internet giant, a doomsday religious sect, and a lawsuit in Silicon Valley

    A former Google video producer has sued the internet giant alleging he was unfairly fired for blowing the whistle on a religious sect that had all but taken over his business unit. 

    The lawsuit demands a jury trial and financial restitution for "religious discrimination, wrongful termination, retaliation and related causes of action." It alleges Peter Lubbers, director of the Google Developer Studio (GDS) film group in which 34-year-old plaintiff Kevin Lloyd worked, is not only a member of The Fellowship of Friends, the exec was influential in growing the studio into a team that, in essence, funneled money back to the fellowship.

    In his complaint [PDF], filed in a California Superior Court in Silicon Valley, Lloyd lays down a case that he was fired for expressing concerns over the fellowship's influence at Google, specifically in the GDS. When these concerns were reported to a manager, Lloyd was told to drop the issue or risk losing his job, it is claimed. 

    Continue reading
  • UK competition watchdog seeks to make mobile browsers, cloud gaming and payments more competitive
    Investigation could help end WebKit monoculture on iOS devices

    The United Kingdom's Competition and Markets Authority (CMA) on Friday said it intends to launch an investigation of Apple's and Google's market power with respect to mobile browsers and cloud gaming, and to take enforcement action against Google for its app store payment practices.

    "When it comes to how people use mobile phones, Apple and Google hold all the cards," said Andrea Coscelli, Chief Executive of the CMA, in a statement. "As good as many of their services and products are, their strong grip on mobile ecosystems allows them to shut out competitors, holding back the British tech sector and limiting choice."

    The decision to open a formal investigation follows the CMA's year-long study of the mobile ecosystem. The competition watchdog's findings have been published in a report that concludes Apple and Google have a duopoly that limits competition.

    Continue reading
  • End of the road for biz living off free G Suite legacy edition
    Firms accustomed to freebies miffed that web giant's largess doesn't last

    After offering free G Suite apps for more than a decade, Google next week plans to discontinue its legacy service – which hasn't been offered to new customers since 2012 – and force business users to transition to a paid subscription for the service's successor, Google Workspace.

    "For businesses, the G Suite legacy free edition will no longer be available after June 27, 2022," Google explains in its support document. "Your account will be automatically transitioned to a paid Google Workspace subscription where we continue to deliver new capabilities to help businesses transform the way they work."

    Small business owners who have relied on the G Suite legacy free edition aren't thrilled that they will have to pay for Workspace or migrate to a rival like Microsoft, which happens to be actively encouraging defectors. As noted by The New York Times on Monday, the approaching deadline has elicited complaints from small firms that bet on Google's cloud productivity apps in the 2006-2012 period and have enjoyed the lack of billing since then.

    Continue reading
  • Google offers $118m to settle gender discrimination lawsuit
    Don't even think about putting LaMDA on the compensation committee

    Google has promised to cough up $118 million to settle a years-long gender-discrimination class-action lawsuit that alleged the internet giant unfairly pays men more than women.

    The case, launched in 2017, was led by three women, Kelly Ellis, Holly Pease, and Kelli Wisuri, who filed a complaint alleging the search giant hires women in lower-paying positions compared to men despite them having the same qualifications. Female staff are also less likely to get promoted, it was claimed.

    Gender discrimination also exists within the same job tier, too, the complaint stated. Google was accused of paying women less than their male counterparts despite them doing the same work. The lawsuit was later upgraded to a class-action status when a fourth woman, Heidi Lamar, joined as a plaintiff. The class is said to cover more than 15,000 people.

    Continue reading

Biting the hand that feeds IT © 1998–2022