Uncle Sam wants to tackle bias in algorithms by ordering tech corps to explain how their machines really work

New bill grants the FTC powers to investigate companies


US senators introduced a bill on Wednesday that will allow the Federal Trade Commission to inspect if corporations are using algorithms that are biased, discriminatory, and insecure.

The bill, known as the Algorithmic Accountability Act of 2019, was backed by Senator Ron Wyden (D-OR), Senator Cory Booker (D-NJ), and Representative Yvette Clarke (D-NY).

The Algorithmic Accountability Act is focused on regulating “automated decision systems”. Congress has considers these systems as more of a “computational process,” used to help companies make decisions that directly impact consumers. The systems are built on techniques in machine learning, statistics or AI.

Tackling bias and discrimination is a hot subject in AI. Researchers have already shown that commercial facial recognition systems struggle more when trying to identify women and people of color. Experts in the AI community have urged the government to take a stronger approach to regulating tech companies, and it looks like the US government is slowly starting to take notice.

Wyden explained that these systems could potentially have a great impact on people’s lives if they were involved in determining things like loans, jobs, or recidivism.

“Computers are increasingly involved in the most important decisions affecting Americans’ lives –whether or not someone can buy a home, get a job or even go to jail," he said. "But instead of eliminating bias, too often these algorithms depend on biased assumptions or data that can actually reinforce discrimination against women and people of color.”

Under the act, corporations will have to submit impact assessments to FTC officials. These reports have to address the accuracy, fairness, bias, discrimination, privacy and security issues of any automated decision systems being deployed.

Companies will have to show how the system was built and designed, what kind of data was used to train it, and what it’s being used for. They also have to evaluate how beneficial it really is to customers, by considering the sensitivity of the information being used by the systems to make decisions and how that data is stored and used. Any potential risks that a consumer might face if these systems are inaccurate, unfair or biased have to be discussed as well.

doctor

Not so fast AI Doctor, the FDA would like to check how good you really are at healthcare

READ MORE

“Algorithms shouldn’t have an exemption from our anti-discrimination laws,” Clarke said in a statement.

“Our bill recognizes that algorithms have authors, and without diligent oversight, they can reflect the biases of those behind the keyboard. By requiring large companies to not turn a blind eye towards unintended impacts of their automated systems, the Algorithmic Accountability Act ensures 21st Century technologies are tools of empowerment, rather than marginalization, while also bolstering the security and privacy of all consumers.”

The bill explicitly targets giant tech conglomerates like Facebook or Google. All companies that reap in more than $50m in gross annual income, have more than a million consumers, and collect personal information on their users will have to submit detailed risk assessments to the FTC. These reports can be released to the public if the corporation chooses to be more transparent, there is no obligation to do so.

If the report is found to be unfair or deceptive, the FTC has the right to conduct its own investigation to uncover any information that has been withheld by companies. Under the Federal Trade Commission Act, the FTC can issue subpoenas to collect documents or evidence from people related to the investigation. ®

Broader topics


Other stories you might like

  • DuckDuckGo tries to explain why its browsers won't block Microsoft ad trackers
    Meanwhile, Tails 5.0 users told to stop what they're doing over Firefox flaw

    DuckDuckGo promises privacy to users of its Android, iOS browsers, and macOS browsers – yet it allows certain data to flow from third-party websites to Microsoft-owned services.

    Security researcher Zach Edwards recently conducted an audit of DuckDuckGo's mobile browsers and found that, contrary to expectations, they do not block Meta's Workplace domain, for example, from sending information to Microsoft's Bing and LinkedIn domains. Specifically, DuckDuckGo's software didn't stop Microsoft's trackers on the Workplace page from blabbing information about the user to Bing and LinkedIn for tailored advertising purposes. Other trackers, such as Google's, are blocked.

    "I tested the DuckDuckGo so-called private browser for both iOS and Android, yet neither version blocked data transfers to Microsoft's Linkedin + Bing ads while viewing Facebook's workplace[.]com homepage," Edwards explained in a Twitter thread.

    Continue reading
  • Despite 'key' partnership with AWS, Meta taps up Microsoft Azure for AI work
    Someone got Zuck'd

    Meta’s AI business unit set up shop in Microsoft Azure this week and announced a strategic partnership it says will advance PyTorch development on the public cloud.

    The deal [PDF] will see Mark Zuckerberg’s umbrella company deploy machine-learning workloads on thousands of Nvidia GPUs running in Azure. While a win for Microsoft, the partnership calls in to question just how strong Meta’s commitment to Amazon Web Services (AWS) really is.

    Back in those long-gone days of December, Meta named AWS as its “key long-term strategic cloud provider." As part of that, Meta promised that if it bought any companies that used AWS, it would continue to support their use of Amazon's cloud, rather than force them off into its own private datacenters. The pact also included a vow to expand Meta’s consumption of Amazon’s cloud-based compute, storage, database, and security services.

    Continue reading
  • Atos pushes out HPC cloud services based on Nimbix tech
    Moore's Law got you down? Throw everything at the problem! Quantum, AI, cloud...

    IT services biz Atos has introduced a suite of cloud-based high-performance computing (HPC) services, based around technology gained from its purchase of cloud provider Nimbix last year.

    The Nimbix Supercomputing Suite is described by Atos as a set of flexible and secure HPC solutions available as a service. It includes access to HPC, AI, and quantum computing resources, according to the services company.

    In addition to the existing Nimbix HPC products, the updated portfolio includes a new federated supercomputing-as-a-service platform and a dedicated bare-metal service based on Atos BullSequana supercomputer hardware.

    Continue reading

Biting the hand that feeds IT © 1998–2022