Google explains new page rankings

Pigeons now more bomb resistant

Some sanity returned to Google 's page rankings last week, and the only damage incurred appears to be a few bruised egos. So we were surprised when Wired adopted a note of faux outrage (hey! that's our job) in its coverage of the new index.

"Geeks Aghast"! reported Paul Boutin: "The inevitable backlash finally appears to have hit the world's most popular search engine." An anonymous poster cited by the report declares that PigeonRank™" ... is dead."

Is it? Perhaps not: by the end of the first page the report tentatively admits "In fact, it may just be bloggers who are bothered," and on page two, the web developer who on page one describes the new index as "seriously degraded" after his own online journal fell from first to sixth in the Google rankings, admits the old index was "probably not fair." So this appears to be a case of over-enthusiastic sub-editing.

In fact, the new index corrects one of the weirder skews prompted by the explosion of online journals (And surely no one calls them blogs anymore … that's soooo 2001).

The effect was to bump obscure but densely-linked sites high in the rankings. When deployed to a particular effect, it's called "Google bombing", but even determined hyperlinkers could benefit. With the latest redeployment of Google's pigeons, this skew appears to be mitigated.

Not everyone who was flattered by the rankings is taking it hard.

"Amazing what people get upset about," noted Dave Winer, who was no longer the world's number one Dave. "I still think this is ridiculous, I rank higher than The Dave Matthews Band. Hello. They're famous."

"When people say they're taking food out of their family's mouth, I think they should get a real job. Depending on the vagaries of an algorithm programmed by engineers at a VC-backed Silicon Valley dotcom-vestigial company is not a good idea."

Well, quite.

Not that Google itself will shed much light on the specifics of the new algorithms. When we caught up with Google software engineer Matt Cutts (and not Cutz, as we wrote) yesterday, he denied that this month's index was a specific reaction to the Blog Skew:

"We're always trying to improve the quality of the index - this is not a reaction to a particular search," he told us.

"Google loves the weblogging community, because it creates useful content and helps us categorize the web. Webloggers produce great content."

The scoring improvements, said Cutts, are both qualitative and quantitative.

"We're always trying new experiments and this was a natural extension of that; we have human evaluators who test each index. Things have to score higher before we push a new index out."

Cutts reckoned that "fad" of Google bombing had all but died out: "You don't see may people doing it all: a lot of the time people write news stories, and when you search for a particular 'bomb' the stories rank higher."

We wondered if there was any cross-pollination between the Usenet trust metrics and the Web algorithms. Would a high score for Kibo, the humorist who made his reputation on net news, feed into Kibo's web ranking?

Cutts said it was an interesting idea.

"If you were searching for information on an intricate part of the Linux kernel you'd love to see a post by Linus on the term come up first," he said. "We're always looking to find a better trust metric."

And ideally, Google would have one search box:

"Realistically we'd like to have one place to search where you don't have to have tabs for each category: web, Usenet, news."

Cutts shed some light on Google's news service:

"It's a combination of PageRank - how many sources are writing about a story, and how recent they are." Google examines over 4,000 news sources, he said, and is constantly revisiting and rechecking them.

We wondered - purely out of self-interest, of course - how the News search could track a story that develops.

"A much larger portion of the web than anyone could guess is duplicates, and it's not just the 5,000 pages of Linux man page and duplicate sites. We've actually had to come up with a lot of different algorithms: not just hard matches, but soft matches."

Obviously dozens of sources republish the same wire content, and much of that doesn't need to be presented in the search results, he said.

Google is erroneously seen as a truth machine, but there's something it can't do very much about: it only captures public discourse. On private email lists, in IM rooms, in irc channels and on closed CIX conferences, for example, the robots don't venture.

"There's always going to be places we can't go," agrees Cutts. That's only a problem if you view Google as an opinion pollster, though: when the signal to noise ratio in public gets too high, or where's there's too much prattle, we go behind closed doors.

Curiously enough, it was this factor and the Blog Skew that prompted me to call Google a couple of weeks ago. Buzz Aldrin had just been cleared of an assault charge for striking a fruitcake who believes the moon landings had been faked, and I wondered how long it would be before a search for Buzz Aldrin began to return entries from the lunatic fringe.

And one of my favorite b-bl-bl journals (an antidote to the armchair pugilists Governor Ventura calls 'Chickenhawks') had grabbed top spot in Google's page rank for "Demosthenes". Which as the author readily admitted was absurd, and not very helpful if you were doing a school project on ancient Greece.

But Google indicated to world+dog that it was aware of the problem with its new index, last week. For which we ought to thank columnist Jon Udell, perhaps - he says he buttonholed Sergey Brin about the skew recently.

The first reference to the Greek Demosthenes only appears at No.3 in the current index - so Google hasn't entirely fixed the skew yet. But it is improving. ®

Other stories you might like

  • FTC urged to protect data privacy of women visiting abortion clinics
    As Supreme Court set to overturn Roe v Wade, safeguards on location info now more vital than ever

    Democrat senators have urged America's Federal Trade Commission to do something to protect the privacy of women after it emerged details of visits to abortion clinics were being sold by data brokers.

    Women's healthcare is an especially thorny issue right now after the Supreme Court voted in a leaked draft majority opinion to overturn Roe v Wade, a landmark ruling that declared women's rights to have an abortion are protected by the Fourteenth Amendment of the US Constitution.

    If the nation's top judges indeed vote to strike down that 1973 decision, individual states, at least, can set their own laws governing women's reproductive rights. Thirteen states already have so-called "trigger laws" in place prohibiting abortions – mostly with exceptions in certain conditions, such as if the pregnancy or childbirth endangers the mother's life – that will go into effect if Roe v Wade is torn up. People living in those states would, in theory, have to travel to another state where abortion is legal to carry out the procedure lawfully, although laws are also planned to ban that.

    Continue reading
  • Zuckerberg sued for alleged role in Cambridge Analytica data-slurp scandal
    I can prove CEO was 'personally involved in Facebook’s failure to protect privacy', DC AG insists

    Cambridge Analytica is back to haunt Mark Zuckerberg: Washington DC's Attorney General filed a lawsuit today directly accusing the Meta CEO of personal involvement in the abuses that led to the data-slurping scandal. 

    DC AG Karl Racine filed [PDF] the civil suit on Monday morning, saying his office's investigations found ample evidence Zuck could be held responsible for that 2018 cluster-fsck. For those who've put it out of mind, UK-based Cambridge Analytica harvested tens of millions of people's info via a third-party Facebook app, revealing a – at best – somewhat slipshod handling of netizens' privacy by the US tech giant.

    That year, Racine sued Facebook, claiming the social network was well aware of the analytics firm's antics yet failed to do anything meaningful until the data harvesting was covered by mainstream media. Facebook repeatedly stymied document production attempts, Racine claimed, and the paperwork it eventually handed over painted a trail he said led directly to Zuck. 

    Continue reading
  • Florida's content-moderation law kept on ice, likely unconstitutional, court says
    So cool you're into free speech because that includes taking down misinformation

    While the US Supreme Court considers an emergency petition to reinstate a preliminary injunction against Texas' social media law HB 20, the US Eleventh Circuit Court of Appeals on Monday partially upheld a similar injunction against Florida's social media law, SB 7072.

    Both Florida and Texas last year passed laws that impose content moderation restrictions, editorial disclosure obligations, and user-data access requirements on large online social networks. The Republican governors of both states justified the laws by claiming that social media sites have been trying to censor conservative voices, an allegation that has not been supported by evidence.

    Multiple studies addressing this issue say right-wing folk aren't being censored. They have found that social media sites try to take down or block misinformation, which researchers say is more common from right-leaning sources.

    Continue reading
  • US-APAC trade deal leaves out Taiwan, military defense not ruled out
    All fun and games until the chip factories are in the crosshairs

    US President Joe Biden has heralded an Indo-Pacific trade deal signed by several nations that do not include Taiwan. At the same time, Biden warned China that America would help defend Taiwan from attack; it is home to a critical slice of the global chip industry, after all. 

    The agreement, known as the Indo-Pacific Economic Framework (IPEF), is still in its infancy, with today's announcement enabling the United States and the other 12 participating countries to begin negotiating "rules of the road that ensure [US businesses] can compete in the Indo-Pacific," the White House said. 

    Along with America, other IPEF signatories are Australia, Brunei, India, Indonesia, Japan, South Korea, Malaysia, New Zealand, the Philippines, Singapore, Thailand and Vietnam. Combined, the White House said, the 13 countries participating in the IPEF make up 40 percent of the global economy. 

    Continue reading
  • 381,000-plus Kubernetes API servers 'exposed to internet'
    Firewall isn't a made-up word from the Hackers movie, people

    A large number of servers running the Kubernetes API have been left exposed to the internet, which is not great: they're potentially vulnerable to abuse.

    Nonprofit security organization The Shadowserver Foundation recently scanned 454,729 systems hosting the popular open-source platform for managing and orchestrating containers, finding that more than 381,645 – or about 84 percent – are accessible via the internet to varying degrees thus providing a cracked door into a corporate network.

    "While this does not mean that these instances are fully open or vulnerable to an attack, it is likely that this level of access was not intended and these instances are an unnecessarily exposed attack surface," Shadowserver's team stressed in a write-up. "They also allow for information leakage on version and build."

    Continue reading
  • A peek into Gigabyte's GPU Arm for AI, HPC shops
    High-performance platform choices are going beyond the ubiquitous x86 standard

    Arm-based servers continue to gain momentum with Gigabyte Technology introducing a system based on Ampere's Altra processors paired with Nvidia A100 GPUs, aimed at demanding workloads such as AI training and high-performance compute (HPC) applications.

    The G492-PD0 runs either an Ampere Altra or Altra Max processor, the latter delivering 128 64-bit cores that are compatible with the Armv8.2 architecture.

    It supports 16 DDR4 DIMM slots, which would be enough space for up to 4TB of memory if all slots were filled with 256GB memory modules. The chassis also has space for no fewer than eight Nvidia A100 GPUs, which would make for a costly but very powerful system for those workloads that benefit from GPU acceleration.

    Continue reading
  • GitLab version 15 goes big on visibility and observability
    GitOps fans can take a spin on the free tier for pull-based deployment

    One-stop DevOps shop GitLab has announced version 15 of its platform, hot on the heels of pull-based GitOps turning up on the platform's free tier.

    Version 15.0 marks the arrival of GitLab's next major iteration and attention this time around has turned to visibility and observability – hardly surprising considering the acquisition of OpsTrace as 2021 drew to a close, as well as workflow automation, security and compliance.

    GitLab puts out monthly releases –  hitting 15.1 on June 22 –  and we spoke to the company's senior director of Product, Kenny Johnston, at the recent Kubecon EU event, about what will be added to version 15 as time goes by. During a chat with the company's senior director of Product, Kenny Johnston, at the recent Kubecon EU event, The Register was told that this was more where dollars were being invested into the product.

    Continue reading
  • To multicloud, or not: Former PayPal head of engineering weighs in
    Not everyone needs it, but those who do need to consider 3 things, says Asim Razzaq

    The push is on to get every enterprise thinking they're missing out on the next big thing if they don't adopt a multicloud strategy.

    That shove in the multicloud direction appears to be working. More than 75 percent of businesses are now using multiple cloud providers, according to Gartner. That includes some big companies, like Boeing, which recently chose to spread its bets across AWS, Google Cloud and Azure as it continues to eliminate old legacy systems. 

    There are plenty of reasons to choose to go with multiple cloud providers, but Asim Razzaq, CEO and founder at cloud cost management company Yotascale, told The Register that choosing whether or not to invest in a multicloud architecture all comes down to three things: How many different compute needs a business has, budget, and the need for redundancy. 

    Continue reading

Biting the hand that feeds IT © 1998–2022