Facebook dumps AWS, moves Instagram's images to own bit barns

Server count down by a third, says engineer, and Iowa data centre coming online now


Facebook has migrated Instagram's colossal collection of images out of Amazon Web Services and into its own bit barns.

News of the move comes in a Youtube interview (no longer available) with Facebook infrastructure engineer and Open Compute Foundation program development chap Charlie Manese conducted by Australian hyperscale compute appliance startup Infrx.

At about the 7:45 mark of the video, Manese says Instagram has moved onto Facebook infrastructure and now uses about a third fewer servers, “obviously reducing our costs from when we had it on the Amazon platform.”

Instagram accumulates 45 million new photos a day, he said, but that's dwarfed by the 300 million or so uploaded to Facebook each day. The Social NetworkTM also has handles six billion Likes and needs to make over 200 billion connections to ensure everything its users do show up on friends' timelines.

Menese also reveals that Facebook is “just starting to open” a new data centre in Iowa, adding to its Sweden facility and two others in the land of the free. The new Iowa facility is powered largely by wind, at a cost close to that of conventional energy sources.

Another nugget Menese reveals is that Facebook's Open Compute designs don't always deliver the same savings. Different workloads have different demands, he explains, so while power consumption is down everywhere, not everything Facebook does has generated the same 24 per cent server count reduction the company enjoys in its web server fleet.

Having said that, he also says “If we had to buy five or six times more servers I don't think Facebook would be where it is today”.

Facebook has doubtless built a rig tuned to Instagram's needs, so it is probably not reasonable to draw a conclusion that AWS can't keep up with the house of Zuckerberg's data centre skills. Having said that, AWS can't have enjoyed losing such a colossal client. That Facebook promotes Open Compute kit as a way to achieve hyperscale, on-premises or in the cloud, must also rankle as its open source designs create an ever-more compelling alternative. ®


Other stories you might like

  • How ICE became a $2.8b domestic surveillance agency
    Your US tax dollars at work

    The US Immigration and Customs Enforcement (ICE) agency has spent about $2.8 billion over the past 14 years on a massive surveillance "dragnet" that uses big data and facial-recognition technology to secretly spy on most Americans, according to a report from Georgetown Law's Center on Privacy and Technology.

    The research took two years and included "hundreds" of Freedom of Information Act requests, along with reviews of ICE's contracting and procurement records. It details how ICE surveillance spending jumped from about $71 million annually in 2008 to about $388 million per year as of 2021. The network it has purchased with this $2.8 billion means that "ICE now operates as a domestic surveillance agency" and its methods cross "legal and ethical lines," the report concludes.

    ICE did not respond to The Register's request for comment.

    Continue reading
  • Fully automated AI networks less than 5 years away, reckons Juniper CEO
    You robot kids, get off my LAN

    AI will completely automate the network within five years, Juniper CEO Rami Rahim boasted during the company’s Global Summit this week.

    “I truly believe that just as there is this need today for a self-driving automobile, the future is around a self-driving network where humans literally have to do nothing,” he said. “It's probably weird for people to hear the CEO of a networking company say that… but that's exactly what we should be wishing for.”

    Rahim believes AI-driven automation is the latest phase in computer networking’s evolution, which began with the rise of TCP/IP and the internet, was accelerated by faster and more efficient silicon, and then made manageable by advances in software.

    Continue reading
  • Pictured: Sagittarius A*, the supermassive black hole at the center of the Milky Way
    We speak to scientists involved in historic first snap – and no, this isn't the M87*

    Astronomers have captured a clear image of the gigantic supermassive black hole at the center of our galaxy for the first time.

    Sagittarius A*, or Sgr A* for short, is 27,000 light-years from Earth. Scientists knew for a while there was a mysterious object in the constellation of Sagittarius emitting strong radio waves, though it wasn't really discovered until the 1970s. Although astronomers managed to characterize some of the object's properties, experts weren't quite sure what exactly they were looking at.

    Years later, in 2020, the Nobel Prize in physics was awarded to a pair of scientists, who mathematically proved the object must be a supermassive black hole. Now, their work has been experimentally verified in the form of the first-ever snap of Sgr A*, captured by more than 300 researchers working across 80 institutions in the Event Horizon Telescope Collaboration. 

    Continue reading
  • Shopping for malware: $260 gets you a password stealer. $90 for a crypto-miner...
    We take a look at low, low subscription prices – not that we want to give anyone any ideas

    A Tor-hidden website dubbed the Eternity Project is offering a toolkit of malware, including ransomware, worms, and – coming soon – distributed denial-of-service programs, at low prices.

    According to researchers at cyber-intelligence outfit Cyble, the Eternity site's operators also have a channel on Telegram, where they provide videos detailing features and functions of the Windows malware. Once bought, it's up to the buyer how victims' computers are infected; we'll leave that to your imagination.

    The Telegram channel has about 500 subscribers, Team Cyble documented this week. Once someone decides to purchase of one or more of Eternity's malware components, they have the option to customize the final binary executable for whatever crimes they want to commit.

    Continue reading
  • Ukrainian crook jailed in US for selling thousands of stolen login credentials
    Touting info on 6,700 compromised systems will get you four years behind bars

    A Ukrainian man has been sentenced to four years in a US federal prison for selling on a dark-web marketplace stolen login credentials for more than 6,700 compromised servers.

    Glib Oleksandr Ivanov-Tolpintsev, 28, was arrested by Polish authorities in Korczowa, Poland, on October 3, 2020, and extradited to America. He pleaded guilty on February 22, and was sentenced on Thursday in a Florida federal district court. The court also ordered Ivanov-Tolpintsev, of Chernivtsi, Ukraine, to forfeit his ill-gotten gains of $82,648 from the credential theft scheme.

    The prosecution's documents [PDF] detail an unnamed, dark-web marketplace on which usernames and passwords along with personal data, including more than 330,000 dates of birth and social security numbers belonging to US residents, were bought and sold illegally.

    Continue reading

Biting the hand that feeds IT © 1998–2022