Smack-talking overflow: Mining developer sentiment to understand the most popular APIs

Boffins build search engine based on feelings expressed about programming interfaces

Developers looking for guidance about APIs may wish to try a search engine prototype called Opiner to assess how their peers feel about specific programming interfaces, based on a limited set of data pulled from Stack Overflow.

Opiner is a sentiment-based search engine. At present, it only knows about technologies associated with the terms JSON and Java. But it can tell you, for example, that about 64 per cent of developers have expressed positive opinions about MongoDB and about 36 per cent have disparaged it. And it aggregates Stack Overflow comments so searchers can review the specific statements people have made about the technology.

The project was developed by Gias Uddin when he was working on his doctorate at McGill University and his PhD advisor, Foutse Khomh, associate professor at Polytechnique Montréal. Uddin is currently a senior data scientist at the Bank of Canada and he also participated in past research about the security risks of code copied from Stack Overflow.

"Using Opiner, developers can search an API by name (e.g., Google GSON) and see all the opinions about the API collected from Stack Overflow in summarized form," Uddin explained in an email to The Register.

"In seven user studies involving both [professional] and novice software developers, we found that Opiner was effective to assist developers to complete diverse development tasks, such as API selection, usage, [and so on]."

The project draws on work to automatically mine the opinions expressed by Stack Overflow users about APIs and to automatically summarize those written reviews. It's described in a previously published research paper, Automatic Summarization of API Reviews.

Sorry Shutterstock image

Flak overflow: Barrage of criticism prompts very public Stack Overflow apology


In an interview with Stack Overflow, Khomh suggested Opiner can help bridge documentation gaps, because official documentation doesn't always tell developers how to use a given technology effectively. API documentation is often incomplete or missing, a problem Apple developers have been complaining about for years.

Asked about this, Uddin told The Register that the surveys conducted for his research "reveal that developers consider the API reviews in Stack Overflow as a form of API documentation, especially because the reviews offer insights from real-world usage of the APIs, which traditional documentation does not offer."

He pointed one developer who, in response to a survey question, said he seeks out APIs reviews "because those offer 'possibility to get an answer to a specific question (which may not be explained in other sources like the API's documentation).'"

Uddin said he has not spoken with Stack Overflow about improving Opiner further, but that remains a possibility. "I do have plans to expand this research beyond what we have," he said, noting his work obligations. "The major pending question has been the allocation of resources. Once that is addressed, the expansion will take place." ®

Other stories you might like

  • Infosys skips government meeting - and collecting government taxes
    Tax portal wobbles, again

    Services giant Infosys has had a difficult week, with one of its flagship projects wobbling and India's government continuing to pressure it over labor practices.

    The wobbly projext is India's portal for filing Goods and Services Tax returns. According to India’s Central Board of Indirect Taxes and Customs (CBIC), the IT services giant reported a “technical glitch” that meant auto-populated forms weren't ready for taxpayers. The company was directed to fix it and CBIC was faced with extending due dates for tax payments.

    Continue reading
  • Google keeps legacy G Suite alive and free for personal use

    Google has quietly dropped its demand that users of its free G Suite legacy edition cough up to continue enjoying custom email domains and cloudy productivity tools.

    This story starts in 2006 with the launch of “Google Apps for Your Domain”, a bundle of services that included email, a calendar, Google Talk, and a website building tool. Beta users were offered the service at no cost, complete with the ability to use a custom domain if users let Google handle their MX record.

    The service evolved over the years and added more services, and in 2020 Google rebranded its online productivity offering as “Workspace”. Beta users got most of the updated offerings at no cost.

    Continue reading
  • GNU Compiler Collection adds support for China's LoongArch CPU family
    MIPS...ish is on the march in the Middle Kingdom

    Version 12.1 of the GNU Compiler Collection (GCC) was released this month, and among its many changes is support for China's LoongArch processor architecture.

    The announcement of the release is here; the LoongArch port was accepted as recently as March.

    China's Academy of Sciences developed a family of MIPS-compatible microprocessors in the early 2000s. In 2010 the tech was spun out into a company callled Loongson Technology which today markets silicon under the brand "Godson". The company bills itself as working to develop technology that secures China and underpins its ability to innovate, a reflection of Beijing's believe that home-grown CPU architectures are critical to the nation's future.

    Continue reading
  • China’s COVID lockdowns bite e-commerce players
    CEO of e-tail market leader JD perhaps boldly points out wider economic impact of zero-virus stance

    The CEO of China’s top e-commerce company, JD, has pointed out the economic impact of China’s current COVID-19 lockdowns - and the news is not good.

    Speaking on the company’s Q1 2022 earnings call, JD Retail CEO Lei Xu said that the first two years of the COVID-19 pandemic had brought positive effects for many Chinese e-tailers as buyer behaviour shifted to online purchases.

    But Lei said the current lengthy and strict lockdowns in Shanghai and Beijing, plus shorter restrictions in other large cities, have started to bite all online businesses as well as their real-world counterparts.

    Continue reading
  • Foxconn forms JV to build chip fab in Malaysia
    Can't say when, where, nor price tag. Has promised 40k wafers a month at between 28nm and 40nm

    Taiwanese contract manufacturer to the stars Foxconn is to build a chip fabrication plant in Malaysia.

    The planned factory will emit 12-inch wafers, with process nodes ranging from 28 to 40nm, and will have a capacity of 40,000 wafers a month. By way of comparison, semiconductor-centric analyst house IC Insights rates global wafer capacity at 21 million a month, and Taiwanese TSMC’s four “gigafabs” can each crank out 250,000 wafers a month.

    In terms of production volume and technology, this Malaysian facility will not therefore catapult Foxconn into the ranks of leading chipmakers.

    Continue reading
  • NASA's InSight doomed as Mars dust coats solar panels
    The little lander that couldn't (any longer)

    The Martian InSight lander will no longer be able to function within months as dust continues to pile up on its solar panels, starving it of energy, NASA reported on Tuesday.

    Launched from Earth in 2018, the six-metre-wide machine's mission was sent to study the Red Planet below its surface. InSight is armed with a range of instruments, including a robotic arm, seismometer, and a soil temperature sensor. Astronomers figured the data would help them understand how the rocky cores of planets in the Solar System formed and evolved over time.

    "InSight has transformed our understanding of the interiors of rocky planets and set the stage for future missions," Lori Glaze, director of NASA's Planetary Science Division, said in a statement. "We can apply what we've learned about Mars' inner structure to Earth, the Moon, Venus, and even rocky planets in other solar systems."

    Continue reading

Biting the hand that feeds IT © 1998–2022