Tracking Scientific Software Impact Through Online Mentions

Why It Matters

Understanding how scientific software is discussed and referenced online is crucial for developers and researchers to gauge its adoption, identify areas of interest, and inform future development. This approach offers a novel way to assess the broader influence of digital tools beyond traditional citation metrics.

Key Finding

By examining where and how scientific software is mentioned online, researchers can differentiate between its use in academic work and broader public or informational interest.

Key Findings

• Mentions in academic literature (Google Scholar) indicate the software's use as a research resource.
• Mentions on general webpages (Majestic) and social media (Twitter) reflect informational interest and conversational engagement with the software's website.

Research Evidence

Aim: How can a link-based webometric approach be used to characterize the online mentions and impact of scientific software across different analytical frameworks?

Method: Webometric analysis

Procedure: The study used VOSviewer's official website as a baseline and counted online mentions across three frameworks: academic literature (Google Scholar), general webpages (Majestic), and social media (Twitter). The number of mentions in each framework was recorded and analyzed to understand different facets of software impact.

Sample Size: Google Scholar: 988 publications, Majestic: 1,330 websites, Twitter: 267 tweets

Context: Scientific software usage and impact assessment

Design Principle

Assess the digital footprint of designed tools to understand their real-world influence and user engagement.

How to Apply

For a new scientific tool, track its mentions on academic databases, relevant forums, and social media to build a comprehensive impact profile.

Limitations

The study's findings are specific to the VOSviewer software and the chosen analytical frameworks; generalizability to all scientific software may vary. The interpretation of 'mentions' can be subjective and may not always directly correlate with deep usage or impact.

Student Guide (IB Design Technology)

Simple Explanation: This research shows that you can learn how much people are using and talking about scientific software by looking at where its website is linked online – in research papers, on other websites, and on social media.

Why This Matters: Understanding how software is discussed online helps designers see its real-world value and how it fits into the broader scientific community, which is important for making informed design decisions.

Critical Thinking: How might the 'conversational' aspect of social media mentions differ in its value compared to academic literature mentions when assessing software utility?

IA-Ready Paragraph: The study by Orduña‐Malea and Costas (2021) highlights the utility of webometric analysis in understanding the impact of scientific software. By examining online mentions across academic literature, general webpages, and social media, it's possible to gain a more comprehensive view of a tool's adoption and influence, moving beyond traditional citation metrics.

Project Tips

• When researching existing software for a design project, consider searching for online mentions to understand its current standing.
• Use this approach to justify the need for a new tool or to highlight the success of an existing one.

How to Use in IA

• Reference this study when discussing how you evaluated the impact or usage of existing software solutions in your design project.

Examiner Tips

• Demonstrate an understanding of how to measure the impact of digital tools beyond simple download counts or citations.

Independent Variable: Analytical framework (academic literature, webpages, tweets)

Dependent Variable: Number of online mentions (links)

Controlled Variables: Baseline website (VOSviewer official website)

Strengths

• Provides a novel, multi-dimensional approach to assessing software impact.
• Utilizes readily available online data sources.

Critical Questions

• Does the volume of mentions directly correlate with the quality or effectiveness of the software?
• How can this methodology be adapted to assess the impact of non-software-based research outputs?

Extended Essay Application

• An Extended Essay could explore the online impact of a specific open-source scientific library by applying this link-based webometric approach across various platforms.

Source

Link-based approach to study scientific software usage: the case of VOSviewer · Scientometrics · 2021 · 10.1007/s11192-021-04082-y