multiobs

Our Recent Productions

Datasets, working papers, and peer-reviewed articles produced by MultiObs researchers.

Showing 61–80 of 102

  1. Conference Paper2026Open Access
    'The science is clear': tracking mentions of science in parliamentary debates in five countries(opens in a new tab)

    Boshoff, Nelius; Gauch, Stephan; Basson, Isabel; Hamarowski, Bartosz; Sachse, Jacqueline; Butcher, Gillian; Sorgatz, Nikita; Wróblewska, Marta Natalia; Williams, Kate

    The paper evaluates the possibility of tracking societal impact of research by applying the logic of citations to parliamentary debates. It explores the extent and manner in which science and research are mentioned by parliamentary speakers. We analysed 3,815 relevant segments from 331 parliamentary debate documents across five countries (Australia, Germany, Poland, South Africa, and the UK) for the year 2023. Using grounded theory-inspired content analysis, we classified mentions based on the degree of traceable scientific evidence invoked versus appeals to scientific authority. Results show that scientific evidence is frequently mobilised, with the highest density of relevant segments in the UK and Australia. Fully traceable referencing of specific publications is rare (4–13% of evidence segments). Speakers typically name research producers or invoke collective scientific authority. Parliamentary debates offer potential for societal impact metrics, but the lack of traceable claims challenges traditional bibliometric methods, suggesting the need for reflexive evaluation.

  2. Conference Paper2026Open Access
    Exclusive Bibliographic Coupling: identifying the influence of co-authorship on the identification of scientific domains(opens in a new tab)

    Moutinho, Sônia Oliveira Matos; Grácio, Maria Cláudia Cabrini; Perianes-Rodriguez, Antonio

    This study proposes Exclusive Bibliographic Coupling (EBC) as a methodological alternative to mitigate the influence of co-authorship in bibliographic coupling networks. The method excludes co-author relationships while preserving organic links between non-collaborators. The comparison between the traditional model and EBC includes analyses of author networks to demonstrate that the exclusive method reduces the appearance of links resulting from collaboration, preserving connections based on the theoretical convergence of authors' citation identities. It has been determined that EBC increases the accuracy of identifying cognitive structures and scientific domains, contributing to more consistent and reliable bibliometric analyses.

  3. Conference Paper2026Open Access
    The effect of open access on numbers of downloads and their geographic diversity(opens in a new tab)

    van Bellen, Simon; Larivière, Vincent

    Despite their usefulness in analyzing the uses of research papers within and beyond academia, the availability of download data remains scarce. Using data from the Érudit journal platform, this paper analyzes the effect of open access availability on numbers of downloads and their geographic diversity. Results show that OA positively affects the numbers of downloads by a factor of 3.0 during the embargo period, and that downloads may maintain this advantage during the following years. Eighty percent of downloads originated from non-subscribing visitors, with the end of the embargo period being strongly associated with an expansion of their geographic diversity. On the whole, our results show that journals can substantially broaden international readership by adopting immediate OA, and that metadata quality is at least as influential as OA for downloads.

  4. Conference Paper2026Open Access
    Assessing the Use of Machine Learning Techniques Across Scientific Fields (1990–2025)(opens in a new tab)

    Isla, Malena Méndez; Kozlowski, Diego; Larivière, Vincent

    Artificial intelligence (AI) is reshaping scientific practice. While recent advances in large language models (LLMs) are substantial, machine learning (ML) has a long history of developments across science. This study analyses the evolution of machine learning in global science from 1990 to 2025, by examining 4.9 million articles from OpenAlex. Using a hierarchical taxonomy of 252 ML techniques and architectures, we found that while deep learning exploded post-2015 and LLMs after 2022, established methods, such as linear and logistic regressions, declined in their share of the total scientific output. Utilizing state-of-the-art embeddings (mE5) and dimensionality reduction (UMAP), we constructed the ML Semantic Space that reveals a core-periphery structure dominated by the Physical Sciences. Computer Science acts as the primary methodological anchor, while Engineering drives applied developments. Health Sciences, led by Medicine, represents the second-largest expansion zone of ML techniques.

  5. Article2026Open Access
    Looking Within the Ivory Tower: How Research Groups’ Characteristics Affect Industrial Innovation(opens in a new tab)

    Sott, Michele Kremer; Mikhaĭlov, A. A.; Ruffoni, Janaína; Tello‐Gamarra, Jorge; Fischer, Bruno Brandão

    Numerous studies have examined innovative partnerships between universities and industrial companies; however, universities are typically treated as a monolithic unit of analysis. Shifting the focus to individual academic research groups (RGs) provides a better understanding of the complexity and heterogeneity of such interactions. This article aims to analyze the interactions between Brazilian industrial firms and university research groups to understand how specific characteristics of these micro-level units influence firms' innovative outcomes. The research utilizes data from the Brazilian national census of research groups (DGP-CNPq) combined with a survey of industrial firms that collaborated with these groups. The study develops five econometric models to measure the effects of firm and research group characteristics on the dimensions of innovation performance, such as technological and business capabilities, and product and process innovation. The results indicate that research group characteristics do not directly affect a firm’s innovation performance. Instead, the presence of a robust knowledge infrastructure and involvement in R&D departments are the primary determinants of enhanced technological and business capabilities in collaborative agreements. Furthermore, while applied science is a significant predictor for product innovation, process innovation is primarily driven by the firm's own technological intensity and the university’s knowledge infrastructure. This study is among the first to provide a granular, micro-level analysis of how research group characteristics — rather than university-wide traits — shape the tangible benefits firms derive from collaboration, specifically within the context of an emerging economy.

  6. Article2026Open Access
    La dinámica local-global de la circulación del conocimiento en una facultad de ciencias bioquímicas de una universidad pública argentina: aportes para repensar los sistemas de evaluación científica en América Latina(opens in a new tab)

    Cybulski, Larisa E.; Isuani, Gabriela; Sciara, Andrés A.; Pacífico, Fernando Díaz; Pallitto, Nahuel; Beigel, Fernanda

    Since the establishment of the Science Citation Index in the 1960s, scientific evaluation systems have favored metrics like the impact factor (IF), creating a hierarchy that privileges “mainstream” journals while marginalizing local publications. This model has driven Latin American researchers to publish in international journals, often in English and with high article processing charges (APCs), to gain academic recognition and funding. However, this dynamic has undervalued regional journals, despite initiatives like SciELO, RedALyC, and Latindex demonstrating high standards of quality, open access, and increasing internationalization. In response, an interdisciplinary team proposed the creation of a local scientific journal at the Faculty of Biochemical and Pharmaceutical Sciences of the National University of Rosario (FBIOyF, by its Spanish acronym), aiming to engage globally without neglecting local values and criteria. To assess this initiative, we conducted a survey among faculty researchers. The results reveal significant interest in a publication that promotes the dissemination of locally generated knowledge, facilitates access for non-English-speaking communities, and fosters interdisciplinary collaborations, making science more equitable and more sensitive to social context.

  7. Article2026Open Access
    Following the evidence: Mapping the cited scientific base of Brazil’s public health guidelines(opens in a new tab)

    Cabral, Bernardo Pereira; Tetzner, Gabriela Araujo; Salles Filho, Sérgio; Pereira, Cesar A. Guimarães; Hollanda, Sandra; Cristofoletti, Evandro Coggo; Pinto, Karen Esteves Fernandes; Juk, Yohanna Vieira; Araujo, Iago; Toledo, Carlos; Cordeiro, Vinícius; Silva, Gessica

    In Brazil, health policy formulation, particularly through Clinical Protocols and Therapeutic Guidelines (PCDTs), is significantly influenced by scientific evidence. The National Commission for the Incorporation of Technologies into the Unified Health System (CONITEC) approves these PCDTs to standardize healthcare practices, thereby exemplifying the nexus of scientific research and policy. This study analyzes the scientific literature referenced in the PCDTs approved by CONITEC, exploring the flow of knowledge from global scientific research to Brazil’s health policy. Our approach involved a data pipeline for collecting, preprocessing, and analyzing information from scientific publications cited in all CONITEC’s PCDT reports published until 2023. The process encompasses web scraping, pattern recognition, and bibliometric analysis. The study identified references predominantly from the United States and the United Kingdom, with notable contributions from Brazilian sources. Cited research is almost entirely written in English and published in high-impact factor English-language journals. These findings document the global influence on Brazil’s health policies, with a substantial portion of the cited scientific evidence originating from international sources.

  8. Working Paper2026Open Access
    Are University Journals Truly Local? National and Institutional Anchoring in Seven Research Systems(opens in a new tab)

    Nazarovets, Maryna; Beigel, Fernanda; Van Schalkwyk, François B.; Taşkın, Zehra; Meng, Ping

    University journals (UJs) are often described as local or inward-looking, although national and institutional embeddedness are rarely distinguished. This study examines the internationally indexed segment of university journals, analysing Web of Science-indexed titles from seven countries with contrasting publishing traditions and evaluation regimes (Argentina, China, Germany, South Africa, Türkiye, Ukraine, and the United Kingdom), based on publications from 2022-2024. National anchoring (N-Anch) measures the share of papers with at least one author from the journal’s home country, while institutional anchoring (I-Anch) captures participation by authors from the publishing university. The results reveal a clear divergence between these dimensions. National anchoring is high in Türkiye, China, Ukraine, South Africa, and Argentina, but considerably lower in Germany and UK university-press journals. Institutional anchoring remains low across all countries. Thus, strong integration into a national research community does not imply institutional anchoring. The findings show that patterns of national and institutional anchoring vary substantially across countries with different research, evaluation, and publishing systems and cannot be explained by university ownership alone.

  9. Working Paper2026Open Access
    Sustaining scientific ties after mobility: determinants of continued collaboration with country of origin(opens in a new tab)

    Ge, Huilin; Calero‐Medina, Clara; Costas, Rodrigo

    This study examines why some internationally mobile researchers continue to collaborate with their academic country of origin after moving abroad, while others do not. Based on a comprehensive dataset of scientific publications indexed in the Dimensions, we identify 663,802 internationally mobile researchers who first appeared in the publication record between 1990 and 2020. We examine three dimensions of pre-mobility origin-related collaboration: persistent origin ties, internationally connected origin-country coauthors, and origin collaboration concentration. The results show that all three dimensions are positively associated with continued origin collaboration after mobility. Among them, internationally connected origin-country coauthors show the strongest association, suggesting that origin collaborators with international experience may serve as important bridges between mobile researchers and their academic origins. The associations also vary across origin-country development levels, mobility directions, return status, and scientific fields. These results show that post-mobility collaboration with country of origin is closely related to the collaboration structures researchers formed before mobility, rather than being simply a result of mobility itself or individual productivity.

  10. Article2026Open Access
    “My Wife Says…”: Epistemic Injustice in the Rationale of Parenting Responsibilities Among Academic Parents(opens in a new tab)

    Derrick, Gemma; Hauseux, Marlene; Sheridan, Mary; Chen, Peiying; Larivière, Vincent; van Leeuwen, Thed N.; Sugimoto, Cassidy R.

    The event of having a child for an academic is associated with lower research productivity for women, even when the parenting burden is shared by both male and female parents. Universities and research organizations commonly employ “family‐friendly” policies to simultaneously ease work expectations and provide flexibility in work patterns, performance, and participation. Recent trends of fathers taking more responsibility for parenting engagement than past generations have challenged universities to adopt a greater diversity of family‐friendly policy approaches to ensure maximum workforce participation. However, such policies have done little to ameliorate that increased harm on academic careers, especially women's. Using a global survey of 10,445 academic parents, this study analyzes 5903 free‐text, qualitative responses to explore individualized rationales of how a parenting “unit” functions at the household level. By examining the gaps and silences in the testimonies of parents, this study concentrates on the gendered nature of parental rationales and the power imbalances and assumptions made around a partner's conceptualization of choice in parenting. The findings show that differing notions of parental workplace flexibility are used to reinforce gendered concepts of care at the household level. This undermines policy goals of helping parents in the workplace, especially if the policies are used to nudge mothers to disengage from work.

  11. Working Paper2026Open Access
    English dominance in scholarly communication: Historical roots and bibliometric evidence(opens in a new tab)

    Brasil, André

    English functions as the principal shared language of international scholarly communication, but its dominance also creates inequalities in the production, dissemination, visibility, and assessment of research. Developed as a complementary output of the CoARA Working Group on Multilingualism and Language Biases in Research Assessment, this report examines the historical development of English dominance and the contemporary mechanisms through which it is reproduced. It combines evidence from the literature with descriptive bibliometric analyses based on Web of Science, Scopus, OpenAlex, and CWTS Journal Indicators. The findings show that English is especially dominant in journals with high field normalised citation impact and in the selective segments of scholarly communication most frequently used in research evaluation. However, the extent of this dominance varies considerably across disciplines and countries, and publication in national languages remains important in the social sciences, humanities, and fields directed toward local professional and societal audiences. The report also demonstrates how database selection, metadata quality, and analytical choices affect the visibility of multilingual scholarship. Web of Science and Scopus predominantly represent English language journal literature, whereas OpenAlex reveals a much broader body of multilingual research, although incomplete language, authorship, and institutional metadata remain important limitations. The report further examines the financial, linguistic, and time burdens associated with English language publication and considers how publishing infrastructures, bibliometric indicators, rankings, and assessment practices influence which research becomes visible and valued. This report contributes to the landscape analysis conducted by the Coalition for Advancing Research Assessment (CoARA) Working Group (WG) on Multilingualism and language biases in research assessment and it complements the Implementation proposal for language-aware assessments (Annex II.3).

  12. Working Paper2026Open Access
    Appendix A. Definitions of technological information(opens in a new tab)

    Damian, Ieda Pelógia Martins; Araujo de Rezende Alvares, Lillian Maria; Segundo, Washington; Garcia de Souza, Marcel

    Introduction: technological information plays a strategic role in scientific, technological, and industrial development, especially in contexts marked by innovation and competitiveness. Objective: this study aims to present an updated concept of technological information that reflects current demands in academic and productive sectors. Methodology: a Systematic Literature Review (SLR) was conducted using national and international databases in the field of Information Science. The search resulted in 1,108 documents, from which 68 relevant definitions of technological information were selected and analyzed. Results: the analysis enabled the identification of recurring themes and common elements in existing definitions, allowing for a deeper understanding of the concept. The study highlights the main characteristics and functions of technological information, such as its association with innovation, competitiveness, and strategic decision-making. It emphasizes its role in improving products, processes, and services, and its relevance in patents and research outputs. Conclusion: the study proposes a new definition of technological information as knowledge related to technologies that generate strategic value through their application. This updated definition contributes to theoretical advances in Information Science and offers practical support to organizations aiming to use technological information as a strategic asset. It also broadens the understanding of the term’s scope, reinforcing its importance for sustainable development and innovation.

  13. Article2026Open Access
    From Digital Data to Electoral Forecasts: A Systematic Review and Taxonomy of Computational Approaches(opens in a new tab)

    Maruyama, William Takahiro; Digiampietri, Luciano A.

    The increasing use of digital data in electoral prediction has motivated a growing body of computational research, yet the field remains methodologically diverse and lacks consolidated comparative frameworks. This article presents a systematic review of computational approaches for electoral outcome prediction using digital data between 2020 and 2025. Following rigorous systematic methodology, searches were conducted across three scientific databases, resulting in 80 primary studies analyzed after applying explicit quality criteria. The review proposes a taxonomy classifying studies by data integration and predictive complexity, enabling systematic identification of methodological patterns. Results reveal geographic concentration in few countries, with Twitter as the dominant platform and sentiment analysis as the most frequent technique. Vote percentage prediction and winner identification represent the primary objectives, evaluated mainly through regression and classification metrics. The field demonstrates numerical expansion with modest geographic diversification, yet persistent challenges remain regarding sample representativeness, cross-context generalization, and absence of standardized validation protocols. Findings indicate the need for broader geographic coverage, reduced platform dependency, and establishment of uniform evaluation criteria to advance methodological maturity in computational electoral prediction.

  14. Dataset2026Open Access
    A Hierarchical IPC-Based Search System for Patents in the Brazilian IP Office (IPC Scheme)(opens in a new tab)

    Lorensi do Canto, Fábio; Carneiro, Renan; Dias, Thiago; Talau, Marcos; Segundo, Washington

    This dataset provides a structured JSON representation of the International Patent Classification (IPC) scheme used in the prototype described in the associated paper. The dataset encodes the hierarchical organization of IPC symbols, supporting navigation across classification levels and the construction of Boolean search strategies for exact and hierarchical patent retrieval. The JSON structure was prepared to support a web-based patent search prototype that enables bilingual IPC navigation in English and Portuguese and assists users in formulating IPC-based queries for execution in the beta version of the new patent search system of the Brazilian Industrial Property Office (INPI). By making the IPC scheme available as a reusable dataset, this deposit supports transparency, reproducibility, and reuse of the classification structure employed in the study. This dataset is intended as a research component associated with the paper and may be used for studies or systems involving patent information retrieval, IPC-based query expansion, hierarchical classification browsing, and the development of search interfaces based on patent classification schemes.

  15. Working Paper2026Open Access
    The Future of Peer Review: A system-wide perspective(opens in a new tab)

    Pinfield, Stephen; Waltman, Ludo; Kolarz, Peter; Gregory, Kathleen; Brasil, André

    This report presents the main outcomes of the PEER REVIEW project conducted by the Research on Research Institute (RoRI) from 2023 to 2026. It draws on the substantial literature on peer review as well as 39 in-depth interviews with experts from across the research system, including policymakers, funders, publishers, editors, researchers and others. Peer review is often seen as one of the cornerstones of the research system. At the same time, many researchers and other actors in the system have expressed deep concerns about dysfunctions of peer review. In response to this, much work has been done to assess and improve peer review in individual domains, notably within research funding, scholarly publishing, career advancement, and assessment of research units.However, by considering peer review in each domain in isolation, knowledge about peer review has remained fragmented, offering a weak basis for strengthening the organisation of peer review.In this report, we take a systemic perspective on peer review across domains. Rather than focusing on incremental process-level innovations in individual domains, we conclude there is a need for system-wide reform in peer review. We outline future pathways for such reform.

  16. Working Paper2026Open Access
    Questioning peer review: Understanding peer review system-wide (RoRI Working Paper No. 21)(opens in a new tab)

    Gregory, Kathleen; Brasil, André; Kolarz, Peter; Pinfield, Stephen; Waltman, Ludo

    Peer review is omnipresent across the research system and is typically seen as a critical means of quality assurance and decision-making. However, there is a growing consensus that peer review is under strain, owing in large part to the proliferation of peer review demands in various parts of the research system. We argue that a holistic understanding of peer review across the research system is needed to move towards robust, complementary modes of evaluation that address these concerns. We draw on the findings from expert interviews to question the why (aims and purposes), who (actors), how (procedures and criteria), and what (objects) of peer review across “domains” where peer review is organised (research funding, scholarly publishing, career advancement, and research units). We then discuss the relationships between these domains, including the extent to which it may or may not be possible to combine reviewing efforts. We further identify five cross-domain themes through an inductive analysis: quality, capacity, diversity, openness, and trust. These themes interact with four contextual factors: disciplines, geographies, technology and governance. We argue that addressing these themes and their associated challenges in a holistic way is necessary to help peer review achieve its aims across the research system. In an associated project report, we draw on the understandings developed here to propose strategic pathways for working towards system-wide change.

  17. Working Paper2026Open Access
    Different operationalizations of local research and their associated citation patterns: A study of African publications(opens in a new tab)

    Alonso-Álvarez, Patricia; Boshoff, Nelius

    Local research has gained increasing attention in recent years, with a growing body of literature emphasizing its significance—especially for peripheral communities underrepresented in mainstream scientific discourse. However, despite this growing interest, there remains no clear consensus on how to define local research. Conceptual clarity is essential for conducting consistent and replicable analyses that capture the specific characteristics, contexts, and societal relevance of local research. This need is particularly acute in the Global South, where structural inequalities in visibility and recognition often marginalize regionally focused scholarship. In Africa, for instance, a substantial share of research is published in local or regional journals that are poorly represented in global indexing databases. As bibliometric analyses typically rely on these databases, this exclusion diminishes their perceived relevance. To address this gap, the present study incorporates data from regional and open-access sources to examine citation patterns associated with African local research. It uses multiple conceptualizations of local research to classify publications as either local or non-local depending on the definition used. These classifications are correlated with three citation-based indicators: average citations per publication, time to first citation, and the proportion of uncited publications. Additionally, the study explores the characteristics of citing publications, distinguishing between local and non-local sources as well as domestic and international citations. The findings reveal that citation patterns differ significantly across locality definitions, underscoring the importance of adopting nuanced, context-sensitive approaches to assess and support local research.

  18. Conference Paper2026Open Access
    Subfields in LIS: Insights from 215 Canadian Doctoral Dissertations(opens in a new tab)

    Poitras, Constance; Demers, Camille; Dufour, Christine; Ninkov, Anton; Larivière, Vincent

    This project investigates the disciplinary structure of Library and Information Science (LIS) across Canadian doctoral research. Using a qualitative content analysis of 215 dissertations (2010–2024), the study identifies topic clusters, theoretical anchors, and methodological patterns in the field, while probing into the existence of shared disciplinary knowledge. Preliminary results show distinct clusters of topics, approaches, methods and emerging school-level differences. Sous‑domaines en BSI : perspectives tirées de 215 thèses doctorales canadiennesCe projet examine la structure disciplinaire de la bibliothéconomie et des sciences de l’information (BSI) à travers la recherche doctorale canadienne. À partir d’une analyse qualitative de contenu portant sur 215 thèses soutenues entre 2010 et 2024, l’étude identifie des regroupements thématiques, des ancrages théoriques et des configurations méthodologiques dans le domaine, tout en explorant l’existence de connaissances disciplinaires partagées. Les résultats préliminaires montrent des clusters distincts de sujets, d’approches et de méthodes, ainsi que l’émergence de différences entre les écoles.

  19. Article2026Open AccessPT
    Periódicos brasileiros de turismo (2020-2024)(opens in a new tab)

    Köhler, André Fontan; Segatto, Camila Alves; Digiampietri, Luciano A.

    Trabalha-se com um estudo bibliométrico do tipo avaliativo. Seu corpus consiste em 24 periódicos brasileiros de turismo; o objeto de estudo são os artigos neles publicados, em 2020-2024, e suas citações. Há dois objetivos principais, a saber: i) avaliar a trajetória das citações; ii) avaliar e ordenar esses periódicos, segundo seu impacto (citações). Os materiais e métodos consistem na coleta, revisão e desambiguação manuais dos artigos e citações, estatística descritiva e cálculo dos índices H e G. Os resultados são comparados aos de 1990-2018, por meio de literatura. A Revista Brasileira de Pesquisa em Turismo ocupa a primeira posição para todas as métricas e rankings, via de regra com resultados muito acima do periódico seguinte. A Revista Rosa dos Ventos destaca-se nas métricas e rankings baseados no conjunto de artigos mais citados para cada periódico, aproximando-se, neles, dos resultados da Revista Brasileira de Pesquisa em Turismo. Complementam o primeiro quartil dos periódicos mais citados a Anais Brasileiros de Estudos Turísticos, PODIUM Sport, Leisure and Tourism Review, Turismo: Visão e Ação e Revista Acadêmica Observatório de Inovação do Turismo. Houve profundas mudanças nos rankings de impacto e nos índices H e G, em comparação com os resultados do período 1990-2018.

  20. Working Paper2026Open Access
    Operationalizing FAIR in National Research Information Systems: The BrCris Example and Its Role in Open Repositories(opens in a new tab)

    Segundo, Washington; Dias, Thiago Magela; Souza, Marcel Garcia; do Canto, Fábio Lorensi; Sena, Priscila Machado

    The adoption of the FAIR principles (Findable, Accessible, Interoperable, Reusable) has become a cornerstone of Open Science, guiding practices aimed at improving the quality, transparency, and reuse of scientific data. In the context of CRIS (Current Research Information Systems), these principles play a strategic role in supporting the integration, standardization, and governance of scientific information on a national scale. This article analyzes the application of the FAIR principles within the Brazilian Scientific Research Information Ecosystem (BrCris), developed by the Brazilian Institute of Information in Science and Technology (Ibict), with the aim of discussing how its technical and organizational practices contribute to building a more reliable, interoperable, and reusable scientific data infrastructure. The methodology adopted is based on a literature review of the FAIR principles and a document analysis of technical reports, scientific articles, and institutional materials related to BrCris. The results indicate that BrCris shows significant progress in adopting the FAIR principles, especially in the use of persistent identifiers, semantic data integration, interoperability with international infrastructures, and the availability of data in open and reusable formats. It is concluded that BrCris constitutes a strategic infrastructure for the implementation of the FAIR principles in Brazil.