Invited Talk on “𝐐𝐮𝐚𝐥𝐢𝐭𝐲 𝐀𝐬𝐬𝐞𝐬𝐬𝐦𝐞𝐧𝐭 𝐨𝐟 𝐒𝐜𝐢𝐞𝐧𝐜𝐞 𝐚𝐧𝐝 𝐓𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐲 𝐏𝐨𝐥𝐢𝐜𝐢𝐞𝐬”
Speaker: Bhavya Mehta, Consultant – S&T Policy, Centre for Civil Society.
Date & Time: 𝐖𝐞𝐝𝐧𝐞𝐬𝐝𝐚𝐲, 𝟐𝟒 𝐀𝐮𝐠 𝟐𝟎𝟐𝟐, 𝟒 𝐏𝐌
Exploring the Current Practices in Research Assessment within Indian Academia
About the project
India has a considerably large research community of ministries, scientific and industrial research organisations; universities, research councils, and autonomous institutions directly dealing with research/funding. The country also boasts of ~0.34 million FTE researchers. The quantum of research undertaken/funded by these institutions are also quite large. Research assessment criteria vary with the type of institutions, research, and the goal of assessment.
However, like many other countries, research assessment in Indian institutions and funding agencies is currently overly dependent on matrices such as Journal Impact Factor (JIF), h-index, etc. Though started well intended, matrices proliferated to be an abused instrument. Keeping this in view, the proposed project aims to initiate a broader discussion on the framework used by these institutions, their institutional capacities, and strengths and gaps in the existing practices.
For this purpose, we plan to organise a series of workshops with the major stakeholders of the Indian research ecosystem to understand and deliberate on the strengths and weaknesses of current practices.
The workshop outcome will help us better understand the existing practices, how to look beyond the quantitative journal indicator-based metrics, and suggest pathways to make them more effective and inclusive wherever necessary. The project outcome will help the institutions build robust, flexible research assessment frameworks.
Time for India's own open-access digital publishing platform?
Knowledge sharing is the key to research in academia, and scientific journals play a crucial role in that. It started with noble intentions and sponsorships from various learned societies almost 400 years ago. Then in the 1950s, Robert Maxwell turned scientific journals into a money-making instrument. Presently the academic publishing industry functions in a concentrated market filled with big players and driven by revenue. Elsevier, one of the biggest publication houses, earned aprofit margin of more than 35% higher than tech giants like Apple and Microsoft. The success of their business model hinges on the prosumer nature of the researcher. Even though technological advancements have shifted the industry to adopt the digital format, most knowledge is still paywalled. Initiatives likeBudapest Open Access Initiative, stresses self-archiving and open-access. The extortionatelyhigh article processing fee (APC) charged by publishing groups for open-access publication beats the purpose of equity and inclusivity. Academic communities in transitioning economies like India also face the added challenge of scattered community involvement in the peer-review process, which combined with theUS effect, breeds inequity.
Advancements in open-access practices have fuelled innovative approaches, especially in Latin America.Non-commercial models to scholarly communication like the Latin American Council of Social Sciences (CLACSO) and Redalyc have emerged. They successfully function with decentralised electronic publishing platforms, no APCs, open-access repositories, and not for profit indexing services. On a similar adaptability approach, African Journals OnLine (AJOL) and Nepal Journals Online (NepJOL) also function in open-access mode.
Viewing the increasing acceptability and advocacy of open access, some dominant and young academic publishers such asF1000Research,eLife,Gates Open Research, etc. have also made subtle shifts in their operating model. Concepts like an open peer-review system removes the opaqueness of the peer-review by publishing the reviewer comments along with the manuscript. Preprint open-access repositories like bioRxiv, engrXiv, SocArXiv, etc., are also steering the changes in online paper archiving models.
Technological progression and open-access advocacy have trickled down to compel the publishing industry to evolve its business models and practices. Still, this hasn’t changed the management of peer-reviewed academic journals. Non-profit initiatives such as Public Knowledge Project, supported by Stanford University, the Simon Fraser University Library and various other development partners, have focused on strategizing and developing open software solutions to improve the online environment for better management, publication, and indexing of journals.
Indian academia, as a result of access and equity challenges, is falling prey to predatory publishing. Recognition biases coalesced with financial and infrastructure constraints prevent researchers from publishing in high-quality journals. TheUGC mandate of one compulsory publication as a pre-condition to PhD also fuels predatory publishing. This calls for the development of a digital open-access environment with minimal (funded by the research project) to no-APCs. There is already a precedent, the Open Research Europe by the European Commission. This platform encourages quick but quality open-peer-reviewed publications for research across all subject areas, stemming from Horizon 2020 funding.
India has many opportunities to leverage from its own digital publishing platform. The country is currently positioned third in the world in scientific publication with a 12.9% growth rate in scientific publications. India’s digital expertise at both individual and corporate levels is also well acknowledged. Only a few Tier 1 public sector universities at present can afford to make scholarly publication accessible to researchers. A potential solution discussed is One Nation, One Subscription (ONOS). But it will call for huge investments every year without addressing core issues like improving the quality of Indian research, more practical research evaluation matrices, and monetisation of public-funded research output by a few corporate publishers. Against this backdrop, a digital publishing platform will address access issues of publicly funded research in India. It can create a vibrant community of researchers enabling scholarly knowledge sharing and communication. Further, a digital publishing platform with a very firm stand on quality publication not only holds promises to provide fair and open-access avenues for Indian (and the rest of the world) researchers to publish, but associated analytics such as views, download, social media presence, etc. of a published article. This can open up new possibilities to judge the impact of research not based on the impact factor of a journal but the real impact of the said work.
Innovation Challenge to build an AI powered pre-print and publishing platform
Currently, the scientific publishing system faces the problem of access and equity. Commercial publishing houses charge exorbitantly high article processing and subscription charges. Even though most of the research published is publicly funded and digital interventions have substantially reduced the processing costs, most of the scholarly knowledge still resides behind paywalls, not only for the general public but also for researchers generating academic content. The exclusion of the global south perspective and increase in the number of predatory journals have also escalated the debate on the knowledge-quality and effectiveness of the current process of knowledge creation and dissemination.
The recently released draft UNESCO Open Science recommendations advocates for open access to scientific publication, unrestricted distribution, interoperability and long-term digital préservation and archiving.The draft of the 5th STI policy India also promotes open access to publicly funded research output.
With the belief that knowledge is a public good and must be accessible without barriers, we propose an open-access publication platform. One of the primary goals of this platform will be to foster unhindered access to scholarly publications, primarily through digital technologies. Working on the recommendations of various stakeholders, the idea is to build a robust digital platform that is transparent, efficient, cost-effective, and addresses the mainstream problems faced by both the scholars and editors.
The problem is one of access and equity. Access relates to both access to read and access to publish. A bulk of material is behind paywalls. Open Access publication is prohibitively expensive. Community involvement is scattered and peer review is difficult to find. Metric bases are cherry-picked by corporate interests, like impact factor, h-index, etc., and promoted in a way that it benefits those who are already at the top of the food chain (western, first world scholarship).
There is an opportunity to build a pre-print archive and an open national research publishing platform that solves the problems of access and equity. There are possibilities to attribute matrices on each article based on pragmatic research evaluation criteria that suit the needs of Indian funding agencies. This will encourage research that address the local challenges which usually are overlooked by the international community and benefit in one or more of the components of research content, namely:
Title, Abstract, Affiliation, Keywords, Bibliography.
Additional opportunities are available: A pragmatic approach to a publishing model that is digital first with an option to print, when and if needed, can leapfrog the platform ahead of all prior art.
Develop an automated, AI-powered digital open-access publication platform for accessible, equitable, and efficient dissemination of knowledge in academia.
Day 1 (18 Feb., 2021)
Day 2 (19 Feb., 2021)
Day 1 (18 Feb., 2021)
Dr. Imogen Wade, Research Fellow in Transformative Innovation, SPRU, University of Sussex
|Dr. Venkat Nadella, Post-doctoral Policy Fellow, DST-CPR-Indian Institute of Science, Bangalore
Ms Yasemin Aslan, PhD scholar, Science Policy Research Unit, University of Sussex
Dr. Nimita Pandey, Post-doctoral Policy Fellow, Office of the Principal Scientific Advisor to the GoI and UNESCO New Delhi
Ms Nora Nedge, PhD Scholar, Science Policy Research Unit, University of Sussex
|Implementing transformative innovation policies across geographical contexts: TIPC in South Africa, Sweden and the European Union
|Financing Science, Technology and Innovation: Lessons from Polycentric System of Governance
|A Novel Index Knowledge Triangle: The Entrepreneurial and Innovative University Index of Turkey
|Gender Equity and Inclusion in STI: Towards Institutional Transformation
|Investing in Science, Technology and Innovation: Learning from a complimentary approach piloted in East Africa
Day 2 (19 Feb., 2021)
|Dr. Suchiradipta Bhattacharjee, Senior Policy Fellow, DST-CPR Indian Institute of Technology, Delhi
Dr. Alexandra Boni, INGENIO (CSIC-UPV), Universitat Politècnica de València
|Dr. Mansimran Khokhar, Senior Scientist D, DST-CPR Panjab University, Chandigarh
Dr. Joshua Moon, Research Fellow, Science Policy Research Unit, University of Sussex
|Dr. Saumya Pathak, Post-doctoral Policy Fellow. DST-CPR BBAU Lucknow University
|Looking at India’s climate change initiatives in agriculture through an innovation systems lens
Evaluating transformative innovation policies in a formative way
|Public-Private Partnerships in STI: Key to Multi-stakeholders Participation in STI
Fear and Apathy in Implementation: Learning the lessons of learning lessons for epidemic preparedness
|Internationalisation of Indian Standard Medicine: Strengthening Patent Regime, Strategies and Modulation of Policy
Thematic Group discussions (Break-out rooms)
- Conceptualising STI Policy: Global context
- STI Policy for Transformative Change
- Research, Innovation and Entrepreneurship
- STI Governance Developmental Context
- STI roadmaps for the SDGs
- Open Science and Science Communication
- Implementation and Evaluation of STI Policy
- Inclusivity and Equity in STI
- Sheth BP, Basha CB and Roy I. Workshop Report on Science, Technology and Innovation Policy Research. Current Science 2018; Vol 118 [Accepted for publication]
- Reddy M, Basha CB. Data-Collection Methodology for R&D Statistics – Indian Scenario and International Comparison. 2017. Report submitted to Policy Research Cell, DST, India
- Rani M T, Madhan M, Arunachalam S, Abinandanan T A. Chemistry research in India as seen from InCites 2006-2015. Report submitted to Policy Research Cell, DST, India
- Rani M T, Madhan M, Arunachalam S, Abinandanan T A. Engineering research in India: An analysis based on papers indexed in InCites for the period 2006-2015. Report submitted to Policy Research Cell, DST, India
- Rani M T, Madhan M, Arunachalam S, Abinandanan T A. Materials Science Research in India: An analysis based on papers indexed in InCites for the period 2006-2015. Report submitted to Policy Research Cell, DST, India
- Pandey P. EU-India Meeting on Advanced Biofuels. New Delhi 2018, Report submitted to Biofuels Working Group, Ministry of Petroleum and Natural Gas, Government of India.
- Arunachalam S, Madhan M. Adopting ORCID as a unique identifier will benefit all involved in scholarly communication. The National Medical Journal of India 2016; Vol 29, No. 4, pp. 227–234.
- Muthu M, Kimidi SS, Gunasekaran S, Arunachalam S (2016) Should Indian researchers pay to get their work published? Current Science 2017; Vol 112, No. 4, pp. 703-713.
- Arunachalam, S. and Madhan, M. and Gunasekaran, S. Chemistry research in India: making progress, but not rapidly. Current Science 2017; Vol 112, No. 7, pp. 1330-1339. http://www.currentscience.ac.in/Volumes/112/07/1330.pdf
- Madhan M, Gunasekaran S, Arunachalam S. Evaluation of research in India: Are we doing it right? Indian Journal of Medical Ethics, Published online on March 23, 2018. DOI: 10.20529/IJME.2018.024
- Subbiah Arunachalam. Social Justice in Scholarly Publishing: Open Access Is the Only Way. The American Journal of Bioethics 2017: Vol 17, No. 10, pp. 15-17, DOI: 10.1080/15265161.2017.1366194
- Francis Jayakanth and Muthu Madhan. Open Access for Engineers and Engineering. IEEE India Info 2017; Vol. 12, No. 4, pp. 53-57.
- Chagun Basha. Mapping Indian National STI to Garner 2030 Agenda for Sustainable Development. Proceedings of RIS-ITEC Capacity Building Programme on Science Diplomacy, New Delhi 2017: pp 43-46.
- Pandey P, Desai P.N, Chaturvedi S. Towards a Global TA. [Accepted for publication, KIT Scientific Publishing, Germany 2018]
- Pandey P, Dutt. U. RRI’s Commitment to Care and Vulnerabilities of Agricultural Systems: A Case of Rice Straw Burning in India. [Manuscript under review for Science, Technology and Society, Sage Publication 2018]
- Pandey P. What Values Drive Innovation? A Socio-Cultural Analysis of Academia-Industry Interaction for Nanobiotechnology in India. [Paper peer-reviewed and accepted for presentation in Globelics conference 23-25 October 2018, Accra, Ghana]
- Pandey P, Valkenburg G. All we want is to get rid of the straw’: How Biofuel Policies Need to Take Account of Different Visions of Biomass. [Under review for Energy Policy]
Pandey, P., Valkenburg, G., Mamidipudi, A. and Bijker, W.E. (2017). The key to resolving straw burning: farmers’ expertise. Policy brief on missing cultural perspectives. Maastricht, the Netherlands: Maastricht University. http://www.maastrichtsts.nl/wp-content/uploads/2017/12/Policy_brief_final.pdf