The importance of meta-research in dentistry
www.nature.com/ebd
EDITORIAL
The importance of meta-research in dentistry
© The Author(s), under exclusive licence to British Dental Association 2023
1234567890();,:
Evidence-Based Dentistry (2023) 24:98–99; https://doi.org/10.1038/
s41432-023-00880-w
Credit: Foto Divulgação Atitus Educação
The number of articles published yearly in dental science is
immense. Scopus data indicate that 22,115 documents with
“dentistry” as the subject area were published in 20211,
representing increases of 28% and 175% in articles compared
with 2011 and 2001, respectively. While the number of studies
constantly increases, many challenges remain to be faced relative
to the research methods that are used. Reports have highlighted
that poor-quality research is a major issue in the biomedical
field and in oral health research2,3. Up to October 2022, the
Catalogue of Bias had identified 62 different types of bias in
biomedical research4 making it challenging to plan new studies.
New biases and data security issues may continue to arise as
an increasing amount of research involves digital sources and
artificial intelligence to acquire and use information obtained from
patients. Once the studies have been completed, open sharing of
Published online: 22 September 2023
research data could enable data verification and reuse. Although
calls for open science have intensified in recent years, the majority
of authors are still reluctant to share their data, even when they
indicate in their article that their data is available on request5.
These are only some of the issues plaguing the modern research
enterprise.
It is of crucial importance for the dental community to
understand how dental research is planned, funded, conducted,
reported, and disseminated. Moreover, the consequences of
research biases, use of open science tools, and impact of dental
research on society should be assessed. In such a complex
scenario, meta-research studies play a key role.
Meta-research, i.e., research on research or methodological
studies, could be considered a new discipline devoted to
studying research practices. Results of meta-research studies
(MRS) make it possible to identify problems and plan initiatives
to qualify and disseminate good scientific practices6,7. MRS may
include mixed research methods and present a variety of
frameworks, including different objectives (e.g., assessing bias,
methods, reporting practices, test interventions to improve
research practices, or summarize knowledge), designs (crosssectional, longitudinal, prospective, retrospective, or studies of
interventions), units of analysis (types of study, analysis, records,
or humans), and sampling strategies8.
A recent example of the importance of MRS could be illustrated
throughout the COVID-19 pandemic. While a considerable number
of articles were published, MRS emphasized the presence of
research problems and the need to interpret study findings
cautiously. The problems included redundant, poorly reported,
and irreplicable systematic reviews9–11 and biased publications
with the presence of spin and ethical issues12–14. It was shown that
many researchers did not share their data openly at the beginning
of the pandemic although they hurried to post their findings on
preprint servers15. Cases such as these demonstrated how metaresearch could help to improve the applicability of scientific
findings during a public health emergency.
MRS studies in dentistry are still scarce. Faggion et al.
identified that the majority of the 155 dental MRS published in
5 years focused on general dentistry questions, studied research
methods, and the primary studies included in most MRS were
randomized trials16. To date, few MRS have assessed in vitro
studies and we still do not have a proper tool for critically
appraising dental laboratory studies. Ioannidis et al. pointed out
that many themes could be covered by meta-research, including
methods, reporting, reproducibility, evaluation, and incentives6.
These areas have still not been sufficiently explored in the dental
science. This link https://osf.io/72pqg presents examples of how
meta-research themes and topics have been investigated in
dentistry, in addition to opportunities that are open for
exploration. Apparently, we have a long road ahead to attain
advancement with MRS in dentistry.
The dental research community needs to pay attention to this
matter because meta-research scientists may face several
challenges throughout their processes of research. The first
challenge to overcome is to acquire sponsorship for MRS, as
funding agencies and grant assessors may not be very receptive
to meta-research proposals6. One reason for this barrier could
be that sponsors and assessors assume that MRS do not require
specific apparatus or laboratory structure, and consequently,
99
funding may not be necessary. However, computers, software
programs, file hosting and other online services are essential for
this work, and the team involved in the research should be paid.
Furthermore, there is prejudice against MRS, which has been
described as not being “real research” or “not even medicine”17.
Therefore, authors, journals, and editors play an essential role
in demonstrating the importance of MRS to sponsors, for the
improvement of dental science.
Another challenge is the lack of proper guidance to help
researchers to plan and conduct meta-research. One example is
the usual arbitrary selection of a relevant period (e.g., number of
years) within which studies will be retrieved and data synthesized
when evaluating a given subject. In this situation, authors could
either conduct searches without time restrictions, use a specific
time period (e.g., last 5 years), or two periods (e.g., before and after
guideline publication). In this case, the main recommendations are
to justify the choice of the period selected and verify whether
there is any relevant event (e.g., publication of a guideline or
checklist) that could have impact on the selection and results18.
The time is ripe for the development of guidance on conducting
evidence-based meta-research with emphasis on the methodological expectations.
The third challenge is related to the peer-review process. Editors
and reviewers may be tempted to classify all meta-research
studies as being systematic reviews and encourage authors to use
the PRISMA reporting guideline, for instance19. However, metaresearch is not merely a systematic review, even when systematic
searches are conducted, using structured article screening and
data extraction processes. A more recent initiative has been to
develop a specific reporting guideline for MRS8,20, but this is also
particularly challenging due to the complex and varied nature and
possibilities in meta-science.
This editorial emphasizes the contemporary relevance of MRS in
dentistry and challenges faced by meta-researchers. Metaresearch plays a vital role in the advancement of oral health
research, implementation of good research practices, and reduction (...truncated)