Professional Documents
Culture Documents
Original article
Abstract
Objective: To analyze study topic, study design, usage of statistical test, and other selected document parameters in published original
research articles. Materials and Methods: Three journals (1) Indian Journal of Community Medicine (IJCM), (2) Indian Journal of Public
Health (IJPH), and (3) Bulletin of World Health Organization (WHO) were reviewed and all original research article published during three
years, that is, January 2014 to December 2016, were considered, and selected document parameters were recorded using checklist. During this
period, IJCM released volumes 39 to 41, IJPH released 58 to 60, and WHO released 92 to 94. Results: A total of 318 original articles were
reviewed with the contribution of 28.9% in IJCM, 27.6% in IJPH, and 43.3% in WHO bulletin. Out of all the publications, highest (46.5%)
original article belonged to research domain category-I [communicable, maternal and child health (MCH)] followed by 104 (32.7%) category-
II (noncommunicable diseases) and 66 (20.8%) by category-III (health system, medical education, and environment). Overall 79.2% original
articles were cross-sectional in study design followed by cohort (15.4%), intervention/experimental study (3.4%), and case-control (1.8%).
Average number of authors per article in WHO bulletin was 8.1 [95% confidence interval (CI): 7.19.0] followed by IJCM 4.2 (95% CI:
3.84.6), and IJPH (3.84, 95% CI: 3.494.19). There were 95 (29.9%) articles where-in all the authors were from a single institution, whereas
in 223 (70.1%) articles coauthors were from different institutions. It was also found that most (80.1%) of the study papers did not contained
any background statement regarding statistical sample size estimation; 239 (75.2%) articles used statistical software; majority had utilized
SPSS (61.08%), followed by STATA (19.24%), SAS (8.76%), R-software (5.45%), EPI-info (3.76%), and EXCEL (1.25%); nearly 210 (66%)
original research articles utilized at least one of the inferential statistics (basic, advance, and survival analytical methods). Higher proportion of
advance (60.2%) inferential statistical test and survival analysis (92.3%) were used in Bulletin of WHO; 82% of references used were within
10 years of publications of articles in WHO while this figure was 66% (IJCM) and 63% (IJPH). Conclusion: This study provides an objective
snapshot of national and international public health journal that may aid researcher for better comprehension, situational, and trend analysis as
well as assist them in their future research endeavor.
Keywords: Author mapping, bibliometric evaluation, citation, document properties, developing countries, global burden of disease, research
publications, statistical test, study-design, study topic, statistical software
INTRODUCTION Address for correspondence: Dr. Sandeep Sachdeva, MD, DNB, Department
of Community Medicine, North DMC Medical College and Hindu Rao Hospital,
The conveyance of information by research publication is New Delhi-110007, India.
responsible for growth and development of the subject area, e-mail: sachdevadr@yahoo.in
journals as well as authors and readers. This further provides
This is an open access article distributed under the terms of the Creative Commons
Access this article online Attribution-NonCommercial-ShareAlike 3.0 License, which allows others to remix,
tweak, and build upon the work noncommercially, as long as the author is
Quick Response Code:
credited and the new creations are licensed under the identical terms.
Website:
www.mamcjms.in For reprints contact: reprints@medknow.com
new insights and inspiration for new researchers to work on that is, January 2014 to December 2016 were considered,
the same or related field. Role of scientific journal ranges downloaded from the respective website, and reviewed by
from building a collective knowledge base, communicating authors. Thus editorial, personal view-point, commentary,
information, validating the quality of research, distributing oration, review article, student research section, field report,
rewards, and building scientific communities across the essay, news or letters to editors were excluded from present
globe.[1-3] During last decade there has been increased analysis. During this period IJCM released volumes 39 to 41;
thrust being given to research in the developing countries IJPH released 58 to 60 and WHO released 92 to 94.
especially India due to various internal and external driving
For every original research article following document
forces. Interalia there has been rapid expansion of research
parameters were recorded using check-list: thematic topic of
publications and appearance of new journals with a
research domain, study design, statistical methods, software,
considerable fear of diluting the quality of research
inputs for proper calculation of sample size, number of authors,
standards. An attempt has been made in the present study
department, and institution of first/corresponding authors,
to undertake selective bibliometric evaluation of original
number of pages and references used. The research domain
research articles published in reputed national and
was classified and adapted according to global burden of
international public health journals.
disease[9] categories: category-I = communicable, maternal,
Bibliometrics are quantitative technique of measuring output, perinatal, congenital, food-borne, vaccine coverage, and
mapping pattern, emerging trend and obsolesce of nutritional disorders; category-II = noncommunicable
publications, authorship, citation impact, and use of diseases, mental health, associated risk factors, geriatrics,
literature. It encompasses measurement of properties of drug abuse, injuries, burn, occupational diseases, domestic
documents and document related processes.[4,5] However, violence, and oral health; and category-III = miscellaneous
surveying peer-reviewed medical journals for their (health systems research, medical education, environment, and
contents in terms of study design and statistical methods is information technology).
not an uncommon practice.[6-8] This review is expected to
Papers containing statistical analysis beyond descriptive
serve as an objective approach for improving the quantitative
statistics (percentage, mean, median, and standard
and qualitative content of journal and learning amongst
deviation) were classified into three categories of
readers as there are very limited studies available to throw
inferential statisticsbasic, advance, and survival analysis.
light on this dimension.
We utilized SPSS ver. 16 (IBM, Armonk, New York, USA) to
Indian Journal of Community Medicine (IJCM) and Indian summarize our study findings by descriptive statistics and
Journal of Public Health (IJPH) are peer-reviewed, calculating chi-square value.
historically trusted, widely acknowledged quarterly
English language publications in the domain of RESULTS
community medicine and public health managed by two
independent professional bodies in the country. Both these A total of 318 original articles were reviewed with the
free to access journals are indexed in large number of contribution of 28.9% in IJCM, 27.6% in IJPH and 43.3%
database and earliest records of IJPH available in in WHO bulletin with 256 (80.5%) original research articles
PubMed dates back to year 1961 and 1974 (IJCM) being full-length papers while rest (62, 19.5) were brief/
respectively. IJCM is available online (www.ijcm.org.in) shorter format of original research articles.
since September 15, 2007 and IJPH is available online Table 1 and Figure 1 depict thematic study domain of
(www.ijph.in) since September 25, 2010. For comparison published original research articles. Out of all the
purpose, we also evaluated international journal of publications, highest (46.5%) original article belonged to
public health, Bulletin of the World Health Organization research domain category-I (communicable, MCH etc.)
(available in PubMed since 1948) on the same followed by 104 (32.7%) category-II (noncommunicable
parameters. Both IJCM and IJPH publish peer reviewed diseases etc.) and 66 (20.8%) by category-III (health
quarterly (four issues per year) while bulletin of system, medical education, environment, etc.). Highest
the WHO is published on monthly bases (12 issues per research articles with category-I (communicable diseases,
year). SCImago Journal Rank of IJCM was 0.62 MCH etc.) domain was published in bulletin of WHO (70,
with 1.14 cites/document; IJPH was 0.44 with 0.83 cites 47.3%) followed by IJCM (41, 27.7%) and IJPH (37, 25.0%).
and Bulletin of the WHO was 2.82 with 4.97 cites/ Amongst noncommunicable category, both the Indian
documents. journals had similar but slightly higher publications than
WHO while category-III research domain was dominated
MATERIALS AND METHODS in WHO bulletin.
Three journals (1) IJCM, (2) IJPH, and (3) Bulletin of World The study design of 79.2% original research articles was
Health Organization (WHO) journal were reviewed. All cross-sectional in nature followed by cohort (15.4%),
original research published either as full-length paper or intervention/experimental study (3.4%) and case-control
brief/short communication during last three calendar years (1.8%). Details are shown in Table 2 and Figure 2.
The quality of publication in both Indian journals has evolved This is in contrast to Pakistan Journal of Medical Sciences
for better since last couple of years. Both the Indian (20052015), where nonclarity of research design ranged
community medicine (I = 44.5%, II = 40.2%, and III = from 5 to 16%.[15]
15.2%) and public health (I = 42.4%, II = 40.9%, and III =
An interesting study assessing the quality of reporting of
17.04%) journal have published similar proportion of original
cross-sectional studies (20102011) in IJCM described that
articles under broad three-research categories. However,
58% of the articles reported less than 15 items of the desirable
bulletin of the WHO published category-I = 50.7%,
22 in the Strengthening the Reporting of Observational
category-II = 22.4%, and category-III = 26.8%, reflecting
Studies in Epidemiology statement checklist.[16] This
the higher burden of communicable disease/maternal and
information is needed to give readers a clear idea as to
child health issues amongst substantial population of
what was planned and what was done. Similarly, in our
developing and under-developed countries of the world.
study, it was observed that most (80.1%) of the study
Another study (20042009) carried out on four Indian papers did not contain any background statement regarding
journals also depicted that 43% of all published articles statistical sample size estimation, which is very crucial to any
were on noncommunicable diseases (category-II). It was efficient study design. Another important aspect noted was
also reported that IJCM published about 30% of articles that 134 (42.1%) articles did not report clear inclusion/
on non-communicable diseases (NCDs).[10] In our study exclusion criteria for the sample recruitment. One of the
(20142016), higher proportion (40.2%) of articles on probable reasons for this could be the word-count
NCDs were published reflecting the time evolution and restriction imposed by journals in manuscript.
priority being received by NCDs in the recent times. Since Rigby et al. found that articles reporting no statistics
developing country like India is undergoing epidemiological constituted 29.1, 32.4, and 40.7% studies in the British
transition and experiencing double burden of disease, both the Medical Journal, British Journal of General Practice, and
Indian journal seems to be adequately reflecting the ground- Family Practice, respectively.[17] Nonutilization of statistics
realities. in our analysis was 34%. On a corollary, 66% of articles had
Considering the feasibility and applicability perspective, utilized some statistical test that is in contrast as reported in
cross-sectional studies are easy to conduct, and hence the study published in Journal of Family and Community
predominance (79.2%) of such designs in public health Medicine (71%) and Chinese Medical Journal (78.1%).[11,18]
research articles as noted in present analysis. This finding Majority of health journals prescribe Vancouver style of
seems to corroborate with other studies done amongst reference formatting with increase focus on recent journal
international primary care, general, community medicine, publications as references. Number of references/article
or public health journal too.[11] There are limited studies allowed is directly related to type of manuscript, strength/
available on public health journals for comparison purpose detail of write-up, word-limit restriction, and/or number of
especially in Indian setting. However, this is in contrast to pages per articles and should be visualized accordingly. The
another study, evaluating predominantly 14 Indian clinical Indian journals prescribe limits of 6 authors with 30 references
journals wherein 60.8% research articles were prospective in full-length original articles and up to 6 authors with 10
study and least common was cross-sectional study (6.2%) references in short/brief research article. In our analysis, mean
design.[12] McDermott, way back in 1991, found that 35.0% number of references used with 20.2 (95% CI: 18.322.1) in
papers published in JAMA, The Lancet, and New England IJCM and 17.8 (95% CI: 16.119.5).
Journal of Medicine were clinical trials.[13] Another recent
study carried on these three clinical journals for the period Both the Indian journals have evolved for better in terms of
(20052009) reflected randomized clinical trial (30.9%), quality of research and publications yet the difference
clinical trial (3.7%), cohort and case-control studies observed on review of literature could perhaps be due to
(19.2%), cross-sectional studies (2.4%), and case reports specialty (clinical vs. public health journal). The scope of
(43.8%).[14] publication in Indian journals could be enhanced with young
public health researchers exploring clinical epidemiology in
In our analysis, there was no article with ambiguous research future. Both Indian journals have demonstrated certain
design in any of the three journals that is suggestive of good- strength and similarities in present study and discussed by
quality research/write-up and/or editorial screening decision. authors elsewhere also.[19,20] Introspection and constructive
criticism when taken in positive perspective facilitates growth 10. Mony PK, Srinivasan K. A bibliometric analysis of published non-
and development leading to learning, expansion, and communicable disease research in India. Ind J Med Res 2011;134:232-
34.
retention of journal users in long run. 11. Aljoudi AS. Study designs and statistical methods in the Journal of
Family and Community Medicine 19942010. J Fam Community Med
Financial support and sponsorship 2013;20:8-11.
12. Jaykaran X, Solanki P, Saxena D, Kantharia ND. Study design and
Nil. statistical methods in Indian Medical Journals. J Pharm Negative
Results 2011;2:35-8.
Conflicts of interest 13. McDermott MM, Lefevre F, Feinglass J, Reifler D, Dolan N. Changes
in study design, gender issues, and other characteristics of clinical
There are no conflicts of interest. research published in three major medical journals from1971 to 1991. J
Gen Intern Med 1995;10:13-18.
14. von Ballmoos MCW, Ware JH, Haring B. Clinical research Quo Vadis?
REFERENCES Trends in reporting of clinical trials and observational study designs
1. Momen H. The role of journals in enhancing health research in over two decades. J Clin Med Res 2015;7:428-34.
developing countries. Bull World Health Organ 2004;82:163. 15. Akhtar S, Shah SWA, Rafiq M, Khan A. Research design and statistical
2. Ding Y, Foo S, Chowdhury G. A Bibliometric analysis of collaboration in methods in Pakistan Journal of Medical Sciences. Pak J Med Sci
the field of information retrieval. Int Inf Lib Review 1999;30:367-76. 2016;32:151-54.
3. Doloon DJ. The role of peer review for scholarly journals in the 16. Jeelani A, Malik WR, Haq I, Aleem S, Mujtaba M, Syed N. Cross-
information age. J Electron Publ 2007;10:1-10. sectional studies published in Indian Journal of Community Medicine:
4. Glanzel W. Bibliometrics as a research field. A course on theory and evaluation of adherence to strengthening the reporting of observational
application of bibliometric indicators: 2013. Available from nsdl. studies in epidemiology statement. Ann Med Health Sci Res
niscair.res.in/jspui/bitstream/123456789/../1/Bib_Module_KUL.pdf. 2014;4:875-8.
[Last accessed Mar 9, 2016]. 17. Rigby AS, Armstrong GK, Campbell MJ, Summerton N. A survey of
5. Borgman CL, Furner J. Scholarly communication and bibliometrics. statistics in three UK general practice journal. BMC Med Res Methodol
Annul Rev Inform Scie Tech 2002;36:3-72 2004;4:28.
6. Emerson JD, Colditz GA. Use of statistical analysis in the New 18. Jin Z, Yu D, Zhang L, Meng H, Lu J, Hong M, et al. A retrospective
England Journal of Medicine. N Engl J Med 1983;309:709-13. survey of research design and statistical analyses in selected Chinese
7. Thomas T, Fahey T, Somerset M. The content and methodology of Medical Journals in 1998 and 2008. PLoS One 2010;5:e10822.
research papers published in three United Kingdom Primary Care doi:10.1371/journal.pone.0010822
Journals. Br J Gen Pract 1998;48:1229-32. 19. Dwivedi N, Sachdeva S. Forecasting visitor accession trend of two
8. Wang Q, Zhang BH. Research design and statistical methods in prominent Indian health journal websites for the period 20152020
Chinese Medical Journals. JAMA 1998;280:283-85. using time-series analysis. Digit Med 2016;2:57-63.
9. Mathers CD, Lopez AD, Murray CJL, editors. The burden of disease and 20. Sachdeva S, Sachdev TR, Sachdeva R. Bibliometric evaluation of
mortality by condition: data, methods, and results for2001. Global Burden published Indian research on knowledge, attitude, and practices. Indian
of Disease and Risk Factors. New York: Oxford University Press; 2006. J Health Sci Biomed Res 2017.