A Delphi study for setting up tobacco research and practice network in India
© Persai et al. 2016
Received: 24 June 2015
Accepted: 25 January 2016
Published: 2 February 2016
There are key gaps in the production and dissemination of evidence-based tobacco control research in developing countries. In India, limited research has been made to address and understand the function, constitution, thematic areas of research of a research and practice network in tobacco control. This study aimed to identify priority areas that were agreed by stakeholders for building tobacco research and practice network in India.
This study used the well-established Delphi survey, which involves asking experts a recurring progression of questions through a series of questionnaires. The study was conducted in two rounds in the year 2013–14. Experts working in tobacco control participated in the study. In Round II, respondents rated agreement using a five-point Likert scale. Interquartile Range (IQR) was used to calculate the strength of the consensus.
Experts expressed strong consensus on tobacco cessation and economic research as a focus areas for tobacco research network in India. Lack of funding was stated as a barrier impeding formation of tobacco research network in India by majority of respondents. A strong consensus was achieved on the fact that network can be sustained financially by Government funds (IQR = 1). Information sharing and capacity building of young researchers were the two major benefits as stated by respondents which achieved strong consensus.
This study produced the first national stakeholder-informed priority area for developing tobacco research and practice network in India. The consensus priorities highlight the most important and urgent needs in developing research and practice network in tobacco control.
Tobacco use is the single most important cause of preventable morbidity and premature mortality . In India over a dozen distinct forms of tobacco are consumed by millions of people . In comparison to the huge diversity of the problem, tobacco research is still in its nascent stages. In Low and Middle Income Country (LMIC) such as India, few people work full time on tobacco control. Even fewer are involved in tobacco control research that is relevant for the populations. A plethora of research conducted in LMICs has yet to be summarized and disseminated and important combinations and linkages have yet to be made within the voluminous evidence produced by researchers . Studies have suggested that the barriers to research in tobacco control in India include lack of data standardization and weak communication networks . There are also key gaps in the production and dissemination of evidence-based tobacco control research. Evidence-informed policies and programs can easily be impeded when there is insufficient capacity to produce new and relevant research to meet the information need of decision makers in timely manner . On the other hand failure to translate evidence into practice threatens to undermine much of the excellent tobacco control work undertaken in many low- and middle-income countries . In addition, linkages within selected expert groups have limited the work in consensus building on contentious issues in tobacco control. Overall a collaborative and cohesive approach to respond to the problem has not been the characteristic of research in tobacco control. One of the reasons for such disconnect amongst researchers could be a lack of a national tobacco research network in the country where researchers can connect with each other and share ideas, protocols, and findings. While many of the electronic networks have contributed positively to the discussion of tobacco control, they are not universally accessible in the developing world .
Research of different types can contribute to more effective choice and implementation of tobacco control activities but resources are limited and expertise in this field is scarce. There is a case for concentrating research resources on investigating targeted problems and potential solutions in tobacco control. If researchers and funders were to concentrate efforts and resources, then which topics should be the focus and which criteria should be used to set priorities? Should choices be made on the likelihood of the question being answerable by current methods? We believe that the research platform would only work if the framework of such a platform is developed by inputs from researchers throughout the country. In India, limited research has been made to address and understand the function, constitution, thematic areas of research and establishment of a practice network in tobacco control. The present study aimed to assess the perceptions of varied stakeholders working in tobacco control to guide the formulation of the Tobacco Research and Practice Network in India. The purpose of this paper is to present a new conceptual framework for developing tobacco research and practice network in India.
This study used the Delphi survey, which involves asking questions through a series of questionnaires. The Delphi method has been used to develop research priorities in many areas of health. We selected it because it is known to be effective when (1) consensus is sought in an area where none previously existed, (2) the research problem does not lend itself to precise analytical approaches but can be illuminated by subjective collective judgments, (3) the study respondents have diverse backgrounds in their experience and expertise and therefore consensus cannot easily be reached [8, 9].
Questionnaire and methodology
Survey tools for Round I & II
Survey tool for Round I
What are the main factors holding back the formation of Tobacco control Research and practice Network (TRNI) in India?
What should be the priority of the TRNI?
What should be the focus of TRNI?
How TRNI can aid in implementation of tobacco control policies and program in the country?
How the quality of good tobacco control research and practice network can be assured?
What are the activities which can be undertaken in the TRNI?
How TRNI can financially sustain?
How TRNI can help in your research and practice?
Survey tool for Round II
Below, is a list of the focus areas identified for tobacco research and practice network. Please rate each of the areas in terms of its value in developing a Tobacco Research and Practice Network in India.
How can Tobacco Research and Practice Network influence evidence-based implementation of tobacco control policies and programs?
What are the main factors holding back research dissemination & knowledge sharing in research pertaining to tobacco control in India?
How can the TRNI address such issues?
According to you, who should be the part of tobacco research network in India?
What activities can enhance information exchange between researchers in the Tobacco Research and Practice Network
How TRNI would benefit researchers?
Three-stage process for establishing consensus on research priorities
Topics identified through literature review
Survey instrument was developed and refined as follows:
− Online survey pilot
− Online survey data were collected from
respondents (n = 36; 60 % response rate)
Consensus formed by expert panel (Delphi process) (n = 10)
− Expert panel completed online survey
− Consensus declared by
facilitator and group
Topics were incorporated into survey instrument
Stakeholder survey data provided foundation for consensus formation
Research priorities finalized and disseminated
▪ Focus of tobacco research network in India
▪ Factors holding back research dissemination & knowledge sharing in research pertaining to tobacco control
▪ Evidence-based implementation of tobacco control policies and programs
- 2)Organizational Structure & Funding
▪ Members of Tobacco research network in India
▪ Financial sustainability of tobacco research network in India
- 3)Partnerships & Networking
▪ Information sharing among members of TRNI
▪ Benefits of Research Network
Researchers and practitioners were sampled according to their expertise. In the first round, the survey instrument was sent to 60 researchers working in tobacco control across different regions of the country.
As the Delphi technique is a qualitative method, the samples needed to be comparable in terms of homogeneity but not in terms of representativeness. Nevertheless, the Delphi technique is valid, in terms of its effect on outcomes, irrespective of sample size . A rigorous procedure has been followed to ensure the identification of relevant experts and gave them the opportunity to participate in the study. Characteristics of the final sampling frame were reviewed to assure that it included policy makers, researchers, academia and Non-government organizations. Potential respondents for the survey were identified as those who had multiple publications in tobacco-related research or who have expertise in tobacco control.
Based on the results of Round I, research areas were identified and mutually exclusive research questions were framed. Analysis of surveys in rounds II used descriptive statistics. Interquartile ranges (IQRs) were calculated for the panel responses to each question. The “level of agreement or disagreement” achieved was measured according to the following criteria: Consensus on a questionnaire item was considered “strong” when at least 75 % of respondents reached an agreement. “Moderate” consensus required 60 % to 74 % of respondents to agree on individual items of the questionnaire. Absence of consensus was determined when less than 60 % of respondents agreed on the individual items. Interquartile range (IQR) is used to calculate the strength of the consensus. IQR is the absolute value of the difference between the 75th and 25th percentiles, with smaller values indicating higher degrees of consensus. Interquartile range of 0 specifies a strong group consensus and 2 indicates dispersed responses [11, 12]. Statistical analyses were performed using SPSS Version 17.
The study was approved by the institutional ethical committee. The respondents provided their written informed consent to participate in the study. The institutional ethics committee approved the consent procedure.
Participation, attrition, demographic data
Of the 60 experts whom we attempted to contact, 36 experts agreed to participate in the first round of the survey. A total of 10 experts participated in the second round. The average years of experience of respondents in tobacco control were 10 years. Professional backgrounds of the experts in both rounds were in national and international NGOs (31 %), Government (31 %), research organizations (11 %), and medical institutes (27 %).
Experts consensus in Delphi study
Consensus (agreement in %)
Inter quartile range
Focus of TRNI
Implementation of tobacco control policy
Sharing best practices
Funds from government
Factors holding back research dissemination
Lack of funds
Benefits of the network
Focus of TRNI
Implementation of tobacco control policy
Establishing standard protocols
Factors holding back research
Lack of technical expertise
Funds from International organizations
Involvement of private sector and pharmaceutical companies
Private sector should be involved with caution
Benefits of the network
Evidence-based policy implementation
Factors holding back research
Lack of emphasis on tobacco control
Lack of platform/forum
Nominal membership fees
Involvement of private sector and pharmaceutical companies
Private sector can be in involved in the network
Pharmaceutical companies should be involved with caution
Private sector and pharmaceutical companies should not be involved in the network
Benefits of the network
Barriers in formation of tobacco research network in India
In the first round, more than two-third of the respondents stated that lack of emphasis on tobacco-related research (77 %) and lack of collaboration between researchers and research organizations (62 %) are the main barriers in formation of tobacco research and practice network in India. Respondents stated that other factors which impede formation of a network are lack of funding (39 %) and resistance among researchers in sharing data (19 %). In the second round, experts had strong consensus on lack of funding as a barrier impeding formation of tobacco research network in India (IQR = 0). However, no consensus was achieved on lack of emphasis on tobacco-related research in the Round II of Delphi survey.
Focus of research and practice network in tobacco control
Experts were asked about their opinion on focus of the research and practice network. In Round I, all the respondents agreed on the fact that the focus of research and practice network should be on surveillance and legislation. More than two-third of the respondents agreed that the focus should be on tobacco cessation, diseases research and economics and taxation-related research. However, in Round II experts expressed strong consensus on tobacco cessation and economic research (IQR = 1) as a priority area of focus for tobacco research network in India.
Network’s role in implementation of tobacco control policies and program
Network structure and sustainability
Experts mentioned that the network should be multidisciplinary. A strong consensus was obtained on involvement of Government authorities, Non-Government Organizations and academia in the research and practice network. However, no consensus was observed on involvement of pharmaceutical and private sector in the network. In the first round of survey, experts stated that network can be sustained financially by securing funds from government (45) and international organizations (45 %). However, strong consensus was achieved only on fact that network can be sustained financially by Government funds.
Benefits of research and practice network in tobacco control
Discussion and conclusions
This study produced the first national stakeholder-informed priority area for developing tobacco research and practice network in India. The consensus priorities highlight the most important and urgent needs in developing research and practice network in tobacco control. The expert panel approach was successful in building on stakeholder survey results to further define and prioritize research themes that reflected consensus. Final priorities were crafted into a statement which could be effectively communicated to the larger group of stakeholders.
The training, skills, and areas of expertise of researchers and practitioners working in tobacco control differ greatly . For example, a researcher who studies the tobacco cessation uses different methods and requires a different skill set than a more applied researcher who compares the impact of different policies on tobacco control legislation. However, both types of research can influence the course of tobacco control. Thus, we captured responses of experts working in different areas in tobacco control on the focus of the research and practice network. The expert panel considered articulating research priorities that would be broad enough to encompass critical areas of research, yet sufficiently specific to guide the identification of actual priority areas for the research and practice network. Ultimately, the panel defined four major focus areas for the research and practice network identified in first round of survey i.e. Tobacco Cessation, legislation, diseases research and economics research. However, in the second round strong consensus was obtained only on the two areas i.e. tobacco cessation and economic research. Studies suggest that research on interventions to promote tobacco cessation and prevent tobacco initiation have been areas of relative neglect [14, 15]. Thus, research and practice network must accord priority to the design interventions to reduce tobacco consumption, promote cessation and prevent initiation.
WHO and the Global Tobacco Research Network have conducted studies assessing factors that foster and impede tobacco control research in low and middle income countries. These studies have shown consistently that funding, infrastructure, and resources are the most challenging impediments to building up tobacco control research [16, 17]. Similarly, findings of our study revealed that lack of funds, lack of resources, and lack of platform are the few factors which impedes research dissemination in tobacco control.
Consistent to the structure of tobacco research network in other developing and developed countries, majority of the respondents in our study emphasizes that research and practice network should be multidisciplinary and should involve researchers, academia, NGOs and Government bodies. However, there are examples of health promotion networks that purposefully excluded government representatives because of the perception that their presence would prevent the use of effective advocacy mechanisms . Partnerships and alliances involving both government representatives and representatives of civil-society organizations thus pose challenges if the end result is perceived to be government action such as policy and program implementation.
Studies which assessed factors that impede tobacco control research in low and middle income countries have shown consistently that funding, infrastructure, resources are the most challenging impediments to building up tobacco control research [17–19]. Similarly, in our study experts from all professional affiliations chose funding issues as most important factor impeding formation of tobacco research network in both the rounds of survey. This underline the complexity of the issue and the need to increase and sustain public and private sector funding towards tobacco related research and formation of research network in India.
Analysis of the results of the Round I showed the researchers and practitioners stated that the research and practice network will benefit young researchers by improved information dissemination, technical support, access to tools and protocols, and increased career opportunities. Similar findings were reported in a study by Stillman et.al conducted in 2011 . Considering the current and potential socio-economic burden of tobacco production and consumption there is an urgent need to bolster research capacity of young researchers in tobacco control.
Findings from this study revealed that Delphi method could be a valuable tool for building consensus on research and activities in tobacco control. The potential limitations of this study are low response rates in the online survey, low sample size in Round II of the survey, known weaknesses of the Delphi technique and the subjective process used for defining expert panelists for the sampling frame. The Delphi technique is also limited by whether the anonymous nature influences accountability and response rates . Finally, the survey was concluded at the end of Round II even though full consensus was not achieved for all of the items. Although it is possible that greater consensus would have been reached with additional rounds, the decision was made to end the study due to concerns about limitation of time, panel fatigue and associated low response rates.
The present study envisaged that consensus-based research priorities would serve as a common rallying point for researchers and practitioners working in tobacco control to collaborate around common research goals. In this respect the study assesses perception of researchers and practitioners on available research infrastructure, capacities, organizational structure and themes of the research and practice network in tobacco control. The method of this study provides a model for the initial development of framework of tobacco research and practice network in India. Further work is needed to establish the validity of the responses. Consensus on the underlying constructs, themes, focus and constitution should be prioritized before setting up a research and practice network. These findings provide direction for future research based on the consensus views of renowned researchers, practitioners, policy makers and civil society members. It is acknowledged that priorities for research change as evidence builds to answer the questions. A much larger assessment which will collect information on organizational expertise and priorities and ongoing tobacco control research activities is needed.
This work was supported by a Wellcome Trust Capacity Strengthening Strategic Award to the Public Health Foundation of India and a consortium of UK universities.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- U.S. Department of Health and Human Services. The Health Consequences of Smoking: A Report of the Surgeon General. Atlanta: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health; Washington, D.C.; 2004. http://www.cdc.gov/tobacco/data_statistics/sgr/2004/complete_report/index.htm. Accessed 10 May 2015.
- Warner KE. The role of research in international tobacco control. Am J Public Health. 2005;95:976–84. doi:10.2105/AJPH.2004.046904.PubMed CentralView ArticlePubMedGoogle Scholar
- Stillman FA, Wipfli HA, Lando HA, Leischow S, Samet JM. Building capacity for international tobacco control research: the global tobacco research network. Am J Public Health. 2005;95(6):965–8. doi:10.2105/AJPH.2004.047183.PubMed CentralView ArticlePubMedGoogle Scholar
- Baris E, Waverley B, Prindiville J. Research priorities for tobacco control in developing countries: a regional approach to a global consultative process. Tob Control. 2000;9:217–23. doi:10.1136/tc.9.2.217.PubMed CentralView ArticlePubMedGoogle Scholar
- McDonald P, Viehbeck S, Robinson S. Building research capacity for evidence-informed tobacco control in Canada: a case description. Tob Induced Diseases. 2009;5:12. doi:10.1186/1617–9625–5–12.View ArticleGoogle Scholar
- Research for International Tobacco Control (RITC). Bridging the Research Gaps in Global Tobacco Control: Report on the Meeting in Ottawa, Canada, 2002. Ottawa. Ontario, Canada: RITC; 2002.Google Scholar
- World Health Organization. Building blocks for tobacco Ccontrol- a Hhandbook. Geneva: World Health Organization; 2004.Google Scholar
- Bayley EW, MacLean SL, Desy P, McMahon M. ENA’s Delphi study on national research priorities for emergency nurses in the United States. J Emerg Nurs. 2004;30:12–21.View ArticlePubMedGoogle Scholar
- McIntyre S, Novak I, Cusick A. Consensus research priorities for cerebral palsy: a Delphi survey of consumers, researchers, and clinicians. Developmental Medicine & Child Neurolog. 2010;52(3):270–5.View ArticleGoogle Scholar
- Reste JY, Nabbe P, Rivet C, Lygidakis C, Doerr C, Czachowski S, et al. The European general practice research network presents the translations of its comprehensive definition of multimorbidity in family medicine in Ten European languages. PLoS One. 2015:10(1).Google Scholar
- Rayens MK, Hahn EJ. Building consensus using the policy Delphi method. Policy Polit Nurs Pract. 2000;1:308–15.View ArticleGoogle Scholar
- Novakowski N, Wellar B. Using the Delphi technique in normative planning research: methodological design considerations. Environ Plan. 2008;40(6):1485–500.Google Scholar
- Stillman FA. Capacity building and human resource development for tobacco control in Latin America. Salud Publica Mex. 2010;5(2):S340–6.View ArticleGoogle Scholar
- Reddy S, Chaloupkaii FJ, Arora M, Panda R, Mathur MR, Sametvi J. Working paper series. WHO Meetings on Development of a prioritized Research Agenda for Prevention and Control of Noncommunicable Diseases 2008, 2009, 2010. Geneva Switzerland: World Health Organization; 2010.Google Scholar
- World Health Organization. Research Agenda for Prevention and Control of Major Noncommunicable Diseases (NCDs). Geneva Switzerland: World Health Organization; 2010.Google Scholar
- World Health Organization. Joint national capacity assessment of the implementation of effective tobacco control policies in Thailand. Geneva: World Health Organization; 2011Google Scholar
- Global Tobacco Research Network. Tobacco control needs assessment. Conducted in September 2009 for the Second SRNT-IAHF Latin America Tobacco Control Conference. Mexico: Mexico City; 2009.Google Scholar
- International Network of Health Promotion Foundations. Supporting the establishment of new Health Promotion Foundations: strategies for resource mobilization. Bangkok: International Foundation for Health Promotion; 2005.Google Scholar
- Hamann SL, Mock J, Hense S, Charoenca N, Kungskulniti N. Building tobacco control research in Thailand: meeting the need for innovative change in Asia. Health Res Policy Syst. 2012;10:3.PubMed CentralView ArticlePubMedGoogle Scholar