Developing and evaluating a smartphone application …...Developing and evaluating a smartphone application for tuberculosis amongst private sector academic clinicians in India Mémoire
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Developing and evaluating a smartphone application for tuberculosis amongst private sector
academic clinicians in India
Mémoire
Tripti Pande
Maîtrise en Santé Communautaire – Santé mondiale Maître ès sciences (M. Sc.)
application for tuberculosis amongst private sector
academic clinicians in India
Mémoire
Tripti Pande
Sous la direction de :
Marie-Pierre GAGNON, directrice de recherche
Madhukar PAI, codirecteur de recherche
iii
Résumé Contexte : La tuberculose est la première cause de mortalité au monde et parmi les 10,4
millions de cas de tuberculose par année, 2,8 millions proviennent de l’Inde. De ce fait, il est
considéré comme le pays ayant le plus haut taux d’incidence de la tuberculose au monde.
Une manque de qualité des soins est une cause majeure pour l’épidémie de la tuberculose en
Inde. Le secteur privé, qui n’est pas réglementé, prend soin de 50% des patients ayant la
tuberculose. Des études précédentes indiquent le mauvais diagnostic ou le mauvais traitement
comme des facteurs qui sont présents dans le secteur privé. Ce secteur comprend plusieurs
types de médecins, dont ceux qui ont un diplôme en médecine et ceux qui n’ont pas de
diplôme en médecine mais pratiquent la médicine. Une amélioration dans l’éducation des
cliniciens utilisant les technologies mobiles, dont les applications mobiles, pourrait être une
solution pour améliorer et assurer la qualité des soins des patients ayant la tuberculose.
Toutefois, il existe peu d’études sur les technologies mobiles pour la tuberculose en Inde.
Objectifs : Ce mémoire vise à évaluer l’expérience de l’usager et l’acceptabilité d’une
application mobile (LearnTB) parmi les cliniciens académiques du secteur privé en Inde.
Méthodes: L’étude a utilisé une approche à deux étapes. Cinq cliniciens (étape 1) et 101
cliniciens (étape 2) ont été contactés à Kasturba Hospital Manipal, Manipal, Inde entre février
et mars 2017. L’expérience des participants était évaluée par le System Usability Scale.
L’acceptabilité était évaluée par un questionnaire adopté du Technology Assessment Model.
Les résultats étaient analysés à l’aide des statistiques descriptives, la régression linéaire
multiple ainsi que la régression logistique.
Résultats : Des taux de réponse de 100% et 99% ont été obtenus pour la première et
deuxième partie respectivement. L’expérience de l’usager était vraiment positive. En ce qui
concerne l’acceptabilité, une analyse de cheminement a confirmé la relation directe entre
l’utilité perçue et l’intention d’utilisation, et la relation indirecte entre la facilité d’utilisation
perçue et l’intention d’utilisation. La régression logistique a permis de cibler les items qui
influencent fortement l’intention d’utilisation.
Conclusion : L’expérience de l’usager pour LearnTB était vraiment positive, et l’utilité
perçue a le plus grand impact sur l’intention d’utilisation (acceptabilité). Cette étude permet
d’avoir une analyse préliminaire de l’acceptabilité des cliniciens concernant les technologies
iv
mobiles pour la tuberculose en Inde. D’autres recherches dans ce domaine sont requises afin
d’assurer l’implantation optimale de ces technologies.
v
Abstract Background: Tuberculosis (TB) is the leading infectious killer, and India accounts for 2.8
of the 10.4 million TB cases that occur each year, making it the highest TB burden country
worldwide. Poor quality of TB care is a major driver of the epidemic in India. India’s large
private, unregulated health sector manages over 50% of the TB patients, with studies showing
suboptimal diagnosis and treatment in the private sector. This sector comprises of health
professionals who are medically trained, and those who are not medically trained but are
practicing medicine. Better education of doctors using mobile health (mHealth) applications
is a possible solution. However, little is known about mHealth around TB in India.
Objective: This masters thesis aimed to evaluate the user experience and acceptability of a
smartphone application for TB (LearnTB) amongst private sector academic clinicians in
India.
Methods: This study adopted a two part approach. Five clinicians (part 1) and 101 clinicians
(part 2) were contacted at Kasturba Hospital Manipal, Manipal, India between February and
March 2017. The user experience of participants (part 1) was evaluated based on the System
Usability Scale (SUS). Acceptability (part 2) was evaluated based on the Technology
Acceptance Model (TAM). Data were analyzed using descriptive statistics, multiple linear
regression as well as logistic regression analysis.
Results: Response rates of 100% and 99% were achieved for part 1 and part 2, respectively.
User experience was very positive. Regarding acceptability, a path analysis confirmed the
direct relationship between perceived usefulness and intention to use, and the indirect
relationship between perceived ease of use and intention to use. Logistic regression analysis
helped target items strongly influencing intention to use.
Conclusion: The user experience with LearnTB was very positive, and perceived usefulness
has the highest impact on intention to use (acceptability). This study provides a preliminary
analysis of mHealth interventions for TB in India, and emphasizes the need for future
research in this domain.
vi
TABLE OF CONTENTS
Résumé ................................................................................................................................. iii Abstract .................................................................................................................................. v
List of Tables ..................................................................................................................... viii List of Figures ....................................................................................................................... ix
Abbreviations ........................................................................................................................ x Acknowledgement ................................................................................................................ xi
Avant – propos ................................................................................................................... xii CHAPTER 1 Introduction ................................................................................................. 1
CHAPTER 2 Context ......................................................................................................... 5 2.1 General information: Tuberculosis ...................................................................... 5 2.2 General epidemiology of TB .................................................................................. 6 2.3 Revised National TB Control Programme (RNTCP) ......................................... 7 2.4 Health portrait of India ......................................................................................... 7
2.4.1 Geographic, demographic and economic context ............................................. 7 2.4.2 Health systems: the increasing gap ................................................................... 9
2.5 General information: mHealth ........................................................................... 10
4.1 User experience: the importance of usability studies ........................................ 17 4.2 Development of mHealth strategies .................................................................... 18 4.3 Acceptability of mHealth interventions .............................................................. 19 4.4 Factors influencing adoption of mHealth interventions ................................... 21 4.5 Knowledge gap & justification ............................................................................ 22
CHAPTER 5 Research Question and Objectives .......................................................... 25 5.1 Question ................................................................................................................ 25 5.2 Objectives .............................................................................................................. 25 5.3 Hypothesis ............................................................................................................. 25
CHAPTER 6 Mobile application ..................................................................................... 26
CHAPTER 7 Methodology .............................................................................................. 29 7.1 Study design .......................................................................................................... 29 7.2 Study setting ......................................................................................................... 29 7.3 Study population & recruitment ......................................................................... 30 7.4 Data collection ...................................................................................................... 32 7.5 Data analysis ......................................................................................................... 34 7.6 Ethics consideration and approvals .................................................................... 35
Appendix A : Proof of submission ..................................................................................... 84 Appendix B : Search strategy ............................................................................................ 85
Appendix C : SUS questionnaire ....................................................................................... 86 Appendix D : Tasks for user experience (part 1) ............................................................. 88
Appendix E : TAM questionnaire ..................................................................................... 89 Appendix F : Consent forms .............................................................................................. 92
viii
List of Tables Table 1 : Part 1 – Sociodemographic characteristics (n=5) ................................................. 66Table 2 : Variables and items present in TAM questionnaire (n=100) ................................ 66Table 3 : Part 2 – sociodemographic characteristics (n=100) .............................................. 68Table 4 : Pearson’s correlation coefficients between variables (n=99) ............................... 69Table 5 : Multiple linear regression model for Intention to Use .......................................... 70
ix
List of Figures Figure 1 : Political map of India (source : www.worldmaps.org) ......................................... 8Figure 2: Original 10 statement SUS questionnaire developed by J. Brooke in 1996 ........ 13Figure 3: Original Technology Assessment Model (TAM) by Davis 1989 ........................ 15Figure 4: Adapted version of TAM including user experience ........................................... 16Figure 5: LearnTB application – home page ....................................................................... 27Figure 6: LearnTB application – subsections present in Section 6 “Childhood tuberculosis”
....................................................................................................................................... 27Figure 7: LearnTB application – figure of chest x-ray in Section 4 “Role of chest x-rays in
the management of tuberculosis” .................................................................................. 28Figure 8: Map of Manipal, Karnataka, India (source : http://szusicon2017.com/travel/) ... 30
x
Abbreviations BCE: Before common era
CE: Common era
CÉRUL: Comité d’éthiques de la recherché avec des êtres humains de l’Université Laval
DOI: Diffusion of innovation theory
DOTS: Directly observed treatment short course
eHealth: Electronic health
GDP: Gross domestic product
HBC: High TB burden country
IU: Intention to use
LMIC: Low and middle income country
MBBS: Bachelor of medicine and bachelor of surgery
MDR-TB: Multi-drug resistant tuberculosis
mHealth: Mobile health
MUEC : Manipal University ethics committee
NAATS: Nucleic acid amplification tests
NTP: National tuberculosis program
PDA: Personal digital assistants
PEU: Perceived ease of use
PTB: Pulmonary tuberculosis
PU: Perceived usefulness
RNTCP: Revised national tuberculosis control program
SMS: Short messaging service
SUS: System usability scale
TAM: Technology assessment model
TB : Tuberculosis
TB-HIV: Tuberculosis and HIV coinfection
TPB: Theory of planned behavior
TRA: Theory of reasoned action
UTAUT: Unified theory of acceptance and use of technology
WHO : World Health Organization
xi
Acknowledgement This thesis project has been brought to its stage today through the TMA Pai Endowment
Fund, and the help and support of many key people. Firstly, I would like to thank my
supervisor Dr. Marie Pierre Gagnon for her constant support and reassurance throughout the
whole entire thesis process. From the day that we had met to discuss my thesis project, you
did not cease to help me in any way possible. Your confidence and continuous drive to make
me reach my goals has brought me to the stage I am at today; submitting my masters thesis,
thank you! I would also like to thank my co-supervisor Dr. Madhukar Pai for his constant
push to allow me to reach the heights I did with this thesis project. Your constant
encouragement has helped me create new opportunities and achieve the goals I had planned
for this thesis project, thank you!
I am grateful to Dr. Zelalem Temesgen and Mr. Al Seyoum for their countless hours allowing
the prototype version of the LearnTB application be ready for demonstration in India. I would
also like to thank Dr. Kavitha Saravu for being an amazing field supervisor in Manipal. The
way you flawlessly integrated me into the hospital environment since the first day I reached
India definitely eased the data collection process and helped me reach my sample size goal.
Also, a special thank you to Dr. Deekthish Mahadev for your dedication to helping me
achieve my target sample size, as well as Dr. Shipra Rai and Dr. Raghavendra Rao for their
efforts in participant recruitment.
Thank you to all my friends and colleagues in Manipal for your immense hospitality and
easing my stay in India. Many thanks to all the interns, post graduate residents, junior faculty,
senior faculty and staff of Kasturba Hospital Manipal for participating in this research study.
As I submit this thesis, I would like to thank my family for their immense encouragement
during my masters degree. We have gone through it together, and thank you for always being
there. Thank you to all my friends who have supported me and shown me the positive side
of the situation throughout these two years- special thank you to Johanne and Priscille!
Finally, thank you to all my professors for your support and mentorship throughout my
academic career, it has helped me reach where I am today. Thank you everyone!
xii
Avant – propos This masters thesis comprises of one original article titled “Evaluating clinicians’ user
experience and acceptability of LearnTB, a smartphone application for tuberculosis in
India”. The primary author of this article is Tripti Pande, and the co-authors include her
thesis supervisor Dr. Marie-Pierre Gagnon, co-supervisor Dr. Madhukar Pai, followed by Dr.
Kavitha Saravu, Dr. Zelalem Temesgen, Mr. Al Seyoum, Dr. Shipra Rai, Dr. Raghavendra
Rao, Dr. Deekshith Mahadev. Tripti Pande, author of the article and this thesis, designed and
conducted the study as well as wrote the manuscript. Drs. Marie-Pierre Gagnon and
Madhukar Pai helped design the study and edit the manuscript. Dr. Kavitha Saravu provided
field supervision at Kasturba Hospital Manipal, Drs Shipra Rai, Raghavendra Rao and
Deekshith Mahadev helped in participant recruitment and data collected at Kasturba Hospital
Manipal. Dr. Zelalem Temesgen and Mr. Al Seyoum helped in the development of the
LearnTB application. All co-authors helped finalize the manuscript for submission.
The article has been inserted into Chapter 8 – Manuscript, of this thesis project. A detailed
introduction, context and methods section has been presented prior to the article, to help
readers understand the need for such a research study. The article presents similar sections,
however does not contain as much detail. By presenting a pre-lude to the manuscript, the
author hopes that all readers will understand the scientific and social justification for such a
research study.
The article was submitted to the mHealth journal on May 9th, 2017 and accepted without
revisions on June 27th, 2017 (DOI: 0.21037/mhealth.2017.07.01). The proof of submission
is presented in Appendix A.
1
CHAPTER 1 Introduction
Tuberculosis (TB), caused by Mycobacterium tuberculosis, is an airborne infectious disease
known to be the leading infectious disease killer in the world (1). In 2015, the World Health
Organization (WHO) reported 10.4 million new cases of TB causing 1.8 million deaths
worldwide (2). Furthermore, there is a gap of 4.3 million between incident and notified cases
of TB. India, Indonesia and Nigeria account of 50% of this gap (2). There are 30 high TB
burden countries in the world (HBCs), composed largely of low- and middle- income
countries (LMICs) (3), where India is the highest TB burden country, accounting for 27%
(2.8 million) of the world’s TB cases, and 29% of the 1.8 million TB deaths (2).
The End TB strategy, previously proposed by the WHO, had three milestones for 2020 to
end TB burden worldwide: 35% reduction in TB deaths, 20% reduction of TB incidence rate
and 0% of TB affected families should face catastrophic costs due to treatment (3). These
numbers have since been revised to 95%, 90% and 0% respectively for 2035. The current
rate of decline of TB is 1.5% (3). To achieve the End TB strategy goals, this rate must
increase to 4-5% per year (2).
Scientific studies had previously underestimated the TB incidence rate, due to insufficient
data provided by countries (4). India has increased its case notification rate by 34% between
2013 and 2015, allowing an improved estimation of the world wide TB burden (2). Research
continues to highlight the constant neglect and mismanagement of TB patients within India’s
two prominent health care sectors, the public and private sector, causing the high burden of
disease (5, 6).
The public sector is regulated by the Indian government, whereas the private sector is not (7).
Over the past 20 years, the private sector has grown from managing 5-10% of the general
patient population to 82% (5). Moreover, this sector manages 50% of India’s TB cases and
studies have reported patients prefer private clinics as opposed to public clinics. The private
sector lacks regulation regarding diagnostic and prescribing practices (8) due to its “for-
2
profit” nature and the high heterogeneity amongst health care professionals. There are
qualified formal doctors, as well as unqualified/informal providers and practitioners of
alternative medicine. Nevertheless, patients prefer private sector clinics as they are of closer
proximity to vulnerable populations residing in remote rural areas, and there is minimal wait
time (8). Studies have shown the increased need to implicate the private sector, especially
health care professionals, in TB control interventions throughout India (9). The implication
of NIKSHAY, an electronic TB case notification system, has significantly increased the case
notification rates in India, due to its presence in the private sector. Between 2013 and 2015
NIKSHAY increased India’s case notification by 34%, which is the largest TB case
notification increase worldwide (4). The latter emphasizes the potential of the new era digital
technologies in health, especially in the Indian context.
Mobile health (mHealth) is defined as the delivery of health care services and information
through the internet and telecommunication technologies (10). It has the potential to play a
vital role in delivering health care to remote populations lacking human resources, through
the use of mobile phones (10). India is the second highest mobile phone consumer due to its
low cost handsets, thus making it an excellent target for such interventions (11). Although
there are numerous different types of mHealth interventions, such as personal digital
assistants (PDAs), and short messaging service (SMS), mobile applications (smartphone
applications) are continuing to increase their market. mHealth is largely consumer driven and
previous studies have focused largely on developing mHealth interventions, and evaluating
the acceptability of the intervention after diffusion. A systematic review by Iribarren et al.
identified a total of 1332 mHealth applications of which 24 focused on TB (patient support,
health care provider management, and awareness) (12). Very few applications had been
formally studied in usability or acceptability (12). There are few studies on mHealth
strategies for TB amongst health care professionals in India and to our knowledge there is no
research study evaluating the user experience and acceptability of a smartphone application
amongst clinicians in the private sector in India. Better understanding of mHealth strategies
amongst private health care professionals in India will help increase uptake and eventually
help the future of TB patients in India.
3
With this perspective, this study aims to understand the user experience and acceptability of
a smartphone application for tuberculosis amongst private sector clinicians in India. The
private sector is targeted due to its unregulated nature. Health care professionals practicing
in the private sector often do not have the resources (laboratory equipment, lab personnel
financial stability) to perform proper diagnosis and treatment of TB. Studies show
complicated care seeking pathways, extensive diagnostic delays (13), widespread empirical
management (14) and poor adherence to established standard of care in the private sector
(15). All factors are largely attributable to the high TB burden present in India today.
Clinicians have been chosen as they are an educated population who are in contact with TB
patients everyday. They are the target population due to their ability to assure proper
diagnostic and treatment methods for TB. TB is chosen as the disease of interest, as it is the
highest infectious disease killer in the world, and of highest prevalence in India.
This thesis has been separated into 10 detailed chapters to facilitate understanding. In the first
two chapters, the author presents the introduction of the topic and detailed context of
tuberculosis in general, mHealth in general, TB burden in India, and mHealth interventions
currently in place in India. Subsequently Chapter 3 presents the theoretical frameworks
adopted for this thesis project and chapter 4 provides an overview of the existing scientific
literature on user experience, developing mHealth interventions, acceptability of mHealth
interventions, factors influencing adoption by health professionals and highlights the existing
knowledge gap. This chapter is concluded with a scientific and social justification for this
thesis project. Chapter 5 presents a structured view of the research question, objectives and
hypotheses. The mobile application of interest, LearnTB is presented in detail, with figures,
in Chapter 6. Chapter 7 provides an indepth overview of the methodology used to conduct
this thesis project, including explanation on the study design, setting, population, methods
for data collection, data analysis and ethics approvals obtained. Chapter 8 presents the
inserted manuscript. Chapter 9 presents a general overview of the results, highlights study
strengths and limits followed by an explanation regarding the thesis’ contribution to public
4
health. Finally, chapter 10 presents a brief conclusion regarding future recommendations for
scientific studies.
5
CHAPTER 2 Context
This chapter focuses on presenting the general context for both TB and mHealth. It will first explain the etiology and general epidemiology of TB, followed by a section regarding the Revised National Tuberculosis Control Program in India, an initiative assembled in 1997 to facilitate TB control in the public health sector of India. We will then elaborate on the TB burden in India and provide an overview of the two main health sectors in India, the public and private sector. The final section will elaborate on mHealth technologies and their presence around the world. It will mainly focus on providing an overview of the functionalities of mHealth and the different types of mHealth interventions existing worldwide and in India.
2.1 General information: Tuberculosis
Tuberculosis (TB) is an airborne bacterial infection caused by Mycobacterium tuberculosis.
Although there are numerous forms of TB such as extra pulmonary TB, military TB, and
laryngeal TB; pulmonary TB (PTB) is the most prominent form. Being an airborne disease,
TB can be transmitted via cough (16), rendering it to be a highly infectious agent in confined
spaces such as overpopulated health care centers and/or hospitals. There are two phases of
TB, the latent phase and active phase (16). Approximately 5-10% of individuals infected with
TB will progress to active TB cases during their lifetime (16). The remaining cases are known
to be latent TB cases. Although the chances of a TB infection progressing from the latent TB
phase to the active TB phase are quite minimal, the aggressive nature of the TB infection
demands timely diagnosis and adequate treatment.
There are numerous diagnostic tests for TB such as sputum smear microscopy, rapid
diagnostic tests, nucleic acid amplification tests (NAATS) as well as liquid and solid cultures
(2). Most TB programs use direct sputum smears to confirm TB diagnosis, however the
preferred gold standard is microbiological confirmation; liquid or solid culture (17, 18).
Regarding the treatment of TB, a 6-month regimen with four first line drugs; rifampicin,
isoniazid, ethambutol and pyrazinamide is prescribed (2). Due to lack of treatment adherence
amongst patients, the rates of multi-drug resistant TB (MDR-TB) have progressively
increased (2), thus leading to the availability of second and third line drug regimens as well.
6
2.2 General epidemiology of TB
Based on the annual WHO Global TB Report, there were 10.4 million new TB cases
worldwide. 60% of these cases emerged from India, Indonesia, China, Nigeria, Pakistan and
South Africa (2). Notified TB cases increased by 34% between 2013 and 2015 due to India’s
increased case notification system, however a global 4.3 million gap remains between
incident and notified cases (2). The largest proportion, 50%, of this gap is due to India,
Indonesia and Nigeria. Worldwide, 49 million patients with TB were treated between 2000
and 2015, however significant gaps between diagnostic practices and treatment regimens
continue to exist (2). In 2015, approximately 6.1 million TB patients had access to quality
care, however 4.3 million patients did not receive proper care. This gap can be closed through
better reporting, diagnosis and access to care (4).
India accounts for 27%, 2.8 million, of TB cases worldwide, thus making it the highest TB
burden country in the world (4). An estimated 40% of India’s population is infected with TB,
however the large majority are in the latent phase (19). TB prevalence is known as the number
of active TB cases. In 2015, 1.28 million TB cases were undergoing treatment under the
Revised National Tuberculosis Control Programme (RNTCP), however a rate of 111 per
100 000 cases were notified to the RNCTP (public sector) and 184 802 TB cases were notified
to the private sector (19). Drug resistant TB rates have drastically increased over the years,
leading India to be the country with the second highest multi drug resistant TB (MDR-TB)
burden. It accounts for 16% of the estimated 480 000 new cases of MDR-TB (20). TB human
immunodeficiency virus (TB-HIV) coinfection is prominent in India as TB is the most
common HIV related coinfection (21). Currently, 5% of TB cases in India are co-infected
with HIV (21). The TB HIV coinfection is often of higher risk to patients with latent TB
disease. In India, every two people out of five (2/5) have latent TB disease, thus increasing
their risk of developing TB-HIV coinfection (21). The national budget for TB is USD (United
States Dollar) $ 280 million, where 38% is domestic funding and 62% is international funding
(22). As reported by National Tuberculosis Programs (NTP), the total expenditure by the
NTP per TB case notified is USD $28. This is significantly lower than other HBCs, for
example Brazil where it is USD $118 (23). Globally, India’s TB burden is highly visible and
7
attributed to numerous factors, including lack of governmental support, lack of management
and the disparity between the health care sectors, the public and private sectors.
2.3 Revised National TB Control Programme (RNTCP)
The Revised National Tuberculosis Programme (RNCTP), launched in 1997 by the
Government of India under the recommendation of the WHO, aimed to reduce numerous
managerial issues such as lack of treatment adherence, non-standard treatment regimens and
lack of systematic information on treatment (24). This programme also implemented the
Directly Observed Treatment Short-course (DOTS) strategy encouraging patients to take the
proper medication and adhere to treatment regimens. The DOTS strategy also provides basic
TB diagnosis and treatment to all patients in India (24). Despite the promising nature of the
RNCTP strategy, India remains the highest TB burden country in the world due to the
disparities amongst the two health care sectors in India, the public and private sector. The
RNTCP DOTS strategy is not highly implemented in the Indian private sector.
2.4 Health portrait of India
2.4.1 Geographic, demographic and economic context
India, officially known as the Republic of India, is the second most populated country in the
world, with a population of 1.3 billion (22). It is bordered by six different countries; Pakistan,
China, Nepal, Bhutan, Bangladesh and Myanmar (23). Its northern mountain range, the
Himalayas, define the South Asian sub-continent from the rest of Asia. India is surrounded
by bodies of water as well, the Bay of Bengal to the east and the Arabian sea to the west. It
is known for its diverse religious and traditional culture. It has a vast history of colonization,
starting with the Indus civilization from 2600 – 2000 Before Common Era (BCE), followed
by the Muslim rule (Mughal era) in the 8th century Common Era (CE), then the Portuguese
lead by Vasco de Gama in 1498 ending with the 200-year British colonization. India gained
its independence on August 15th 1947, with 29 states and 6 union territories, and since has
been an independent democracy (23). Since independence, India’s economy has been
growing substantially, and it now hosts three of the world’s fastest growing high technology
8
cities; Bangalore, Chennai and Hyderabad (23). The total health expenditure is
approximately 4.7% of the Gross Domestic Product (GDP)1 and the gross national income
per capita is 5 international dollars (Int’l $)2 (22). Life expectancy at birth is 70 years for
females and 67 years for males, which is a healthy life expectancy according to WHO
standards (25). Literacy rates has increased to 72.2% (26) since 1951 (18.3%), however the
gap remains large between female literacy rates, 54.2% and male literacy rates, 75.9% (27).
It is visible that India has improved drastically in numerous aspects since independence and
continues to do so, however the TB burden and health care system continues to remain a
prominent issue.
Figure 1 : Political map of India (source : www.worldmaps.org)
1 The Gross Domestic Product (GDP) is an elaborate calculation of the total domestic uses of goods and services including exports but excluding imports (https://www.insee.fr/en/metadonnees/definition/c1365). 2 The international dollar, also referred to as the Geary-Khamis dollar, is a unit of currency permitting comparison with the United States Dollar through the same purchasing power parity (www.worldbank.org).
9
2.4.2 Health systems: the increasing gap
There are two main health sectors in India, the government controlled public sector and the
growing private sector. The public sector, as mentioned previously, is government controlled
and standardized (DOTS) treatment is offered at all public hospitals and clinics (28). The
RNTCP increasingly promotes universal access to quality TB diagnosis and treatment for all
patients in the community (29). 90% of TB cases are confirmed via positive sputum smears
in the public sector, unfortunately this is not so for the private sector (29). As mentioned
previously, microbiological confirmation is the preferred international gold standard
diagnostic test, however sputum smear is the most commonly used confirmatory diagnostic
test (17). The unmanaged and unregulated private sector has grown over the past 20 years. It
manages 82% of general patients and 50% of India’s TB population (5). The National Health
Survey-3 reported 70% of households in urban areas and 63% of households in rural areas
visit the private sector as their primary source of healthcare (30). It is often preferred by TB
patients due to social determinants such as distance, accessibility, responsiveness, and
opening hours (30). Numerous studies have shown a TB diagnosis-delay of two months, and
visits to three health care providers prior to receiving a treatment regimen (31). Additionally,
diagnostic techniques are not regulated in the private sector which leads to high cost of
reliable diagnostic equipment, and use of unreliable tests, i.e. blood tests (29). Despite one
third of the medically trained clinicians practicing in the private sector, there is a discrepancy
between what is reported by practitioners and what patients adhere to (32). Furthermore, a
large proportion of cases treated in the private sector are often left unreported, thus increasing
concern regarding this vastly unregulated sector (28). Private practitioners often do not
adhere to treatment regimens that are commissioned by the WHO, and often do not assure
treatment completion (33). There is a highly heterogeous population of private practitioners,
ranging from formally trained clinicians to informally trained practitioners and alternative
medicine practitioners. The inconsistency of care is often due to poor knowledge of TB
amongst informally trained practitioners, inaccessibility to proper training as well as
inadequate supervision and re-training. In summary, the large discrepancy in management
and regulation of the two health care sectors in India is apparent. The numerous lacunas in
the private health sector further emphasizes the need for extensive research in this sector, and
10
increases the need for public private partnerships, which is advocated by numerous studies
(31, 34).
2.5 General information: mHealth
Mobile health (mHealth) is defined as the delivery of health care services and information
through internet and telecommunication technologies (10). It has the potential to play a vital
role in delivering health care to remote populations lacking human resources, through the use
of mobile phones (10). mHealth technologies are not limited to mobile phones, they also
include; personal digital assistants (PDAs), PDA phones (ie. Blackberry®), smartphones (ie.
iPhone), portable media players (ie. MP3s), video-game consoles (ie. Nintendo), and ultra-
portable computers (ie. tablets) (35). Such technologies have been gaining popularity over
the past decade, due to their low cost interventions (35). mHealth technologies allow users
to overcome geographic barriers, as well as personal barriers, such as stigma and loss of
privacy (11). Previous studies have shown the rapid growth of mobile communications in
low income countries, thus permitting large geographical coverage (35-38). mHealth
strategies aim to support health care providers through education, patient management, and
support in diagnosis, as they are largely consumer centered and consumer driven (39, 40).
Although there is limited evidence on the effectiveness of mHealth, a systematic review
conducted by Gagnon et al. identified 33 studies evaluating adoption of mHealth
interventions amongst health care professionals. Less than half the studies were conducted
on physicians or medical residents and only one study was conducted in India (39).
India is the world’s second largest mobile phone consumer base, due to low cost handsets
and affordable calling plans (11). There are approximately 877 million (96%) wireless
subscribers in India (41). mHealth and eHealth technologies have been increasing steadily in
India for TB, namely SMS interventions. Studies have shown the use of SMS for TB
treatment adherence have increased compliance from 40% to 90% (11). Moreover, mHealth
interventions also include awareness, counselling services and data collection (42). An e-
Health web based case notification strategy largely implemented in 2012, NIKSHAY, has
significantly increased TB case notification in India, as reported in the WHO Global TB
11
Report 2015 (4). Through the introduction of this eHealth platform in both the private and
public sectors, the RNTCP has been able to actively engage the private sector in their TB
strategies. Between 2013 and 2015, this platform has increased TB case notifications in India
by 34%, the largest case notification improvement worldwide (4). The success of this eHealth
strategy demonstrates the potential of other eHealth, mHealth, telemedicine or mobile
technology interventions to be accepted in the Indian health care environment.
12
CHAPTER 3 Theoretical Framework
This chapter aims to present the two theoretical frameworks used for this study. To facilitate understanding this research study was separated into two parts; part 1 being a user experience study and part 2 being an acceptability study. To ensure understanding of terms used in our study, the following definitions have been listed:
- Acceptability: intention to use - Clinician: resident doctors and academic clinicians practicing at Kasturba Hospital
Manipal (Manipal University) - Mobile application: smartphone applications only - Usability: used as a proxy for user experience
PART 1:
Usability has been increasingly studied by researchers to optimize usage of mobile
technologies or information technologies (43). Although usability studies follow different
theoretical frameworks, the most common, free, and easy to use framework is the System
Usability Scale (SUS) developed by J. Brooke in 1996 (44). SUS, a Likert scale largely used
in usability studies, measures user experience, the utility including the efficacy and
satisfaction with which users accomplish specific tasks (45). It was created using statements
insisting extreme agreement or disagreement to specific statements. A pool of 50 questions
were initially used to create SUS. These questions were presented to respondents and
statements soliciting extreme agreement or extreme disagreement were used in the final SUS
questionnaire (46). According to Brooke et al. ambiguous questions are not good to determine
a participant’s attitude towards a specific technology. Therefore, SUS is often the scale
preferred by authors of usability studies (46). They assess participants’ immediate reaction
to the use of a specific technology, prior to any discussion with the researcher (46). Such
studies are often used to understand preliminary needs of users to improve prototype mobile
technologies, or to evaluate the usability of an existing technology. A SUS usually comprises
of 10 statements evaluating the user experience (Figure 2), however our study used the
modified version of SUS with 9 statements preceding acceptability assessment.
13
Figure 2: Original 10 statement SUS questionnaire developed by J. Brooke in 1996
PART 2:
There are numerous theoretical frameworks which exist to examine mHealth strategies
and/or interventions and their acceptability amongst users, namely the Theory of Planned
Behaviour (TPB) (47), the Diffusion of Innovation Theory (DOI) (48), the Unified Theory
of Acceptance and Use of Technology (UTAUT) (49). Each respective framework aims to
evaluate a different aspect of user acceptability, also classified as intention to use. The TPB
aims to demonstrate the attitudes and personality traits existent and influential to human
behaviour. The TPB originates from the Theory of Reasoned Action (TRA), but includes the
notion of behavioural control for behaviours over which humans have incomplete volitional
control (47). A separate theory, the DOI, aims to take a different approach to understanding
14
the acceptance of a technology. The theory diverges from the norm of persuading individuals
to change to a more evolutionary technique involving “reinvention” of product and
behaviours to better fit the needs of the individuals (50). The diffusion of new innovations,
as defined by Rogers, involves “an innovation that is communicated through certain channels
over time among the members of a social system” (48). This theory emphasizes the impact
time can have on the rate of acceptance of a specific innovation. It further examines a five
stage innovation decision process involving knowledge, persuasion, decision,
implementation, and confirmation. Adopters of the technology are also further classified into
4 categories, early adopters representing 13.5% of the study population, early majority
(34%), late majority (34%) and laggards (16%) (50). Each of the categories mentioned
previously differ from one another due to personality variables, as explained in the DOI.
Finally, the UTAUT has four key constructs; performance expectancy, effort expectancy,
social influence and facilitating conditions. This theory is largely limited to organizational
contexts and bases acceptance to use a technology on the latter. Based on predictions
suggested by this theory, performance expectancy, effort expectancy and social influence
should encourage behavioural intention and facilitate conditions for acceptance of a
technology (49).
Although all models mentioned above present numerous different factors influencing
intention to use, there are nuances which render them unsuitable for our research study.
Firstly, the TPB is not specific to information systems, or information technologies.
Secondly, the DOI is focused on preliminary steps of the development of an innovation, in
our case a mHealth intervention, which is not the main focus of our study. Finally, although
the UTAUT aims to evaluate individual factors in an organizational context, it is largely
focused on technical factors. The proposed theoretical framework for our study is the widely
used Technology Acceptance Model (TAM).
15
Figure 3: Original Technology Assessment Model (TAM) by Davis 1989
The Technology Assessment Model (TAM) proposed by Davis in 1989 is considered to be
influenced by the Theory of Reasoned Action (51). This framework is used to evaluate the
acceptability of an information technology by users in an organizational setting. The TAM
suggests that the acceptance (behavioral intention to use) of a new information technology is
affected directly and indirectly by a user’s attitude towards use (A), and two internal
individual beliefs; perceived usefulness (U) and perceived ease of use (E). Perceived
usefulness is defined to be “the user’s subjective probability that using a specific application
system will increase his or her job performance within an organizational context” (51),
whereas perceived ease of use is defined as “the degree to which the prospective user expects
the target system to be free of effort” (51). Behavioural intention to use measures the
likelihood of a person employing the intervention, whereas attitude is related to the user’s
evaluation of the desirability of employing the intervention (52). One of the advantages of
the TAM is that it can be generalized amongst all populations, however one of its
disadvantages is that it does not consider environmental factors such as institutional, or social
factors which can influence technology acceptance. Based on the original TAM presented in
Figure 3, perceived usefulness has a direct influence on behavioural intention to use, whereas
perceived ease of use has an indirect influence, through attitude. Our study plans to use a
modified version of TAM, eliminating the Attitude variable (Figure 4). Based on a previous
study conducted by Asua et al., attitude and perceived usefulness have shown
16
multicollinearity, and as attitude is more generic than perceived usefulness, it was eliminated
from the TAM model. For this reason, our study has also eliminated attitude from our
modified TAM (53).
Figure 4: Adapted version of TAM including user experience
User
experience
Perceived
Usefulness (PU)
Perceived Ease of
Use (PEU)
Behavioural intention to
use
Part 1 Part 2
17
CHAPTER 4 Literature review
This chapter provides an extensive overview of existing literature in mHealth strategies worldwide as well as ones targeting TB. A review of literature was performed using a broad search strategy on three main databases; PUBMED, EMBASE and Web of Science. Additional articles were also found through the bibliographies of included articles. The search strategy is presented in Appendix B. This chapter has been divided into five sections to facilitate understanding. We have regrouped the existing studies into the first four sections; user experience, development of mHealth strategies, acceptability of mHealth interventions, and factors influencing adoption of mHealth interventions. The final section presents the knowledge gap in the existing literature as well as the scientific and social justification of this thesis topic.
4.1 User experience: the importance of usability studies
User experience studies are important influencers in mHealth intervention development, as
they can potentially help increase eventual uptake and acceptability of the intervention (46,
54). Despite their high importance, few scientific studies have reported evaluation of user
experience. Previous studies have indicated the usefulness of SUS to quantify user experience
(54, 55). Both studies used mixed-methods by incorporating an interview following the SUS
questionnaire to enable qualitative results regarding the mHealth interventions. The study
conducted by Uddin et al. in Canada aimed to develop a mobile application to capture the
user’s electrocardiogram and transmit it to a mobile phone, in real time (54). The authors
assessed usability and task completion through both questionnaires and debriefing
interviews. The authors identified the main barrier as insufficient knowledge of the
application. Users took more time to complete given tasks, as they were unfamiliar with the
application (54). The study conducted by Gunter et al. in the United States of America (USA)
assessed the usability of the WoundCheck application, which allows patients to take a picture
of their wound and send it to their health care provider from their home (55). Participants are
given the application alongside a training program post – operation to assure proper
understanding of the application. The authors noticed a high degree of usability of the
application, as the average usability (SUS) score was 83.3, however similarly to Uddin et al.
the authors noticed delays in task completion as users were not familiar with the application
(55). Based on previous studies, the need for user experience is evident. A study conducted
by Mourouzis et al. stated the importance of usability studies namely to assure that the
18
application of choice responds to a specific problem (56). The authors also suggest
developing a beta version (prototype version) of the application, performing the usability
study on a set of participants and then improving the application prior to dissemination to the
public. Although some studies, presented below, have adopted this strategy, the two studies
Uddin et al. and Gunter et al. evaluated the user experience of the final versions of their
respective applications.
4.2 Development of mHealth strategies
In the context of evaluating the acceptability of mHealth strategies, certain studies aimed to
understand the context to further improve their mHealth intervention prior to evaluating the
acceptability of the application. A study conducted by Narasimhan et al. in India further
demonstrates this notion through their iterative pilot project study design. The authors aimed
to use their study to facilitate the eventual acceptance of their mHealth intervention by
improving the design of the software and service over time. The authors adopted an eight-
step approach to assure proper usability of their mHealth intervention. As there are numerous
theoretical frameworks which can be adopted to evaluate acceptance of technologies, the
authors adopted a House of Quality matrix as their framework to evaluate the “arrival to users
needs” (57). Regarding the health problem studied, the authors aimed to assist in treatment
adherence of TB medication amongst TB patients. Treatment adherence remains to be a large
issue in LMICs such as India, as patients often refrain from taking their medication after the
first two months of the six-month regime (58). Despite the positive results disseminated by
the authors, a limitation of the study was noted to be an absence of ownership of mobile
phones and knowledge of use amongst illiterate and elderly populations living in remote rural
areas (57).
This type of iterative study design is not limited to treatment adherence studies. For instance,
a study conducted by Ginsburg et al. in Ghana aimed to address childhood pneumonia
mortality and improve health care providers’ ability to diagnose and manage childhood
pneumonia via a mobile health application, mPneumonia (59). Similar to the study conducted
by Narasimhan et al., the researchers adopted an iterative development study design to create
19
their mPneumonia application. The researchers transformed a paper-based algorithm into a
step-by-step electronic questionnaire with instructions, and visual aids (i.e., pictures, videos)
on an Android mobile phone based system or a tablet technology. Although this study aimed
to understand the usability of the mobile based application, it did not report sufficient findings
regarding the acceptability of the application, therefore rendering it unable to reduce the
knowledge gap (59).
4.3 Acceptability of mHealth interventions
As mentioned in Chapter 2, section 2.5, there are numerous types of mHealth interventions
such as telecommunications (SMS), and eHealth, which aim to support health care
professionals or patients in various aspects such as treatment adherence, protocol compliance
and education. Based on a systematic review conducted by Kallander et al. summarizing
mHealth interventions focussing on community health workers in LMICs, the most common
mHealth intervention used was telecommunication (SMS) (60).
Three studies conducted in India aimed to understand the acceptability of a mHealth
applications amongst rural health care workers (61), community health workers (62), and the
general population respectively (41). Two studies aimed to enforce protocol compliance
using a mHealth intervention, through different methods (61, 62). The study conducted by
Gautham et al. focused on three conditions: fever, diarrhoea and respiratory problems (61),
whereas the second study conducted by Modi et al. focused on promotional maternal,
newborn and child health services amongst pregnant women or new mothers (62).
Additionally, both studies did not refer directly to the framework used to develop or evaluate
the acceptance of the mHealth intervention. However, Modi et al. mentioned the use of a
framework recommended by the Medical Research Council (United Kingdom) (62). The
study conducted by DeSouza et al. aimed to understand the acceptability of health care
interventions via mobile phones, specifically SMS (41). The authors performed a household
study, and 99% of participants expressed interest in receiving health promotion on their
mobile phones. However, a significant proportion of the participants preferred to receive
information through voice calls rather than SMS (41). The authors concluded that a major
20
barrier was literacy levels in rural villages. SMS reminders are often in English, and patients
in rural settings prefer communicating in their local languages (41). Similarly, the main
limitation stated by Gautham et al. as well as Modi et al. was the lack of previous exposure
to a mobile phone by the health care providers.
Contrary to the three studies mentioned above, a study conducted in Colombia aimed to
investigate the potential benefits in performance of community health care workers regarding
point of care clinical guidelines implemented as an interactive job aid on a mobile phone
based application (63). For the purpose of this study, an interactive job aid was defined as a
mobile-based application with audio-visual effects. Although the researchers provided
human simulated patients to the community health workers, they found that interactive job
aids on a mobile phone help reduce error rates and increase protocol compliance amongst
community health workers. The researchers highlighted the main limitation of the study to
be the use of human simulated patients rather than real patients as results may vary in real
patients due to disparities in medical conditions (63).
Further emphasizing this point, a systematic review conducted by Iribarren et al. aimed to
determine the number of TB apps, evaluate their functionality and determine if there was any
testing available on the apps (12). The authors identified 1332 health applications, of which
only 24 were TB related. Most applications targeting clinicians were not tested formally.
There were numerous functionality problems with the applications such as incapacity to
open, unavailability of files, and lack of up to date information (12). This systematic review
elucidates the need for acceptability studies for mobile applications targeting TB. A
systematic review conducted by Aranda-Jan et al. identified 44 studies evaluating mHealth
interventions in Africa, of which four focused on staff evaluation, monitoring and guidelines’
compliance (64). The largest number of studies (n=19) assessed patient follow up and
medication adherence. Although the feasibility of mHealth interventions for patient follow
up and treatment adherence was agreed upon unanimously by all studies included in the
systematic review, very few studies presented information regarding health workers’
guideline compliance (64, 65). Only one study evaluated health education, but amongst the
21
general population (66). This emphasizes the need for studies evaluating health
workers’/health professionals’ guideline compliance and health education in LMICs such as
India.
4.4 Factors influencing adoption of mHealth interventions
A systematic review conducted by Gagnon et al. aimed to identify studies evaluating factors
influencing the adoption of mHealth strategies amongst health care professionals (39). The
review was performed on all published studies between the years 2001 and 2014. The
researchers included 33 studies regarding mHealth strategies and factors influencing
adoption amongst health care professionals. They identified health care professionals as
nurses, physicians, residents, health workers, pharmacist and other providers (39). Overall
results of the systematic review indicated more than half the studies were performed in
developed countries, such as Canada, the United States of America and the United Kingdom.
A few studies were performed in Asia and Africa, of which only one study was performed in
India (39). All studies were largely conducted amongst health care professionals such as
nurses, midwives and community health care workers. This demonstrates the lack of
knowledge and studies present worldwide regarding the perspective of health care clinicians
and mHealth interventions.
Upon further review of the literature, four studies were retrieved evaluating factors
influencing mHealth adoption using an adapted version of the Technology Assessment
Model (TAM) (67-70). This theoretical model, further elaborated in chapter 5, is most
commonly used in mHealth acceptability studies. A study conducted in Germany adopted
Unified Theory of Acceptance and Use of Technology (UTAUT), an advanced extension to
the TAM model, as their favored theoretical framework for acceptability analysis (71). All
studies evaluated different groups such as; university faculty members (68), university
students (70), nursing home residents (69), and inpatient diagnostic groups (71). Although
all studies used the original TAM theoretical framework to assess the acceptability of the
mHealth interventions, some additional factors were added such as: job relevance, lack of
learning management system availability, lack of usage experience (68), and technology
22
anxiety and perceived enjoyment (69). The study conducted by Alharbi et al. (Saudi Arabia)
aimed specifically to evaluate the organizational context (68) and the study by Park (Korea)
aimed to evaluate solely the individual context (70). Contrary to the aforementioned studies,
Huang et al. (Taiwan) and Henneman et al. (Germany) aimed to test their technologies on
patients, namely inpatient diagnostic groups (71) and nursing home residents (69) rather than
health care professionals. Overal,l all three TAM studies concluded similar findings to those
suggested by the TAM theoretical framework, where an increase in perceived usefulness
increases the degree of positivity to usage, which therefore increases the behavioural
intention to use (67, 68, 70).
4.5 Knowledge gap & justification
Despite the limited scientific evidence studies have demonstrated a positive uptake of
mHealth technologies, namely telecommunications, applications for protocol compliance,
and applications for self-evaluation, amongst their respective populations (55, 57-59, 61-63,
71). Further emphasizing this point, Florez-Arango et al. (Colombia) reported a decrease in
error rates and enhanced protocol compliance amongst health care workers due to the mobile
application (63). However, two main questions soliciting increased research are: the
acceptance of such a mHealth technology amongst health care clinicians in India, and the
implementation of an mHealth technology to increase TB knowledge.
Firstly, there is lack of knowledge in the acceptance of mHealth interventions or strategies
amongst health care clinicians in India. Most studies included in the analysis focused their
mHealth strategies towards health care providers/workers (59, 61-63, 67, 68) or towards
patients (57, 58, 69, 71). The systematic review conducted by Gagnon et al., identified no
studies evaluating an mHealth intervention amongst physicians or clinicians in a LMIC (39).
Our study’s pertinence is further justified by the systematic reviews conducted by Iribarren
et al. elaborating the lack of testing of mobile applications for TB, targeting clinicians (12)
and Kallander et al. emphasizing the lack of studies evaluating smartphone mHealth
interventions in LMICs (60). With the exception of one study conducted amongst nurses and
doctors in Spain (67), a developed country, the knowledge gap regarding the perceptions of
23
health care clinicians towards the acceptance of a mHealth intervention for TB in LMICs is
evident. As indicated by Akter et al. mHealth is largely consumer driven and consumer
centered (40), therefore the need for studies in this specific population (health care clinicians)
in an LMIC, such as India, is highly visible. Additionally, Mouzoukis et al. have emphasized
the need for usability studies assuring the mHealth intervention responds to a specific
problem (56). The study has elucidated numerous steps which may lead to positive uptake of
a mHealth intervention, namely: study the user, involve clinicians and health professionals,
study health care landscape, and focus on core use cases (56).
Secondly, there are limited studies evaluating mHealth strategies increasing TB knowledge
amongst health care clinicians. Of the studies included in this literature review, four studies
observed mHealth platforms on diseases or services which were un-related to tuberculosis:
maternal and child health services (62), pneumonia (59), geriatric self assessment (69) and
fever, diarrhoea and respiratory problems (61). Although the Nihamsan et al. (India) study
evaluated treatment adherence to TB, our mobile application aims to educate Indian private
sector clinicians on TB diagnosis and treatment practices as this has been noted to be a
significant problem in India requiring public health attention (13).
Thirdly, most studies did not include their reference theoretical framework. Most studies
stating their reference theoretical framework used the TAM (67, 68) or a derivation, the
UTAUT (71). However, these studies were conducted in developed countries (67, 68, 71) or
amongst populations other than health care clinicians (68, 71). Additionally, few published
studies have evaluated the user experience regarding mHealth technologies. The two studies
included in this literature review evaluated user experience after having created the final
version of their respective applications. As indicated in previous studies, user experience or
usability studies are most fruitful when done on a beta/prototype-version of the application,
prior to dissemination (46, 56). Our study aims to assess the user experience, prior to
evaluating the acceptability of the mHealth intervention. As mentioned previously, mHealth
strategies are often consumer driven, thus to maximize the uptake of our smartphone
application, our study aims to further understand consumer needs.
24
Our study aims to surpass limitations presented in the previous studies, namely limited
accessibility (59) and knowledge of mobile technology by study populations (54, 55, 61, 62,
69). A survey conducted in 2013 by the Heart Care Foundation of India on numerous working
class professionals, reported that 31% of family physicians used smartphones, and 70% of
them keep their cellphone on them constantly (72). This survey validates the knowledge of
mobile phone technologies amongst health care clinicians in India.
In summary, the knowledge gap regarding mHealth strategies in India is apparent
emphasizing the need for more research in this field. Due to India’s growing mobile phone
user-base and TB burden, perhaps mHealth technologies may be a part of the solution to help
reduce TB incidence. To our knowledge, a scientific study evaluating user experience and
the factors influencing acceptance of a mHealth strategy for TB amongst health care
clinicians in India has not yet been documented, therefore bringing upon the interest of our
study in the public health platform.
25
CHAPTER 5 Research Question and Objectives
5.1 Question
Based on the context presented in the previous chapters, our study aims to answer the
following two questions:
1. What is the user experience of the private academic clinicians in India while using a
smartphone application for tuberculosis?
2. What factors influence the acceptability of a smartphone application for tuberculosis
amongst private sector academic clinicians in India?
5.2 Objectives
The main objective of the study is evaluating the user experience and acceptability of a
smartphone application – LearnTB – amongst private sector academic clinicians in India.
This will be further evaluated through the following sub objectives:
1. Identify the user experience with the aim of improving the mobile application
2. Identify, with the help of TAM, the factors influencing adoption of the smartphone
application.
5.3 Hypothesis
Based on the theoretical background, and context presented above, our study aims to
evaluate the following hypothesis, to support our research questions:
1. The usability of the mobile application can influence the user experience of the
private sector academic clinicians.
2. The TAM constructs shall explain a significant proportion of clinicians’ intention to
use the mobile application.
a. Perceived usefulness is positively correlated to intention to use
b. Perceived ease of use is positively correlated to intention to use
c. Perceived ease of use is positively correlated to perceived usefulness
26
CHAPTER 6 Mobile application
This chapter gives an indepth explanation of the smartphone application used in this study, LearnTB. It permits the readers to visualize the application and understand its origin.
The smartphone application of interest for this study, LearnTB, was inspired by the contents
of Let’s Talk TB, a free, online handbook aimed for general practitioners in India (available
http://www.letstalktb.org). The handbook has been specifically created for the Indian
medical context, and many chapters have been co-authored by Indian doctors. The LearnTB
application, a collaboration between Mayo Clinic Center for Tuberculosis (Rochester, USA)
and McGill International Tuberculosis Centre (Montreal, Canada), aims to educate Indian
clinicians regarding the definition, diagnosis, treatment, management and counselling
practices available for TB. The primary version of the application was created by Global
Innovative Services Inc. (Maryland, USA) This study tested the pilot website (prototype)
version of the application.
LearnTB presents numerous different sections regarding TB management, such as childhood
TB, latent TB infection, extra pulmonary TB, and common pitfalls of TB management
(Figure 5). Each section is based on International Standards of TB Care, as well as WHO
guidelines and Standards for TB Care in India (73, 74). When clicking on a specific section
(ie. Childhood tuberculosis), participants are presented with subsections involving
suspecting, diagnosing and treating TB for each respective case (Figure 6). Dosage tables,
and specific names of drugs are also included to facilitate understanding and ensure
comprehension. A subsection regarding chest x-rays for TB presents figures of different types
of TB lesions to help visualize the extend and manifestations of TB disease (Figure 7). The
section focusing on the TB HIV co-infection also includes frequently asked questions to help
clinicians asses specific/special cases. In addition to reference material, most sections present
short quizzes to assure proper comprehension and emphasize educational learning from the
application. A multiple choice response format was chosen for quizzes and upon selection of
the incorrect answer, clinicians were prompted to read a short explanation of the correct
answer. This emphasized the educational aspect of the LearnTB application.
Figure 7: LearnTB application – figure of chest x-ray in Section 4 “Role of chest x-rays in the
management of tuberculosis”
29
CHAPTER 7 Methodology
This chapter illustrates all methods used for this research study. To facilitate comprehension, it has been separated into 6 detailed sections: study design, study setting, study population, data collection (part 1 and part 2), data analysis (part 1 and part 2), as well as ethics considerations and approvals. Hereinafter, the first part of the study will be named “usability (part 1)” and the second part, “acceptability (part 2)”.
7.1 Study design
As the main purpose of the study was to describe the user experience and acceptability of the
LearnTB smartphone application amongst private sector clinicians in India, a cross-sectional
study design with no comparator group was used. Cross sectional studies are used to describe
a subpopulation within a reference population based on a specific outcome, at a given point
of time (75). They do not evaluate associations over a period, thus causality cannot be
inferred. Previous studies have used a cross sectional design for their user experience and/or
acceptability evaluations as well, thus this study design was preferred for our study as well
(53, 67, 68, 70).
7.2 Study setting
Both parts of the study took place at Kasturba Hospital Manipal, Manipal, India located in
the south Indian state of Karnataka. Karnataka, located on the west coast of India, is one of
the four large south Indian states with a population of 61.1 million (76). It has an overall TB
case notification rate of 98 per 100 000 (77) and approximately 40 000 TB patients are treated
in private clinics annually (78). It experiences one of the highest TB HIV coinfection
epidemics in India. Karnataka is separated into 30 districts, one of which is the Udipi district
which hosts Kasturba Hospital Manipal (Figure 8). The town of Manipal has a population of
280 000 which is largely comprised of Manipal University students, faculty and staff (79).
Kasturba Hospital Manipal, a tertiary teaching hospital for Kasturba Medical College,
Manipal University, has 2023 beds, 300 consultant doctors, 200 duty doctors, and 2200
support staff (80). It is ranked as the second best private medical college in India and is the
first medical hospital in Karnataka to achieve a National Board Accreditation of Hospitals
Affiliations : 1 Département de médecine préventive et sociale, Université Laval, Québec Canada 2 Department of Medicine, Kasturba Medical College, Manipal University, Manipal India 3 Manipal McGill Center for Infectious Diseases, Manipal University, Manipal India 4 Mayo Clinic Center for Tuberculosis, Mayo Clinic, Rochester, Minnesota, USA 5 Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal Canada
Corresponding author: Marie-Pierre Gagnon, PhD
Canada Research Chair in Technologies and Practices in Health 1050 Ave De la Médecine
Figure 6: Learn TB application - image of chest x-ray within section 4 “The role of chest
x-rays in the management of tuberculosis”
65
Figure 7: Part 1 - average SUS scores across different sociodemographic groups. The error
bars represent the 95% confidence intervals (n=5)
86
88
90
92
94
96
98
100
102
AVER
AG
E SU
S SC
OR
E
CHARACTERISTIC
66
Table 1 : Part 1 – Sociodemographic characteristics (n=5)
Characteristic N (%) Sex Male 3 (60) Female 2 (40) Age <30 years 3 (60) 30-39 years 1 (20) >40 years 1 (20) Title Medical resident/student 2 (40) Junior faculty member 1 (20) Senior faculty member 2 (40) Number of years of clinical experience 4.8 ±7.4
Previous use of mobile applications✝
Yes 3 (60)
No 1 (20) Comfortable with using mobile applications
Yes 4 (80)
No 1 (20)
✝Variable contains missing information
67
Table 2 : Variables and items present in TAM questionnaire (n=100)
Variables Items Mean ±SD Cronbach alpha (𝜶)
Perceived Usefulness (PU) 5.918 ±0.675 0.898 PU 1 The use of the LearnTB application could
help me assess my patients more adequately 5.904 ±0.893
PU 2 I think that it would be easy to perform the tasks necessary to assess my patients using the Learn TB application
5.967 ±0.857
PU 3 The use of the LearntB application could improve my assessment of my patients
5.925 ± 0.722
PU 4 The use of the LearnTB application is compatible with my work habits
5.606 ± 1.109
PU 5 The use of the LearnTB application could promote good clinical practice
6.00 ± 0.879
PU 6 Using the LearnTB application could improve my performance in patients care
6.01 ± 0.725
PU 7 Using the LearnTB application could facilitate the care of my patients
5.989 ± 0.809
Perceived Ease of Use (PEU) 5.596 ±0.579 0.757 PEU 1 I think that the LearnTB application would be
easy to use 6.03± 0.842
PEU 2 I think that the LearnTB application is a flexible technology to interact with
6.15 ± 0.737
PEU 3 I think that I could easily learn how to use the LearnTB application
6.39 ± 0.637
PEU 4 Using the LearnTB application could help me get the most out of my time assessing my patients
5.58 ± 1.129
Intention to use (IU) 6.00 ± 0.854 0.907 IU 1
I have the intention to use the LearnTB application for patient care
5.88 ± 0.966
IU 2 I have the intention to use the LearnTB application when it becomes available in my health center
6.02 ± 0.920
IU 3 I have the intention to use the LearnTB application when necessary to provide health care to my patients
6.12 ±0.902
68
Table 3 : Part 2 – sociodemographic characteristics (n=100)
Characteristics N Percentage (%)
Sex Male 60 60 Female 40 40 Age <30 94 94 30-39 4 4 40-49 1 1 50-59 1 1 >60 0 0 Title✝ Medical resident/ student 82 82.83 Junior faculty member 15 15.15 Senior faculty member 3 2.02 Technical staff 0 0 Years of experience 2.88 ±4.20☨ Previous use of mobile applications Yes 86 86 No 14 14 Comfortable with using mobile application* Yes 92 95.83 No 4 4.17 ✝This characteristic contains missing variables
☨These values represent the mean and standard deviation (SD)
69
Table 4 : Pearson’s correlation coefficients between variables (n=99)
IU PU PEU Age Sex Title
IU 1.0000
PU 0.70812 1.0000 <0.0001
PEU 0.27248 0.46072 1.0000 <0.0001 <0.0001
Age 0.01773 0.01577 -0.19606 1.0000 0.8617 0.8769 0.0518
Sex -0.11124 -0.25962 -0.00374 -0.07902 1.0000 0.2730 0.0095 0.9707 0.4369
PEU: Perceived Ease of Use; PU: Perceived Usefulness; IU: Intention to Use
70
Table 5 : Multiple linear regression model for Intention to Use
Variables Beta Standard error
95% confidence interval
P value
Unadjusted values
PU 0.936 0.101 0.734 – 1.138 <0.0001
PEU -0.109 0.119 -0.345 – 0.127 0.3625
Adjusted values
PU 0.982 0.107 0.769 – 1.195 <0.0001 PEU -0.092 0.125 -0.341 – 0.156 0.4616 Age -0.238 0.210 -0.656 – 0.179 0.2605 Sex 0.189 0.132 -0.073 – 0.452 0.1558 Title 0.319 0.198 -0.074 – 0.713 0.1111
PU: Perceived Usefulness; PEU: Perceived ease of use
71
REFERENCES
1. World Health Organization. Global tuberculosis report 2016. 2016. 2. World Health Organization. Private sector contributions and their effect on physician emigration in the developing world 2013 [Available from: http://www.who.int/bulletin/volumes/91/3/12-110791/en/. 3. World Health Organization. The End TB Strategy. 2015. 4. World Health Organization. Global Tuberculosis Report 2015. 2015. 5. Kanabus A. Information about tuberculosis 2016 [Available from: http://www.tbfacts.org/. 6. Bhargava A, Pinto L, Pai M. Mismanagement of tuberculosis in India: causes, consequences, and the way forward. Hypothesis. 2011;9(1). 7. Satyanarayana S, Subbaraman R, Shete P, Gore G, Das J, Cattamanchi A, et al. Quality of tuberculosis care in India: a systematic review. The international journal of tuberculosis and lung disease: the official journal of the International Union against Tuberculosis and Lung Disease. 2015;19(7):751-63. 8. Sandhu GK. Tuberculosis: current situation, challenges and overview of its control programs in India. Journal of Global Infectious Diseases. 2011;3(2):143. 9. Sengupta A, Nundy S. The private health sector in India: Is burgeoning, but at the cost of public health care. BMJ: British Medical Journal. 2005;331(7526):1157. 10. Salve S, Sheikh K, Porter JD. Private Practitioners’ Perspectives on Their Involvement With the Tuberculosis Control Programme in a Southern Indian State. International Journal of Health Policy and Management. 2016. 11. World Health Organization. WHO Report on Global Tuberculosis Control: Epidemiology, Strategy, Financing. Geneva: World Health Organization; 2013. 12. Sreeramareddy CT, Qin ZZ, Satyanarayana S, Subbaraman R, Pai M. Delays in diagnosis and treatment of pulmonary tuberculosis in India: a systematic review. The international journal of tuberculosis and lung disease: the official journal of the International Union against Tuberculosis and Lung Disease. 2014;18(3):255. 13. McDowell A, Pai M. Treatment as diagnosis and diagnosis as treatment: empirical management of presumptive tuberculosis in India. The International Journal of Tuberculosis and Lung Disease. 2016;20(4):536-43. 14. Das J, Kwan A, Daniels B, Satyanarayana S, Subbaraman R, Bergkvist S, et al. Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study. The Lancet Infectious Diseases. 2015;15(11):1305-13. 15. Ajzen I. The theory of planned behavior. Organizational behavior and human decision processes. 1991;50(2):179-211. 16. Free C, Phillips G, Felix L, Galli L, Patel V, Edwards P. The effectiveness of M-health technologies for improving health and health services: a systematic review protocol. BMC research notes. 2010;3(1):250. 17. Akter S, Ray P. mHealth-an ultimate platform to serve the unserved. Yearb Med Inform. 2010;2010:94-100. 18. Gagnon M-P, Ngangue P, Payne-Gagnon J, Desmartis M. m-Health adoption by healthcare professionals: a systematic review. Journal of the American Medical Informatics Association. 2016;23(1):212-20.
72
19. Elangovan R, Arulchelvan S. A study on the role of mobile phone communication in tuberculosis DOTS treatment. Indian journal of community medicine: official publication of Indian Association of Preventive & Social Medicine. 2013;38(4):229. 20. Brooke J. SUS-A quick and dirty usability scale. Usability evaluation in industry. 1996;189(194):4-7. 21. Uddin AA, Morita PP, Tallevi K, Armour K, Li J, Nolan RP, et al. Development of a Wearable Cardiac Monitoring System for Behavioral Neurocardiac Training: A Usability Study. JMIR mHealth and uHealth. 2016;4(2). 22. Gunter R, Fernandes-Taylor S, Mahnke A, Awoyinka L, Schroeder C, Wiseman J, et al. Evaluating Patient Usability of an Image-Based Mobile Health Platform for Postoperative Wound Monitoring. JMIR mHealth and uHealth. 2016;4(3). 23. Narasimhan P, Bakshi A, Kittusami S, Prashant S, Mathai D, Bakshi K, et al. A customized m-Health system for improving tuberculosis treatment adherence and follow-up in south India. Health and Technology. 2014;4(1):1-10. 24. Ginsburg AS, Delarosa J, Brunette W, Levari S, Sundt M, Larson C, et al. mPneumonia: Development of an Innovative mHealth Application for Diagnosing and Treating Childhood Pneumonia and Other Childhood Illnesses in Low-Resource Settings. PloS one. 2015;10(10):e0139625. 25. Modi D, Gopalan R, Shah S, Venkatraman S, Desai G, Desai S, et al. Development and formative evaluation of an innovative mHealth intervention for improving coverage of community-based maternal, newborn and child health services in rural areas of India. Global Health Action. 2015;8. 26. Gautham M, Iyengar MS, Johnson CW. Mobile phone–based clinical guidance for rural health providers in India. Health informatics journal. 2015;21(4):253-66. 27. Florez-Arango JF, Iyengar MS, Dunn K, Zhang J. Performance factors of mobile rich media job aids for community health workers. Journal of the American Medical Informatics Association. 2011;18(2):131-7. 28. DeSouza SI, Rashmi M, Vasanthi AP, Joseph SM, Rodrigues R. Mobile phones: the next step towards healthcare delivery in rural India? PloS one. 2014;9(8):e104895. 29. Gagnon MP, Orruño E, Asua J, Abdeljelil AB, Emparanza J. Using a modified technology acceptance model to evaluate healthcare professionals' adoption of a new telemonitoring system. Telemedicine and e-Health. 2012;18(1):54-9. 30. Alharbi S, Drew S. Using the technology acceptance model in understanding academics’ behavioural intention to use learning management systems. International Journal of Advanced Computer Science and Applications (IJACSA). 2014;5(1). 31. Huang F, Chang P, Hou I-c, Tu M-H, Lan C-f. Use of a Mobile Device by Nursing Home Residents for Long-term Care Comprehensive Geriatric Self-assessment: A Feasibility Study. Computers Informatics Nursing. 2015;33(1):28-36. 32. Park SY. An Analysis of the Technology Acceptance Model in Understanding University Students' Behavioral Intention to Use e-Learning. Educational technology & society. 2009;12(3):150-62. 33. Hennemann S, Beutel ME, Zwerenz R. Drivers and Barriers to Acceptance of Web-Based Aftercare of Patients in Inpatient Routine Care: A Cross-Sectional Survey. Journal of Medical Internet Research. 2016;18(12):e337. 34. Iribarren SJ, Schnall R, Stone PW, Carballo-Diéguez A. Smartphone Applications to Support Tuberculosis Prevention and Treatment: Review and Evaluation. JMIR mHealth and uHealth. 2016;4(2):e25.
73
35. Wilson EV, Lankton NK. Modeling patients' acceptance of provider-delivered e-health. Journal of the American Medical Informatics Association. 2004;11(4):241-8. 36. Hopewell PC, Pai M, Maher D, Uplekar M, Raviglione MC. International standards for tuberculosis care. The Lancet infectious diseases. 2006;6(11):710-25. 37. Mohan A. International standards of tuberculosis care. The National medical journal of India. 2006;19(6):301. 38. Manipal KMC. About KMC 2017 [Available from: https://manipal.edu/kmc-manipal/hospital/services.html. 39. Manipal University. History 2016 [Available from: http://manipal.edu/mu/about-us/history.html. 40. Nielsen J, Landauer TK, editors. A mathematical model of the finding of usability problems. Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems; 1993: ACM. 41. Six JM, Macefield R. How to Determine the Right Number of Participants for Usability Studies 2016 [Available from: http://www.uxmatters.com/mt/archives/2016/01/how-to-determine-the-right-number-of-participants-for-usability-studies.php. 42. Garcia A. UX Research, Standardized Usability Questionnaires 2013 [Available from: http://chaione.com/ux-research-standardizing-usability-questionnaires/. 43. Sauro J. Measuring usability with the system usability scale 2011 [Available from: https://measuringu.com/sus/. 44. Rogers EM. Diffusion of innovations: Simon and Schuster; 2010. 45. Tavakol M, Dennick R. Making sense of Cronbach's alpha. International journal of medical education. 2011;2:53. 46. Land KC. Principles of path analysis. Sociological methodology. 1969;1:3-37. 47. Kwak E-S, Chang H. Medical Representatives' Intention to Use Information Technology in Pharmaceutical Marketing. Healthcare Informatics Research. 2016;22(4):342-50. 48. Zhang X, Han X, Dang Y, Meng F, Guo X, Lin J. User acceptance of mobile health services from users’ perspectives: The role of self-efficacy and response-efficacy in technology acceptance. Informatics for Health and Social Care. 2016:1-13. 49. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly. 1989:319-40. 50. Chen J, Park Y, Putzer GJ. An examination of the components that increase acceptance of smartphones among healthcare professionals. Electronic journal of health informatics. 2010;5(2):16. 51. Cajita MI, Hodgson NA, Budhathoki C, Han H-R. Intention to Use mHealth in Older Adults With Heart Failure. Journal of Cardiovascular Nursing. 2017. 52. Omar A, Ellenius J, Lindemalm S. Evaluation of Electronic Prescribing Decision Support System at a Tertiary Care Pediatric Hospital: The User Acceptance Perspective. Studies in health technology and informatics. 2017;234:256. 53. Hsu H-M, Chang I-C, Lai T-W. Physicians’ perspectives of adopting computer-assisted navigation in orthopedic surgery. International journal of medical informatics. 2016;94:207-14. 54. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Intl Journal of Human–Computer Interaction. 2008;24(6):574-94.
74
CHAPTER 9 Discussion
This chapter presents a brief overview of the discussion, along with the strengths and limits of our study. The section is concluded with this study’s contribution to public health. As this section has been elaborated in detail within the manuscript presented above, it provides an overview of what has previously been stated to avoid repetition.
9.1 Main results
Our study aimed to understand the user experience and acceptability of a smartphone
application for TB, LearnTB, amongst private sector academic clinicians in India. The study
was divided into two parts, as explain in Chapter 7 – Methodology. The participants were
first presented the LearnTB application, asked to perform two tasks, and answer a user
experience questionnaire. The second part of the study involved a presentation of the
LearnTB application as well, followed by an acceptability questionnaire inspired by the TAM
framework. Our results indicate that perceived usefulness strongly influences intention to
use, and the overall user experience of the LearnTB application was high. Two out of the
three hypothesis determined for this study were confirmed and detailed ad hoc analysis
insinuated new avenues for future research in this domain. Through path analysis, the direct
relationship between perceived usefulness and intention to use, as well as the indirect
relationship between perceived ease of use and intention to use, were confirmed. Informal
discussions with the participants highlighted certain queries, specifically related to
accessibility of the application (internet access, network problems). Such problems should
be addressed in the future version of the LearnTB application, and taken into consideration
in upcoming mHealth studies as well.
9.2 Strengths and limits
Strengths
Our study is the first to evaluate the user experience and acceptability of a smartphone
mHealth intervention for tuberculosis amongst clinicians in India. It is also among the few
studies which test a pilot version of an mHealth application prior to creating the final version.
75
This is one of the biggest strengths of our study. As mentioned previously, mHealth is a
consumer driven domain, thus testing a pilot version of an application prior to dissemination
to the public, is ideal (56). The questionnaires used in the study, for both user experience
(part 1) and acceptability (part 2), were valid and reliable. Both questionnaires had been
tested in previous studies, and they had a Cronbach alpha greater than 0.91 (86) and 0.80-
0.94 respectively (67, 70). Furthermore the questionnaires were created in English as it is
second language in India (91). Our study achieved a response rate of 100% and 99% for user
experience (part 1) and acceptability (part 2), respectively. This is another major strength of
our study, increasing the study power and credibility. Finally, our study assessed TB, an issue
which is prominent and of importance in India thus increasing the relevance of our study to
public health.
Limits
Despite the numerous strengths of our study, the results must be interpreted while taking
certain limitations into consideration. Primarily, our study has a degree of selection bias as
participants were sampled using a non-probabilistic sampling method, specifically
convenience and snow-ball sampling. Due to time constraints, this was the most feasible for
our study, however future studies should adapt a probabilistic approach which could further
increase generalizability of the results. The results of this study cannot be generalized to all
clinicians in India, as our sample population and study setting were very specific, thus
decreasing our external validity. Our study was conducted on a homogeneous population
consisting only of academic clinicians at Kasturba Hospital Manipal, one of the top ranked
private medical school, and therefore does not reflect the heterogeneity of private sector
providers in India. Future studies should ideally be done on a larger and heterogeneous
population within numerous hospitals (both private and public) in India. Secondly,
participants could have been subject to social desirability bias, as the researcher
administering the questionnaires, TP, had been a part of the application development process.
Moreover, participants were contacted by their unit heads, thus participants could have
shown interest in the study to respect seniority. Response rates of 100% and 99% can also be
considered indicative of the latter. As participants were asked to participate by their unit
76
heads, our study may be subject to social desirability bias as well. Our sample size was not
reflective of the population of employees at Kasturba Hospital Manipal. The results indicate
82.8% of participants were medical residents/interns and 94% were under the age of 30. The
employee population of Kasturba Hospital Manipal is 73.6% medical residents/interns (81),
thus our values could have surestimated the results. A future study presenting an equal
distribution of participant demography would allow for a better understanding and
comparaison of participant intention to use of the LearnTB application. Thirdly, the study
design was cross sectional, thus permitting analysis of only one time point. The study was
initially designed in two parts to allow for improvement of the application prior to the
acceptability analysis. However, due to time constraints, both parts were done simultaneously
at one time point. Ideally, the first five participants should have done the user experience
study and suggestions should have been implemented in the LearnTB application, and the
same five participants should have been re-contacted to evaluate the difference in the user
experience of the application. As mentioned previously, due to time constraints this was not
possible. Additionally, due to the latter, participants were not able to use the LearnTB
application during their routine medical practice. Future studies should use longitudinal
designs to; 1) allow time between the user experience study and the acceptability study and
2) observe uptake and acceptance rates of users, perhaps using the diffusion of innovation
theory as a theoretical framework (48). Finally, the SUS scale used in our study comprised
of only 9 statements as compared to the theoretical model of 10 statements. The mathematical
procedure using a factor of 2.78 to analyse SUS scores has not been previously validated, to
our knowledge, thus a validated model would have been favorable.
9.3 Contribution to public health
Despite the limitations listed previously, the results of this study can have a significant impact
on mobile technology research in India. As India is the second largest consumer of mobile
phones in the world, mobile technologies have great potential in this market. Through
observation, it was noted that doctors communicate largely through their mobile phones
regarding patient cases, or during hospital rotations. Thus, mobile technologies can impact
patient care and management in a meaningful manner. This smartphone application,
77
LearnTB, addressed an issue which is largely present in India. It is the country with the
highest TB burden in the world, and vast differences in medical education. Using this
application, all health care professionals in India will be able to access reliable and valid
information regarding diagnosis, treatment and management of TB. The results of this study
are largely positive, indicating interest in mobile applications and the potential for positive
uptake as well as acceptability, empowering proper diagnosis and treatment of TB, a disease
which kills millions in India every year.
78
CHAPTER 10 Conclusion
This thesis project aimed to understand the user experience and acceptability of a smartphone
application for tuberculosis, LearnTB, amongst private sector academic clinicians in India.
This was evaluated through a two-part approach involving assessment of user experience and
acceptability of the smartphone application. Primarily the smartphone application was
created using the Let’s talk TB handbook as a reference followed by an evaluation amongst
academic clinicians at Kasturba Hospital Manipal, Manipal India. The overall results of the
study have presented positive user experience and high intention to use of the LearnTB
application. Academic clinicians were excited and intrigued by the usefulness of the
application, which lead to a high intention to use. As this study was the first of its kind,
certain lessons should be taken from this experience. Future studies involving smartphone
technologies for tuberculosis in India should not only take the vast mobile consumer presence
into consideration, but also the lack of network accessibility and internet accessibility.
Numerous clinicians expressed concerns over lack of internet availability in certain regions
of India. Clinicians were immensely interested in an application which would not require
data usage, or Wi-Fi usage. Furthermore, clinicians showed interest to a free of charge
application versus a paid application, to increase accessibility. mHealth strategies addressing
the issues mentioned above, may increase their rates of acceptance amongst clinicians in
India, however acceptability testing is encouraged in all cases, as it enables proper
understanding of consumer needs. This exploratory, descriptive thesis project has provided
sufficient information allow future studies to build upon, explore new avenues and lead to
eventual dissemination of the LearnTB application with the aim of helping proper diagnosis
and treatment of TB, eventually decreasing the high burden of TB in India.
79
CHAPTER 11 References
1. World Health Organization. Global tuberculosis report 2014. 2014. Geneva: World Health Organization. 2015. 2. World Health Organization. Global tuberculosis report 2016. 2016. 3. World Health Organization. The End TB Strategy. 2015. 4. World Health Organization. Global Tuberculosis Report 2015. 2015. 5. Sengupta A, Nundy S. The private health sector in India: Is burgeoning, but at the cost of public health care. BMJ: British Medical Journal. 2005;331(7526):1157. 6. Das J. The quality of medical care in low-income countries: from providers to markets. PLoS Med. 2011;8(4):e1000432. 7. Bhargava A, Pinto L, Pai M. Mismanagement of tuberculosis in India: causes, consequences, and the way forward. Hypothesis. 2011;9(1). 8. Sudha G, Nirupa C, Rajasakthivel M, Sivasusbramanian S, Sundaram V, Bhatt S, et al. Factors influencing the care-seeking behaviour of chest symptomatics: a community-based study involving rural and urban population in Tamil Nadu, South India. Tropical Medicine & International Health. 2003;8(4):336-41. 9. Satyanarayana S, Subbaraman R, Shete P, Gore G, Das J, Cattamanchi A, et al. Quality of tuberculosis care in India: a systematic review. The international journal of tuberculosis and lung disease: the official journal of the International Union against Tuberculosis and Lung Disease. 2015;19(7):751-63. 10. Kay M, Santos J, Takane M. mHealth: New horizons for health through mobile technologies. World Health Organization. 2011:66-71. 11. Elangovan R, Arulchelvan S. A study on the role of mobile phone communication in tuberculosis DOTS treatment. Indian journal of community medicine: official publication of Indian Association of Preventive & Social Medicine. 2013;38(4):229. 12. Iribarren SJ, Schnall R, Stone PW, Carballo-Diéguez A. Smartphone Applications to Support Tuberculosis Prevention and Treatment: Review and Evaluation. JMIR mHealth and uHealth. 2016;4(2):e25. 13. Sreeramareddy CT, Qin ZZ, Satyanarayana S, Subbaraman R, Pai M. Delays in diagnosis and treatment of pulmonary tuberculosis in India: a systematic review. The international journal of tuberculosis and lung disease: the official journal of the International Union against Tuberculosis and Lung Disease. 2014;18(3):255. 14. McDowell A, Pai M. Treatment as diagnosis and diagnosis as treatment: empirical management of presumptive tuberculosis in India. The International Journal of Tuberculosis and Lung Disease. 2016;20(4):536-43. 15. Das J, Kwan A, Daniels B, Satyanarayana S, Subbaraman R, Bergkvist S, et al. Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study. The Lancet Infectious Diseases. 2015;15(11):1305-13. 16. Prevention CfDCa. Tuberculosis 2016 [Available from: https://www.cdc.gov/tb/. 17. Campbell IA, Bah-Sow O. Pulmonary tuberculosis: diagnosis and treatment. BMJ: British Medical Journal. 2006;332(7551):1194. 18. Ryu YJ. Diagnosis of pulmonary tuberculosis: recent advances and diagnostic algorithms. Tuberculosis and respiratory diseases. 2015;78(2):64-71. 19. Kanabus A. Information about tuberculosis 2016 [Available from: http://www.tbfacts.org/.
80
20. Olson S, English RA, Guenther RS, Claiborne AB. Facing the Reality of Drug-Resistant Tuberculosis: Challenges and Potential Solutions in India: Summary of a Joint Workshop by the Institute of Medicine, the Indian National Science Academy, and the Indian Council of Medical Research: National Academies Press; 2012. 21. Steinbrook R. Tuberculosis and HIV in India. New England Journal of Medicine. 2007;356(12):1198-9. 22. World Health Organization. India: country statistics 2015 [Available from: http://www.who.int/countries/ind/en/. 23. Srivastava AL, Allchin FR, Schwartzberg JE, Kikshit KR, Alam M, Calkins PB, et al. India 2016 [Available from: https://www.britannica.com/place/India. 24. Revised National Tuberculosis Control Programme for India. TB India: RNTCP Status Report: Central TB Division, Directorate General of Health Services, Ministry of Health and Family Welfare; 2001. 25. World Health Organization. India: WHO statistical profile 2016 [Available from: http://www.who.int/gho/countries/ind.pdf?ua=1. 26. United Nations Education Scientific and Cultural Organization. India 2017 [Available from: http://en.unesco.org/countries/india. 27. Kapur S, Murthi M. Literacy in India. 2009. 28. Arinaminpathy N, Batra D, Khaparde S, Vualnam T, Maheshwari N, Sharma L, et al. The number of privately treated tuberculosis cases in India: an estimation from drug sales data. The Lancet Infectious Diseases. 2016;16(11):1255-60. 29. Pai M. Promoting affordable and quality tuberculosis testing in India. Journal of laboratory physicians. 2013;5(1):1. 30. Salve S, Sheikh K, Porter JD. Private Practitioners’ Perspectives on Their Involvement With the Tuberculosis Control Programme in a Southern Indian State. International Journal of Health Policy and Management. 2016. 31. Pai M, Satyanarayana S, Hopewell P. Improving quality of Tuberculosis care in India. Indian J Tuberce. 2014;61:12-8. 32. Uplekar M, George A. Access to health care in India: present situation and innovative approaches for improvement. Bombay: Foundation for Research in Community Health. 1993. 33. Ratnavelu VK, Pai M. Tuberculosis Care in India: how can private practitioners make a difference? CHEST (India edition). 2014;5(1). 34. Pai M, Yadav P, Anupindi R. Tuberculosis control needs a complete and patient-centric solution. The Lancet Global Health. 2014;2(4):e189-e90. 35. Free C, Phillips G, Felix L, Galli L, Patel V, Edwards P. The effectiveness of M-health technologies for improving health and health services: a systematic review protocol. BMC research notes. 2010;3(1):250. 36. Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. American journal of preventive medicine. 2009;36(2):165-73. 37. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. British journal of health psychology. 2010;15(1):1-39. 38. Krishna S, Boren SA, Balas EA. Healthcare via cell phones: a systematic review. Telemedicine and e-Health. 2009;15(3):231-40.
81
39. Gagnon M-P, Ngangue P, Payne-Gagnon J, Desmartis M. m-Health adoption by healthcare professionals: a systematic review. Journal of the American Medical Informatics Association. 2016;23(1):212-20. 40. Akter S, Ray P. mHealth-an ultimate platform to serve the unserved. Yearb Med Inform. 2010;2010:94-100. 41. DeSouza SI, Rashmi M, Vasanthi AP, Joseph SM, Rodrigues R. Mobile phones: the next step towards healthcare delivery in rural India? PloS one. 2014;9(8):e104895. 42. Devi BR, Syed-Abdul S, Kumar A, Iqbal U, Nguyen P-A, Li Y-CJ, et al. mHealth: An updated systematic review with a focus on HIV/AIDS and tuberculosis long term management using mobile phones. Computer methods and programs in biomedicine. 2015;122(2):257-65. 43. Arhippainen L, Tähti M, editors. Empirical evaluation of user experience in two adaptive mobile application prototypes. MUM 2003 Proceedings of the 2nd International Conference on Mobile and Ubiquitous Multimedia; 2003: Linköping University Electronic Press. 44. Jordan PW, Thomas B, McClelland IL, Weerdmeester B. Usability evaluation in industry: CRC Press; 1996. 45. Monkman H, Kushniruk AW. The consumer health information system adoption model. Studies in health technology and informatics. 2015;218:26-31. 46. Brooke J. SUS-A quick and dirty usability scale. Usability evaluation in industry. 1996;189(194):4-7. 47. Ajzen I. The theory of planned behavior. Organizational behavior and human decision processes. 1991;50(2):179-211. 48. Rogers EM. Diffusion of innovations: Simon and Schuster; 2010. 49. Venkatesh V, Thong JY, Xu X. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS quarterly. 2012;36(1):157-78. 50. Robinson L. A summary of diffusion of innovations. Enabling change. 2009. 51. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly. 1989:319-40. 52. Surendran P. Technology acceptance model: A survey of literature. International Journal of Business and Social Research. 2012;2(4):175-8. 53. Asua J, Orruño E, Reviriego E, Gagnon MP. Healthcare professional acceptance of telemonitoring for chronic care patients in primary care. BMC medical informatics and decision making. 2012;12(1):139. 54. Uddin AA, Morita PP, Tallevi K, Armour K, Li J, Nolan RP, et al. Development of a Wearable Cardiac Monitoring System for Behavioral Neurocardiac Training: A Usability Study. JMIR mHealth and uHealth. 2016;4(2). 55. Gunter R, Fernandes-Taylor S, Mahnke A, Awoyinka L, Schroeder C, Wiseman J, et al. Evaluating Patient Usability of an Image-Based Mobile Health Platform for Postoperative Wound Monitoring. JMIR mHealth and uHealth. 2016;4(3). 56. Mourouzis A, Chouvarda I, Maglaveras N. MHEALTH: COMMON USABILITY AND USER EXPERIENCE PRACTICES AND FLAWS. 57. Narasimhan P, Bakshi A, Kittusami S, Prashant S, Mathai D, Bakshi K, et al. A customized m-Health system for improving tuberculosis treatment adherence and follow-up in south India. Health and Technology. 2014;4(1):1-10.
82
58. Bediang G, Stoll B, Elia N, Abena J-L, Nolna D, Chastonay P, et al. SMS reminders to improve the tuberculosis cure rate in developing countries (TB-SMS Cameroon): a protocol of a randomised control study. Trials. 2014;15(1):35. 59. Ginsburg AS, Delarosa J, Brunette W, Levari S, Sundt M, Larson C, et al. mPneumonia: Development of an Innovative mHealth Application for Diagnosing and Treating Childhood Pneumonia and Other Childhood Illnesses in Low-Resource Settings. PloS one. 2015;10(10):e0139625. 60. Kallander K, Tibenderana JK, Akpogheneta OJ, Strachan DL, Hill Z, Ten Asbroek AH, et al. Mobile health (mHealth) approaches and lessons for increased performance and retention of community health workers in low-and middle-income countries: a review. Journal of medical Internet research. 2013;15(1). 61. Gautham M, Iyengar MS, Johnson CW. Mobile phone–based clinical guidance for rural health providers in India. Health informatics journal. 2015;21(4):253-66. 62. Modi D, Gopalan R, Shah S, Venkatraman S, Desai G, Desai S, et al. Development and formative evaluation of an innovative mHealth intervention for improving coverage of community-based maternal, newborn and child health services in rural areas of India. Global Health Action. 2015;8. 63. Florez-Arango JF, Iyengar MS, Dunn K, Zhang J. Performance factors of mobile rich media job aids for community health workers. Journal of the American Medical Informatics Association. 2011;18(2):131-7. 64. Aranda-Jan CB, Mohutsiwa-Dibe N, Loukanova S. Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa. BMC public health. 2014;14(1):188. 65. Jones CO, Wasunna B, Sudoi R, Githinji S, Snow RW, Zurovac D. “Even if you know everything you can forget”: health worker perceptions of mobile phone text-messaging to improve malaria case-management in Kenya. PLoS One. 2012;7(6):e38636. 66. L'Engle KL, Vahdat HL, Ndakidemi E, Lasway C, Zan T. Evaluating feasibility, reach and potential impact of a text message family planning information service in Tanzania. Contraception. 2013;87(2):251-6. 67. Gagnon MP, Orruño E, Asua J, Abdeljelil AB, Emparanza J. Using a modified technology acceptance model to evaluate healthcare professionals' adoption of a new telemonitoring system. Telemedicine and e-Health. 2012;18(1):54-9. 68. Alharbi S, Drew S. Using the technology acceptance model in understanding academics’ behavioural intention to use learning management systems. International Journal of Advanced Computer Science and Applications (IJACSA). 2014;5(1). 69. Huang F, Chang P, Hou I-c, Tu M-H, Lan C-f. Use of a Mobile Device by Nursing Home Residents for Long-term Care Comprehensive Geriatric Self-assessment: A Feasibility Study. Computers Informatics Nursing. 2015;33(1):28-36. 70. Park SY. An Analysis of the Technology Acceptance Model in Understanding University Students' Behavioral Intention to Use e-Learning. Educational technology & society. 2009;12(3):150-62. 71. Hennemann S, Beutel ME, Zwerenz R. Drivers and Barriers to Acceptance of Web-Based Aftercare of Patients in Inpatient Routine Care: A Cross-Sectional Survey. Journal of Medical Internet Research. 2016;18(12):e337. 72. Aggarwal K. Twenty-six Percent Doctors Suffer from Severe Mobile Phone-induced Anxiety: Excessive use of Mobile Phone can be Injurious to your Health. Indian Journal of Clinical Practice. 2013;24(1).
83
73. Hopewell PC, Pai M, Maher D, Uplekar M, Raviglione MC. International standards for tuberculosis care. The Lancet infectious diseases. 2006;6(11):710-25. 74. Mohan A. International standards of tuberculosis care. The National medical journal of India. 2006;19(6):301. 75. Levin KA. Study design III: Cross-sectional studies. Evidence-based dentistry. 2006;7(1):24-5. 76. Shastri S, Naik B, Shet A, Rewari B, De Costa A. TB treatment outcomes among TB-HIV co-infections in Karnataka, India: how do these compare with non-HIV tuberculosis outcomes in the province? BMC public health. 2013;13(1):838. 77. Central TB Division. Revised National TB Control Programme 2015 [Available from: http://www.tbcinidia.nic.in/. 78. Government of Karnataka. Revised National Tuberculosis Control Programme (RNCTP) 2016 [Available from: http://www.karnataka.gov.in/hfw/nhm/pages/ndcp_cd_rntcp.aspx. 79. Manipal University. About Us 2017 [Available from: https://manipal.edu/mu/about-us.html. 80. KMC Hospital Mangalore. Kasturba Hospital, Manipal 2017 [Available from: http://www.kmchospitalsmangalore.com/index.php?option=com_content&task=view&id=59&Itemid=118. 81. Manipal KMC. About KMC 2017 [Available from: https://manipal.edu/kmc-manipal/hospital/services.html. 82. Verma R, Khanna P, Mehta B. Revised national tuberculosis control program in India: the need to strengthen. Int J Prev Med. 2013;4(1):1-5. 83. Nielsen J, Landauer TK, editors. A mathematical model of the finding of usability problems. Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems; 1993: ACM. 84. Six JM, Macefield R. How to Determine the Right Number of Participants for Usability Studies 2016 [Available from: http://www.uxmatters.com/mt/archives/2016/01/how-to-determine-the-right-number-of-participants-for-usability-studies.php. 85. Kitchenham B, Pfleeger SL. Principles of survey research: part 5: populations and samples. ACM SIGSOFT Software Engineering Notes. 2002;27(5):17-20. 86. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Intl Journal of Human–Computer Interaction. 2008;24(6):574-94. 87. Sauro J. Measuring usability with the system usability scale 2011 [Available from: https://measuringu.com/sus/. 88. Tavakol M, Dennick R. Making sense of Cronbach's alpha. International journal of medical education. 2011;2:53. 89. Land KC. Principles of path analysis. Sociological methodology. 1969;1:3-37. 90. Massé R, Saint-Arnaud J. Ethique et santé publique: enjeux, valeurs et normativité: Presses Université Laval; 2003. 91. India To. Indiaspeak: English is our 2nd langauge 2010 [Available from: http://timesofindia.indiatimes.com/india/Indiaspeak-English-is-our-2nd-language/articleshow/5680962.cms.
84
Appendix A : Proof of submission
85
Appendix B : Search strategy The search strategy involved the use of three medical databases namely PubMed,
EMBASE and Web of Science. Due to the limited literature available regarding this topic, broad search terms, such as “mHealth” and “tuberculosis” were used. There were no restrictions regarding languages or dates in the search strategy. Furthermore, literature was also retrieved via retrospective searches (i.e. references of studies used and/or found) and with the help of a systematic review conducted by Gagnon et al. (39). Studies conducted on mHealth strategies involving other diseases, both non-communicable and infectious were also included. Additionally, mHealth strategies involve numerous platforms, such as mobile applications, short message service (SMS), personal digital assistants and other wireless devices (10), therefore all studies involving the latter were also included. Studies involving all health care professionals were included, as there were few studies specific to health care clinicians. As there are a limited number of studies investigating this topic, the following search terms were used, in each respective database: Pubmed: ((("Tuberculosis"[Mesh]) AND ( "Tuberculosis/analysis"[Mesh] OR "Tuberculosis/anatomy and histology"[Mesh] OR "Tuberculosis/classification"[Mesh] OR "Tuberculosis/diagnosis"[Mesh] OR "Tuberculosis/education"[Mesh] OR "Tuberculosis/epidemiology"[Mesh] OR "Tuberculosis/mortality"[Mesh] OR "Tuberculosis/organization and administration"[Mesh] OR "Tuberculosis/prevention and control"[Mesh] OR "Tuberculosis/statistics and numerical data"[Mesh] OR "Tuberculosis/transmission"[Mesh] )) AND "Diagnosis/diagnosis"[Mesh]) AND "Telemedicine"[Mesh] EMBASE: 'mhealth' AND ('tuberculosis'/exp OR 'tuberculosis’) Web of Science: (mhealth) AND TOPIC: (tuberculosis) Timespan: All years. Search language=Auto
86
Appendix C : SUS questionnaire Questionnaire #: Date:
PURPOSE OF THE QUESTIONNAIRE To identify user experience amongst private sector academic clinicians in India, with the
goal of improving the development of the smartphone application LearnTB What are you asked to do: You will be asked to perform a series of tasks using the LearnTB application and then respond to a two-part questionnaire. This questionnaire should not take more than 3-5 minutes to complete. You will be asked for general demographic information and to respond to 10 statements regarding your experience while using the smartphone application. All participants should have had previous access to the LearnTB application and must be members of Manipal University. The anonymity of the questionnaires is assured. STATEMENT OF CONSENT: I have read the above information, and have received answers to any questions I asked. I consent to take part in the study. I agree to participate in this study:
Please select A SINGLE OPTION for each statement.
SECTION 1 : DEMOGRAPHIC INFORMATION 1. Sex � Male
� Female 2. Age � <30 years
� 30-39 years � 40-49 years � 50-59 years � >60 years
3. Title � Medical resident/student � Junior faculty member � Senior faculty member � Technical staff
4. Number of years of clinical experience
5. I have previously used mobile applications in my clinical work
� Yes � No
6. I feel comfortable using mobile applications in my clinical work
� Yes � No
87
Here are 9 statements related to various factors that may influence the user experience related to the use of the LearnTB application. Please indicate your level of agreement with each of the following statements using the scale presented below: Please select A SINGLE OPTION for each statement
-2 Strongly disagree
-1 Disagree
0 Neither agree nor disagree
1 Agree
2 Strongly agree
SECTION 2: USER EXPERIENCE 1. I think that I would like to use the
LearnTB application frequently -2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
2. I found the LearnTB application unnecessarily complex
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3. I think that I would need support of a
technical person to be able to use the LearnTB application
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
4. I found the various functions in the LearnTB application were well integrated
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
5. I thought there was too much inconsistency in the LearnTB application
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
6. I imagine that most people would
learn to use the LearnTB application very quickly
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
7. I found the LearnTB application very awkward to use
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
8. I felt very confident using the LearnTB application
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
9. I needed to learn a lot of things before I could get going with the LearnTB application
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
Additional comments:
Thank you for your participation!
88
Appendix D : Tasks for user experience (part 1)
Developing and evaluating a smartphone application for tuberculosis amongst private
sector clinicians in India
Researcher: Tripti Pande
Supervisor(s): Dr. Kavitha Saravu (Manipal University)
Dr. Marie-Pierre Gagnon (Université Laval)
Dr. Madhukar Pai (McGill University)
Length: 5 minutes
OVERALL TASK: Please Indicate where you found each of the responses
TASK 1: General tasks
- How many of the sputum tests are WHO endorsed?
- Name three scenarios should one always remember when working with a TB patient?
TASK 2: Case Scenario
1. You have performed numerous tests and established that your patient has latent TB
infection (LTBI). You are asked to provide a full diagnostic overview of the patient
and provide treatment information. How will you go about?
o Please respond to the question at the end of the LTBI section and provide your
final score
89
Appendix E : TAM questionnaire Questionnaire #: Date:
PURPOSE OF THE QUESTIONNAIRE To determine the factors influencing intention to use the mHealth application LearnTB
amongst private academic clinicians in India What are you asked to do: You will be asked to perform a series of tasks using the LearnTB application and then respond to a two-part questionnaire. The questionnaire should not take more than 5-7 minutes to complete. You will be asked for general demographic information and to respond to 15 statements regarding specific factors which could influence the acceptability of the smartphone application. Having previous experience using a mobile application is not necessary to respond to this questionnaire. All participants must be members of Manipal University (Manipal, India). The anonymity of all responses is assured. STATEMENT OF CONSENT: I have read the above information, and have received answers to any questions I asked. I consent to take part in the study:
SECTION 1 : DEMOGRAPHIC INFORMATION 7. Sex � Male
� Female 8. Age � <30 years
� 30-39 years � 40-49 years � 50-59 years � >60 years
9. Title � Medical resident/student � Junior faculty member � Senior faculty member � Technical staff
10. Number of years of clinical experience
11. I have previously used mobile applications � Yes � No
12. I feel comfortable using mobile application
� Yes � No
90
Here are 15 statements related to various factors that may influence the acceptance of an mHealth intervention for TB. Please indicate the level of agreement with each of the following statements using the scale presented below: Please select A SINGLE OPTION for each statement:
-3 Totally disagree
-2 Disagree
-1 Slightly disagree
0 Neither
agree nor disagree
1 Slightly agree
2 Agree
3 Totally agree
SECTION 2: PERCEIVED USEFULNESS 1. The use of the LearnTB application could
help me assess my patients more adequately
-3 ⊡
�
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
2. I think that it would be easy to perform the tasks necessary to assess my patients using the LearnTB application
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
3. The use of the LearnTB application could
improve my assessment of my patients -3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
4. The use of the LearnTB application is
compatible with my work habits -3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
5. The use of the LearnTB application could
promote good clinical practice -3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
6. Using the LearnTB application could improve my performance in patients care
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
7. Using the LearnTB application could facilitate the care of my patients
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
SECTION 3: PERCEIVED EASE OF USE
8. I think that the LearnTB application would be easy to use
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
9. I think that the LearnTB application is a
flexible technology to interact with -3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
10. I think that I could easily learn how to use the LearnTB application
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
91
-3 Totally disagree
-2 Disagree
-1 Slightly disagree
0 Neither
agree nor disagree
1 Slightly agree
2 Agree
3 Totally agree
11. Using the LearnTB application could help me get the most of out of my time assessing my patients
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
12. The use of the LearnTB application could
interfere with the usual follow up of my patients
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
SECTION 4: INTENTION TO USE
13. I have the intention to use the LearnTB application for patient care
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
14. I have the intention to use the LearnTB application when it becomes available in my health centre
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
15. I have the intention to use the LearnTB
application when necessary to provide health care to my patients
-3 ⊡
-2 ⊡
-1 ⊡
0 ⊡
1 ⊡
2 ⊡
3 ⊡
Additional comments:
Thank you for your participation!
92
Appendix F : Consent forms Consent form – PART 1: Development of Application and User Experience
You are being asked to take part in a research study regarding the development of a smartphone application for tuberculosis amongst private academic clinicians in India. Please read this form carefully prior to taking part in the study. Should you have any additional questions, please do not hesitate to ask the researcher in charge, Tripti Pande. Objective of the study: Identify the user experience of private academic clinicians in India while using the LearnTB application for tuberculosis. What are you asked to do: You will be asked to perform a series of tasks using the LearnTB application and then respond to a two-part questionnaire. This questionnaire should not take more than 5 minutes to complete. What are the risks and benefits: The main benefit of this study is to provide an application containing diagnostic, treatment, counselling and general information about tuberculosis in India. There are no potential risks in this research study. Confidentiality and Anonymity: All participants can be assured of the confidentiality of their responses. All questionnaires are anonymous and will remain in a secure location which will be only accessible to Tripti Pande, the principal researcher of this study, and her supervisor, Dr. Marie-Pierre Gagnon from Université Laval in Quebec City, Canada. Person to contact if you have further questions: If you have any further questions, please contact Tripti Pande, the principal researcher of this study. Tripti Pande (MSc – Global Health student) Phone: +91 92054 36732 Email: [email protected] (preferred method of communication) STATEMENT OF CONSENT: I have read the above information, and have received answers to any questions I asked. I consent to take part in the study. Please click here if you consent to participate in this study Date:
93
Consent form – PART 2: Acceptability of application You are being asked to take part in a research study regarding the factors influencing the acceptability of a smartphone application for tuberculosis amongst private academic clinicians in India. Please read this form carefully prior to taking part in the study. Should you have any additional questions, please do not hesitate to ask the researcher in charge, Tripti Pande. Objective of the study: To identify, with the help of the Technology Assessment Model, the factors which influence acceptance of a smartphone application by academic clinicians in the private sector of India. What are you asked to do: You will be asked to download the LearnTB application and respond to a two-part questionnaire. The researchers will guide all participants regarding the usage of the application and participants will be given a couple of minutes to observe the application on their own. The questionnaire should not take more than 10 minutes to complete. What are the risks and benefits: The main benefit of this study is to provide an application containing diagnostic, treatment, counselling and general information about tuberculosis in India. There are no potential risks in this research study. Confidentiality and Anonymity: All participants can be assured of the confidentiality of their responses. All questionnaires are anonymous and will remain in a secure location which will be only accessible to Tripti Pande, the principal researcher of this study, and her supervisor, Dr. Marie-Pierre Gagnon from Université Laval in Quebec City, Canada. Person to contact if you have further questions: If you have any further questions, please contact Tripti Pande, the principal researcher of this study. Tripti Pande (MSc – Global Health student) Phone: +91 92054 36732 Email: [email protected] (preferred method of communication) STATEMENT OF CONSENT: I have read the above information, and have received answers to any questions I asked. I consent to take part in the study. Please click here if you consent to participate in this study: Date: