<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">SAJPsy</journal-id>
<journal-title-group>
<journal-title>South African Journal of Psychiatry</journal-title>
</journal-title-group>
<issn pub-type="ppub">1608-9685</issn>
<issn pub-type="epub">2078-6786</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">SAJPsy-24-1163</article-id>
<article-id pub-id-type="doi">10.4102/sajpsychiatry.v24.i0.1163</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Barriers to the implementation of a computer-based rehabilitation programme in two public psychiatric settings</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-2495-3159</contrib-id>
<name>
<surname>Ferreira-Correia</surname>
<given-names>Aline</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Barberis</surname>
<given-names>Tyler</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Msimanga</surname>
<given-names>Lerato</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<aff id="AF0001"><label>1</label>Department of Psychology, University of the Witwatersrand, South Africa</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author:</bold> Aline Ferreira-Correia, <email xlink:href="aline.ferreiracorreia@wits.ac.za">aline.ferreiracorreia@wits.ac.za</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>11</day><month>06</month><year>2018</year></pub-date>
<pub-date pub-type="collection"><year>2018</year></pub-date>
<volume>24</volume>
<elocation-id>1163</elocation-id>
<history>
<date date-type="received"><day>04</day><month>09</month><year>2017</year></date>
<date date-type="accepted"><day>04</day><month>05</month><year>2018</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2018. The Authors</copyright-statement>
<copyright-year>2018</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution License.</license-p>
</license>
</permissions>
<abstract>
<sec id="st1">
<title>Background</title>
<p>Working memory (WM) deficits have a negative impact on treatment adherence and quality of life. Efficient and effective interventions are needed in order to improve the cognitive functioning of those affected, especially in low-resource communities. Computer-based rehabilitation programmes (CBRP) are low-cost therapeutic approaches for WM deficits. Perceptions and experiences of target users may influence whether CBRP constitute an effective therapeutic option for adults with cognitive impairment in under-resourced environments.</p>
</sec>
<sec id="st2">
<title>Aim</title>
<p>The goal of the study was to explore the experiences of a group of volunteers with WM deficits (associated with diagnoses of HIV and schizophrenia), in terms of the perceived barriers they encountered during their participation in a CBRP.</p>
</sec>
<sec id="st3">
<title>Methods</title>
<p>A qualitative, descriptive research design was implemented. Short interviews and field notes were used in order to investigate the experiences of nine participants in relation to the CBRP. The sample included four participants living with HIV and five with schizophrenia, all with WM deficits.</p>
</sec>
<sec id="st4">
<title>Results</title>
<p>Using a thematic analysis, eight barriers were identified: unawareness of the cognitive deficit, anticipation of negative results, stigma, difficulties accessing a computer and/or Internet connection, ill health, negative emotional experiences, daily routine challenges and non-conducive or sabotaging environments. A representational model of these barriers is proposed.</p>
</sec>
<sec id="st5">
<title>Conclusion</title>
<p>The implementation of a cognitive rehabilitation strategy should not only take into consideration issues of access to particular strategies and materials but should also be preceded by an exploration of how individual and contextual barriers are experienced by the potential users, as these contribute to the risk of dropout.</p>
</sec>
</abstract>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Introduction</title>
<p>Professionals and researchers in the cognitive rehabilitation arena are dedicated to the creation and advancement of interventions that are efficacious, cost-effective, easily administered and applicable to large numbers of patients across different levels of impairment.<sup><xref ref-type="bibr" rid="CIT0001">1</xref></sup> Computer-based rehabilitation programmes (CBRP) are very promising as they offer high levels of customisation, applicability and familiarity.<sup><xref ref-type="bibr" rid="CIT0002">2</xref></sup></p>
<p>Many CBRP have been developed under the cognitive retraining paradigm. Although this paradigm has several limitations,<sup><xref ref-type="bibr" rid="CIT0003">3</xref>,<xref ref-type="bibr" rid="CIT0004">4</xref></sup> its potential has been explored and its efficacy tested in several randomised trials<sup><xref ref-type="bibr" rid="CIT0005">5</xref></sup>; however, despite the increased attention that these technologies have received, their clinical and financial potential has not yet been clearly established.<sup><xref ref-type="bibr" rid="CIT0006">6</xref></sup></p>
<p>The inconsistent findings regarding effectiveness of CBRP have been linked to multiple factors, including characteristics of each diagnostic entity,<sup><xref ref-type="bibr" rid="CIT0007">7</xref></sup> the nature of the cognitive function that is targeted by the programme<sup><xref ref-type="bibr" rid="CIT0008">8</xref></sup> and practice effects and quantity of the exercise.<sup><xref ref-type="bibr" rid="CIT0009">9</xref></sup></p>
<p>The content (in terms of variability and purpose) and design (using the apparatus, adjustment of levels of difficulty and characteristics of the interface) of both software and hardware have been identified as important variables in the implementation and effectiveness of the CBRP, not only in terms of specific technological features but in how this is experienced by users in terms of the complex intersections between the specific types of deficits and the personal characteristics of the users.<sup><xref ref-type="bibr" rid="CIT0010">10</xref></sup></p>
<p>Personal variables, including insight into the cognitive deficit,<sup><xref ref-type="bibr" rid="CIT0011">11</xref></sup> vulnerability to fatigue,<sup><xref ref-type="bibr" rid="CIT0010">10</xref></sup> levels of self- motivation and external support to engage in cognitive rehabilitation<sup><xref ref-type="bibr" rid="CIT0006">6</xref></sup> are tied to the degree of success of a particular programme. Lack of engagement is a common challenge in neuropsychological rehabilitation, and promoting a consistent effort is thus of paramount importance, not only for the patients but for all stakeholders around them.<sup><xref ref-type="bibr" rid="CIT0012">12</xref></sup></p>
<p>Access (in terms of availability in different contexts, financial costs and familiarity with computers) also plays an important role in the potential efficacy of CBRP.<sup><xref ref-type="bibr" rid="CIT0010">10</xref></sup> Having the opportunity to get involved in a rehabilitation programme, being able to afford it and to engage with it at ease are prerequisites for participation in these therapeutic offers.</p>
<p>CogMed is one of the most popular CBRP available, but its potential has, and continues to be, under investigation and debate.<sup><xref ref-type="bibr" rid="CIT0013">13</xref></sup> This program claims to provide effective training for working memory (WM), but findings on its effectiveness are inconsistent. These inconsistencies are suggestive of methodological challenges as well as a lack of exploration of the underlying mechanisms that facilitate improvement and transfer effects (or lack thereof) to other WM tasks and other associated cognitive functions.<sup><xref ref-type="bibr" rid="CIT0014">14</xref></sup></p>
<p>It is clear that the effectiveness of CBRP, and specifically of CogMed, is currently under scrutiny. However, only two studies of the feasibility of using CBRP in under-resourced environments are available, each one involving paediatric samples in Uganda: one consisting of children with cognitive impairment associated with cerebral malaria<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> and one involving children with human immunodeficiency virus (HIV).<sup><xref ref-type="bibr" rid="CIT0016">16</xref></sup> Both studies found that these types of interventions have significant potential in sub-Saharan Africa, not only because they demonstrated improvements but also because the use of computers and access to Internet in the region is sharply increasing, which facilitates the implementation of these techniques in groups of people with a single facilitator.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> Furthermore, despite the challenges posed by difficulties with transport to the clinic and limited prior experience with computers, adherence was good and the treatment was shown to be beneficial.<sup><xref ref-type="bibr" rid="CIT0016">16</xref></sup></p>
<p>Overall, CBRP have substantial potential but are associated with a range of barriers<sup><xref ref-type="bibr" rid="CIT0002">2</xref></sup> that are perceived and constructed by particular groups in various ways.<sup><xref ref-type="bibr" rid="CIT0017">17</xref></sup> Although the literature includes studies testing the rehabilitation potential of these tools, there is a lack of studies of whether these programs are an effective therapeutic option for adults with cognitive impairment in under-resourced environments. Thus, this research aims to examine the participants&#x2019; experiences of a CBRP (specifically, CogMed) in terms of the perceived impediments to participation they encountered in the entire process of engagement with the programme. Better understanding of the challenges that are present before and during the implementation of Internet-based cognitive rehabilitation in a low-income context can potentially guide the provision of cognitive therapy in terms of selecting the best match of technology, client and context, as well as informing the support structure required to ensure the best possible outcome for the client.</p>
</sec>
<sec id="s0002">
<title>Research methods and design</title>
<sec id="s20003">
<title>Study design and data collection</title>
<p>This research employed a qualitative descriptive research design.<sup><xref ref-type="bibr" rid="CIT0018">18</xref></sup> This design intends to provide a comprehensive description of participants&#x2019; experiences of a phenomenon, without being restricted to a specific interpretative or theoretical framework.<sup><xref ref-type="bibr" rid="CIT0019">19</xref></sup></p>
<p>In line with this design, the data collection involved short semi-structured interviews conducted at two points during the research: (1) before commencement of the CBRP and (2) at the end of the rehabilitation, whether this occurred because of completion or attrition.</p>
<p>Two semi-structured interview guides were developed. The pre-intervention guide included questions about the participants&#x2019; expectations and concerns with regard to the CBRP and perceptions of potential facilitators and impediments to their engagement with the programme. The post-intervention questionnaire was more comprehensive, including questions eliciting participants&#x2019; experiences and perceptions of the content of the program (in terms of the interface, potential cognitive and emotional effects, and levels of difficulty and motivation throughout the process).</p>
<p>Field notes were produced by the researchers during the entire intervention in order to keep track of significant comments made by the participants during the coaching calls, as well as general observations that were deemed potentially significant by the researchers.</p>
</sec>
<sec id="s20004">
<title>Setting, participants and sampling strategy</title>
<p>Convenience and purposive sampling methods were used. Psychiatrists and nurses at a government mental health hospital and directors of three halfway houses (non-governmental organisations) were approached in order to inform them about the project. These professionals then extended invitations to potential participants and allowed the posting of recruitment ads. Those interested in participating contacted the researchers or requested (via communication with the health professionals) to be contacted telephonically. Meetings were arranged in order to inform them about the research project and to ascertain their suitability for the study. Times and venues for the cognitive assessment and installation of the program were arranged with those who met the inclusion criteria and signed the consent form.</p>
<p>Two diagnostic groups were formed: (1) participants living with HIV and on antiretroviral treatment and (2) participants previously diagnosed with paranoid schizophrenia in full remission. These groups were selected because HIV<sup><xref ref-type="bibr" rid="CIT0019">19</xref></sup> and schizophrenia<sup><xref ref-type="bibr" rid="CIT0020">20</xref></sup> patients are known to display cognitive deficits associated with the pathology and pharmacological treatment specific to each diagnosis, with WM deficits common to both.<sup><xref ref-type="bibr" rid="CIT0021">21</xref>,<xref ref-type="bibr" rid="CIT0022">22</xref></sup> Although the neurobiological bases of the WM deficits in HIV and schizophrenia are different,<sup><xref ref-type="bibr" rid="CIT0023">23</xref>,<xref ref-type="bibr" rid="CIT0024">24</xref></sup> and variances in therapeutic outcomes of CBRP have been linked to the underlying diagnosis,<sup><xref ref-type="bibr" rid="CIT0007">7</xref></sup> the implementation of the programme was the same in both groups, thus allowing for the qualitative exploration of the participants&#x2019; experiences of the CBRP. Furthermore, participants of both groups were healthcare users of the same government hospital, and therefore it was assumed that the socio-economic status of the participants was relatively homogenous.</p>
<p>A different researcher was assigned responsibility for managing each group in terms of recruiting, interviewing, monitoring and coaching. Those with co-morbid medical and psychiatric diagnoses not related to the main diagnosis were excluded. Only participants with WM impairment (maximum performance in the low average range) and access to a computer and an Internet connection were included. Participants&#x2019; demographic characteristics are presented in <xref ref-type="table" rid="T0001">Table 1</xref>.</p>
<table-wrap id="T0001">
<label>TABLE 1</label>
<caption><p>Sample descriptive characteristics.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Variable</th>
<th valign="top" align="center"><italic>n</italic></th>
<th valign="top" align="center"><italic>M</italic> (s.d.)</th>
<th valign="top" align="center">Range</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Age</td>
<td align="center">9</td>
<td align="center">33.4 (8.41)</td>
<td align="center">26&#x2013;45</td>
</tr>
<tr>
<td align="left">Years of education</td>
<td align="center">9</td>
<td align="center">13.1 (1.16)</td>
<td align="center">12&#x2013;15</td>
</tr>
<tr>
<td align="left" colspan="4"><bold>Gender</bold></td>
</tr>
<tr>
<td align="left">Females</td>
<td align="center">5</td>
<td align="center">-</td>
<td align="center">55.5&#x0025;</td>
</tr>
<tr>
<td align="left">Males</td>
<td align="center">4</td>
<td align="center">-</td>
<td align="center">44.5&#x0025;</td>
</tr>
<tr>
<td align="left" colspan="4"><bold>Employment status</bold></td>
</tr>
<tr>
<td align="left">Employed</td>
<td align="center">5</td>
<td align="center">-</td>
<td align="center">55.5&#x0025;</td>
</tr>
<tr>
<td align="left">Unemployed</td>
<td align="center">4</td>
<td align="center">-</td>
<td align="center">44.5&#x0025;</td>
</tr>
<tr>
<td align="left" colspan="4"><bold>Main diagnosis</bold></td>
</tr>
<tr>
<td align="left">Schizophrenia, paranoid</td>
<td align="center">5</td>
<td align="center">-</td>
<td align="center">55.5&#x0025;</td>
</tr>
<tr>
<td align="left">HIV</td>
<td align="center">4</td>
<td align="center">-</td>
<td align="center">44.5&#x0025;</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>s.d., standard deviation.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s20005">
<title>Intervention</title>
<p>The CBRP used was the CogMed Working Memory Training Program, a computerised and Internet-based rehabilitation tool. This training consists of 25 daily sessions of approximately 30&#x2013;40 min each, to be completed in 5 weeks. Each participant carries out the training in their own home. The coach is responsible for providing information about the best training conditions.</p>
<p>The program offers multiple indices that can be used to ascertain the levels of functioning in WM, as well as progress measures including daily total span, daily training and pause times, and performance rate. The interface provides access to detailed quantitative information easily available for the researcher to track the performance on a daily basis. During the program, technical support was provided by the researchers when needed. The researchers monitored daily progress scores, which are automatically registered by the rehabilitation programme. The researchers contacted the participants telephonically once a week in order to provide feedback. If particular problems (such as low or absent engagement in activities) were identified by any of the program&#x2019;s performance indices, the researcher called more often. These calls also aimed to identify and troubleshoot difficulties and to encourage and congratulate the participant for persistence and achievements.</p>
</sec>
<sec id="s20006">
<title>Data analysis</title>
<p>Thematic analysis<sup><xref ref-type="bibr" rid="CIT0025">25</xref></sup> was used to analyse the data. Themes were defined as pieces of information that were relevant in terms of the research question. Therefore, only references made by the participants (or present in the field notes) in relation to the barriers or obstacles that hindered their participation in the CBRP were extracted. These themes were captured and coded by using an inductive and semantic approach.<sup><xref ref-type="bibr" rid="CIT0026">26</xref></sup> This approach is data driven and focuses on meanings explicitly available in the data. Thematic categories were identified based on all the available data, which was produced without establishing an <italic>a priori</italic> principle of saturation. All themes that emerged within the topic were noted and grouped according to their explicit similarities. Subsequently, descriptive labels were developed and then integrated into a flowchart to reflect the interactions between the themes and the period within which they were relevant.</p>
</sec>
</sec>
<sec id="s0007">
<title>Ethical consideration</title>
<p>Ethical clearance was obtained from the university. Formal permission was obtained from an HIV outpatient clinic located at a mental health hospital and the halfway houses where the recruitment process took place. Participant information sheets were provided, and consent forms were signed by all participants. Permission from CogMed (<ext-link ext-link-type="uri" xlink:href="http://www.cogmed.com/">http://www.cogmed.com/</ext-link>) to use the computer- and Internet-based rehabilitation programme for working memory for research purposes was requested and obtained. Free licences were granted to all participants.</p>
</sec>
<sec id="s0008">
<title>Results</title>
<p>The eight barriers described in the following sections were identified as influencing the uptake and adherence to the CBRP.</p>
<sec id="s20009">
<title>Barrier 1: Unawareness of the cognitive deficit</title>
<p>The salience of the cognitive deficit and the awareness of cognitive loss were pivotal factors in participants&#x2019; engagement with the programme. Participants who were able to clearly identify cognitive symptoms and take &#x2018;ownership&#x2019; of a complaint were more amenable to the suggestion of treatment and perceived the programme as an opportunity for improvement. In contrast, participants who declined the invitation or dropped out of the programme in the first week were typically referred by a healthcare worker who reported cognitive issues in the referral, but the participants themselves did not spontaneously indicate cognitive complaints (despite having shown deficits in previous cognitive assessments). These cases were typically coupled with reports of a lack of understanding about cognition in general and what rehabilitation is (e.g. P1: &#x2018;To tell you honestly, I don&#x2019;t even know what cognitive training is about!&#x2019;).</p>
<p>For some participants, rehabilitation was for those with high levels of impairment. This suggests that patients may not have been seeking help with cognitive deficits because they did not see the cognitive deficit as a symptom that could potentially be treated unless it was incapacitating (e.g. P1: &#x2018;I know that my friend went for cognitive training, but she doesn&#x2019;t really have a memory&#x2019;).</p>
</sec>
<sec id="s20010">
<title>Barrier 2: Anticipation of negative results</title>
<p>Expectations such as worsening of anxiety levels because of increased awareness of cognitive symptomatology, or the development of anxiety symptomatology because of exposure to the exercises, were recurrently reported by participants who chose not to participate or who dropped out early. Specifically, participants from the schizophrenia group appeared to take into consideration their abilities to cope with challenges and stress when deciding to do the rehabilitation process, while participants from the HIV group did not seem to have this concern, for example:</p>
<disp-quote>
<p>&#x2018;I&#x2019;m a bit apprehensive; worried about it being a bit too stressful and a bit &#x2026; impacting on me negatively and that sort of thing &#x2026; Like putting too much stress on me, making me feel bad about myself for not being clever enough to figure out the answers.&#x2019; (P2)</p>
</disp-quote>
<p>Two elements of this theme are thus apparent: (1) it is important for a person living with chronic illness to be able to identify emotional triggers in order to avoid relapses; (2) the programme is seen as a potential threat to self-esteem and hence a potential precipitating factor of emotional stress.</p>
</sec>
<sec id="s20011">
<title>Barrier 3: Stigma</title>
<p>Offering rehabilitation programmes in hospital contexts is often associated with particular services. Attendance at specific clinics may thus force diagnosis disclosure by some healthcare users. This raises important ethical concerns that can act as a barrier to treatment, as a face-to-face invitation compromises the person&#x2019;s rights to anonymity and privacy. Two of the healthcare workers indicated that their difficulty in attracting participants may have been partly a result of issues of confidentiality in relation to HIV. Additionally, participants who enrolled in the programme suggested that it was difficult to find interested potential users because &#x2018;other people are not as open about disclosing their HIV status&#x2019; (Field Notes 1). This was thus an apparent obstacle in the HIV clinic but not for the schizophrenia group.</p>
</sec>
<sec id="s20012">
<title>Barrier 4: Ill health</title>
<p>Because of the immune suppression that is commonly associated with HIV, even for those patients on antiretrovirals (ARVs), the presence of frequent illnesses can severely interfere with the ability to commit to a time-intensive training programme. Some of the participants were thus unable to enrol for the study because of ill health during the recruitment and installation stage (Field Notes).</p>
</sec>
<sec id="s20013">
<title>Barrier 5: Difficulties accessing a computer and/or Internet connection</title>
<p>Although one of the inclusion criteria for this research was having access to a computer and Internet connection, in practice, access was problematic. Specifically, the poor quality and high cost of Internet connections interfered negatively with some participants&#x2019; motivation to engage in the sessions (e.g. P4: &#x2018;Some days I struggled to connect to the Internet and it made me feel so, so demotivated&#x2019;). Furthermore, some participants were not aware of the quantity of data that was involved in the use of the program and hence did not plan for the costs involved (e.g. P6: &#x2018;My mom pays for the Internet. I just thought you were going to pay for it&#x2019;).</p>
<p>The implications of having limited access are threefold. Firstly, the quality of the Internet connection may interfere with the exercises, feedback and monitoring of the program and consequently increase the frustration of participants. Secondly, the amount of data required by the program could become problematic after the participants were involved with the training, which could threaten the participation of some participants with initial high motivation. These factors are out of the control of the participant and appear to negatively affect those with high motivation but low tolerance for frustration, which is a common combination in psychiatric populations. Thirdly, limited access must also be considered as a financial issue, which is of particular concern in contexts of high inequality like South Africa.</p>
<p>Use of the materials was also reportedly affected by the relative ease of access, as participants reported that their motivation was negatively impacted by the effort required to set up the laptop (e.g. P1: &#x2018;I could find the time but I was like, just getting my computer out&#x2019;). Consequently, some participants reported that these types of interventions would be easier to follow or adhere to if they were easier to access (such as through cellular phones and tablets) and available at times that were more convenient (e.g. P3: &#x2018;But if it was on cell phone, like if it was at a place like where I was at the clinic waiting, then I could&#x2019;ve done it there&#x2019;).</p>
</sec>
<sec id="s20014">
<title>Barrier 6: Negative emotional experiences</title>
<p>Participants who displayed low tolerance for frustration had difficulties in maintaining participation because of the increased difficulty of the exercises. For some participants, the increases in difficulty were challenging and motivating. However, participants with high levels of anxiety associated with low performance reported feeling discouraged and overwhelmed when they experienced failure during the tasks, thus concluding that the programme was beyond their personal capabilities and deciding to abandon it.</p>
<p>Because the program adjusts the level of difficulty according to the progress history of the user, what is initially experienced as successful and rewarding may later on be seen as failure (e.g. P6: &#x2018;I started off doing very well, but I just got worse and worse and worse at it&#x2019;). The anticipation of failure causes disengagement with the activity and a tendency to give up (e.g. P1: &#x2018;The ones that I couldn&#x2019;t do, especially near the end, I get like demotivated&#x2019;).</p>
<p>The increasing difficulty of the exercises also reportedly elicited in some participants a fear of failing (e.g. P1: &#x2018;I suppose in a way I was a bit threatened, in a way. Um, like of failing&#x2019;) and mental exhaustion (e.g. P3: &#x2018;It was quite draining. It was almost like it took a hell of a lot of energy from me &#x2026; after I&#x2019;d done it I felt tired; my mind was completely tired&#x2019;). These were reported as reasons for dropping out during the middle section of the programme.</p>
</sec>
<sec id="s20015">
<title>Barrier 7: Daily routine challenges</title>
<p>Participants with difficulties incorporating the programme into their daily routine did not continue the training after initial uptake. Common challenges reported were associated with family and work responsibilities (e.g. P4: &#x2018;There was just no time &#x2026; It&#x2019;s difficult to find suitable time during the day at the office&#x2019;).</p>
<p>Unpredictable schedules or the inability to establish a regular daily training time were recurrently reported as reasons for discontinuance. This issue was particularly present in the schizophrenia group (e.g. P5: &#x2018;My schedule is quite erratic generally so I didn&#x2019;t have a specific schedule that I kept&#x2019;).</p>
<p>Participants who were aware of their planning and monitoring difficulties expressed the need for an external source to provide support in this regard (e.g. P2: &#x2018;If I had someone giving me a set timetable&#x2019;; P1: &#x2018;Say to me: P1 you must do it at ten o&#x2019;clock today, or P1 you must do it at three&#x2019;).</p>
</sec>
<sec id="s20016">
<title>Barrier 8: Non-conducive or sabotaging environment</title>
<p>An ideal environment for the intervention is a quiet, well-lit room without interruptions. In clinical settings the environment is controlled in order to reduce interference. However, all participants engaged in the training in their homes, with many citing frequent interruptions (e.g. noise, cell phone, family members) as hindrances to their motivation to engage with the rehabilitation (e.g. P4: &#x2018;I always have to wait until the kids are sleeping; otherwise they interrupt me a lot and sometimes it&#x2019;s more difficult to concentrate while they are watching TV&#x2019;).</p>
<p>The challenge with this tendency arose when the training was dependent on the availability of a facilitative space, instead of implementing a regularly scheduled slot without any regard for when the participant had an optimal cognitive disposition. Hence, participants who dropped out of the programme tended to report that the training was controlled or affected by the environment(s) available to them.</p>
<p>In particular, participants from the schizophrenia group reported dissatisfaction with their training environment on the basis of being disturbed by the presence of other people and a house-related routine that they claimed interfered negatively with their motivation to engage with the programme, for example:</p>
<disp-quote>
<p>&#x2018;Usually what happens is that I have the computer out, and then something will call me away. Like, I must go do this, I must go do that and something like that might stop me &#x2026; If I go outside there&#x2019;s people so, and if I&#x2019;m inside, then someone&#x2019;s always walking inside.&#x2019; (P1)</p>
</disp-quote>
<p>The environment was also understood as an emotional ambiance, as they reported being negatively affected by the lack of a supportive and encouraging atmosphere (e.g. P9: &#x2018;I just felt this place has, like, breaking me down. People aren&#x2019;t encouraged &#x2026; it feels like encouragement or more positivity or more group work or more teamwork&#x2019;).</p>
</sec>
</sec>
<sec id="s0017">
<title>Discussion</title>
<p>During the implementation of the CBRP, participants experienced several obstacles that were specific to particular moments of the intervention. <xref ref-type="fig" rid="F0001">Figure 1</xref> provides a representation of how participants reportedly experienced impediments from the invitation to take part in the rehabilitation programme to its completion.</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>Representational model of the barriers to the implementation of an Internet-based rehabilitation program in a public healthcare setting.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="SAJPsy-24-1163-g001.tif"/>
</fig>
<p>Not being aware of the cognitive deficit, experiencing stigma associated with the main clinical diagnosis (HIV or schizophrenia) and anticipating a negative outcome were the three barriers that affected the likelihood of initial participation in the programme. All of them can be understood as psychological variables, as they are cognitive and emotional in nature.</p>
<p>Many psychological variables have been previously identified as obstacles for participation in rehabilitation programmes, with unawareness of the cognitive deficit being prominently linked to lack of participation in cognitive rehabilitation.<sup><xref ref-type="bibr" rid="CIT0026">26</xref></sup> In the present study, this issue was twofold. Firstly, not recognising the presence of a cognitive symptom results in no perception of need for treatment, despite the encouragement of a third party (such as the psychiatrist). Therefore, a referral may be futile unless the patient has clearly verbalised a cognitive complaint. Secondly, unawareness of the nature and severity of the cognitive issue and associated therapeutic option was found to reduce participation. Both of these issues are particularly relevant in diagnostic groups where the cognitive impairment is insidious.<sup><xref ref-type="bibr" rid="CIT0027">27</xref></sup></p>
<p>The experience of stigma is common in HIV<sup><xref ref-type="bibr" rid="CIT0028">28</xref></sup> and schizophrenia.<sup><xref ref-type="bibr" rid="CIT0029">29</xref></sup> Although the negative power of stigma could not be fully ascertained in this research, it was observed that there was reduced access to the rehabilitation programme for users of the HIV clinic, which supports the claim that stigma interferes with access to treatment opportunities.<sup><xref ref-type="bibr" rid="CIT0030">30</xref></sup></p>
<p>The impact of the anticipation of negative outcomes found in the schizophrenia group was similar to the one previously identified in Alzheimer&#x2019;s disease, especially in terms of its negative influence on mood and self-efficacy, as well as reluctance to participate in activities that act as triggers for anxiety, depression and low self-esteem.<sup><xref ref-type="bibr" rid="CIT0027">27</xref></sup></p>
<p>The theme <italic>negative emotional experiences</italic>, although considered to be also of a psychological nature, had an impact after the initial uptake, which is consistent with previous research reporting that high levels of psychological distress preceding engagement with rehabilitation programmes has been linked to early attrition.<sup><xref ref-type="bibr" rid="CIT0031">31</xref></sup> The results suggest that low tolerance to frustration, high anxiety, high vulnerability to mental fatigue and low levels of motivation were associated with attrition. This finding can be interpreted as resulting from cognitive bias, which is common in people living with emotional psychopathology. Cognitive bias makes people more prone to selectively attend to the emotionally negative aspects of an experience.<sup><xref ref-type="bibr" rid="CIT0032">32</xref>,<xref ref-type="bibr" rid="CIT0033">33</xref></sup></p>
<p>Other barriers that were frequently reported as reasons to give up the CBRP after the set-up session seemed to be circumstantial. These themes were presented as situations that were outside the participants&#x2019; control. An example is daily routine challenges, which interfered with the scheduling of the rehabilitation session. This difficulty incorporating the programme into the routine and maintaining a consistent practice is possibly related to deficits in other cognitive domains, such as executive functions. Research has interpreted the failure to incorporate activities into the daily schedule, as well as sourcing a conducive environment, as symptoms of executive dysfunction<sup><xref ref-type="bibr" rid="CIT0034">34</xref>,<xref ref-type="bibr" rid="CIT0035">35</xref></sup> that are common in people with schizophrenia<sup><xref ref-type="bibr" rid="CIT0036">36</xref>,<xref ref-type="bibr" rid="CIT0037">37</xref></sup> and HIV.<sup><xref ref-type="bibr" rid="CIT0038">38</xref>,<xref ref-type="bibr" rid="CIT0039">39</xref></sup></p>
<p>A central issue for the participants was associated with their living conditions, which were reported in some cases to be non-conducive or even sabotaging. The lack of an appropriate space that provided privacy, silence and encouragement, or at least did not actively interfere with the training sessions, was an important reported reason for attrition. Despite participants being informed about the ideal environmental conditions for training (such as good light, comfortable seating and no interruptions), most of them were unable to work under these conditions. This is a strong indicator that take-home rehabilitation programmes may be problematic, thus therapists should weigh the challenges associated with going to the hospital<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> against the benefits of controlling the rehabilitation environment.</p>
<p>Having ill health can be a circumstantial barrier when mild or acute conditions coincide with the beginning of the programme. Previous research has reported medical conditions as a reason for withdrawing participation.<sup><xref ref-type="bibr" rid="CIT0040">40</xref></sup> When users have a chronic health condition that makes them vulnerable to health problems, such as HIV, it is possible that the perception of one&#x2019;s health can be used as a reason to refrain from participating in long commitments that require daily engagement, such as CBRP.</p>
<p>Limited access to the computer or Internet affected participation at all stages of implementation. This particular theme was associated with psychological and circumstantial factors. In the first instance, this obstacle reportedly triggered feelings of frustration or conflict with important stakeholders, such as family members. Furthermore, personal variables, such as lack of motivation, reduced energy and low tolerance to frustration, were expressed in relation to managing access (e.g. setting up the workstation or laptop was reportedly an extraordinary effort), which connects the theme of limited access with the cognitive bias and dysexecutive syndrome described above.</p>
<p>Difficulties accessing a computer and/or Internet connection appeared to be linked to circumstantial factors, specifically to the financial resources available and program accessibility. User experience in cognitive rehabilitation is an important factor for consideration. Programs that are not error-free and require significant computer skill or maintenance from users are likely to exhibit decreased efficacy.<sup><xref ref-type="bibr" rid="CIT0010">10</xref></sup></p>
<p>The quality and costs of the Internet connection were particularly relevant. Better quality connections are usually more expensive, and programs that utilise the Internet also require resources in terms of bandwidth, which results in additional expenses to participants. This factor is significant when considering the socio-economic status (and financial dependence) of participants in any intervention. Interventions that are unable to plan for and address unique environmental or social factors in their implementation may face problems with recruitment or compliance. Financial affordability is a serious concern in neuropsychological rehabilitation in general, and more so in low-income contexts.</p>
</sec>
<sec id="s0018">
<title>Limitations</title>
<p>Several limitations associated with the methodology implemented should be acknowledged. First, the qualitative design only provides a descriptive level of analysis, with low potential for generalisability to other contexts and other diagnoses.<sup><xref ref-type="bibr" rid="CIT0041">41</xref></sup> Although purposive, non-probabilistic sampling is typically used in qualitative research,<sup><xref ref-type="bibr" rid="CIT0042">42</xref></sup> it is possible that the type of intervention (computer-based) as well as the method of recruiting could have introduced a selection bias, as many of the participants attending the health centres did not have a computer or did not attend consultation with their healthcare practitioner during the recruitment phase. Efforts to minimise researcher bias and improve the validity of the analysis were taken, including additional reviewers during the data analysis process; however, the use of field notes may have resulted in a bias in the presentation of results relating to the researchers&#x2019; identification of what was important enough to include in the notes.</p>
</sec>
<sec id="s0019">
<title>Conclusion</title>
<p>Our findings suggest that participants faced several obstacles that hindered their participation in the CBRP. The experience of stigma, a lack of awareness of the cognitive deficit and the anticipation of negative outcome were barriers that apparently interfered with the initial engagement with the treatment. Having negative emotional experiences associated with the programme, experiencing the environment as non-conducive or sabotaging of the rehabilitation, facing daily challenges and ill health seemed to be linked to an increased risk of attrition after the CBRP had begun. Limited access to a computer and the Internet reportedly reduced the chances of participation at all stages of the CBRP.</p>
<p>These findings suggest that, prior to the selection of a cognitive rehabilitation option and recommendation to specific candidates, the healthcare professional should take into consideration not only issues of access to particular strategies and materials but also individual and contextual factors that may pose a higher risk for treatment dropout, such as the ones highlighted here. Understanding how these barriers to participation in particular therapeutic options are experienced and perceived by users is of paramount importance in order to select better therapeutic strategies as well as to increase the chances of treatment uptake and adherence.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>This research was supported by CogMed Working Memory Training Program (Pearson), who provided free licences for each participant. The authors would like to acknowledge Prof. Kevin Whitehead for his constructive input and his assistance with the data analysis.</p>
<sec id="s20020" sec-type="COI-statement">
<title>Competing interests</title>
<p>The authors declare that they have no financial or personal relationships which may have inappropriately influenced them in writing this article.</p>
</sec>
<sec id="s20021">
<title>Authors&#x2019; contributions</title>
<p>A.F.C. was the project leader and supervisor, was partially responsible for the data analysis and was responsible for the preparation of the article. T.B and L.M. were responsible for the data collection and partially for data analysis.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><label>1.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hwang</surname> <given-names>J-H</given-names></string-name>, <string-name><surname>Cha</surname> <given-names>H-G</given-names></string-name>, <string-name><surname>Cho</surname> <given-names>Y-S</given-names></string-name>, <string-name><surname>Kim</surname> <given-names>T-S</given-names></string-name>, <string-name><surname>Cho</surname> <given-names>H-S</given-names></string-name></person-group>. <article-title>The effects of computer-assisted cognitive rehabilitation on Alzheimer&#x2019;s dementia patients memories</article-title>. <source>J Phys Ther Sci</source>. <year>2015</year>;<volume>27</volume>(<issue>9</issue>):<fpage>2921</fpage>&#x2013;<lpage>2923</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1589/jpts.27.2921">https://doi.org/10.1589/jpts.27.2921</ext-link></comment></mixed-citation></ref>
<ref id="CIT0002"><label>2.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gartland</surname> <given-names>D</given-names></string-name></person-group>. <article-title>Considerations in the selection and use of technology with people who have cognitive deficits following acquired brain injury</article-title>. <source>Neuropsychol Rehabil</source>. <year>2004</year>;<volume>14</volume>(<issue>1&#x2013;2</issue>):<fpage>61</fpage>&#x2013;<lpage>75</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09602010343000165">https://doi.org/10.1080/09602010343000165</ext-link></comment></mixed-citation></ref>
<ref id="CIT0003"><label>3.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wilson</surname> <given-names>BA</given-names></string-name></person-group>. <article-title>Cognitive rehabilitation: How it is and how it might be</article-title>. <source>J Int Neuropsychol Soc</source>. <year>1997</year>;<volume>3</volume>(<issue>05</issue>):<fpage>487</fpage>&#x2013;<lpage>496</lpage>.</mixed-citation></ref>
<ref id="CIT0004"><label>4.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wilson</surname> <given-names>BA</given-names></string-name></person-group>. <article-title>Neuropsychological rehabilitation: State of the science</article-title>. <source>S Afr J Psychol</source>. <year>2013</year>;<volume>43</volume>(<issue>3</issue>):<fpage>267</fpage>&#x2013;<lpage>277</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/0081246313494156">https://doi.org/10.1177/0081246313494156</ext-link></comment></mixed-citation></ref>
<ref id="CIT0005"><label>5.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Amato</surname> <given-names>MP</given-names></string-name>, <string-name><surname>Goretti</surname> <given-names>B</given-names></string-name>, <string-name><surname>Viterbo</surname> <given-names>RG</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Computer-assisted rehabilitation of attention in patients with multiple sclerosis: Results of a randomized, double-blind trial</article-title>. <source>Mult Scler J</source>. <year>2013</year>;<volume>20</volume>(<issue>1</issue>):<fpage>91</fpage>&#x2013;<lpage>98</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1352458513501571">https://doi.org/10.1177/1352458513501571</ext-link></comment></mixed-citation></ref>
<ref id="CIT0006"><label>6.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kapur</surname> <given-names>N</given-names></string-name>, <string-name><surname>Glisky</surname> <given-names>EL</given-names></string-name>, <string-name><surname>Wilson</surname> <given-names>BA</given-names></string-name></person-group>. <article-title>Technological memory aids for people with memory deficits</article-title>. <source>Neuropsychol Rehabil</source>. <year>2004</year>;<volume>14</volume>(<issue>1&#x2013;2</issue>):<fpage>41</fpage>&#x2013;<lpage>60</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09602010343000138">https://doi.org/10.1080/09602010343000138</ext-link></comment></mixed-citation></ref>
<ref id="CIT0007"><label>7.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cipriani</surname> <given-names>G</given-names></string-name>, <string-name><surname>Bianchetti</surname> <given-names>A</given-names></string-name>, <string-name><surname>Trabucchi</surname> <given-names>M</given-names></string-name></person-group>. <article-title>Outcomes of a computer-based cognitive rehabilitation program on Alzheimer&#x2019;s disease patients compared with those on patients affected by mild cognitive impairment</article-title>. <source>Arch Gerontol Geriatr</source>. <year>2006</year>;<volume>43</volume>(<issue>3</issue>):<fpage>327</fpage>&#x2013;<lpage>335</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.archger.2005.12.003">https://doi.org/10.1016/j.archger.2005.12.003</ext-link></comment></mixed-citation></ref>
<ref id="CIT0008"><label>8.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mitolo</surname> <given-names>M</given-names></string-name>, <string-name><surname>Venneri</surname> <given-names>A</given-names></string-name>, <string-name><surname>Wilkinson</surname> <given-names>ID</given-names></string-name>, <string-name><surname>Sharrack</surname> <given-names>B</given-names></string-name></person-group>. <article-title>Cognitive rehabilitation in multiple sclerosis: A systematic review</article-title>. <source>J Neurol Sci</source>. <year>2015</year>;<volume>354</volume>(<issue>1&#x2013;2</issue>):<fpage>1</fpage>&#x2013;<lpage>9</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jns.2015.05.004">https://doi.org/10.1016/j.jns.2015.05.004</ext-link></comment></mixed-citation></ref>
<ref id="CIT0009"><label>9.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Barnes</surname> <given-names>DE</given-names></string-name>, <string-name><surname>Santos-Modesitt</surname> <given-names>W</given-names></string-name>, <string-name><surname>Poelke</surname> <given-names>G</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>The Mental Activity and eXercise (MAX) trial: A randomized controlled trial to enhance cognitive function in older adults</article-title>. <source>JAMA Intern Med</source>. <year>2013</year>;<volume>173</volume>(<issue>9</issue>):<fpage>797</fpage>&#x2013;<lpage>804</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1001/jamainternmed.2013.189">https://doi.org/10.1001/jamainternmed.2013.189</ext-link></comment></mixed-citation></ref>
<ref id="CIT0010"><label>10.</label><mixed-citation publication-type="conference"><person-group person-group-type="editor"><string-name><surname>Egglestone</surname> <given-names>SR</given-names></string-name>, <string-name><surname>Axelrod</surname> <given-names>L</given-names></string-name>, <string-name><surname>Nind</surname> <given-names>T</given-names></string-name>, <etal>et al.</etal>, editors</person-group>. <article-title>A design framework for a home-based stroke rehabilitation system: Identifying the key components</article-title>. <conf-name>2009 3rd International Conference on Pervasive Computing Technologies for Healthcare</conf-name>; <conf-date>2009 Apr 01&#x2013;03</conf-date>. <year>2009</year>.</mixed-citation></ref>
<ref id="CIT0011"><label>11.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Farina</surname> <given-names>E</given-names></string-name>, <string-name><surname>Raglio</surname> <given-names>A</given-names></string-name>, <string-name><surname>Giovagnoli</surname> <given-names>AR</given-names></string-name></person-group>. <article-title>Cognitive rehabilitation in epilepsy: An evidence-based review</article-title>. <source>Epilepsy Res</source>. <year>2015</year>;<volume>109</volume>:<fpage>210</fpage>&#x2013;<lpage>218</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.eplepsyres.2014.10.017">https://doi.org/10.1016/j.eplepsyres.2014.10.017</ext-link></comment></mixed-citation></ref>
<ref id="CIT0012"><label>12.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Brett</surname> <given-names>CE</given-names></string-name>, <string-name><surname>Sykes</surname> <given-names>C</given-names></string-name>, <string-name><surname>Pires-Yfantouda</surname> <given-names>R</given-names></string-name></person-group>. <article-title>Interventions to increase engagement with rehabilitation in adults with acquired brain injury: A systematic review</article-title>. <source>Neuropsychol Rehabil</source>. <year>2017</year>;<volume>27</volume>(<issue>6</issue>):<fpage>959</fpage>&#x2013;<lpage>982</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09602011.2015.1090459">https://doi.org/10.1080/09602011.2015.1090459</ext-link></comment></mixed-citation></ref>
<ref id="CIT0013"><label>13.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Morrison</surname> <given-names>AB</given-names></string-name>, <string-name><surname>Chein</surname> <given-names>JM</given-names></string-name></person-group>. <article-title>The controversy over Cogmed</article-title>. <source>J Appl Res Mem Cogn</source>. <year>2012</year>;<volume>1</volume>(<issue>3</issue>):<fpage>208</fpage>&#x2013;<lpage>210</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jarmac.2012.07.005">https://doi.org/10.1016/j.jarmac.2012.07.005</ext-link></comment></mixed-citation></ref>
<ref id="CIT0014"><label>14.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jaeggi</surname> <given-names>SM</given-names></string-name>, <string-name><surname>Buschkuehl</surname> <given-names>M</given-names></string-name>, <string-name><surname>Jonides</surname> <given-names>J</given-names></string-name>, <string-name><surname>Shah</surname> <given-names>P</given-names></string-name></person-group>. <article-title>Cogmed and working memory training &#x2013; Current challenges and the search for underlying mechanisms</article-title>. <source>J Appl Res Mem Cogn</source>. <year>2012</year>;<volume>1</volume>(<issue>3</issue>):<fpage>211</fpage>&#x2013;<lpage>213</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jarmac.2012.07.002">https://doi.org/10.1016/j.jarmac.2012.07.002</ext-link></comment></mixed-citation></ref>
<ref id="CIT0015"><label>15.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bangirana</surname> <given-names>P</given-names></string-name>, <string-name><surname>Giordani</surname> <given-names>B</given-names></string-name>, <string-name><surname>John</surname> <given-names>CC</given-names></string-name>, <string-name><surname>Page</surname> <given-names>C</given-names></string-name>, <string-name><surname>Opoka</surname> <given-names>RO</given-names></string-name>, <string-name><surname>Boivin</surname> <given-names>MJ</given-names></string-name></person-group>. <article-title>Immediate neuropsychological and behavioral benefits of computerized cognitive rehabilitation in Ugandan pediatric cerebral malaria survivors</article-title>. <source>J Dev Behav Pediatr</source>. <year>2009</year>;<volume>30</volume>(<issue>4</issue>):<fpage>310</fpage>&#x2013;<lpage>318</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1097/DBP.0b013e3181b0f01b">https://doi.org/10.1097/DBP.0b013e3181b0f01b</ext-link></comment></mixed-citation></ref>
<ref id="CIT0016"><label>16.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Boivin</surname> <given-names>MJ</given-names></string-name>, <string-name><surname>Busman</surname> <given-names>RA</given-names></string-name>, <string-name><surname>Parikh</surname> <given-names>SM</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>A pilot study of the neuropsychological benefits of computerized cognitive rehabilitation in Ugandan children with HIV</article-title>. <source>Neuropsychology</source>. <year>2010</year>;<volume>24</volume>(<issue>5</issue>):<fpage>667</fpage>&#x2013;<lpage>673</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/a0019312">https://doi.org/10.1037/a0019312</ext-link></comment></mixed-citation></ref>
<ref id="CIT0017"><label>17.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Robinson</surname> <given-names>JM</given-names></string-name>, <string-name><surname>Trochim</surname> <given-names>WMK</given-names></string-name></person-group>. <article-title>An examination of community members&#x2019;, researchers&#x2019; and health professionals&#x2019; perceptions of barriers to minority participation in medical research: An application of concept mapping</article-title>. <source>Ethn Health</source>. <year>2007</year>;<volume>12</volume>(<issue>5</issue>):<fpage>521</fpage>&#x2013;<lpage>539</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/13557850701616987">https://doi.org/10.1080/13557850701616987</ext-link></comment></mixed-citation></ref>
<ref id="CIT0018"><label>18.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lambert</surname> <given-names>VA</given-names></string-name>, <string-name><surname>Lambert</surname> <given-names>CE</given-names></string-name></person-group>. <article-title>Qualitative descriptive research: An acceptable design</article-title>. <source>Pac Rim Int J Nurs Res</source>. <year>2012</year>;<volume>16</volume>(<issue>4</issue>):<fpage>255</fpage>&#x2013;<lpage>256</lpage>.</mixed-citation></ref>
<ref id="CIT0019"><label>19.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>McArthur</surname> <given-names>JC</given-names></string-name></person-group>. <article-title>HIV dementia: An evolving disease</article-title>. <source>J Neuroimmunol</source>. <year>2004</year>;<volume>157</volume>(<issue>1&#x2013;2</issue>):<fpage>3</fpage>&#x2013;<lpage>10</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jneuroim.2004.08.042">https://doi.org/10.1016/j.jneuroim.2004.08.042</ext-link></comment></mixed-citation></ref>
<ref id="CIT0020"><label>20.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>O&#x2019;Carroll</surname> <given-names>R</given-names></string-name></person-group>. <article-title>Cognitive impairment in schizophrenia</article-title>. <source>Adv Psychiatr Treat</source>. <year>2000</year>;<volume>6</volume>(<issue>3</issue>):<fpage>161</fpage>&#x2013;<lpage>168</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1192/apt.6.3.161">https://doi.org/10.1192/apt.6.3.161</ext-link></comment></mixed-citation></ref>
<ref id="CIT0021"><label>21.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stout</surname> <given-names>JC</given-names></string-name>, <string-name><surname>Salmon</surname> <given-names>D</given-names></string-name>, <string-name><surname>Butters</surname> <given-names>N</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Decline in working memory associated with HIV infection</article-title>. <source>Psychol Med</source>. <year>1995</year>;<volume>25</volume>(<issue>6</issue>):<fpage>1221</fpage>&#x2013;<lpage>1232</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1017/S0033291700033195">https://doi.org/10.1017/S0033291700033195</ext-link></comment></mixed-citation></ref>
<ref id="CIT0022"><label>22.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Manglam</surname> <given-names>MK</given-names></string-name>, <string-name><surname>Ram</surname> <given-names>D</given-names></string-name>, <string-name><surname>Praharaj</surname> <given-names>SK</given-names></string-name>, <string-name><surname>Sarkhel</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Working memory in schizophrenia</article-title>. <source>Age</source>. <year>2010</year>;<volume>16</volume>:<fpage>6.34</fpage>.</mixed-citation></ref>
<ref id="CIT0023"><label>23.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Manoach</surname> <given-names>DS</given-names></string-name>, <string-name><surname>Gollub</surname> <given-names>RL</given-names></string-name>, <string-name><surname>Benson</surname> <given-names>ES</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Schizophrenic subjects show aberrant fMRI activation of dorsolateral prefrontal cortex and basal ganglia during working memory performance</article-title>. <source>Biol Psychiatry</source>. <volume>48</volume>(<issue>2</issue>):<fpage>99</fpage>&#x2013;<lpage>109</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/S0006-3223(00)00227-4">https://doi.org/10.1016/S0006-3223(00)00227-4</ext-link></comment></mixed-citation></ref>
<ref id="CIT0024"><label>24.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chang</surname> <given-names>L</given-names></string-name>, <string-name><surname>Speck</surname> <given-names>O</given-names></string-name>, <string-name><surname>Miller</surname> <given-names>EN</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Neural correlates of attention and working memory deficits in HIV patients</article-title>. <source>Neurology</source>. <year>2001</year>;<volume>57</volume>(<issue>6</issue>):<fpage>1001</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1212/WNL.57.6.1001">https://doi.org/10.1212/WNL.57.6.1001</ext-link></comment></mixed-citation></ref>
<ref id="CIT0025"><label>25.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Braun</surname> <given-names>V</given-names></string-name>, <string-name><surname>Clarke</surname> <given-names>V</given-names></string-name></person-group>. <article-title>Using thematic analysis in psychology</article-title>. <source>Qual Res Psychol</source>. <year>2006</year>;<volume>3</volume>(<issue>2</issue>):<fpage>77</fpage>&#x2013;<lpage>101</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1191/1478088706qp063oa">https://doi.org/10.1191/1478088706qp063oa</ext-link></comment></mixed-citation></ref>
<ref id="CIT0026"><label>26.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Medley</surname> <given-names>AR</given-names></string-name>, <string-name><surname>Powell</surname> <given-names>T</given-names></string-name></person-group>. <article-title>Motivational interviewing to promote self-awareness and engagement in rehabilitation following acquired brain injury: A conceptual review</article-title>. <source>Neuropsychol Rehabil</source>. <year>2010</year>;<volume>20</volume>(<issue>4</issue>):<fpage>481</fpage>&#x2013;<lpage>508</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09602010903529610">https://doi.org/10.1080/09602010903529610</ext-link></comment></mixed-citation></ref>
<ref id="CIT0027"><label>27.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Choi</surname> <given-names>J</given-names></string-name>, <string-name><surname>Twamley</surname> <given-names>EW</given-names></string-name></person-group>. <article-title>Cognitive rehabilitation therapies for Alzheimer&#x2019;s disease: A review of methods to improve treatment engagement and self-efficacy</article-title>. <source>Neuropsychol Rev</source>. <year>2013</year>;<volume>23</volume>(<issue>1</issue>):<fpage>48</fpage>&#x2013;<lpage>62</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s11065-013-9227-4">https://doi.org/10.1007/s11065-013-9227-4</ext-link></comment></mixed-citation></ref>
<ref id="CIT0028"><label>28.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Reidpath</surname> <given-names>DD</given-names></string-name>, <string-name><surname>Chan</surname> <given-names>KY</given-names></string-name></person-group>. <article-title>A method for the quantitative analysis of the layering of HIV-related stigma</article-title>. <source>AIDS Care</source>. <year>2005</year>;<volume>17</volume>(<issue>4</issue>):<fpage>425</fpage>&#x2013;<lpage>432</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09540120412331319769">https://doi.org/10.1080/09540120412331319769</ext-link></comment></mixed-citation></ref>
<ref id="CIT0029"><label>29.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Dickerson</surname> <given-names>FB</given-names></string-name>, <string-name><surname>Sommerville</surname> <given-names>J</given-names></string-name>, <string-name><surname>Origoni</surname> <given-names>AE</given-names></string-name>, <string-name><surname>Ringel</surname> <given-names>NB</given-names></string-name>, <string-name><surname>Parente</surname> <given-names>F</given-names></string-name></person-group>. <article-title>Experiences of stigma among outpatients with schizophrenia</article-title>. <source>Schizophr Bull</source>. <year>2002</year>;<volume>28</volume>(<issue>1</issue>):<fpage>143</fpage>&#x2013;<lpage>155</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1093/oxfordjournals.schbul.a006917">https://doi.org/10.1093/oxfordjournals.schbul.a006917</ext-link></comment></mixed-citation></ref>
<ref id="CIT0030"><label>30.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Corrigan</surname> <given-names>P</given-names></string-name></person-group>. <article-title>How stigma interferes with mental health care</article-title>. <source>Am Psychol</source>. <year>2004</year>;<volume>59</volume>(<issue>7</issue>):<fpage>614</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/0003-066X.59.7.614">https://doi.org/10.1037/0003-066X.59.7.614</ext-link></comment></mixed-citation></ref>
<ref id="CIT0031"><label>31.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Glazer</surname> <given-names>KM</given-names></string-name>, <string-name><surname>Emery</surname> <given-names>CF</given-names></string-name>, <string-name><surname>Frid</surname> <given-names>DJ</given-names></string-name>, <string-name><surname>Banyasz</surname> <given-names>RE</given-names></string-name></person-group>. <article-title>Psychological predictors of adherence and outcomes among patients in cardiac rehabilitation</article-title>. <source>J Cardiopulm Rehabil Prev</source>. <year>2002</year>;<volume>22</volume>(<issue>1</issue>):<fpage>40</fpage>&#x2013;<lpage>46</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1097/00008483-200201000-00006">https://doi.org/10.1097/00008483-200201000-00006</ext-link></comment></mixed-citation></ref>
<ref id="CIT0032"><label>32.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hertel</surname> <given-names>PT</given-names></string-name></person-group>. <article-title>Cognitive biases in anxiety and depression: Introduction to the special issue</article-title>. <source>Cogn Emot</source>. <year>2002</year>;<volume>16</volume>(<issue>3</issue>):<fpage>321</fpage>&#x2013;<lpage>330</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/02699930143000509">https://doi.org/10.1080/02699930143000509</ext-link></comment></mixed-citation></ref>
<ref id="CIT0033"><label>33.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mathews</surname> <given-names>A</given-names></string-name>, <string-name><surname>MacLeod</surname> <given-names>C</given-names></string-name></person-group>. <article-title>Cognitive vulnerability to emotional disorders</article-title>. <source>Annu Rev Clin Psychol</source>. <year>2005</year>;<volume>1</volume>:<fpage>167</fpage>&#x2013;<lpage>195</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1146/annurev.clinpsy.1.102803.143916">https://doi.org/10.1146/annurev.clinpsy.1.102803.143916</ext-link></comment></mixed-citation></ref>
<ref id="CIT0034"><label>34.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Velligan</surname> <given-names>DI</given-names></string-name>, <string-name><surname>Bow-Thomas</surname> <given-names>CC</given-names></string-name>, <string-name><surname>Mahurin</surname> <given-names>RK</given-names></string-name>, <string-name><surname>Miller</surname> <given-names>AL</given-names></string-name>, <string-name><surname>Halgunseth</surname> <given-names>LC</given-names></string-name></person-group>. <article-title>Do specific neurocognitive deficits predict specific domains of community function in schizophrenia?</article-title> <source>J Nerv Ment Dis</source>. <year>2000</year>;<volume>188</volume>(<issue>8</issue>):<fpage>518</fpage>&#x2013;<lpage>524</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1097/00005053-200008000-00007">https://doi.org/10.1097/00005053-200008000-00007</ext-link></comment></mixed-citation></ref>
<ref id="CIT0035"><label>35.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Simon</surname> <given-names>AE</given-names></string-name>, <string-name><surname>Giacomini</surname> <given-names>V</given-names></string-name>, <string-name><surname>Ferrero</surname> <given-names>F</given-names></string-name>, <string-name><surname>Mohr</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Dysexecutive syndrome and social adjustment in schizophrenia</article-title>. <source>Aust N Z J Psychiatry</source>. <year>2003</year>;<volume>37</volume>(<issue>3</issue>):<fpage>340</fpage>&#x2013;<lpage>346</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1046/j.1440-1614.2003.01186.x">https://doi.org/10.1046/j.1440-1614.2003.01186.x</ext-link></comment></mixed-citation></ref>
<ref id="CIT0036"><label>36.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zayat</surname> <given-names>E</given-names></string-name>, <string-name><surname>Rempfer</surname> <given-names>M</given-names></string-name>, <string-name><surname>Gajewski</surname> <given-names>B</given-names></string-name>, <string-name><surname>Brown</surname> <given-names>CE</given-names></string-name></person-group>. <article-title>Patterns of association between performance in a natural environment and measures of executive function in people with schizophrenia</article-title>. <source>Psychiatry Res</source>. <volume>187</volume>(<issue>1</issue>):<fpage>1</fpage>&#x2013;<lpage>5</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.psychres.2010.11.011">https://doi.org/10.1016/j.psychres.2010.11.011</ext-link></comment></mixed-citation></ref>
<ref id="CIT0037"><label>37.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Velligan</surname> <given-names>DI</given-names></string-name>, <string-name><surname>Bow-Thomas</surname> <given-names>CC</given-names></string-name></person-group>. <article-title>Executive function in schizophrenia</article-title>. <source>Semin Clin Neuropsychiatry</source>. <year>1999</year>;<volume>4</volume>(<issue>1</issue>):<fpage>24</fpage>&#x2013;<lpage>33</lpage>.</mixed-citation></ref>
<ref id="CIT0038"><label>38.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chang</surname> <given-names>L</given-names></string-name>, <string-name><surname>Ernst</surname> <given-names>T</given-names></string-name>, <string-name><surname>Witt</surname> <given-names>MD</given-names></string-name>, <string-name><surname>Ames</surname> <given-names>N</given-names></string-name>, <string-name><surname>Gaiefsky</surname> <given-names>M</given-names></string-name>, <string-name><surname>Miller</surname> <given-names>E</given-names></string-name></person-group>. <article-title>Relationships among brain metabolites, cognitive function, and viral loads in antiretroviral-na&#x0131;ve HIV patients</article-title>. <source>Neuroimage</source>. <year>2002</year>;<volume>17</volume>(<issue>3</issue>):<fpage>1638</fpage>&#x2013;<lpage>1648</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1006/nimg.2002.1254">https://doi.org/10.1006/nimg.2002.1254</ext-link></comment></mixed-citation></ref>
<ref id="CIT0039"><label>39.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cattie</surname> <given-names>JE</given-names></string-name>, <string-name><surname>Doyle</surname> <given-names>K</given-names></string-name>, <string-name><surname>Weber</surname> <given-names>E</given-names></string-name>, <string-name><surname>Grant</surname> <given-names>I</given-names></string-name>, <string-name><surname>Woods</surname> <given-names>SP</given-names></string-name>, <collab>the HIVNRPG</collab></person-group>. <article-title>Planning deficits in HIV-associated neurocognitive disorders: Component processes, cognitive correlates, and implications for everyday functioning</article-title>. <source>J Clin Exp Neuropsychol</source>. <year>2012</year>;<volume>34</volume>(<issue>9</issue>):<fpage>906</fpage>&#x2013;<lpage>918</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/13803395.2012.692772">https://doi.org/10.1080/13803395.2012.692772</ext-link></comment></mixed-citation></ref>
<ref id="CIT0040"><label>40.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>McGurk</surname> <given-names>SR</given-names></string-name>, <string-name><surname>Mueser</surname> <given-names>KT</given-names></string-name>, <string-name><surname>Pascaris</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Cognitive training and supported employment for persons with severe mental illness: One-year results from a randomized controlled trial</article-title>. <source>Schizophr Bull</source>. <year>2005</year>;<volume>31</volume>(<issue>4</issue>):<fpage>898</fpage>&#x2013;<lpage>909</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1093/schbul/sbi037">https://doi.org/10.1093/schbul/sbi037</ext-link></comment></mixed-citation></ref>
<ref id="CIT0041"><label>41.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Atieno</surname> <given-names>OP</given-names></string-name></person-group>. <article-title>An analysis of the strengths and limitation of qualitative and quantitative research paradigms</article-title>. <source>Prob Educ 21st Century</source>. <year>2009</year>;<volume>13</volume>(<issue>1</issue>):<fpage>13</fpage>&#x2013;<lpage>38</lpage>.</mixed-citation></ref>
<ref id="CIT0042"><label>42.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mays</surname> <given-names>N</given-names></string-name>, <string-name><surname>Pope</surname> <given-names>C</given-names></string-name></person-group>. <article-title>Rigour and qualitative research</article-title>. <source>BMJ</source>. <year>1995</year>;<volume>311</volume>(<issue>6997</issue>):<fpage>109</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1136/bmj.311.6997.109">https://doi.org/10.1136/bmj.311.6997.109</ext-link></comment></mixed-citation></ref>
</ref-list>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Ferreira-Correia A, Barberis T, Msimanga L. Barriers to the implementation of a computer-based rehabilitation programme in two public psychiatric settings. S Afr J Psychiat. 2018;24(0), a1163. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajpsychiatry.v24.i0.1163">https://doi.org/10.4102/sajpsychiatry.v24.i0.1163</ext-link></p></fn>
</fn-group>
</back>
</article>