Best Practice Guidance
Human Interaction with Technology in Dementia

themes: Process evaluation

Evaluating the effectiveness of specific contemporary technology

The rapid growth of the technological landscape and related new services have the potential to improve the effectiveness and cost-effectiveness of health and social services and facilitate social participation and engagement in activities. But which technology is effective and how is this evaluated best? This section provides recommendations to evaluate the effectiveness of technology in daily life, meaningful activities and healthcare services as well as of technologies aimed to promote the Social Health of people with dementia. Examples of useful technologies in some of these areas are provided.
Technology for meaningful activities

Pay attention to contextual, implementation, and mechanisms of impact factors when evaluating technological interventions

Guidance

When evaluating the benefits of technological interventions for people with dementia and their carers it is recommended to conduct a process evaluation to understand the possible influence of contextual, implementation and mechanisms of impact factors that may have influenced the intervention outcomes. This will also provide useful information on the conditions for successful implementation of the intervention.

Explanation and example

In our randomised controlled exploratory pilot trial into the FindMyApps programme, a tablet-based selection tool and training to help people with dementia to find apps for better self-management and meaningful activities, we conducted a process evaluation based on the British Medical Research Council’s (MRC) guidance for process evaluation of complex interventions (Moore et al., 2015).

This framework highlights the possible influence that contextual, implementation and mechanisms of impact factors may have on intervention outcomes. The process evaluation in the FindMyApps study provided very relevant information. For instance, with regard to contextual factors we found that it is important that the person with dementia has someone who is easy to approach and who can help them in case of practical problems, and that a helpdesk is in place for more complicated questions and technical problems.

With regard to implementation, it proved important to check if and how much a participant had experience in working with technological devices, and to adapt their training accordingly. Additionally, it proved necessary to personalise the approach to a participants’ awareness of their deficits. This was largely because some people with dementia had a more accurate understanding of their abilities and limitations with respect to their deficits than others. With regard to mechanisms of impact, we found that users who regularly practiced and who’s caregivers helped them by means of the errorless learning method learned to use FindMyApps easier than users who practiced less and who’s caregivers were less active in guiding them by using errorless learning.

This information is not only relevant for the outcome evaluation, but also to get insight into conditions for successful implementation of FindMyApps.

Read more >

Implementation of technology in dementia care: facilitators & barriers

Successful implementation of technology in dementia care depends not merely on its effectiveness but also on other facilitating or impeding factors related to e.g. the personal living environment (privacy, autonomy and obtrusiveness); the outside world (stigma and human contact); design (personalisability, affordability and safety), and ethics on these subjects.  This section provides recommendations on the implementation of technology in everyday life, for meaningful activities, healthcare technology and technology promoting Social Health.
Social Health Domain 3: Technology to promote social participation

Users of tablet based interventions and care-providers should make evidence-based decisions about implementation strategy, taking into account important context, implementation and mechanisms of impact factors

Guidance

There are many considerations when planning to implement technological interventions. The issues can be grouped into context, implementation and mechanism of impact factors. Evidence from the FindMyApps project has identified, within these categories, specific factors that are important for successful implementation of a tablet-based intervention, such as FindMyApps. Potential tablet-users and care providers are advised to base their decisions on this evidence.

Explanation/examples:

The FindMyApps project compared the FindMyApps intervention to usual tablet use by community-dwelling people with mild cognitive impairment (MCI) or mild dementia. The following factors were identified as influencing the success of implementation of both the FindMyApps intervention and a standard tablet:

  • Context:
    • People with MCI/mild dementia who previously used a tablet are more likely to use the intervention. Intensive one-on-one support is recommended to those who have never used a tablet.
    • People with MCI and younger people with MCI/mild dementia may use the intervention more. Extra support is recommended for older people with dementia.
    • People experiencing apathy may benefit more from dementia-specific tablet programmes, such as FindMyApps, which provide easy access to selected apps, than from a standard tablet.
  • Implementation:
    • People with slower Wi-Fi connections may find the tablet harder to use.
    • It is often feasible to provide support by telephone and/or video-call but face-to-face contact is more suitable for those who have never used a tablet before.
    • Few people use passive support, such as a telephone helpdesk. It is therefore recommended to pro-actively offer support to those who may need it (see above).
  • Mechanisms of impact:
    • Tablet-use may support social contact and engagement in meaningful activities, more than instrumental activities of daily living. It is recommended to set personal goals accordingly.
    • Limitations of specific tablet-apps (e.g. pop-up advertising, requirements for user-accounts with passwords) should be considered.
    • The quality of tablet-use, seems more important for social health than the quantity (frequency of duration) of tablet use. Set personal goals and evaluate accordingly.
Read more >