Pay attention to contextual, implementation, and mechanisms of impact factors when evaluating technological interventions
Guidance
When evaluating the benefits of technological interventions for people with dementia and their carers it is recommended to conduct a process evaluation to understand the possible influence of contextual, implementation and mechanisms of impact factors that may have influenced the intervention outcomes. This will also provide useful information on the conditions for successful implementation of the intervention.
Explanation and example
In our randomised controlled exploratory pilot trial into the FindMyApps programme, a tablet-based selection tool and training to help people with dementia to find apps for better self-management and meaningful activities, we conducted a process evaluation based on the British Medical Research Council’s (MRC) guidance for process evaluation of complex interventions (Moore et al., 2015).
This framework highlights the possible influence that contextual, implementation and mechanisms of impact factors may have on intervention outcomes. The process evaluation in the FindMyApps study provided very relevant information. For instance, with regard to contextual factors we found that it is important that the person with dementia has someone who is easy to approach and who can help them in case of practical problems, and that a helpdesk is in place for more complicated questions and technical problems.
With regard to implementation, it proved important to check if and how much a participant had experience in working with technological devices, and to adapt their training accordingly. Additionally, it proved necessary to personalise the approach to a participants’ awareness of their deficits. This was largely because some people with dementia had a more accurate understanding of their abilities and limitations with respect to their deficits than others. With regard to mechanisms of impact, we found that users who regularly practiced and who’s caregivers helped them by means of the errorless learning method learned to use FindMyApps easier than users who practiced less and who’s caregivers were less active in guiding them by using errorless learning.
This information is not only relevant for the outcome evaluation, but also to get insight into conditions for successful implementation of FindMyApps.
Read more >