Best Practice Guidance
Human Interaction with Technology in Dementia


Evaluating the effectiveness of specific contemporary technology

The rapid growth of the technological landscape and related new services have the potential to improve the effectiveness and cost-effectiveness of health and social services and facilitate social participation and engagement in activities. But which technology is effective and how is this evaluated best? This section provides recommendations to evaluate the effectiveness of technology in daily life, meaningful activities and healthcare services as well as of technologies aimed to promote the Social Health of people with dementia. Examples of useful technologies in some of these areas are provided.
Social Health Domain 2: Manage ones own life and promote independence

Ensure the appropriate methodology for evaluating social robots


Ensure that the methodology for the evaluation of social robots for older adults with and without dementia is appropriate for the purpose of the study, to strengthen the results of the study.

Explanation and examples

Social robots are seen promising for supporting daily functioning and promoting overall social health of cognitively impaired older people, particularly those with dementia. Our scoping review into methodologies used to study the feasibility, usability, efficacy, and effectiveness of social robots for elderly adults with and without dementia showed that, despite promising results, the quality of studies remains low due to various methodological limitations. We have therefore formulated recommendations focusing on different types of studies that can help future researchers develop appropriate study designs to evaluate social robots, allowing for more reliable information on study outcomes:

  • For feasibility and usability studies an experimental design with mixed-methods of data collection (qualitative and quantitative) are recommended. Multiple interaction sessions with the social robot are recommended as they may reveal changes in feasibility and usability, when the novelty effect gradually fades and people get used to the robot.
  • Appropriate designs for efficacy and effectiveness studies are RCTs, or quasi-experimental designs when randomization is not feasible. Sample sizes should be sufficiently large, and individual interaction sessions with the social robot running for more than one month would serve best for such studies to obtain relatively robust and reliable results. Efficacy and effectiveness should only be studied in fully functioning social robots.
  • It is strongly recommended not to combine different aims in one study. The preferred designs to study the feasibility and usability of a social robot, differ significantly from the designs needed to study efficacy or effectiveness.

Type of evidence

Aysan Mahmoudi (DISTINCT ESR13)

Scoping review


Aysan Mahmoudi Asl, Mauricio Molinari Ulate, Manuel Franco Martin;  Henriëtte van der Roest (2022). Methodologies Used to Study the Feasibility, Usability, Efficacy, and Effectiveness of Social Robots For Elderly Adults: Scoping Review. J Med Internet Res 2022;24(8):e37434