Qualitative Evaluation of a Web-based Risk Profiling and Health Management Service: an Industrial Design Perspective
|
If you are the presenter of this abstract (or if you cite this abstract in a talk or on a poster), please show the QR code in your slide or poster (QR code contains this URL). |
Abstract
Background: Western societies are confronted with a worrisome increase in chronic diseases such as cardiovascular disorders, diabetes, and chronic respiratory illness. These diseases are largely preventable and linked by common risk factors, providing opportunities for early diagnosis, integrated risk profiling and early intervention. The broad availability of internet and validated medical devices designed for home measurement allow for low cost and demedicalizing e-Health and self management services. The user friendliness of these services is of great importance to optimize reach and participation rates.
Objective: To evaluate subjective usability of web-based risk profiling and health management, from an industrial design perspective.
Methods: Ten industrial design engineers were invited to participate in a qualitative evaluation of the Prevention Compass; a Dutch, web-based health management service based on an electronic questionnaire (requiring approx. 30-60 min.), biometric evaluation (for which validated self measurement devices are provided) and laboratory testing (for which blood is drawn by professionals at the regional laboratory). The service allows individuals to assess their personal risk profile for a broad set of common chronic diseases and provides tailored advice for risk reduction by web based knowledge technology.
The qualitative evaluation consisted of a written evaluation questionnaire and a subsequent focus group discussion. In the evaluation, the designers were asked to appraise the Prevention Compass from a designer’s perspective. The focus group discussion was targeted at identifying general impressions, strengths and weaknesses, and formulating recommendations for an optimal e-Health approach. The entire discussion was videotaped and subsequently transcribed. Relevant remarks were extracted from the transcription by two independent researchers.
Results: Six invitees (four male, ages 25-27) agreed to participate. Four of them completed all steps of the risk profiling within one month. The other two were unable to complete before the focus group session due to time limitations (n=1) and fear of measurement devices and needles (n=1); they received a fictitious risk profile and health advice. All six participants completed the written questionnaire and participated in the focus group discussion which took three and a half hours. Overall, the participants appreciated the service as valid and feasible. Strengths of the service were the initiative itself and its medical and reliable appearance. Perceived barriers in use were fear of measurement devices and needles, use of self-measurement devices, and the planning and order of steps. Perceived weaknesses were the clarity of instructions about the order of steps, and lack of clarity in the communication of the assessed risk profile. Recommendations for an optimal e-Health approach included providing a clear overview and sequence of steps, limiting the amount of steps, being consistent in terminology, making use of user-friendly medical products and well informed service providers.
Conclusion: The combination of web-based self-assessment and knowledge technology seems to be a useable approach to medical risk profiling and health management. Points of particular attention are transparency of the risk assessment process to end-users, the number and planning of steps within a process, collaboration with subcontractors and use of consistent and accessible terminology in communication.
Objective: To evaluate subjective usability of web-based risk profiling and health management, from an industrial design perspective.
Methods: Ten industrial design engineers were invited to participate in a qualitative evaluation of the Prevention Compass; a Dutch, web-based health management service based on an electronic questionnaire (requiring approx. 30-60 min.), biometric evaluation (for which validated self measurement devices are provided) and laboratory testing (for which blood is drawn by professionals at the regional laboratory). The service allows individuals to assess their personal risk profile for a broad set of common chronic diseases and provides tailored advice for risk reduction by web based knowledge technology.
The qualitative evaluation consisted of a written evaluation questionnaire and a subsequent focus group discussion. In the evaluation, the designers were asked to appraise the Prevention Compass from a designer’s perspective. The focus group discussion was targeted at identifying general impressions, strengths and weaknesses, and formulating recommendations for an optimal e-Health approach. The entire discussion was videotaped and subsequently transcribed. Relevant remarks were extracted from the transcription by two independent researchers.
Results: Six invitees (four male, ages 25-27) agreed to participate. Four of them completed all steps of the risk profiling within one month. The other two were unable to complete before the focus group session due to time limitations (n=1) and fear of measurement devices and needles (n=1); they received a fictitious risk profile and health advice. All six participants completed the written questionnaire and participated in the focus group discussion which took three and a half hours. Overall, the participants appreciated the service as valid and feasible. Strengths of the service were the initiative itself and its medical and reliable appearance. Perceived barriers in use were fear of measurement devices and needles, use of self-measurement devices, and the planning and order of steps. Perceived weaknesses were the clarity of instructions about the order of steps, and lack of clarity in the communication of the assessed risk profile. Recommendations for an optimal e-Health approach included providing a clear overview and sequence of steps, limiting the amount of steps, being consistent in terminology, making use of user-friendly medical products and well informed service providers.
Conclusion: The combination of web-based self-assessment and knowledge technology seems to be a useable approach to medical risk profiling and health management. Points of particular attention are transparency of the risk assessment process to end-users, the number and planning of steps within a process, collaboration with subcontractors and use of consistent and accessible terminology in communication.
Medicine 2.0® is happy to support and promote other conferences and workshops in this area. Contact us to produce, disseminate and promote your conference or workshop under this label and in this event series. In addition, we are always looking for hosts of future World Congresses. Medicine 2.0® is a registered trademark of JMIR Publications Inc., the leading academic ehealth publisher.

This work is licensed under a Creative Commons Attribution 3.0 License.