Comparing the Usability of the Web-Based 24-h Dietary Recall R24W and ASA24-Canada-2018 among French-Speaking Adults from Québec
Centre Nutrition, Santé et Société (NUTRISS), Institut sur la Nutrition et les Aliments Fonctionnels (INAF), Université Laval, Québec, QC G1V 0A6, Canada
*
Author to whom correspondence should be addressed.
Nutrients 2022, 14(21), 4543; https://doi.org/10.3390/nu14214543
Submission received: 22 September 2022
/
Revised: 22 October 2022
/
Accepted: 27 October 2022
/
Published: 28 October 2022
(This article belongs to the Special Issue Dietary Surveys and Nutritional Epidemiology)
Abstract
:Automated, self-administered, Web-based 24-h dietary recall tools are increasingly available for nutrition research in different settings, particularly in epidemiological studies and national surveys because of their practicality and efficiency. However, the usability of different 24-h dietary recall tools must be assessed and compared for use in specific populations as it is a major driver of the response rate and retention of participants. The primary aim of this study was to compare the usability of two validated, self-administered, web-based 24-h dietary recall tools available for the Canadian population: the R24W and the 2018 Canadian version of the ASA24. The R24W was developed in French for primary use in the province of Québec, Canada while the ASA24 was developed in English for primary use in the USA and recently adapted and translated for use in French-speaking Canadian adults. Whether the R24W and the ASA24-Canada-2018 yield similar nutritional data was also tested. In this randomized crossover study, 48 women and 20 men (mean age of 35 ± 14 years; range: 19–79 years) recruited in the province of Quebec completed the R24W and the ASA24-Canada-2018 in French twice on each occasion. Participants also completed the System Usability Scale (SUS), a reliable and valid scale giving a global view of subjective assessments of usability. Mean SUS score as well as mean dietary intakes of energy, nutrients and food groups generated by each tool were compared using mixed model analyses for repeated measures. On a scale of 0 to 100, the mean SUS scores (±SD) for the R24W and the ASA24-Canada-2018 were 81 ± 2 and 58 ± 2, respectively (p < 0.0001). 84% of participants stated that they would prefer to use the R24W if they were invited to complete additional 24-h dietary recalls. No significant difference was found between the R24W and the ASA24-Canada-2018 for the intake of energy, proteins, lipids, saturated fatty acids, carbohydrates, fibers, sodium and vegetables and fruits. In sum, while the R24W and the ASA24-Canada-2018 generate comparable self-reported dietary intake data, the R24W showed a better usability than the ASA24-Canada-2018 in a sample of French-speaking adults from the province of Quebec.
1. Introduction
Accurate assessment of dietary intake and representativeness of the sample population are key to understanding the relationship between diet and health outcomes and to evaluate the impact of nutrition-focused public health policies. Validation studies using biomarkers have demonstrated that repeated 24-h dietary recalls provide high quality data with minimal systematic bias [1,2,3]. However, traditional 24-h dietary recalls are expensive as they rely on trained interviewers for data collection and coding. For those reasons, researchers have developed automated, self-administered, web-based dietary recall tools that are increasingly available for nutrition research, particularly for epidemiological studies and national surveys [4,5,6,7].
The “Rappel de 24 h Web” (R24W) [8] and The Automated Self-Administered 24-h (ASA24) [9] are two automated, self-administered, web-based dietary recall tools available in Canada in French and in English. The R24W was developed in French at Université Laval in Québec City and released in 2016 whereas the ASA24 was developed in English at the US National Cancer Institute and adapted for use in Canada by Health Canada’s Food Directorate in 2014 and then updated in 2016 and 2018. The ASA24 was also translated in French in 2016. The R24W and the ASA24-Canada-2018 have a different but diversified food list representative of the Canadian population’s food habits, are both linked to the Canadian Nutrient File food composition database (v2015) and use food portion pictures to help respondents estimate portions sizes (Table 1). The R24W refers to 2669 foods from which 148 nutrients can be automatically extracted. The ASA24-Canada-2018 refers to 4794 foods from which 65 nutrients can be automatically extracted. The R24W has an optional supplement intake module that collects qualitative information on the type of supplements consumed while the supplement intake module of the ASA24-Canada-2018 collects both qualitative and quantitative information about supplements types and doses. The main methodological difference between the R24W and the different versions of the ASA24 including the ASA24-Canada-2018 relates to the order of the Automated Multiple-Pass Method [10] steps that respondents must follow to record dietary assessment (Table 1). While the R24W asks for details after each selected food [8], the ASA24 asks for details once all the foods of a given meal have been selected [11]. Both tools have been validated using various methods and populations. For example, in two fully controlled feeding studies, nearly 90% and 80% of the food items provided were reported using the R24W and the ASA24, respectively [12,13]. The portion sizes reported did not differ significantly from the portion sizes offered and it did not have a significant impact on energy intake estimate (−13.9 kcal p = 0.83 for R24W and 125 kcal p = 0.34 for ASA24) [12,13].
However, usability of the R24W and the ASA24-Canada-2018 have not been formally tested and compared in French-speaking populations. This is important because usability may be a major driver of the response rate and retention of participants in a study, hence influencing the quality of the data being collected.
According to the International Organization for Standardization (ISO 9241-11), usability is the extent to which a system can be used by specified users to achieve specified goals with effectiveness (i.e., accuracy and completeness), efficiency, and satisfaction in a specified context of use [14]. Efficiency relates to the resources used (e.g., time and human effort) in relation to the results achieved while satisfaction describes the extent to which the user experience meets the user’s needs and expectations. In other words, usability is the overall experience and ease of use of the system by users. Self-administered web-based dietary assessment tools have two types of users: the respondents who report dietary intakes and the researchers who manage the study logistics and analyze the data. Usability can be assessed by quantitative-retrospective methods (e.g., questionnaires), quantitative-real-time methods (e.g., task completion), qualitative-retrospective methods (e.g., interview or focus groups) or qualitative-real-time methods (e.g., “Think-Aloud” protocol) [15].
The primary aim of this study was to compare the usability from the respondent’s perspective of the R24W and the ASA24-Canada-2018, which is the latest Canadian version, in a sample of French-speaking adults when used on a computer or a tablet in a real-life setting. We also took the opportunity to test for the first time whether the two web-based 24-h recall tools generate comparable dietary intake data. We hypothesized that the usability score of the R24W is higher than the ASA24-Canada-2018 because the former was developed in Québec specifically for the French-speaking population. We also hypothesized that both tools generate comparable dietary intake data.
2. Materials and Methods
2.1. Participants
Participants were recruited between November 2019 and October 2021 through Facebook adds and email lists of employees and students available at Université Laval. Men and women of 18 years of age and over with access to Internet and to a computer or a tablet were eligible. Participants also had to have an active email address and be able to complete questionnaires in French. Being a dietitian or a student in nutrition as well as having already used the R24W or the ASA24 in the past were exclusion criteria because we wanted to test the initial performance with the tools (initial learnability) [16].
2.2. Study Design
This study was undertaken using a randomized crossover study design stratified by sex. As the R24W and the ASA24-Canada-2018 are typically administered in a research context along with other questionnaires, participants were asked to complete questionnaires assessing potential moderating variables such as health literacy and socio-demographic characteristics at baseline. Participants had one week to complete the baseline questionnaires. During the subsequent two-weeks, participants were asked to complete two non-consecutive dietary recalls on unannounced, randomly selected weekdays or weekend days using the French version of either the R24W or ASA24-Canada-2018 according to the sequence assigned. Over the next two weeks, participants were asked to complete two other dietary recalls using the second recall tool. Up to three reminders were sent when recalls were not completed by the initial scheduled date. This approach reflects the settings of prospective studies in which repeated administrations of dietary recalls on non-consecutive days is recommended to examine the association between diet as an independent variable and a health outcome as a dependent variable [17]. Participants were asked to complete the usability questionnaire after having completed each set of recalls before using the second tool. Informed consent was obtained from all subjects involved in the study. The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Université Laval (2019-226 R-2/23 September 2021).
2.3. Dietary Recalls Tools
As described in the introduction, the R24W and the ASA24-Canada-2018 share a lot of similarities but also have important difference (Table 1). In the context of the present study, both tools were configured to be as similar as possible in terms of modules integrated, intake time frame, etc. (see Table S1). Participants were asked to complete the dietary recalls on a computer or a tablet because the R24W was not adapted for smartphone at the beginning of this study. No support was provided to complete the recalls.
2.4. Outcome Measurements
2.4.1. Usability
Participants were invited to complete a free translation of the System Usability Scale twice, once after using the R24W and once after using the ASA24-Canada-2018. The SUS is a reliable and valid scale giving a global view of subjective assessments of usability [18,19]. It is a 10-item scale using a 5-point Likert scale ranging from strongly disagree to strongly agree. Examples of items include “I found the system unnecessarily complex”, “I thought the system was easy to use” and “I found the various functions in this system were well integrated”. SUS yields a single score from 0 to 100 representing a composite measure of the overall usability of a system and allow to ordinally compare two or more systems. A higher score indicates higher usability.
An open-ended question on the most and least appreciated aspects of the tool was added at the end of the SUS questionnaire to further document potential differences between the SUS score of the R24W and the ASA24-Canada-2018. At the end of the study, participants were also asked: “If I had to complete other 24-h dietary recalls, I would prefer to use…”. The answer choices were “The R24W” or “The ASA24”. Finally, completion times (total session duration) were extracted as a measure of efficiency.
2.4.2. Dietary Intakes
Mean dietary intakes of energy, macronutrients and other key nutrients (saturated fat, fibers and sodium) as well as the average number of the 2007 Canada’s Food Guide servings were automatically calculated by the R24W and the ASA24-Canada-2018.
2.4.3. Health Literacy
At baseline, participants were invited to complete the Canadian adaptation of the Newest Vital Sign (NVS) to assess health literacy [20]. The NVS is a validated and reliable tool comprising 6 questions that assesses an individual’s ability to find and understand both text and numerical information on the nutrition label of an ice-cream container [20,21]. Based on the number of correct answers, the respondent is categorized as having a high likelihood of low health literacy (score 0–1), possible low health literacy (score 2–3) or adequate health literacy (score 4–6).
2.4.4. Socio-Demographic Characteristics
The baseline socio-demographic questionnaire included questions on age, sex, height, weight, ethnicity as well as annual gross household income and education level as surrogates of socioeconomic status.
2.5. Sample Size Estimation
Based on previous studies [22,23] and considering a dropout rate of 10%, sample size calculations indicate that a total of 74 participants would yield a power of 80% to detect a minimal difference of 5 points on a scale of 100 (p < 0.05) in SUS score (the study primary outcome) between the R24W and the ASA24-Canada-2018. We considered a 5% difference in usability score to be of significance.
2.6. Statistical Analyses
The SUS score was calculated in accordance with Brooke [18]. Mean SUS score and mean dietary intakes generated by each tool were compared using mixed models for repeated measures. The main fixed effect was the recall tool (R24W vs. ASA24-Canada-2018) compared in paired analyses with subject as a random effect. While the study was not powered to investigate interactions, the moderating effects of sex and age were explored using proper interaction terms. Characteristics of participants and dropouts as well as the preferred recall tools (expressed in percent) were compared using chi-square test. The median completion times for each tool were compared using Wilcoxon test. Statistical analyses were done in SAS® (SAS OnDemand for Academics). An inductive content analysis of the open-ended question about the most and least appreciated aspects of the tools was also conducted by one coder by grouping similar ideas in Excel.
3. Results
3.1. Participant Characteristics
Although the strategy was to recruit the same proportion of men and women, a total of 60 women and 30 men were recruited and randomized by sex to ensure an equal number of men and women within each treatment sequence. The drop-out rate was 24% (Figure 1). As a result, a total of 48 women and 20 men (mean age of 35 ± 14 years; range 19–79 years) were included in the analyses (Table 2). A little over half of the participants reported having a University education and the health literacy was considered “adequate” for all participants. Age, sex, education and income were similar between participants and dropouts.
3.2. Usability
The mean (±SD) SUS scores for the R24W and ASA24-Canada-2018 on a scale of 0 to 100 were 81 ± 2 and 58 ± 2, respectively (p < 0.0001, Table 3). 84% of participants indicated that they would prefer to use the R24W rather than the ASA24-Canada-2018 if they were invited to complete additional dietary recalls. The median (interquartile range) completion time for the R24W and ASA24-Canada-2018 were 14 min (9–19) and 25 min (16–34), respectively (p < 0.001).
Photos of the portions, variety of foods and reminders about frequently forgotten foods and potential additions (e.g., sauces and toppings) were among the most appreciated features of both 24-h recall tools while absence of certain foods was among the least appreciated aspects (Table 4). Visual appearance was among the most appreciated features of the ASA24-Canada-2018 and among the least appreciated feature of the R24W. Not having the possibility to create one’s own recipe or to add a food manually was another feature of the R24W that was less appreciated. The number of steps, details and questions, having to describe portions after listing all foods and the difficulty to find foods with the search function were the least appreciated features of the ASA24-Canada-2018. Simplicity and ease of use were the most appreciated features of the R24W.
3.3. Dietary Intakes
The mean number of food items reported were similar between the R24W and the ASA24-Canada-2018 (18.2 ± 6.4 and 18.6 ± 7.6, p = 0.63). As shown in Table 5, no significant difference was found between the R24W and ASA24 for the self-reported intake of energy, macronutrients, proteins, lipids, saturated fatty acids, carbohydrates, fibers, sodium and of Canada’s 2007 Food groups.
4. Discussion
The present study revealed that the R24W obtains a higher usability score than the ASA24-Canada-2018 in a sample of French-speaking adults from the province of Quebec. The difference in SUS score appears to be due to greater self-reported ease of use and lower completion time for the R24W compared to the ASA24-Canada-2018. Both dietary recall tools yielded comparable self-reported dietary intake data.
Usability was assessed using the SUS administered after experiencing each recall tools. The SUS is one of the most common questionnaires used to evaluate a variety of softwares including in the field of nutrition [7,15]. The SUS score of the R24W was 23 points higher than the SUS score of the ASA24-Canada-2018. According to Bangor et al., SUS scores at least equal to 70 can be considered “good” which was the case for the R24W but not for the ASA24-Canada-2018 in this population [24]. The fact that the R24W was developed in Quebec specifically for the French speaking adult population probably contributes to its good usability. The SUS has also already been used to assess the usability of the 2014 Canadian version of the ASA24 in a subset of participants aged 48 to 67 years from the Canadian Longitudinal Study on Aging cohort. Very similar to data from the present study, the mean SUS score was 57 and half of the participants reported finding the ASA24-Canada-2014 unnecessarily complex [22]. The range of the scores obtained with the R24W and the ASA24-Canada-2018 are also consistent with those obtained for other 24-h recall tools available in other countries. For example, myfood24 developed in United Kingdom had a SUS score of 55 in older adults [25], of 59 in a clinical population [26], of 71 in women with gestational diabetes [23] and of 74 in an adolescent population [27].
The analysis of the open-ended question on the most and least appreciated features of each recall tools identifies potential areas to improve each dietary assessment tool when targeting a French-speaking population. For example, improving the visual appearance of the R24W and adding a functionality to create a recipe or to add food manually would most likely further increase its usability. The food search function of the ASA24-Canada-2018 was considered suboptimal, which is consistent with a usability study of the 2016 Canadian version of the ASA24 among low-income adults in British Columbia, Canada [28]. Of note, the 2020 US version of the ASA24 has improved its food search function [29], and this may contribute to higher usability scores. Even though the variety of food choice available was identified among the most appreciated features for each of the tools, the absence of certain foods was also identified as one of the least appreciated features of both tools. This suggests that broadening the food database would likely increase usability for both the R24W and the ASA24-Canada-2018. According to a recent literature review, the ability to easily identify the correct food is one of the most common issues raised in web-based 24-h recall tools usability studies [7]. In the next few years, the integration of more branded products into these tools should be considered to facilitate the identification of the exact food consumed while providing many descriptors (e.g., country of origin and presence of nutrition or health claim) with less data management. However, the challenges remain to link each branded food to full nutritional composition, to maintain an effective search function with expanded database without increasing the time required to complete the recall and to keep the food database up to date.
The present study revealed no difference between the R24W and ASA24-Canada-2018 for the self-reported intake of energy, proteins, lipids, saturated fatty acids, carbohydrates, fibers, sodium as well as of several food groups. This is not surprising considering that both are validated and were developed with similar objectives and structures. Specifically, both 24-h recall tools use the same nutritional database and use food portions pictures to help in estimating portions size. Participants also reported a similar mean number of food items with the R24W and the ASA24-Canada-2018. Despite that, the median completion time was 11 min shorter with the R24W than with the ASA24-Canada-2018 (14 vs. 25 min, respectively). The median completion of the ASA24-Canada-2018 is essentially similar to the median completion time of 24 min reported on the ASA24 Website [30]. The shorter median completion time with the R24W compared to the ASA24-Canada-2018 probably contributed to its higher usability score.
This study’s strengths include the randomized cross-over study design, the real-life setting and the use of a validated usability questionnaire. Participants had relatively high socioeconomic and health literacy status, which limits the generalization of the results. Despite the advantages of automating dietary recalls, eliminating interviewer contact may increase the difficulty of collecting dietary intake data from the respondents’ perspective, particularly in subgroups with lower socioeconomic status [28] and with older people [22,25]. The study was conducted on computer or tablet using the French versions of the recall tools, which also limits generalizability to the cellphone and to the English versions of these tools. Finally, usability from the researcher’s perspective was not formally tested.
5. Conclusions
While the R24W and the ASA24-Canada-2018 generate comparable self-reported dietary intake data for the nutrients compared, the R24W showed a better usability than the ASA24-Canada-2018 in a sample of French-speaking adults from the province of Quebec. Further research is needed to determine the usability of the R24W in other Canadian provinces, in English-speaking populations, in older adults and in lower socioeconomic populations.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/nu14214543/s1, Table S1: R24W and ASA24-Canada-2018 Setup.
Author Contributions
Conceptualization: C.L., S.L., J.R. and B.L.; Investigation: C.L.; Formal analysis: C.L.; Writing original draft, review and editing: C.L.; Overall project responsibility: B.L. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Université Laval (2019-226 R-2/23 September 2021).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available upon request to the corresponding author.
Acknowledgments
The research team would like to thank Michèle Kearney and Didier Brassard for their help in this study.
Conflicts of Interest
C.L., S.L., J.R. and B.L. develop the R24W. J.R. is chair of Nutrition at Université Laval, which is supported by private endowments from Pfizer, La Banque Royale du Canada, and Provigo-Loblaws.
References
- Schatzkin, A.; Kipnis, V.; Carroll, R.J.; Midthune, D.; Subar, A.F.; Bingham, S.; Schoeller, D.A.; Troiano, R.P.; Freedman, L.S. A comparison of a food frequency questionnaire with a 24-hour recall for use in an epidemiological cohort study: Results from the biomarker-based Observing Protein and Energy Nutrition (OPEN) study. Int. J. Epidemiol. 2003, 32, 1054–1062. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Freedman, L.S.; Commins, J.M.; Moler, J.E.; Willett, W.; Tinker, L.F.; Subar, A.F.; Spiegelman, D.; Rhodes, D.; Potischman, N.; Neuhouser, M.L.; et al. Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for potassium and sodium intake. Am. J. Epidemiol. 2015, 181, 473–487. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Subar, A.F.; Kipnis, V.; Troiano, R.P.; Midthune, D.; Schoeller, D.A.; Bingham, S.; Sharbaugh, C.O.; Trabulsi, J.; Runswick, S.; Ballard-Barbash, R.; et al. Using intake biomarkers to evaluate the extent of dietary misreporting in a large sample of adults: The OPEN study. Am. J. Epidemiol. 2003, 158, 1–13. [Google Scholar] [CrossRef]
- Illner, A.K.; Freisling, H.; Boeing, H.; Huybrechts, I.; Crispim, S.P.; Slimani, N. Review and evaluation of innovative technologies for measuring diet in nutritional epidemiology. Int. J. Epidemiol. 2012, 41, 1187–1203. [Google Scholar] [CrossRef] [Green Version]
- Timon, C.M.; van den Barg, R.; Blain, R.J.; Kehoe, L.; Evans, K.; Walton, J.; Flynn, A.; Gibney, E.R. A review of the design and validation of web- and computer-based 24-h dietary recall tools. Nutr. Res. Rev. 2016, 29, 268–280. [Google Scholar] [CrossRef] [PubMed]
- Eldridge, A.L.; Piernas, C.; Illner, A.K.; Gibney, M.J.; Gurinovic, M.A.; de Vries, J.H.M.; Cade, J.E. Evaluation of New Technology-Based Tools for Dietary Intake Assessment-An ILSI Europe Dietary Intake and Exposure Task Force Evaluation. Nutrients 2018, 11, 55. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Gazan, R.; Vieux, F.; Mora, S.; Havard, S.; Dubuisson, C. Potential of existing online 24-h dietary recall tools for national dietary surveys. Public Health Nutr. 2021, 24, 5361–5386. [Google Scholar] [CrossRef] [PubMed]
- Jacques, S.; Lemieux, S.; Lamarche, B.; Laramee, C.; Corneau, L.; Lapointe, A.; Tessier-Grenier, M.; Robitaille, J. Development of a Web-Based 24-h Dietary Recall for a French-Canadian Population. Nutrients 2016, 8, 724. [Google Scholar] [CrossRef] [Green Version]
- Subar, A.F.; Kirkpatrick, S.I.; Mittl, B.; Zimmerman, T.P.; Thompson, F.E.; Bingley, C.; Willis, G.; Islam, N.G.; Baranowski, T.; McNutt, S.; et al. The Automated Self-Administered 24-hour dietary recall (ASA24): A resource for researchers, clinicians, and educators from the National Cancer Institute. J. Acad. Nutr. Diet. 2012, 112, 1134–1137. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Raper, N.; Perloff, B.; Ingwersen, L.; Steinfeldt, L.; Anand, J. An overview of USDA’s Dietary Intake Data System. J. Food Compos. Anal. 2004, 17, 545–555. [Google Scholar] [CrossRef]
- National Cancer Institute. ASA24® Respondent Website Methodology|EGRP/DCCPS/NCI/NIH. Available online: https://epi.grants.cancer.gov/asa24/respondent/methodology.html (accessed on 19 October 2022).
- Lafrenière, J.; Lamarche, B.; Laramee, C.; Robitaille, J.; Lemieux, S. Validation of a newly automated web-based 24-hour dietary recall using fully controlled feeding studies. BMC Nutr. 2017, 3, 34. [Google Scholar] [CrossRef] [Green Version]
- Kirkpatrick, S.I.; Subar, A.F.; Douglass, D.; Zimmerman, T.P.; Thompson, F.E.; Kahle, L.L.; George, S.M.; Dodd, K.W.; Potischman, N. Performance of the Automated Self-Administered 24-hour Recall relative to a measure of true intakes and to an interviewer-administered 24-h recall. Am. J. Clin. Nutr. 2014, 100, 233–240. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- International Organization for Standardization. ISO—ISO 9241-11:2018—Ergonomics of Human-System Interaction—Part 11: Usability: Definitions and Concepts. Available online: https://www.iso.org/standard/63500.html (accessed on 22 July 2022).
- Maramba, I.; Chatterjee, A.; Newman, C. Methods of usability testing in the development of eHealth applications: A scoping review. Int. J. Med. Inform. 2019, 126, 95–104. [Google Scholar] [CrossRef] [PubMed]
- Grossman, T.; Fitzmaurice, G.; Attar, R. A survey of software learnability: Metrics, methodologies and guidelines. In Proceedings of the Sigchi Conference on Human Factors in Computing Systems, Boston, MA, USA, 4–9 April 2009; pp. 649–658. [Google Scholar]
- National Cancer Institute. Examining the Association between Diet as an INDEPENDENT Variable & a Dependent Variable|Dietary Assessment Primer. Available online: https://dietassessmentprimer.cancer.gov/approach/independent.html (accessed on 25 July 2022).
- Brooke, J. SUS-A quick and dirty usability scale. In Usability Evaluation in Industry; Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, I.L., Eds.; Taylor and Francis: London, UK, 1996; pp. 189–194. [Google Scholar]
- Peres, S.C.; Pham, T.; Phillips, R. Validation of the System Usability Scale (SUS) SUS in the Wild. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 2013, 57, 192–196. [Google Scholar] [CrossRef]
- Mansfield, E.D.; Wahba, R.; Gillis, D.E.; Weiss, B.D.; L’Abbe, M. Canadian adaptation of the Newest Vital Sign(c), a health literacy assessment tool. Public Health Nutr. 2018, 21, 2038–2045. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Weiss, B.D.; Mays, M.Z.; Martz, W.; Castro, K.M.; DeWalt, D.A.; Pignone, M.P.; Mockbee, J.; Hale, F.A. Quick assessment of literacy in primary care: The newest vital sign. Ann. Fam. Med. 2005, 3, 514–522. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Gilsing, A.; Mayhew, A.J.; Payette, H.; Shatenstein, B.; Kirkpatrick, S.I.; Amog, K.; Wolfson, C.; Kirkland, S.; Griffith, L.E.; Raina, P. Validity and Reliability of a Short Diet Questionnaire to Estimate Dietary Intake in Older Adults in a Subsample of the Canadian Longitudinal Study on Aging. Nutrients 2018, 10, 1522. [Google Scholar] [CrossRef] [Green Version]
- Gianfrancesco, C.; Darwin, Z.; McGowan, L.; Smith, D.M.; Haddrill, R.; Carter, M.; Scott, E.M.; Alwan, N.A.; Morris, M.A.; Albar, S.A.; et al. Exploring the Feasibility of Use of An Online Dietary Assessment Tool (myfood24) in Women with Gestational Diabetes. Nutrients 2018, 10, 1147. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Bangor, A.; Kortum, P.; Miller, J. Determining what individual SUS scores mean: Adding an adjective rating scale. J. Usabil. Stud. 2009, 4, 114–123. [Google Scholar]
- Hopstock, L.A.; Medin, A.C.; Skeie, G.; Henriksen, A.; Lundblad, M.W. Evaluation of a Web-Based Dietary Assessment Tool (myfood24) in Norwegian Women and Men Aged 60–74 Years: Usability Study. JMIR Form. Res. 2022, 6, e35092. [Google Scholar] [CrossRef] [PubMed]
- Threapleton, D.E.; Beer, S.L.; Foley, D.J.; Gibson, L.E.; Trevillion, S.; Burke, D.; Wheatstone, P.; Gath, J.; Hex, N.; Setters, J.; et al. Usability of myfood24 Healthcare and Mathematical Diet Optimisation in Clinical Populations: A Pilot Feasibility Randomised Controlled Trial. Nutrients 2022, 14, 1768. [Google Scholar] [CrossRef] [PubMed]
- Albar, S.A.; Carter, M.C.; Alwan, N.A.; Evans, C.E.L.; Cade, J.E. Formative evaluation of the usability and acceptability of myfood24 among adolescents: A UK online dietary assessments tool. BMC Nutr. 2015, 1, 29. [Google Scholar] [CrossRef] [Green Version]
- Kupis, J.; Johnson, S.; Hallihan, G.; Olstad, D.L. Assessing the Usability of the Automated Self-Administered Dietary Assessment Tool (ASA24) among Low-Income Adults. Nutrients 2019, 11, 132. [Google Scholar] [CrossRef] [PubMed]
- National Cancer Institute. ASA24-2020|EGRP/DCCPS/NCI/NIH. Available online: https://epi.grants.cancer.gov/asa24/respondent/2020.html (accessed on 25 May 2022).
- National Cancer Institute. ASA24® Frequently Asked Questions|EGRP/DCCPS/NCI/NIH. Available online: https://epi.grants.cancer.gov/asa24/resources/faq.html (accessed on 6 June 2022).
Figure 1.
Study flow-chart.
Table 1.
Comparison of the Characteristics of the Respondents Website of the R24W and the ASA24-Canada-2018.
Table 1.
Comparison of the Characteristics of the Respondents Website of the R24W and the ASA24-Canada-2018.
| R24W | ASA24-Canada-2018 | |
|---|---|---|
| Developer | Université Laval, Quebec, Canada | US National Cancer Institute, adapted by Health Canada’s Food Directorate |
| App languages | Developed in French and translated in English | Developed in English and translated in French |
| Tutorial | Mandatory video | Written instructions |
| Steps | Modified version of the Automated Multiple-Pass Method (AMPM)
| Modified version of the AMPM
|
| Food identification |
|
|
| Food list |
|
|
| Integrated food composition database |
|
|
| Portions sizes |
|
|
| Data Reports |
|
|
Table 2.
Sociodemographic characteristics of participants (n = 68) and dropouts (n = 22).
| Characteristics | Participants | Dropouts | p Values |
|---|---|---|---|
| % | |||
| Sex | |||
| Female | 71 | 60 | 0.37 |
| Male | 29 | 40 | |
| Age in years | |||
| 18–30 | 43 | 45 | 0.50 |
| 31–50 | 43 | 50 | |
| ≥51 | 15 | 5 | |
| BMI in kg/m2 | |||
| Normal weight, <25 | 63 | 50 | 0.38 |
| Overweight, 25.0–29.9 | 23 | 22 | |
| Obese, ≥30 | 14 | 27 | |
| Education | |||
| Trade school, high school, or no diploma | 7 | 5 | 0.78 |
| CEGEP | 37 | 45 | |
| University | 56 | 50 | |
| Annual gross household income in $ CAD | |||
| <30,000 | 15 | 35 | 0.24 |
| 30,000–59,999 | 26 | 25 | |
| 60,000–99,999 | 25 | 15 | |
| 100,000 and more | 33 | 25 | |
| Health literacy categories | |||
| High likelihood of low health literacy (score 0–1) | 0 | 5 | 0.04 |
| Possible low health literacy (score 2–3) | 0 | 5 | |
| Adequate health literacy (score 4–6) | 100 | 90 | |
BMI: Body mass index; CEGEP: Collège d’enseignement général et professionnel; CAD: Canadian dollars; p value based on Chi-square tests.
Table 3.
Usability of the R24W and ASA24-Canada-2018.
| R24W | ASA24-Canada-2018 | p Values | |
|---|---|---|---|
| SUS score 1, points (/100) | 81 ± 2 | 58 ± 2 | <0.0001 |
| Completion time 2, min | 14 (9–19) | 25 (16–34) | <0.0001 |
| Favorite tool reported 3, % | 84 | 16 | <0.0001 |
SUS: System usability scale; 1 Values (least squares means ± SDs) and p values were obtained from the mixed models and are adjusted for age and sex; 2 Values are median (Q1–Q3). p value based on Wilcoxon test; 3 Values are frequency. P-value based on Chi-square test.
Table 4.
Most and least appreciated features of the R24W and ASA24-Canada-2018 among the 68 study participants.
Table 4.
Most and least appreciated features of the R24W and ASA24-Canada-2018 among the 68 study participants.
| R24W | ASA24-Canada-2018 | |
|---|---|---|
| Most appreciated features |
|
|
| Least appreciated features |
|
|
Table 5.
Mean dietary intakes measured by the R24W and ASA24-Canada-2018.
| R24W | ASA24-Canada-2018 | Differences | p Values | |
|---|---|---|---|---|
| Energy, kcal | 2282 ± 87 | 2252 ± 87 | 30 | 0.69 |
| Vegetables and fruits, servings 1 | 5.5 ± 0.4 | 6.1 ± 0.4 | 0.6 | 0.07 |
| Grain products, servings 1 | 5.0 ± 0.3 | 5.2 ± 0.3 | 0.2 | 0.74 |
| Milk and alternatives, servings 1 | 2.0 ± 0.1 | 1.9 ± 0.1 | 0.8 | 0.38 |
| Meat and alternatives, servings 1 | 2.2 ± 0.2 | 2.1 ± 0.2 | 0.1 | 0.42 |
| Total Fat, g | 93 ± 5 | 94 ± 5 | 1 | 0.81 |
| Saturated Fat, g | 32 ± 2 | 31 ± 2 | 1 | 0.44 |
| Carbohydrate, g | 266 ± 13 | 262 ± 13 | 4 | 0.68 |
| Protein, g | 91 ± 3 | 86 ± 3 | 5 | 0.11 |
| Fibers, g | 23 ± 2 | 23 ± 2 | 0 | 0.52 |
| Sodium, mg | 3201 ± 152 | 3341 ± 152 | 140 | 0.41 |
Values (least squares means ± SDs) and p values were obtained from the mixed models and are adjusted for age and sex; 1 Servings size defined according to the 2007 Canada’s Food Guide.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
MDPI and ACS Style
Laramée, C.; Lemieux, S.; Robitaille, J.; Lamarche, B. Comparing the Usability of the Web-Based 24-h Dietary Recall R24W and ASA24-Canada-2018 among French-Speaking Adults from Québec. Nutrients 2022, 14, 4543. https://doi.org/10.3390/nu14214543
AMA Style
Laramée C, Lemieux S, Robitaille J, Lamarche B. Comparing the Usability of the Web-Based 24-h Dietary Recall R24W and ASA24-Canada-2018 among French-Speaking Adults from Québec. Nutrients. 2022; 14(21):4543. https://doi.org/10.3390/nu14214543
Chicago/Turabian StyleLaramée, Catherine, Simone Lemieux, Julie Robitaille, and Benoît Lamarche. 2022. "Comparing the Usability of the Web-Based 24-h Dietary Recall R24W and ASA24-Canada-2018 among French-Speaking Adults from Québec" Nutrients 14, no. 21: 4543. https://doi.org/10.3390/nu14214543
Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.
