RESEARCH ARTICLE
Development and Validation of the Short Multidimensional Well-Being Questionnaire (SMWQ)
Lucile Bigot1, 3, 4, Catherine Garncarzyk1, 2, Antoine Gauthier1, 3, 4, Gaelle Quarck1, 3, 4, Fabrice Dosseville1, 2, *
Article Information
Identifiers and Pagination:
Year: 2017Volume: 10
First Page: 25
Last Page: 31
Publisher ID: TOPHJ-10-25
DOI: 10.2174/1874944501710010025
Article History:
Received Date: 10/11/2016Revision Received Date: 14/01/2017
Acceptance Date: 24/01/2017
Electronic publication date: 17/04/2017
Collection year: 2017
open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Abstract
Purpose:
Psychological well-being and health are closely linked at older ages. It is widely recognized that adapted regular physical exercise improves drastically both the physical and emotional well-being and allows older adults to stay healthy longer, with a better quality of life. In the framework of a European project (MOTION) to increase the life expectancy, independence and quality of life of older adults, the aim of the current research was to develop and validate a brief, multi-faceted, self-report measure of well-being in older adults.
Method:
The aim of Study 1 was to establish the factor structure of the newly developed measure using Exploratory Factor Analysis (EFA). The aim of Study 2 was to replicate the measure's factor structure using Confirmatory Factor Analysis (CFA), and to evaluate test-retest reliability and convergent validity.
Results:
Analyses allowed generating a model of well-being comprising four dimensions: Perceived physical value, self-esteem and self-efficacy, socialization, and emotional reactions.
Conclusion:
The findings suggest that the SMWQ is appropriate for use with older adults and can help researchers and health professionals to assess the effects of APA programs.
INTRODUCTION
Living an autonomous life, with the ability to carry out their basic tasks of daily life, is a key aspect for maintaining quality of life for the elderly persons. Nevertheless, aging often causes several structural and functional losses in muscle and bone mass, strength and hormonal production [1-5]. But health is affected not just as physiological and biological issues but also by psychological and emotional factors. Other deteriorations are observed in older adults such as emotional and cognitive functioning [6-8]. All these degradations affect autonomy and increase risk of falling and social isolation [9, 10]. One of the most important conditions for supporting autonomy is to maintain physical fitness. It is widely recognized that adapted regular physical exercise improves drastically both the physical and emotional well-being and allows older adults to stay healthy longer, with a better quality of life, while being more independent and far less costly to society [11-17]. Thus, Adapted Physical Activity (APA) is an effective and beneficial strategy for improving well-being in elderly persons.
Current solutions for the physical coaching of seniors suffer from major practical and economic limitations: either a highly expensive home coaching service or the obligation to be at or join a special place (e.g. a retirement home or a gym club). The mission of MOTION project is to increase the life expectancy, independence and quality of life of older adults through a novel holistic technology-based service for remote multi-user physical training of older adults at home by specialized coaches, thereby enabling a totally new level of physical training effectiveness. This project is part of the European Innovation Partnership on Active and Healthy Ageing (EIPAHA) and aims at delivering an offer of remote adapted physical activity by using a collective tool of videoconference. This European project is based on a research consortium comprising one association, four industrial companies and four research and academic organizations from different members or associated countries. The principal aim of the MOTION project is to evaluate the effect of a new delivery system of an APA training programs to improve general quality of life. To ensure that effects of this program are complete and are not limited to physical dimensions, it is important to estimate its psychological impacts on participants. Psychological well-being of participants needs to be monitored using a short multidimensional well-being questionnaire before, during and after the APA training program.
However, well-being, in particular in psychological dimension, remains complex and multifactorial concept. Most of the time, general quality of life questionnaires or tools measuring psychological correlates such as depression, optimism, self-efficacy or self-esteem, are used. But these tools and questionnaires differ according to studies objectives and they assess rarely physical or corporal dimensions. Consequently, under the MOTION project, the main objective of this study is to develop and to validate a new questionnaire by considering that subjective well-being is the resultant of four dimensions: self-esteem and self-efficacy, socialization, emotional reactions and perceived physical value [18-21].
Given the shortcomings in existing measures, the aim of the current research was to develop and validate a brief, multi-faceted, self-report measure of well-being for older people. The objective was to develop a questionnaire that evaluates four main dimensions of well-being in older adults. Firstly, items were generated after reviewing validated questionnaires previously discussed, and, reliability analyses and an Exploratory Factor Analysis (EFA) were performed with a first sample of participants. Secondly, a Confirmatory Factor Analysis (CFA) was conducted with a second sample to test the model. Moreover, this sample also completed a set of other questionnaires to assess the construct validity of the questionnaire.
STUDY 1 - EXPLORATORY FACTOR ANALYSIS
Items Generation
The purposes of study 1 were to develop a pool of items, reduce this pool to a more manageable number, develop a first version of the questionnaire and perform reliability and Exploratory Factor Analysis (EFA). A scientific committee was established at the onset of the project to provide methodological and scientific support and included 5 members, each with expertise in quantitative and qualitative research and questionnaire development in psychology. After reviewing papers about well-being, physical perception, socialization, self-esteem, self-efficacy and emotional reactions assessments, this committee generated an initial pool of 45 items. These items were administered to 10 participants (M = 65.1 ; SD = 7.4) in order to improve their clarity and test responses modalities [22]. Finally, 35 items were retained. A committee from the first author’s university was granted ethical clearance for the entire program of research.
Participants
The sample consisted of 868 participants including university students and elder students recruited in senior association (278 women and 590 men) and voluntary participated in the study 1 intended to test the factorial structure of the 35-items version of the questionnaire. Participants received no compensation for completing the questionnaire. They were between 22 to 76 years old (M = 38.2, SD = 16.4).
Measures
Participants were ensured that their participation would remain anonymous. They answered the 35-items questionnaire using a 5-point Likert-type scale ranging from 1 (“completely disagree”) to 5 (“completely agree”).
Analysis
An EFA was conducted using SPSS version 22 and used to identify the latent structure of the item set and to reduce its length. This analysis was chosen in order to understand, in a more parsimonious manner, the associations between the measured variables with principal components analysis with orthogonal (varimax) rotation [23]. To ensure minimal ambiguity between factors, criteria for an acceptable factor solution were that factors have a minimum eigenvalue of 1, the exclusion of pattern coefficients below 0.40, the exclusion of items loading 0.40 or more if there was cross loading greater than 0.30 on any other factors, and that there should be a minimum of three items on each factor [24].
Result
In order to ensure that the assumptions of EFA were satisfactory, sampling adequacy was tested. Bartlett’s test statistic was significant (χ2 (990) = 12225.79, p < 0.01) indicating that the correlation matrix was appropriate for factor analysis. Consequently, EFA was conducted and the Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy was high (0.85) providing further support for the appropriateness of the data to be used for factor analysis [24]. Results showed a four-factor solution with 23 items and cumulatively accounted for 68.8% of the observed variance Table (1). The first extracted factor accounted for 21.9% of the total variance, the second for 17.5%, the third for 16.6% and the fourth for 12.8%. The first factor included 6 items and was labeled as Perceived Physical Value. The second factor comprised of 6 items and was labeled as self-esteem and self-efficacy. The third factor was represented by 6 items and was labeled Socialization. Finally, the fourth factor included 5 items and was labeled Emotional reactions.
| Variance | PPV | SESE | S | RE | |
|---|---|---|---|---|---|
| I am satisfied with my body | 21.9% | 0.797 | |||
| My body is beautiful to look at | 0.757 | ||||
| I feel good about myself physically | 0.705 | ||||
| On the whole, I am satisfied with my physical capacities | 0.702 | ||||
| I tire easily | 0.679 | ||||
| I have difficulties with dressing undressing | 0.401 | ||||
| I am easily discouraged | 17.5% | 0.706 | |||
| I struggle to cope with social events | 0.527 | ||||
| I have difficulties in concentrating | 0.505 | ||||
| Faced with problem, I can find several solutions | 0.469 | ||||
| Whatever happens, I am able to adjust myself | 0.468 | ||||
| Sometimes I think that I am useless | 0.452 | ||||
| I enjoy meeting people for socializing | 16.6% | 0.673 | |||
| I am comfortable with people | 0.663 | ||||
| I have difficulties with meeting with people | 0.62 | ||||
| I am not an easy person to get along with | 0.575 | ||||
| I have a desire to make new activities | 0.492 | ||||
| I am engaged in group activities | 0.440 | ||||
| I get irritated easily | 12.8% | 0.577 | |||
| I lose easily my temper | 0.556 | ||||
| I am often unhappy, sad or depressed | 0.499 | ||||
| I am often nervous or tense | 0.47 | ||||
| I am easy-going | 0.445 |
STUDY 2 - CONFIRMATORY FACTOR ANALYSIS, INTERNAL CONSISTENCY AND CONVERGENT VALIDITY
Participants
To examine the a priori factor structure of the questionnaire, a confirmatory factor analysis (CFA) was performed. For this purpose a second sample consisted of 325 volunteers aged from 56 to 71 years old (M = 62.6; SD = 5.7 ; 124 women and 201 men).
Analysis
Absolute and incremental fit indices were used to estimate the sufficiency of the overall fit of the measurement models: Satorra-Bentler χ2/df ratio [25], Non-Normed Fit Index NNFI [26], Comparative Fit Index (CFI) [27], Standardized Root Mean Squared Residual SRMR [24, 27], and Root Mean Squared Error of Approximation RMSEA [27, 28]. The NNFI and CFI indices range from 0 to 1, with values above 0.900 representing an acceptable fit of the model [25, 27]. Values of SRMR and RMSEA close to or lower than 0.050 demonstrate an acceptable fit [24]. According to Hu and Bentler [27], the cut-off criterion for SRMR is close to 0.080 and for RMSEA is close to 0.060. To test the internal consistency, Tabachnick and Fidell [24] suggested that Cronbach’s α coefficient should exceed 0.70 for an acceptable internal consistency.
Finally, convergent validity was used to examine the relationships between questionnaire scores and other measures intended to assess similar constructs. The measurement of an instrument with similar constructs will indicate positive correlations, whereas an instrument with different constructs will indicate negative correlations. Thus, convergent validity was tested using two self-report instruments entitled French version of EuroQol assessing perceived health [29], ISP-25 measuring physical perception [30, 31], Generalized Self-Efficacy Scale [24, 32], EES assessing self-esteem [33, 34] and ESDV-5 assessing subjective well-being [35, 36].
RESULTS
The four-factor model indicated a good fit of the instrument according to the fit indices. The χ2/df ratio was 1.29, the NNFI 0.97, the CFI 0.95, the SRMR 0.07 and the RMSEA 0.05 [35, 36]. Internal consistency was measured by Cronbach’s alpha coefficient and reliability analysis indicated that the factors were internally consistent (Perceived Physical Value: α = 0.762; Self-Esteem and Self-Efficacy: α = 0.716; Socialization: α = 0.713; Emotional Reactions: α = 0.701). Finally, correlations showed that Socialization was significantly correlated with ESDV-5 (r = 0.453, p < 0.01), Self-Esteem and Self-Efficacy was significantly correlated with General Self-Efficacy Scale (r = 0.605, p < 0.01) and with EES (r = 0.625, p < 0.01), Perceived Physical Value was significantly correlated with ISP-25 (r = 0.767, p < 0.01) and EuroQol (r = 0.367, p < 0.01).
CONCLUSION
The present paper reports on the development and initial validation of an older adults-specific measure of psychological well-being: the Short Multidimensional Well-being Questionnaire (SMWQ). Several studies on subjective well-being can be found but Diener, Oishi and Lucas [36] underline that these studies often measure a single dimension of well-being or ill-being. Diener [37] provided to assess subjective well-being through both cognitive and emotional dimensions. Other questionnaires assess life quality of satisfaction but are adapted to make comparisons with reference group and do not reflect specificity of patients’ problems [38] or assess death, end-of-life and privacy [39]. With a broad and multidimensional perspective, self-efficacy [32] and self-esteem [34] could be included as a follow-up to elderly persons. Moreover, the attached, estimated or perceived value to physical condition could be an integral part of any well-being evaluation. Some questionnaires refer to strength, flexibility, physical skills and appearance such as Physical Self-Perception Profile [31]. Finally, there are several tools to assess life quality or subjective well-being but they are validated with different target populations and objectives than MOTION project. The 4-factor structure of the SMWQ allows older adults to report on four dimensions of well-being such as Perceived Physical Value, Self-Esteem and Self-Efficacy, Socialization and Emotional Reactions. We assumed that these four factors are determining dimensions in assessment of APA programs effects [40].
The SMWQ is a short and a self-report assessment, correlated with other measures intended to assess similar constructs. Unlike the others existing questionnaires, the SMWQ involves four essential dimensions and we assume that this new questionnaire is useful and relevant to estimate the effects of adapted physical activities. By providing an insight into subjects’ well-being on both a short- and long term, the SMWQ distinguished itself from other questionnaires usually found in the field that aim to assess well-being. Another context of use may be in longitudinal and transversal analyzes [41]. Moreover, its use should allow studying relationships between four extracted dimensions. Validation studies must be made to ascertain the psychometrics of the instrument before it can be used in clinical studies and in human and social sciences.
However, there are some limitations to the current study that point to directions for future research. First, the SMWQ is a self-report tool and desirability bias may exist. Consequently, it would be relevant to associate this well-being multidimensional evaluation with behavioral and physical measures. Second, the questionnaire was developed for elderly and some items were adapted to this age. Future studies could develop a version adapted to adolescents or adults with health problems. Indeed, the SMWQ was developed to estimate effects of APA program through a multi-dimensional perspective. We assume that this tool would allow having a global approach of the APA program impact. Indeed, for a major scientific strength, it is necessary to validate this questionnaire with different groups of people affected by different health problems.
ETHICS APPROVAL AND CONSENT TO PARTICIPATE
The study was granted ethical clearance for the entire program of research by the ethical committee Cerstaps 2015-06-07-10 (Comité d’Ethique pour la Recherche en Sciences et Techniques des Activités Physiques et Sportives).
HUMAN AND ANIMAL RIGHTS
No Animals/Humans were used for studies that are base of this research.
CONSENT FOR PUBLICATION
Not applicable.
CONFLICT OF INTEREST
The authors confirm that this article content has no conflict of interest.
ACKNOWLEDGEMENTS
Declared none.
REFERENCES
| [1] | Bartke A. Growth hormone and aging: A challenging controversy. Clin Interv Aging 2008; 3(4): 659-65. |
| [2] | Chahal HS, Drake WM. The endocrine system and ageing. J Pathol 2007; 211(2): 173-80. |
| [3] | Ferrucci L, Baroni M, Ranchelli A, et al. Interaction between bone and muscle in older persons with mobility limitations. Curr Pharm Des 2014; 20(19): 3178-97. |
| [4] | Janssen I. Influence of sarcopenia on the development of physical disability: The Cardiovascular Health Study. J Am Geriatr Soc 2006; 54(1): 56-62. |
| [5] | Siparsky PN, Kirkendall DT, Garrett WE Jr. Muscle changes in aging: Understanding sarcopenia. Sports Health 2014; 6(1): 36-40. |
| [6] | Charles ST, Carstensen LL. Social and emotional aging. Annu Rev Psychol 2010; 61: 383-409. |
| [7] | Harada CN, Natelson Love MC, Triebel KL. Normal cognitive aging. Clin Geriatr Med 2013; 29(4): 737-52. |
| [8] | Scheibe S, Carstensen LL. Emotional aging: Recent findings and future trends. J Gerontol B Psychol Sci Soc Sci 2010; 65B(2): 135-44. |
| [9] | Holwerda TJ, Beekman AT, Deeg DJ, et al. Increased risk of mortality associated with social isolation in older men: Only when feeling lonely? Results from the Amsterdam Study of the Elderly (AMSTEL). Psychol Med 2012; 42(4): 843-53. |
| [10] | Sherrington C, Whitney JC, Lord SR, Herbert RD, Cumming RG, Close JC. Effective exercise for the prevention of falls: A systematic review and meta-analysis. J Am Geriatr Soc 2008; 56(12): 2234-43. |
| [11] | Alburquerque-Sendín F, Barberio-Mariano E, Brandão-Santana N, Rebelatto DA, Rebelatto JR. Effects of an adapted physical activity program on the physical condition of elderly women: An analysis of efficiency. Rev Bras Fisioter 2012; 16(4): 328-36. |
| [12] | Battaglia G, Bellafiore M, Alesi M, Paoli A, Bianco A, Palma A. Effects of an adapted physical activity program on psychophysical health in elderly women. Clin Interv Aging 2016; 11: 1009-15. |
| [13] | Bherer L, Erickson KI. A review of the effects of physical activity and exercise on cognitive and brain functions in older adults. J Aging Res 2013; 1-8. |
| [14] | Brisswalter J, Collardeau M, René A. Effects of acute physical exercise characteristics on cognitive performance. Sports Med 2002; 32(9): 555-66. |
| [15] | Colcombe S, Kramer AF. Fitness effects on the cognitive function of older adults: A meta-analytic study. Psychol Sci 2003; 14(2): 125-30. |
| [16] | Kirk-Sanchez NJ, McGough EL. Physical exercise and cognitive performance in the elderly: Current perspectives. Clin Interv Aging 2014; 9: 51-62. |
| [17] | Maillot P, Perrot A, Hartley A. Effects of interactive physical-activity video-game training on physical and cognitive function in older adults. Psychol Aging 2012; 27(3): 589-600. |
| [18] | Bailey TC, Eng W, Frisch MB, Snyder CR. Hope and optimism as related to life satisfaction. J Posit Psychol 2007; 2(3): 168-75. |
| [19] | Karademas EC. Positive and negative aspects of well-being: Common and specific predictors. Pers Individ Dif 2007; 435(2): 277-87. |
| [20] | Netz Y, Wu MJ, Becker BJ, Tenenbaum G. Physical activity and psychological well-being in advanced age: A meta-analysis of intervention studies. Psychol Aging 2005; 20(2): 272-84. |
| [21] | Wong SS, Lim T. Hope versus optimism in Singaporean adolescents: Contributions to depression and life satisfaction. Pers Individ Dif 2009; 46(5-6): 648-52. |
| [22] | DeVellis RF. Scale development: Theory and applications. 2nd ed. Thousand Oaks, CA: Sage publications 2003. |
| [23] | Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Multivariate data analysis. New Jersey: Pearson Prentice Hall 2006. |
| [24] | Tabachnik BG, Fidell LS. Using multivariate statistics. 6th ed. New Jersey: Pearson Education 2012. |
| [25] | Bentler PM. Comparative fit indexes in structural models. Psychol Bull 1990; 107(2): 238-46. |
| [26] | Bentler PM, Bonett DG, Douglas C. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull 1980; 88(3): 588-606. |
| [27] | Hu L, Bentler P. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling 1999; 6(1): 1-55. |
| [28] | Jackson DL, Gillaspy JA, Purc-Stephenson R. Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychol Methods 2009; 14(1): 6-23. |
| [29] | EuroQol Group. EuroQola new facility for the measurement of health-related quality of life. Health Policy 1990; 16(3): 199-208. |
| [30] | Ninot G, Delignières D, Fortes M. L'évaluation de l’estime de soi dans le domaine corporel. STAPS 2000; 53: 35-48. |
| [31] | Fox K, Corbin CB. The physical self-perception profile: Development and preliminary validation. J Sport Exerc Psychol 1989; 11(4): 408-30. |
| [32] | Schwarzer R, Jerusalem M. Generalized self-efficacy scale. In: Weinman J, Wright S, Johnston M, Eds. Measures in health psychology: A user’s portfolio Causal and control beliefs. Windsor, UK: NFER-Nelson 1995; pp. 35-7. |
| [33] | Vallières EF, Vallerand RJ. Traduction et validation canadienne-française de l'échelle de l'estime de soi de Rosenberg. Int J Psychol 1990; 25(2): 305-16. |
| [34] | Rosenberg M. Self-concept from middle childhood through adolescence. In: Greenwald JS, Ed. Psychological perspectives on the self. Hillsdale, NJ: Lawrence Erlbaum 1986; pp. 107-36. |
| [35] | Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess 1985; 49(1): 71-5. |
| [36] | Diener E, Oishi S, Lucas R. Subjective well-being: The science of happiness and life satisfaction. In: Lopez SJ, Snyder CR, Eds. The Oxford Handbook of Positive Psychology. Oxford: Oxford University Press 2011; pp. 187-94. |
| [37] | Diener E. Subjective well-being. Psychol Bull 1984; 95(3): 542-75. |
| [38] | Bucquet D, Condon S, Ritchie K. The French version of the Nottingham Health Profile. A comparison of items weights with those of the source version. Soc Sci Med 1990; 30(7): 829-35. |
| [39] | Leplège A, Réveillère C, Ecosse E, Caria A, Rivière H. Psychometric properties of a new instrument for evaluating quality of life, the WHOQOL-26, in a population of patients with neuromuscular diseases. Encephale 2000; 26(5): 13-22. |
| [40] | Blais MR, Vallerand RJ, Pelletier LG, Brière NM. L’échelle de satisfaction de vie: Validation canadienne-française du "Satisfaction with life Scale". Can J Behav Sci 1989; 21(2): 210-23. |
| [41] | Dumont M, Schwarzer R, Jerusalem M. French adaptation of the general self-efficacy scale (Auto-efficacité généralisée), [Online].2000. Available from http://userpage.fu-berlin.de/~health/french.htm |
