Skip to main content

Internal consistency and structural validity of the Swiss easy-read Integrated Palliative Care Outcome Scale for People with dementia: a secondary exploratory factor analysis

Abstract

Background

The Integrated Palliative Care Outcome Scale for People with Dementia (IPOS-Dem) was developed as a promising person-centred proxy measure of symptoms and concerns. We used the Swiss-German easy-read version, a measure designed to be completed individually by family members and frontline staff caring for people with dementia. In this secondary data analysis of multicentre trial data, we investigate the IPOS-Dem’s structural validity and internal consistency of the version.

Methods

A total of 257 people with dementia were assessed by frontline staff, while family members assessed 118 people residing in one of 23 participating Swiss-German long-term care facilities. Each IPOS-Dem version, corresponding to the two rater populations (family members and frontline staff), underwent exploratory factor analysis separately, using data from one assessment per person with dementia. A minimum residual solution with varimax rotation was calculated to determine the factor structure. Item reduction decisions were based on factor loadings and indices for internal consistency.

Results

The construct validity of the Swiss-German easy-read IPOS-Dem for frontline staff is demonstrated by two factors: Dementia Interaction and Physical Impact (Cronbach’s α = 0.83) and Dementia Emotional and Behavioural Impact (Cronbach’s α = 0.81). Four factors, with Cronbach’s α ranging from 0.77 to 0.86, were computed for the family member version: Dementia Interaction Impact, Easy-to-Assess Dementia Physical Impact, Hard-to-Assess Dementia Physical Impact and Dementia Emotional and Behavioural Impact.

Conclusions

Like other reduced patient-related outcome measures, palliative care measures and their parent instrument IPOS we identified subscales in the easy-read IPOS-Dem that describe a psychosocial impact and a physical impact. Differences in the internal structure of the family and staff versions of the IPOS-Dem likely stem from variations in observation intervals, roles and perspectives, with family members often focusing on loss and past experiences whereas staff may equate quality of life with quality of care leading to differing ratings. However, the identified internal consistency indices between 0.77 and 0.86 indicate acceptable internal consistency for the subscales and the IPOS-Dem should be taken forward for further psychometric evaluation.

Trial registration

The overarching trial has been approved by the Swiss Regional Ethics Committee of the Canton of Zürich as the leading ethics committee for the involved regions, with clearance certification number BASEC2019-01847 (12/11/2019). The main study and secondary analysis are registered with the German Clinical Trials Register (DRKS00022339, 05/10/2020). Full registration is available online at http://www.drks.de/DRKS00022339.

Peer Review reports

Background

The use of the Integrated Palliative Care Outcome Scale for Dementia (IPOS-Dem) can help carers recognise the symptoms and concerns of people with dementia. The brief and easy-to-use IPOS-Dem is built on a comprehensive family of person-centred self- and proxy-assessed palliative care outcome measures that are managed through www.pos-pal.org. The IPOS-Dem is a questionnaire designed to be completed by frontline staff in long-term care facilities (LTCFs) and by family members of people with dementia residing in LTCFs.

The Integrated Palliative Care Outcome Scale for People with Dementia (IPOS-Dem) is a multidimensional person-centred outcome measure. It focuses on capturing the most significant symptoms and concerns of individuals with dementia over a recall period of seven days. Examples of common symptoms addressed range from impaired mobility to emotional concerns such as anxiety or agitation (e.g. “Has she/he been feeling anxious or agitated?”) [1]. Because of population shifts, the number of people with dementia is expected to rise dramatically in the coming decades [2]. A substantial proportion of people with dementia in Switzerland and other countries will move to live in LTCFs [2,3,4]. For frontline staff who care for people with dementia to provide person-centred care, it is important to routinely document the symptoms and concerns of the people they care for [5]. People with advanced dementia may lose their ability to communicate verbally, so systematic proxy assessment, as supported by IPOS-Dem, may be indicated but may not change caregiving on its own [6, 7]. Furthermore, most measures designed for this population and the people who care for them in LTCFs are deemed unfit for day-to-day practice and decision-making or are very specific to research applications [8].

The Swiss easy-read translation of the IPOS-Dem has 27 items about common symptoms and concerns of people with dementia [9]. Each item is scored on a five-point scale ranging from 0 (no concern) to 4 (overwhelming). Although mostly taking a self-proxy perspective, it asks three types of questions. After an introduction, there are three open questions regarding the main issues. Following the text boxes, the user is asked to rate a 19-item list of symptoms regarding how much they believe these impacted the person with dementia during the past week. The symptom list continues with eight more questions, switching to a proxy–proxy perspective by asking how frequently a situation occurred. IPOS-Dem closes with three scorable ‘wild card’ symptom fields. The IPOS-Dem was developed for the LTCF context, where its introduction to routine care was established as feasible and acceptable [7]. Our Swiss-German easy-language translation for frontline staff and family members established good face and content validity [9], even though results from the family member rater population remain to be written for publication. Our family member version differs minimally in semantics but not conceptually from the frontline staff version (e.g., asking, ‘Have you or other family members felt anxious or worried?’ instead of ‘Have any of his/her family been anxious or worried about the person?’). Because of the recent challenges of recruiting people with dementia living in nursing homes for research studies, comprehensive psychometric testing for the versions of the IPOS-Dem remains to be completed [5, 9].

In our translation and validation work [9], we found the revised Edmonton Symptom Assessment System (ESAS-r) [10] o be a commonly occurring instrument for assessing symptoms in people with dementia in LTCFs. ESAS-r has been officially translated into German [11] and is known as Minimal Documentation System for Palliative Patients (MIDOS). The target population has always been people in general and specialist palliative care services [12], whose needs may significantly differ from those of people with dementia living in LTCFs [1]. With nine core symptoms, ESAS-r is significantly shorter than IPOS-Dem. Essentially, The version of ESAS-r used in Switzerland is essentially a symptom list with 0–10 numeric rating scales. Although ESAS-r was conceptualised to enable the longitudinal plotting of symptom burden to monitor people regarding symptoms [10], this mode of use has not been widely utilised in Swiss LTCFs, where it has mainly been used for palliative care screening [9]. One of the advantages of IPOS-Dem is that it is specific to older people with dementia, expands on the symptoms in ESAS-r and can easily be integrated into dashboards and serve as an outcome measure across settings and language regions [7, 13].

Our study aimed to determine the structural validity and internal consistency of the Swiss easy-read IPOS-Dem family member and frontline staff versions. Because of the vulnerability of the target population and the patient-reported outcome measure roots of IPOS-Dem, it and its parent measure—the Integrated Palliative Outcome Scale (IPOS)—are reduced instruments (i.e. the various constructs are not overdetermined, being measured by one item each); therefore, unidimensionality was not expected. However, the parent measure, IPOS, was designed based on a reflective model, with the underlying construct being palliative care-related concerns [14]. Because adaptation to the target population of people with dementia added several constructs [1, 9] to the measure, an exploratory approach was taken to describe its internal structure.

Methods

This study is a secondary data analysis from a multicentre study with 15 time periods (T0, T1 … T14), where data were collected as outlined in the main studyreport [15]. The primary study is a stepped-wedge cluster randomised trial of monthly IPOS-Dem assessment. After cross-over to the intervention, the LTCFs added monthly person profiles, in which frontline staff, family members and clinical nurse specialists discussed their IPOS-Dem findings to develop person-centred care plans.

In the present analysis, IPOS-Dem assessments were analysed separately for family members and frontline staff, although the items do not differ conceptually. For the analysis, data from one period per person with dementia for each version were used. Family members assessed the person with dementia to whom they were related, while frontline staff were assigned to people with dementia according to convenience. People with dementia were assessed with IPOS-Dem by family members between 16 January 2021 and 9 January 2023. Staff versions were completed between 5 March 2021 and 16 July 2022.

IPOS-Dem administration

The study team assigned each of the participating LTCFs a clinical champion in collaboration with the LTCF leadership staff. The clinical champion was a full-time local employee of the respective LTCF who oversaw recruitment, data collection and general study coordination with the study team. This is further outlined in the main study protocol [16]. Frontline staff and family members completed the instruments for people with dementia on the paper version of the IPOS-Dem. For frontline staff, we chose to use the completed IPOS-Dem measures from T13T13, which was the last time period in which no concurrent measurement instruments had to be completed, and the frontline staff were theorised as having considerable experience with the measure. Due to attrition and practical considerations for data collected by family members, the baseline data (T0) were included in our analysis. Specifically, our case selection algorithm most readily identified baseline assessments, and family member participation in the intervention condition declined significantly over the 15-month study period, particularly in cluster groups randomised to sequences where the intervention commenced after six or nine months [15].

Data collection procedures

Sociodemographic and clinical details of those with dementia were derived from their respective LTCF’s Minimum Data Set (MDS) into Research Electronic Data Capture (REDCap), hosted at the HES-So University of Applied Science and Arts of Western Switzerland’s Data Acquisition Unit in the Canton of Valais [17, 18]. The sociodemographic and clinical details collected included age, gender, dementia type and severity (if diagnosed). "Immediately after a training session for the main study, frontline staff and family members completed a survey designed to collect their sociodemographic data. This training also included instructions on how to complete the IPOS-Dem. The clinical champions entered the IPOS-Dem data into REDCap, which is browser-based software that provides continuous feedback to its users [17]. Automated tests run by REDCap check the data for plausibility and completeness [17].

Sample size

This overarching trial determined the sample size in which IPOS-Dem was captured. For this trial, between September 2020 and February 2023, we aimed to enrol 220 people with dementia living in 22 LTCFs [16]. Regarding the frontline staff, a total rater population of 440 people was targeted. In contrast, no target number of family members was defined because of demographic realities (i.e. many older people living in Swiss LTCFs do not have visiting relatives). Together with us, the LTCFs determined the sample of people with dementia assessed after screening all residents for inclusion and exclusion criteria (i.e. a convenience sample). We included people with dementia living in the LTCF with a diagnosis of Alzheimer’s or vascular dementia or with symptoms indicating dementia, as documented in the LTCF MDS. Sample size adequacy to conduct our analysis for both assessor groups was determined post hoc by calculating and interpreting the Kaiser–Meyer–Olkin criterion according to Kaiser and Rice [19].

Statistical analysis

The IPOS-Dem assessments were analysed separately for each rater population. First, we inspected common item characteristics. The overall and individual measures of sampling adequacy were interpreted according to Kaiser’s guidance, which deems values below 0.5 as ‘unacceptable’. Furthermore, we tested whether the item correlation matrix was an identity matrix using the methods described by Bartlett [20], here with a Type I error acceptance threshold of 5% (α = 0.05). A visual inspection of the correlation matrix (using Pearson’s correlation coefficient [21]) followed this to exclude multicollinearity issues (correlations > 0.9) and to double-check for insufficient correlations (correlations < 0.3) to conduct factor analysis.

The number of factors to extract was determined by conducting Horn’s parallel analysis, as described by Hayton et al. [22]. Its implementation in the paran 1.5.2 R package [23] performs simulated factor extraction iterations based on random datasets with the same number of items. It contrasts the factor eigenvalues with the extracted eigenvalues for the original dataset [24]. All our analyses were carried out using R 4.2.2 in RStudio 2023.06.0 [25] on macOS 13.4 and various packages, such as tidyverse 2.0.0 [26] for data wrangling and psych 2.3.3 [27] for common calculations in classical test theory.

Exploratory factor analysis

We then proceeded to model solutions for the number of factors resulting from the parallel analysis by conducting an exploratory factor analysis (EFA) with a minimum residual solution and varimax rotation [27]. Next, we inspected the factor loadings onto the factors to guide our dimensionality optimisation. Items were then removed individually, with the factor solution re-estimated after each deletion. Items were removed based on their factor loadings, with the lowest loadings removed first.

Internal consistency

After dimensionality optimisation, the resulting subscales’ interitem and item-total correlations were calculated and described. This was followed by calculating each subscale’s total and Cronbach’s α when the corresponding item was dropped. In this step, we also inspected the values to identify items that increased the subscale total Cronbach’s α. Items identified in this manner were excluded from the model and solution in the same stepwise manner described in the dimensionality optimisation. Subscales were named by the authors based on the items loading onto them. The thematic grouping of IPOS-Dem items suggested by the developers [7] (i.e. physical symptoms; emotional, social and existential; family concerns) was omitted.

Missing data

Some people with dementia were lost to follow-up at T13 of the overarching study, and the last IPOS-Dem rating was carried forward. Regarding this loss to follow-up, IPOS-Dem measures were handled as one entity. For each item, only complete cases were modelled. For IPOS-Dem measures completed by family members, the baseline observation (T0) entered the analysis because there were no concurrent measures for them to complete, and attrition was hypothesised as being high. We conducted a sensitivity analysis using various classic imputation methods (best case (0), worst case (4), numeric marker (5), mean and median) to validate our procedure for handling missing data. The different solutions were compared using multiple absolute and relative fit indices, such as the root mean square error of approximation (RMSEA) with its 90% confidence intervals (90% CI), the Tucker–Lewis Index of factoring reliability (TLI) and the Bayesian information criterion (BIC) to order the various potential solutions.

Additional analysis

Regarding the sociodemographic information for people with dementia, the two rater populations were analysed and reported using common descriptive statistical methods to describe central tendencies (i.e. mean [M] or median [Med]), frequencies (number [n] and percentages [%]) and dispersion (standard deviation [SD], minima and maxima [min-max]) of the sociodemographic data. Basic item characteristics (M score, score SD, % per response option, n of complete cases per item) and additional item characteristics (Med, trimmed M, Med absolute deviation, min-max, range, skew, kurtosis, standard error, interquartile range and item difficulty (mean/4)) were calculated for the family member version and frontline staff version of IPOS-Dem separately.

Results

Participants and characteristics

Frontline staff assessed n = 257 people with dementia, of whomom 118 had family members who also completed and submitted the respective IPOS-Dem. On average, the people with dementia were 86 years old. Despite meeting our inclusion criteria, nearly a third (28.4%) did not have a dementia diagnosis in their records. Of those where dementia severity was documented in the MDS, 62.6% had advanced dementia, but about half of the people with dementia had only low dependency in their activities of daily living, according to the Resident Assessment Instrument for Nursing Homes Activities of Daily Living Short-Form Scale [28]. More details and the differences in the sample as assessed by family members and staff are illustrated in Table 1.

Table 1 People with dementia’s sociodemographic data

The 27 IPOS-Dem items are described in Table 2, as scored by frontline staff, and in Table 3, as scored by family members. Most IPOS-Dem items in both versions showed floor effects, with more than 15% of responses falling into the lowest category [29]. However, in the family member version, only four out of the 27 items—‘Able to interact’, ‘Drowsiness’, ‘Inner peace’ and ‘Weakness’—did not show floor effects. For additional item characteristics, please refer to Additional File 1.

Table 2 IPOS-Dem item characteristics staff version
Table 3 IPOS-Dem item characteristics family version

Swiss easy-read IPOS-Dem for frontline staff

Exploratory factor analysis

With the solution after structural optimisation, 22 of the original 27 IPOS-Dem items were retained, and no item exhibited substantial cross-loading (> 0.3) onto multiple factors. Factor 1, termed ‘Dementia Physical and Interaction Impact’ (DPII), encompassed items related to functional, social and physical needs, while Factor 2, named ‘Dementia Emotional and Behavioural Impact’ (DEBI), focused on the behavioural and psychological symptoms of dementia (BPSD).

The final fitted factor model from an EFA was conducted for 22 items with orthogonal rotation (varimax) and a minimum residual solution. The Kaiser–Meyer–Olkin measure verified the sampling adequacy for the analysis, iMSA = 0.78 (‘middling’, according to Kaiser, 1974), and all iMSA values for individual items were > 0.53, just above the acceptable limit of 0.5. Bartlett’s test of sphericity, χ^2(351) = 2363.878, p < 0.001, indicated that correlations between items were sufficiently large for EFA. A parallel analysis was run to obtain the adjusted eigenvalues for each factor in the data. Two factors had adjusted eigenvalues above 0 and together explained 32% of the variance. The factor loadings are shown in Fig. 1.

Fig. 1
figure 1

Rotated factor loadings for the IPOS-Dem staff versions (n = 257): two tentative subscales

This model did not achieve an acceptable fit (< 0.06 according to Hoyle [30]), with an RMSEA of 0.09 and a 90% confidence interval of 0.082 to 0.098. RMSEA, however, has been considered sensitive to sample sizes below 200 and in small models [30]. Furthermore, the Tucker–Lewis Index of factoring reliability (TLI), which is considered insensitive to small n while penalising model complexity, also indicated poor fit, with the model at 0.707, below its cut-off of 0.95 [30]. A sensitivity analysis was performed to check whether the model fit would differ with various imputation methods to replace the missing responses. However, no improvements in fit were found.

Internal consistency

The two IPOS-Dem subscales—DPII and DEBI— appeared to be internally consistent, with the DPII subscale demonstrating a Cronbach’s α value of 0.83 and the DEBI subscale exhibiting a Cronbach’s α value of 0.81. Individual item statistics are provided in Table 4.

Table 4 Subscale and individual item statistics for the IPOS-Dem frontline staff version

Swiss easy-read IPOS-Dem for Family Members

Exploratory factor analysis

After structural optimisation, we retained 25 of the original 27 items in the model, which mainly differentiated between physical symptoms that are hard to assess by visiting family members, functional symptoms, psychosocial symptoms and concerns and physical symptoms that are easier to assess by visiting family members.

According to this solution, we suggested four subscales, which were in the same vein as the frontline staff version but split DPII into three tentative subscales: Dementia Physical Impact Hard to Assess (DPIh), Dementia Physical Impact Easy to Assess (DPIe) and Dementia Interaction Impact (DII). However, when determining internal consistency, we identified issues with items that seemed to increase Cronbach’s α of their respective scales, that is, DII and DEBI, when deleted from it.

After additional item removals, 21 of the original 27 items were retained. These mainly differentiated between physical symptoms that would be hard to assess by visiting family members, functional symptoms, psychosocial symptoms and concerns and physical symptoms that would be easier to assess by visiting family members. The items that substantially loaded onto two or more of the factors (> 0.3), that is, ‘Constipation’, ‘Weakness’, ‘Drowsiness’, ‘Poor appetite’, ‘Swallowing problems’, ‘Family anxious or worried’, ‘Poor mobility’, ‘Able to interact’ and ‘Lost interest’, were assigned to the factor they loaded onto the most.

The final fitted factor model from an EFA was conducted for 21 items with orthogonal rotation (varimax) and a minimum residual solution. The Kaiser–Meyer–Olkin measure verified the sampling adequacy for the analysis, iMSA = 0.86 (‘meritorious’ according to Kaiser, 1974), and all iMSA values for individual items were > 0.73, which is well above the acceptable limit of 0.5. Bartlett’s test of sphericity, χ2(351) = 1270.148, p < 0.001, indicated that the correlations between items were sufficiently large for EFA. A parallel analysis was run to obtain the adjusted eigenvalues for each factor in the data. Four factors had adjusted eigenvalues above 0 and explained 59% of the variance. The factor loadings are shown in Fig. 2.

Fig. 2
figure 2

Rotated factor loadings for the IPOS-Dem family member versions (n = 118): four tentative subscales

The final model also did not achieve an acceptable fit, with an RMSEA of 0.173 (90% CI: 0.16–0.188). TLI also indicated poor fit, with the model at 0.533. A sensitivity analysis was undertaken to check whether the model fit would differ with various imputation methods to replace the missing responses. However, no improvements in fit were observed.

Internal consistency

Item-wise and subscale correlations and statistics for the IPOS-Dem for family members are shown in Table 5. The four IPOS-Dem subscales in the family member version—DPII, DPIe, DPIh and DEBI—appeared internally consistent, with the DII subscale demonstrating a Cronbach’s α value of 0.83 and the DEBI subscale exhibiting a Cronbach’s α value of 0.86. The Dementia Physical Impact subscales DPIe and DPIh showed Cronbach’s α values of 0.84 and 0.77, respectively.

Table 5 Subscale and individual item statistics for the IPOS-Dem family member version

Discussion

Our study aimed to determine internal consistency and explore the structural validity of the Swiss easy-read IPOS-Dem. A two- and four-factor solution has been described for the frontline staff and family member versions of the measures. The resulting subscales show Cronbach’s α values within acceptable intervals. For the frontline staff version, the DEBI showed a Cronbach’s α of 0.83, and the second subscale, DPII, showed a Cronbach’s α of 0.81. The family member version of DPII was split into hard-to-measure and easy-to-assess symptoms and concerns (DPIh and DPIe) and the interaction impact (DII). The four subscales’ Cronbach’s α ranged between 0.77 and 0.86. However, the fitted two- and four-factor models were not optimal regarding the absolute goodness-of-fit measures, and neither reached thresholds deemed acceptable, with RMSEAs of 0.173 for the family member version and 0.09 for the frontline staff version of IPOS-Dem.

The systematic use and integration of instruments like IPOS-Dem have been shown to be beneficial for individuals with dementia [15]. IPOS-Dem can feasibly assess palliative care-related symptoms and concerns [7, 9, 31]. By involving family members and staff in the care process, IPOS-Dem fosters a person-centred approach, even in advanced dementia or in LTCFs where professional staff experience high turnover [31]. Evidence from specialist palliative care indicates that integrating outcome measures like the IPOS-Dem supports person-centred care planning, counteracting overly task-based care practices [32, 33]. Furthermore, the IPOS-Dem enhances communication, teamwork and systematic care planning by including multiple perspectives and facilitating collaborative assessments [7, 15, 31]. Its use in LTCFs supports holistic monitoring and care provision, while empowering informal caregivers, increasing their engagement in care and improving communication between care providers [7].

We observed differences in the internal structure of the family member and staff versions of IPOS-Dem. While the items still load onto subscales that are similar, it is the emotional and behavioural items—hallucinations or delusions, irritability and aggressiveness, sleeping problems and wandering—that did not meet the criteria for inclusion in the DEBI scale in the family member version of IPOS-Dem. The other main difference, as reflected in our naming of the split DPI subscales, seems to arise from the relatively shorter observation intervals used by family members compared to frontline staff, which they supposedly rely on to make their ratings. It is unsurprising that perceptions and ratings differ, as this has also been described in proxy ratings of people with dementia’s quality of life [34, 35]. Robertson pointed out that differences between staff and family member ratings may stem from multiple dimensions: differences in experiences that shape varying focuses, coping mechanisms related to distinct roles in quality of life, the process of adjusting to and coping with loss, and variations in understanding and insight. The main reason we believe contributes to these differences, in addition to the lack of 24-h presence with the person with dementia, is that family members may evaluate based on the person’s past and what has been lost, while staff may lack insight into the person’s previous experiences but often equate quality of life with quality of care, potentially leading to more positive evaluations.

Strengths and limitations

For the primary study, a considerable sample of people with dementia, family members and frontline staff in LTCFs was engaged. The easy-read IPOS-Dem is a promising person-centred measure for analysing the outcomes of older people with dementia living in LTCFs. The IPOS-Dem’s particular strengths lie in the availability of proxy versions for family members and frontline staff, with a self-report version still in early development. This paper is one of the first publications to evaluate the psychometric properties of the IPOS-Dem in a larger sample. In this secondary analysis of trial data using exploratory factor analysis, several limitations must be highlighted. Our sample of people with dementia may be limited in several ways. Sampling bias is a significant concern when conducting research in LTCFs, particularly in the context of convenience sampling. This type of bias may have been introduced by selecting LTCFs based on their availability or convenience rather than ensuring they were representative of the entire population. Although 435 LTCFs in German-speaking Switzerland were contacted, only a small number were able to participate and provide data. As a result, the findings from our sample may not accurately reflect the broader population of people with dementia living in nursing homes.

Another form of bias, known as self-selection bias, can impact research in LTCFs. This bias may have occurred because participants and their legal representatives were free to decide whether they wanted to participate. Consequently, individuals more interested in the study’s topic may have been more inclined to participate, potentially skewing the sample.

To address these limitations in future research, it would be beneficial to aim for a larger and more representative sample of people with dementia, recruiting participants from a diverse range of facilities. This broader approach could help minimise the influence of sampling bias and enhance the generalisability of the findings. Furthermore, collecting data on participants’ cognitive impairment levels and co-occurring health conditions would be valuable. Although we collected data on dementia severity and type, concerns arose regarding the accuracy and timeliness of information obtained from the minimum dataset of nursing homes. Improving the accuracy and comprehensiveness of data collection on dementia severity and other comorbid diagnoses would strengthen our ability to account for sampling bias and heterogeneity.

In the present study, it is worth noting that a substantial sample of 23 Swiss-German LTCFs was included, providing a reasonable breadth of representation. However, to further enhance the robustness of the findings, expanding recruitment efforts to include a larger number of LTCFs may be beneficial, as this could increase the diversity and representativeness of the sample.

Comparison with other instruments

We compare our results to the IPOS, from which the IPOS-Dem was derived. IPOS underwent confirmatory factor analysis for its 17 scorable items, with 376 participants [36]. However, IPOS was validated in English and German palliative care settings, which primarily dealt with oncologic primary diagnoses and typically cared for younger people compared with our study [36]. Murtagh et al. proposed a three-factor solution grouping the 10 physical symptoms, four emotional symptoms and a third factor with three items related to communication and practical issues. The three subscales showed Cronbach’s α values between 0.58 and 0.70, with a total scale Cronbach’s α of 0.77. We suggest that the difference in population and additional item measures contributed to the difference in the number of subscales. Interestingly, the IPOS confirmatory factor analysis with one-, two- and three-factor solutions was only undertaken for the self-assessment version of IPOS. Although inter-rater reliability was acceptable for most items, it would be interesting to explore whether the internal structure remains similar depending on the rater type. The ability to administer IPOS with different proxies (staff, family members) and in self-assessment is considered one of IPOS’s greatest strengths compared with other health-related quality-of-life measures and measures of symptom burden used in clinical practice and research [36].

The IPOS-Dem, with its list of symptoms and concerns, aims to capture the impact of the health situation on the person with dementia in a multidimensional way. The multidimensionality reflected in IPOS and IPOS-Dem arises from the philosophy of palliative care on which it was based, recognising that relevant needs can be physical, psychological, social and spiritual [1]. Conceptually, the IPOS-Dem appears to be more closely aligned with clinical screening instruments that determine the absence or presence of specific symptoms or their intensity, such as the revised Edmonton Symptom Assessment System (ESAS-r) and its officially validated German translation, ‘Minimales Dokumentationssystem’ (MIDOS2), which is the Swiss standard for symptom assessment [11, 37]. Measures developed for palliative care self-assessment are often reduced to minimise the burden on patients, meaning that psychometric approaches developed for overdetermined measures (i.e., where multiple items measure the same construct) may not be suitable [37]. In MIDOS2, the authors reported three factors. The first one, calculated from four items, indicates existential and psychosocial suffering. The second factor describes the intensity of the physical symptom burden using four items. The last factor, with three items, can be interpreted as an indicator of disease progression.

Conclusion

The IPOS-Dem provides a person-centred outcome measure for people with dementia that is easy to use in LTCFs. The findings from this study offer evidence of the internal consistency and structural validity of the Swiss easy-read IPOS-Dem. For each proxy rater population, frontline staff and family members described comparable internal structures. Internal consistency indices between 0.77 and 0.86 indicated acceptable to good internal consistency for the subscales. This evidence supports the use of the reduced instrument in clinical practice and clinical decision-making processes. However, further research into the psychometric properties of the Swiss easy-read IPOS-Dem is required. To improve the IPOS-Dem, additional efforts targeting rating and observation procedures may be beneficial. One of the theorised strengths of the Swiss easy-read IPOS-Dem was its potential to mitigate contextual barriers to the effective implementation of palliative and person-centred care in Swiss-German LTCFs. These barriers include low incentives for professional staff development, high frontline staff turnover and the supersaturation of methods and instruments for dementia and aged care. [38, 39]

Based on our results, the Swiss easy-read IPOS-Dem DPII and DEBI mean scores may be used in future research involving frontline staff as proxy raters for symptoms and concerns in people with dementia. However, we also recommend tracking how the impact of symptoms and concerns evolves on an individual level. Future research could focus on inter-rater reliability between the two instrument versions for family members and frontline staff at both the subscale and individual symptom levels. Further psychometric analyses on test–retest reliability, concurrent validity and responsiveness are also necessary. Additional publications on its psychometric validation, IPOS-Dem language, setting-specific versions and further resources are available at http://pos-pal.org/.

Data availability

The full dataset and R-code for reproducing the data are available at: Spichiger, F., Koppitz, A. L., Meichtry, A., Larkin, P., HES-SO Fribourg, & University of Lausanne. (2025). Internal consistency and structural validity of the Swiss easy-read Integrated Palliative Care Outcome Scale for Dementia: A secondary exploratory factor analysis [Data set]. Zenodo. https://doiorg.publicaciones.saludcastillayleon.es/10.5281/zenodo.14789065.

Abbreviations

BIC:

Bayesian information criterion

DEBI:

Dementia Emotional and Behavioural Impact

DII:

Dementia Interaction Impact

DPIe:

Dementia Interaction Impact Easy-to-Assess Symptoms and Concerns

DPII:

Dementia Physical and Interaction Impact

DPIh:

Dementia Interaction Impact Hard-to-Measure Symptoms and Concerns

EFA:

Exploratory factor analysis

ESAS-r:

Edmonton Symptom Assessment System - revised

iMSA:

Measure of sampling adequacy

IPOS:

Integrated Palliative Care Outcome Scale

IPOS-Dem:

Integrated Palliative Care Outcome Scale for People with Dementia

LTCF:

Long-term care facility

M:

Mean

MDS:

Minimum data set

Med:

Median

2:

Minimales Dokumentationssystem für Patienten in der Palliativmedizin (Minimal Documentation System for Palliative Patients)

n:

Number

REDCap:

Research Electronic Data Capture

RMSEA:

Root mean square error of approximation

SD:

Standard deviation

TLI:

Tucker–Lewis index of factoring reliability

References

  1. Ellis-Smith C, Evans CJ, Murtagh FE, Henson LA, Firth AM, Higginson IJ, et al. Development of a caregiver-reported measure to support systematic assessment of people with dementia in long-term care: the integrated palliative care outcome scale for dementia. Palliat Med. 2017;31:651–60.

    Article  PubMed  Google Scholar 

  2. Livingston G, Huntley J, Sommerlad A, Ames D, Ballard C, Banerjee S, et al. Dementia prevention, intervention, and care: 2020 report of the Lancet Commission. Lancet. 2020;396:413–46.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Froggatt K, Arrue B, Edwards M, Finne-Soveri H, Morbey H, Payne S, et al. Palliative care systems and current practices in long term care facilities in Europe. EAPC; 2017.

  4. Ecoplan. Alzheimer Schweiz Demenzkostenstudie 2019: Gesellschaftliche Perspektive. Bern: Alzheimer Schweiz; 2019.

  5. Hodiamont F, Hock H, Ellis-Smith C, Evans C, de Wolf-Linder S, Jünger S, et al. Culture in the spotlight—cultural adaptation and content validity of the integrated palliative care outcome scale for dementia: a cognitive interview study. Palliat Med. 2021;35:962–71.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Greenhalgh J, Dalkin S, Gibbons E, Wright J, Valderas JM, Meads D, et al. How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. J Health Serv Res Policy. 2018;23:57–65.

    Article  PubMed  Google Scholar 

  7. Ellis-Smith C, Higginson IJ, Daveson BA, Henson LA, Evans CJ. How can a measure improve assessment and management of symptoms and concerns for people with dementia in care homes? A mixed-methods feasibility and process evaluation of IPOS-Dem. PLoS One. 2018;13:e0200240.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Ellison TS, Cappa SF, Garrett D, Georges J, Iwatsubo T, Kramer JH, et al. Outcome measures for Alzheimer’s disease: a global inter-societal Delphi consensus. Alzheimers Dement J Alzheimers Assoc. 2023;19:2707–29.

    Article  Google Scholar 

  9. Spichiger F, Keller Senn A, Volken T, Larkin P, Koppitz A. Integrated palliative outcome scale for people with Dementia: easy language adaption and translation. J Patient-Rep Outcomes. 2022;6:14.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Hui D, Bruera E. The edmonton symptom assessment system 25 years later: past, present, and future developments. J Pain Symptom Manage. 2017;53:630–43.

    Article  PubMed  Google Scholar 

  11. Krumm N, Larkin P, Connolly M, Rode P, Elsner F. Improving dementia care in nursing homes: experiences with a palliative care symptom-assessment tool (MIDOS). Int J Palliat Nurs. 2014;20:187–92.

    Article  PubMed  Google Scholar 

  12. Ellis-Smith C, Evans CJ, Bone AE, Henson LA, Dzingina M, Kane PM, et al. Measures to assess commonly experienced symptoms for people with dementia in long-term care settings: a systematic review. BMC Med. 2016;14:38.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Cicely Saunders Institute (CSI). The integrated palliative care outcome scale for dementia IPOS-Dem - an assessment to detect and assess symptoms and problems in people with dementia - manual for use in care homes. 2018.

  14. Cicely Saunders Institute (CSI). IPOS-Dem manual and assessment. POS-Meas. 2018;2018(1-5):1-5.

  15. Spichiger F, Koppitz AL, Riese F, Kipfer S, Nagl-Cupal M, Büscher A, et al. Person profile dementia intervention in long-term care: a stepped-wedge cluster-randomized trial. J Am Med Dir Assoc. 2025;26:105351.

    Article  PubMed  Google Scholar 

  16. Spichiger F, Koppitz AL, Wolf-Linder SD, Murtagh FEM, Volken T, Larkin P. Improving caring quality for people with dementia in nursing homes using IPOS-Dem: A stepped-wedge cluster randomized controlled trial protocol. J Adv Nurs. 2021;77:4234–45.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81.

    Article  PubMed  Google Scholar 

  18. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Kaiser HF, Rice J. Little Jiffy, Mark Iv. Educ Psychol Meas. 1974;34:111–7.

    Article  Google Scholar 

  20. Bartlett MS. Properties of Sufficiency and Statistical Tests. Proc R Soc Lond Ser Math Phys Sci. 1937;160:268–82.

    Google Scholar 

  21. Bravais A. Analyse mathématique sur les probabilités des erreurs de situation d’un point. Impr. Royale. 1844;42–51.

  22. Hayton JC, Allen DG, Scarpello V. Factor retention decisions in exploratory factor analysis: a tutorial on parallel analysis. Organ Res Methods. 2004;7:191–205.

    Article  Google Scholar 

  23. Alexis Dinno. Gently clarifying the application of horn’s parallel analysis to principal component analysis versus factor analysis. 2014. http://doyenne.com/Software/files/PA_for_PCA_vs_FA.pdf. Accessed 20 Jun 2023.

  24. Dinno A. Exploring the sensitivity of horn’s parallel analysis to the distributional form of random data. Multivar Behav Res. 2009;44:362–88.

    Article  Google Scholar 

  25. R Core Team. R: a language and environment for statistical computing. 2022. https://www.R-project.org/. Accessed 30 Aug 2023.

  26. Wickham H, Averick M, Bryan J, Chang W, McGowan LD, François R, et al. Welcome to the Tidyverse. J Open Source Softw. 2019;4:1686.

    Article  Google Scholar 

  27. Revelle W. psych: Procedures for psychological, psychometric, and personality research. manual. Evanston: Northwestern University; 2023.

    Google Scholar 

  28. Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999;54:M546–53.

    Article  CAS  PubMed  Google Scholar 

  29. McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 1995;4:293–307.

    CAS  Google Scholar 

  30. Hoyle RH, editor. Handbook of structural equation modelling. 2nd ed. New York: The Guilford Press; 2023.

    Google Scholar 

  31. de Wolf-Linder S, Kramer I, Reisinger M, Murtagh FEM, Schubert M, Ramsenthaler C. Empowering informal caregivers and nurses to take a person-centred view: adaptation and clinical utility of the Integrated Palliative Outcome Scale (IPOS-Dem) for use in acute and community care settings. BMC Geriatr. 2024;24:1030.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Pinto C, Bristowe K, Witt J, Davies JM, de Wolf-Linder S, Dawkins M, et al. Perspectives of patients, family caregivers and health professionals on the use of outcome measures in palliative care and lessons for implementation: a multi-method qualitative study. Ann Palliat Med. 2018;7 Suppl 3:S137-S13S150.

    Article  Google Scholar 

  33. Högberg C, Alvariza A, Beck I. Patients’ experiences of using the Integrated Palliative care Outcome Scale for a person-centered care: a qualitative study in the specialized palliative home-care context. Nurs Inq. 2019;26:e12297.

    Article  PubMed  Google Scholar 

  34. Robertson S, Cooper C, Hoe J, Lord K, Rapaport P, Livingston G. Why do staff and family think differently about quality of life in dementia? A qualitative study exploring perspectives in care homes. Int J Geriatr Psychiatry. 2019;34:1784–91.

    Article  PubMed  Google Scholar 

  35. Orrell M, Hancock GA, Liyanage KCG, Woods B, Challis D, Hoe J. The needs of people with dementia in care homes: the perspectives of users, staff and family caregivers. Int Psychogeriatr. 2008;20:941–51.

    Article  PubMed  Google Scholar 

  36. Murtagh FE, Ramsenthaler C, Firth A, Groeneveld EI, Lovell N, Simon ST, et al. A brief, patient- and proxy-reported outcome measure in advanced illness: Validity, reliability and responsiveness of the Integrated Palliative care Outcome Scale (IPOS). Palliat Med. 2019;33:1045–57.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Stiel S, Matthes ME, Bertram L, Ostgathe C, Elsner F, Radbruch L. Validierung der neuen Fassung des Minimalen Dokumentationssystems (MIDOS2) für Patienten in der Palliativmedizin. Schmerz. 2010;24:596–604.

    Article  CAS  PubMed  Google Scholar 

  38. European Medicines Agency, Committee for Medicinal Products for Human Use, International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use, editors. Guideline for good clinical practice E6(R2). 2016.

  39. World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310:2191–4.

    Article  Google Scholar 

Download references

Acknowledgements

We want to thank the frontline staff who were involved in this study. Furthermore, we wish to thank the clinical champions who participated: A. Beqiri, R. Benz, M. Bonaconsa, A. Brunner, A. Conti, M. Deflorin, D. Deubelbeiss, L. Ebener, S. Egger, E. Eichinger, D. Elmer, A. Ermler, M. Fuhrer, C. Grichting, M. Havarneanu, H. Hettich, E. Hoffmann, E. Imgrueth, R. Juchli, I. Juric, K. Knöpfli, S. Kuonen, F. Laich, H. Meiser, N. Mergime, B. Michel, C. Ming, F. Müller, C. Niederer, G. Parkes, P. Piguet, A. Repesa, C. Ritz, B. Santer, A. Schallenberg, C. Schweiger, M. Spitz, and R. Strunck. We also extend our thanks to F. Murtagh, W. Sermeus, T. v. Achterberg and L. v.d. Block and Th. Volken for their discussions on the results and IPOS-Dem in general with us.

Funding

This work was supported by the Swiss Academic Medical Society, the Gottfried and Julia Bangeter-Rhyner Foundation, the HES-SO University of Applied Science and Arts Western Switzerland Bureau d’Appui et de Coordination de la Formation Doctorale and the Socratic Care Academy of Switzerland.

Author information

Authors and Affiliations

Authors

Contributions

André Meichtry: Data curation, Formal analysis, Methodology, Validation, Visualisation and Writing - review & editing. Andrea Koppitz: Conceptualisation, Funding acquisition, Investigation, Project administration, Resources, Supervision and Writing - review & editing. Frank Spichiger: Conceptualisation, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Visualisation, Writing - original draft and Writing - review & editing. Philip Larkin: Conceptualisation, Funding acquisition, Resources, Software, Supervision and Writing - review & editing.

Corresponding author

Correspondence to Frank Spichiger.

Ethics declarations

Ethics approval and consent to participate

All participants were required to provide informed consent and sign a consent form before data collection. The consent form and study materials were approved by the relevant Ethics Committee of the Canton of Zürich. The trial was approved by the Swiss Regional Ethics Committee of the Canton of Zürich on 12 November 2019, serving as the leading ethics committee for the involved regions, with clearance certification number BASEC2019-01847. The main study and secondary analysis were registered with the German Clinical Trials Register (DRKS00022339). Full registration details can be accessed online at http://www.drks.de/DRKS00022339. The trial was planned and conducted in accordance with the European Medicines Agency Good Clinical Practice Guidelines [38], which are based on the Declaration of Helsinki [39].

Consent for publication

All participants provided informed consent for publication via an informed consent form before data collection.

Competing interests

AK and FS are the translators/developers of the Swiss easy-read IPOS-Dem. The Swiss easy-read IPOS-Dem is a secondary outcome measure in a trial, where AK is the principal investigator. AM and PL have no conflicts of interest to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Spichiger, F., Meichtry, A., Larkin, P. et al. Internal consistency and structural validity of the Swiss easy-read Integrated Palliative Care Outcome Scale for People with dementia: a secondary exploratory factor analysis. BMC Palliat Care 24, 49 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12904-025-01691-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12904-025-01691-9

Keywords