Original article

Scand J Work Environ Health 2016;42(4):273-279    pdf

doi:10.5271/sjweh.3562

Effects of graded return-to-work: a propensity-score-matched analysis

by Bethge M

Objectives Graded work exposure is deemed to have a therapeutic effect. In Germany, graded return-to-work (GRTW) is therefore frequently used following a rehabilitation program if workers are still unable to perform full job duties. The aim of the analyses was to determine long-term effects on disability pension and regular employment.

Methods Analyses were performed with longitudinal administrative data. Patients aged 18–60 years who attended an orthopedic, cardiac, oncological, or psychosomatic rehabilitation between January and June 2007 were eligible to participate in a GRTW scheme. The effects of GRTW were analyzed by a propensity-score-matched comparison of patients with and without GRTW. Outcomes were disability pension rates, regular income, and the duration of receiving welfare benefits due to sickness absence and unemployment up to the end of 2009.

Results The propensity-score-matched sample comprised 1875 patients on GRTW and 1875 matched controls not undergoing GRTW. The probability of a disability pension was decreased by about 40% among GRTW patients [5.4% versus 8.6%; hazard rate ratio (HR) 0.62, 95% confidence interval (95% CI) 0.49–0.80]. The three-year income (2007–2009) was EUR12 920 higher (95% CI EUR10 054–15 786) in the GRTW group. The duration of receiving welfare benefits due to sickness absence and unemployment was significantly reduced.

Conclusions Graded work exposure supports labor participation and reduces the risk of permanent work disability.

This article refers to the following texts of the Journal: 2012;38(1):27-37  2009;35(1):1-5  2012;38(2):120-133  2013;39(1):57-65  2014;40(1):47-56  2015;41(5):491-503
The following articles refer to this text: 2016;42(4):257-259; 2017;43(5):436-446; 2017;43(5):447-456

Work disability has rising direct and indirect costs to societies (1). In Germany, current levels of sickness absence are estimated to equate to 568 million days lost per annum. This corresponds to an annual loss in production of around €59 billion. The loss in productivity due to sickness absence is estimated to be €103 billion annually (2). To meet the challenge of work disability, prevention and management of work disability have become a priority in many national health and welfare strategies (38). These strategies are diverse. In many countries, rehabilitation services are provided to support work-disabled patients to return to work and to achieve sustainable work participation for patients who experience limitations in work functioning. Though clinical interventions like functional restoration or work hardening (915) might be a major component of a rehabilitation strategy, several authors have also stressed the importance of involving workplace stakeholders in managing the return-to-work (RTW) process (16, 17). Involving workplace stakeholders gives rehabilitation and occupational health professionals the opportunity to gauge if rehabilitation can be facilitated by getting the worker back to work though she or he is still unable to perform full job duties. If she or he has returned to work, working hours and tasks can be increased gradually until the worker is again able to cope with regular and full demands (18). This strategy is called therapeutic work resumption, graded work exposure or graded RTW (GRTW).

In Germany, GRTW is possible if patients have finished their rehabilitation program but are still unable to perform full duties. GRTW is defined as a therapeutic measure that aims to test and practice work capacity at the workplace. It is usually initiated by the rehabilitation physician and the social worker in the rehabilitation center and needs consent from the patient, the employer, the general practitioner and the occupational physician. The patient begins to work for at least two hours/day. The rehabilitation physician develops a scheme which gradually increases the working time. The scheme ends with full RTW. In case of GRTW, employees continue to receive sickness benefits from the Pension Insurance Agency. There are no direct costs for wages for the employer. GRTW must be started within four weeks after completion of the rehabilitation program.

Graded work exposure is deemed to have a therapeutic effect among work-disabled persons as prolonged absence from work worsens physical deconditioning, negatively affects mental health, and increases the risk of receiving a disability pension (3, 17, 1921). Returning to work with reduced demands allows the worker to re-experience self-efficacy and co-worker support and challenge avoidance beliefs. Anema and colleagues (22) reported that therapeutic work resumption was a significant predictor for sustainable RTW in a six-nation cohort study of back-pain patients on long-term sick leave. Moreover, a systematic review by Krause and colleagues at the end of the 1990s summarized that graded work exposure increased work participation and reduced the number of lost working days (18). This conclusion was, however, mostly based on observational studies. Moreover, in the included studies, graded work exposure was usually only one element of a broader intervention. Specific effects of graded work exposure were difficult to separate.

In Germany, retrospective analyses demonstrated positive effects of GRTW on labor participation up to one year. One year after the rehabilitation program, 91% of GRTW participants were working, but only 78% without therapeutic work resumption (23). However, covariates for matching were assessed retrospectively and were prone to recall bias. Moreover, follow-up was restricted to one year. Analyses of long-term follow-up effects on disability pension and regular employment are still lacking. Therefore, the aim of this study was to explore the long-term effects of GRTW following a rehabilitation program for patients who were still work-disabled at the end of their rehabilitation program.

Methods

Study design

The German Pension Insurance Agency provided the dataset, which comprised income trajectories, disability pensions and welfare benefits due to sickness absence and unemployment for a random sample of all rehabilitation patients who finished a rehabilitation program between 2002 and 2009. We included persons aged 18–60 years who had finished an orthopedic, cardiac, oncological, or psychosomatic rehabilitation program in the first half of 2007. Persons had to be eligible for GRTW, ie, they had a regular job contract and their rehabilitation physician had given a positive RTW prognosis although they were still unable to perform full job duties at the end of the rehabilitation program. Persons were excluded if they started to receive a disability pension before the end of 2007 or died during the follow-up period.

Primary and secondary outcome

Primary endpoint was the receipt of a disability pension. Disability pensions can be approved as full or partial pensions. About 90% are full pensions. Disability pensions are usually permitted temporarily (≤3 years). Continuation of the pension requires further verification. Once approved, a later refusal is rather rare. Temporary pensions become permanent after nine years. Survival time was computed from 1 January 2008. Cases were censored until the date of starting to receive pension benefits. Non-cases were censored until 31 December 2009. Secondary outcomes were the income from regular employment from 2007 to 2009 as well as duration of receiving welfare benefits due to sickness absence and unemployment during the follow-up period (unemployment, long-term unemployment or sickness benefits).

Explanatory variables

We considered the following variables as potential confounders: age; sex; place of residence; income from regular employment in 2005 and 2006, respectively; the duration of receiving welfare benefits in 2005 and 2006 (unemployment, long-term unemployment or sickness benefits); rehabilitation following a prompt by the health insurance agency; cumulative duration of sickness absence prior to the rehabilitation program (<3 versus ≥3 months); type of rehabilitation program (post-acute rehabilitation versus rehabilitation due to chronic conditions); rehabilitation diagnosis (musculoskeletal disorders, cardiovascular disorders, psychosomatic disorders or cancer); and duration of the completed rehabilitation program.

Statistical analysis

Propensity score matching was used for defining a comparison group, as comparable as possible to the group of persons with GRTW, and issued from the large group of subjects without GRTW (2430). The propensity score is the conditional probability of receiving the treatment (ie, GRTW) given the vector of observed background variables. Matching by propensity scores enables balanced characteristics of the treated and untreated sample if there is sufficient overlap of the propensity scores of both groups. Compared with a conventional direct matching procedure, the problem of multidimensionality in finding a corresponding control (for instance related to age, sex, sick leave duration, former income and others) is thereby reduced to one dimension only.

The propensity score was estimated by a logistic regression model including the 16 potential confounders as described above. For every person who gradually returned to work, the person without GRTW with the most similar propensity score was selected from the larger pool of potential controls. Resampling was realized without replacement. Sensitivity analyses were performed using a caliper of one quarter and one tenth of the standard deviation of the propensity score during resampling to increase the similarity of cases and controls by excluding the cases for whom it was especially difficult to find an adequate control. Additional sensitivity analysis tested if the effects on disability pension varied over the range of the propensity score. For this purpose, the propensity score was categorized based on quartiles, and the effects of GRTW were compared over the quartile-based groups.

Balance of cases and controls before and after matching were checked by bivariate statistics (t test, chi-square test). As an indicator of the bias before and after matching due to differences related to the observed sample characteristics, the standardized percentage bias was calculated. This is the difference of the sample means in cases and controls relative to the square root of the average of the sample variances in both groups (31).

Analyses of treatment effects in propensity-score-matched samples can use the same statistical methods that are also used in experimental studies (24, 25). Differences in the survival distribution in working life for both groups were analyzed with proportional hazards models. The hazard rate ratio (HR) was determined to estimate the relative risk reduction. Moreover, the absolute risk reduction and the number needed to treat (NNT) to avoid one additional disability pensioner were calculated. In addition, interaction terms were included in the proportional hazard model to examine if baseline characteristics, eg, rehabilitation following a prompt by the health insurance agency, moderated the treatment effect. Interactions were first tested for age, sex and diagnostic groups. Age was categorized for this purpose (18–50 versus 51–60 years). Additionally, interactions were tested for indicators of severity of work disability (prompt for rehabilitation by health insurance agency and sickness absence duration) as stronger effects were assumed for more severely restricted persons. The comparative analyses of the effects on average income from regular employment and average time of receiving welfare benefits due to sickness absence and unemployment were done with t tests. Additionally, Mann-Whitney U tests were used as a nonparametric alternative.

Statistical differences were regarded as significant if the two-sided P-value of a test was <0.05. All analyses were performed with STATA statistical software, version 12 (StataCorp LP, College Station, TX, USA). Propensity score matching was realized by using the procedure psmatch2.

Results

Sample

The primary sample included 11 581 persons, of whom, 1875 (16.2%) gradually returned to work at the end of their rehabilitation program. Characteristics of persons with and without GRTW are shown in table 1. There were considerable covariate imbalances. Persons with GRTW were for instance younger and more frequently female compared with work-disabled persons who did not gradually return to work. Moreover, persons with GRTW were more severely restricted in working life as they were more frequently prompted by their health insurance agency to request a rehabilitation program, eg, due to long-term sick leave or severe chronicity, and they were more likely to have ≥3 months of cumulative sick leave within the 12 months before starting the rehabilitation program.

Table 1

Characteristics of patients with and without GRTW [GRTW=graded return-to-work; SD=standard deviation].

With GRTW (N=1875) Without GRTW (N=9706) Matched controls (N=1875)



Mean SD % Mean SD % Mean SD %
Age 44.8 8.0 47.0 8.0 44.6 8.4
Female 50.3 43.2 49.3
Reside in East Germany 13.1 18.4 12.6
Prompt by health insurance agency 17.4 8.5 17.9
Duration of sickness absence (>3 months) 64.8 40.5 66.0
Post-acute rehabilitation 19.1 59.0 19.6
Diagnoses
 Musculoskeletal disorders 63.8 63.7 64.6
 Cardiovascular disorders 9.3 16.8 9.1
 Mental and behavioral disorders 21.2 7.8 20.7
Cancer 5.7 11.7 5.6
Duration of rehabilitation program (days) 29.4 9.2 25.8 7.0 29.5 9.7
Income 2005 (in euros) 30 048 12 332 26 924 14 480 29 955 13 765
Income 2006 (in euros) 28 069 12 844 25 817 14 693 27 948 14 317
Sickness benefits 2005 (days) 7.9 31.3 10.2 39.0 8.8 30.9
Sickness benefits 2006 (days) 41.7 71.7 35.2 70.1 43.9 72.8
Unemployment benefits (days)
 Short-term 2005 4.5 30.2 10.0 43.7 4.5 26.2
 Short-term 2006 2.1 17.2 6.3 33.0 2.3 17.3
 Long-term 2005 4.1 32.7 13.4 61.9 4.1 31.6
 Long-term 2006 3.6 30.8 12.8 61.6 3.8 31.8

The median of the propensity scores of both groups clearly differed (GRTW versus non-GRTW: 0.28 versus 0.08). However, there was substantial overlap between the distributions of propensity scores in the two groups so that for every case one similar control was identified. Baseline differences between cases and controls were reduced to a minimum (mean bias before and after matching: 25.1% versus 1.4%). The one-to-one matched analytic sample included 3750 persons (with GRTW: N=1875; matched controls: N=1875). Characteristics of the matched controls are presented in the third column of table 1. Persons with GRTW and matched controls were balanced regarding all baseline scores, ie, there were no significant differences in any of the observed baseline variables.

Disability pension

The risk of a disability pension was decreased from 8.6% among patients without GRTW to 5.4% among patients with GRTW. This corresponds to a relative risk reduction of about 40% [HR 0.62, 95% confidence interval (95% CI) 0.49–0.80; figure 1]. The absolute risk reduction was 3.2%. The NNT was 31 persons, ie, 31 persons had to start a GRTW to avoid one additional disability pensioner.

Figure 1

Cumulative probability of a disability pension in patients with and without graded return-to-work (GRTW).

SJWEH-42-273-g001.tif

There were no significant interactions with age, sex and diagnostic group. However, findings indicated that there was no effect on a diminished disability pension risk among patients with cardiovascular diseases. The effect of GRTW on a decreased risk of a disability pension was approximately 2-times stronger among patients who started their rehabilitation program following a prompt by their health insurance agency compared to patients who were not (prompted by health insurance agency: HR 0.34, 95% CI 0.18–0.62; not prompted by health insurance agency: HR 0.72, 95% CI 0.55–0.95; interaction: P=0.027). The NNT were 13 and 47, respectively. A similar finding was seen when comparing persons with sickness absence duration prior to the rehabilitation program <3 months (HR 0.81, 95% CI 0.51–1.30) versus ≥3 months (HR 0.57, 95% CI 0.42–0.76). However, the interaction term was not significant in this case (P=0.207).

Income from regular employment

Both groups had comparable earnings in 2005 and 2006 prior to the start of their rehabilitation program. During follow-up, ie, from 2007 until 2009, the average annual income level among persons with GRTW was €3700– 4700 higher than among those without GRTW (table 2 and figure 2). In total, the accumulated income from regular employment from 2007 to 2009 was €12 920 (95% CI €10 054–15 786) higher among GRTW patients.

Table 2

Income and duration of receiving welfare benefits due to sickness absence and unemployment from 2007–2009 [GRTW=graded return-to-work; SD=standard deviation].

With GRTW (N=1875) Matched controls (N=1875) P-valuea


Mean SD Mean SD
Income (euros)
 2007 20 680 11 481 16 190 15 098 <0.001
 2008 27 887 15 452 23 178 18 329 <0.001
 2009 26 289 16 723 22 568 18 985 <0.001
 2007–2009 74 856 40 411 61 937 48 722 <0.001
Sickness benefits (days)
 2007 131.9 73.8 170.1 112.5 <0.001
 2008 30.4 73.0 42.6 80.5 <0.001
 2009 29.1 73.9 31.0 77.2 0.453
 2007–2009 191.4 156.6 243.6 198.7 <0.001
Short-term unemployment benefits (days)
 2007 4.0 23.4 17.2 51.3 <0.001
 2008 18.2 61.7 50.4 98.3 <0.001
 2009 18.9 61.4 31.9 75.5 <0.001
 2007–2009 41.2 110.5 99.5 161.2 <0.001
Long-term unemployment benefits (days)
 2007 0.4 7.4 1.8 20.8 0.005
 2008 1.0 14.6 4.5 31.6 <0.001
 2009 3.8 31.2 14.0 62.4 <0.001
 2007–2009 5.2 42.5 20.3 95.9 <0.001

a Reported P-values resulted from t tests. Mann-Whitney U tests yielded similar findings.

Figure 2

Annual income from 2005 to 2009 in patients with and without graded return-to-work (GRTW).

SJWEH-42-273-g002.tif

Sickness absence and unemployment welfare benefits

Patients with GRTW received less welfare benefits due to sickness absence and unemployment up to the end of 2009 than patients without GRTW (table 2). The accumulated time of receiving sickness benefits was reduced by 52 days (95% CI 40–64 days), short-term unemployment benefits by 58 days (95% CI 49–67 days), and long-term unemployment benefits by 15 days (95% CI 10–20 days).

Sensitivity analyses

Sensitivity analyses that used calipers of 0.1 and 0.25 of the standard deviation of the propensity score for matching resulted in samples of 3738 and 3734 persons. Findings on the effects on disability pension were identical (HR 0.62, 95% CI 0.49–0.80). The comparative analyses of annual income yielded differences of €13 004 (95% CI €10 135–15 873) and €12 889 (95% CI €10 020–15 757) in favor of GRTW patients. The effects on disability pension varied to some extent over the range of the propensity score. Effects were strongest below the first quartile and above the third quartile. However, effects did not differ significantly.

Discussion

Rehabilitation service research examines how services are routinely implemented and what is achieved by their usual application within a national health system. While clinical rehabilitation research focuses on the efficacy of an intervention in a more or less optimal setting with high treatment credibility and carefully selected patients, service research is interested in effectiveness, ie, the effects under routine conditions. This is important as findings of service research and clinical rehabilitation research might differ (30). Service research is, however, challenged by the fact that randomized controlled trials, which could provide the best evidence, are hardly feasible to perform in the case of services that have already been implemented. Moreover, comprehensive data collection in usual care is difficult to achieve (30). In this study, administrative data and propensity score matching were used to analyses the effects of GRTW, a strategy frequently used in German rehabilitation care. The application of propensity score matching reduced bias when comparing work-disabled patients who started gradually returning to work and work-disabled patients who did not. The use of administrative data allowed us to consider a large sample and observe a follow-up period of up to three years. The findings indicate a moderate relative risk reduction of permanent work disability by about 40%. Moreover, the findings clearly show that GRTW is associated with a higher average income level and a reduction in time dependent on welfare benefits due to sickness absence and unemployment.

The absolute risk reduction of permanent work disability, however, was small, and the NNT was high with 31 persons needed to avoid one additional disability pensioner. However, additional analyses showed that the NNT decreased to only 13 persons among patients who started their rehabilitation program following a prompt by their health insurance agency due to long-term sick leave and severe chronicity. This – and the similar finding related to the sickness absence duration – indicate that the effect on a diminished disability pension risk is especially strong among patients with chronic handicaps. The potential effect of GRTW seems to be less if a RTW would be also possible without this additional therapeutic measure. Rehabilitation physicians need to consider that recommending GRTW for less restricted patients may be of no additional benefit even if patients and employers wish to use the opportunity of GRTW.

The arena of work disability as described by Loisel (16) involves many stakeholders (eg, clinicians, workplace actors, insurance agencies, family and friends). Preventing permanent work disability and enabling a RTW therefore needs a strategy which takes account of as many of these actors as possible in order to develop a comprehensive and integrated strategy. This might explain, for example, that – despite the clear evidence that multimodal clinical interventions reduce pain and disability in patients with musculoskeletal disorders (32) – the evidence of the effects on work participation are conflicting. While Schaafsma and colleagues (12) reported small effects on work participation among workers with subacute and chronic back pain as compared with usual care or exercise treatment, Kamper and colleagues (32) failed to identify an effect on work outcomes when they compared multidisciplinary programs to usual care. In contrast, the review by van Vilsteren and colleagues (17) on workplace interventions demonstrated a clear benefit on work outcomes. Most of the interventions in the latter review involved clinical and workplace interventions, as proposed by Loisel and his Sherbrooke model (13). We, therefore, see our findings in line with the review by van Vilsteren and colleagues (17). Workplace involvement, especially by therapeutic work resumption and GRTW, seems to be a major component of a successful work rehabilitation strategy (22).

Strengths and limitations

When interpreting our findings, the following limitations must be considered. First, though propensity score matching is a powerful tool to reduce bias, a propensity-score-matched analysis is still based on observational data only (30). It is not a randomized controlled trial. Consequently, the results are potentially biased by unobserved differences between cases and controls. Second, the risk of bias is increased as the amount of data that can be used for matching to reduce bias is clearly limited when using administrative data. Self-reported data could additionally support the estimation of the propensity scores. In the case of GRTW, factors like job strain, job satisfaction, fear avoidance beliefs, subjective RTW prognosis, self-rated work ability, RTW motivation and support from supervisors and colleagues are probably important predictors for considering a GRTW. For the additional use of self-reported data, large cohort studies are needed as described by Saltychev and colleagues in their papers on the propensity-score-matched analysis of the effects of the Finnish vocationally oriented medical rehabilitation (28, 29, 33). Additionally, linking of administrative and questionnaire data has to be realized to use questionnaire data for such analysis.

The limitations of the study are balanced by the following strengths. First, administrative data allows fairly complete, reliable and valid assessment of data. This was especially the case in this study for several indicators of work participation, which is the primary outcome of RTW strategies and vocational rehabilitation services. Second, using administrative data allows the inclusion of large samples. Third, using administrative data enables a long follow-up period to be observed without sample attrition. Fourth, propensity-score-matched analyses allowed us to determine figures such as the NNT, which are usually derived from randomized controlled trials and needed to appropriately communicate the benefit of an intervention.

Concluding remarks

In conclusion, this study demonstrates that the application of GRTW in usual rehabilitation practice supported return to work and sustainable work participation among patients who were still unable to perform full job duties at the end of their rehabilitation program. However, the results also indicate that the possibility of GRTW should be particularly considered for patients who started their rehabilitation program following a prompt by their health insurance agency due to long-term sick leave and severe chronicity. The additional effect on avoiding disability pensions among less-disabled patients does not seem to be clinically meaningful.

References

1 

OECD. (2010). Sickness, disability and work:Breaking the barriers. A synthesis of findings across OECD countries. Paris: OECD Publishing.

2 

Bundesanstalt für Arbeitsschutz und Arbeitsmedizin. Sicherheit und Gesundheit bei der Arbeit 2013 [Safety and health at work 2013]. (2014). Dortmund:Bundesanstalt für Arbeitsschutz und Arbeitsmedizin.

3 

Seing, I, MacEachen, E, Stahl, C, & Ekberg, K. (2015). Early-return-to-work in the context of an intensification of working life and changing employment relationships. J Occup Rehabil, 25, 74-85, http://dx.doi.org/10.1007/s10926-014-9526-5.

4 

Higgins, A, O’Halloran, P, & Porter, S. (2012). Management of long term sickness absence:a systematic realist review. J Occup Rehabil, 22, 322-32, http://dx.doi.org/10.1007/s10926-012-9362-4.

5 

Poulsen, OM, Aust, B, Bjorner, JB, Rugulies, R, Hansen, JV, Tverborgvik, T, et al. (2014). Effect of the Danish return-to-work program on long-term sickness absence:results from a randomized controlled trial in three municipalities. Scand J Work Environ Health, 40, 47-56, http://dx.doi.org/10.5271/sjweh.3383.

6 

Aust, B, Helverskov, T, Nielsen, MB, Bjorner, JB, Rugulies, R, Nielsen, K, et al. (2012). The Danish national return-to-work program--aims, content, and design of the process and effect evaluation. Scand J Work Environ Health, 38, 120-33, http://dx.doi.org/10.5271/sjweh.3272.

7 

Ilmarinen, J. (2006). Towards a longer worklife!Ageing and the quality of worklife in the European Union. Helsinki: Finnish Institute of Occupational Health.

8 

Ilmarinen, J. (2009). Work ability - a comprehensive concept for occupational health research and prevention. Scand J Work Environ Health, 35, 1-5, http://dx.doi.org/10.5271/sjweh.1304.

9 

Gatchel, RJ, & Mayer, TG. (2008). Evidence-informed management of chronic low back pain with functional restoration. Spine J, 8, 65-9, http://dx.doi.org/10.1016/j.spinee.2007.10.012.

10 

Norlund, A, Ropponen, A, & Alexanderson, K. (2009). Multidisciplinary interventions:review of studies of return to work after rehabilitation for low back pain. J Rehabil Med, 41, 115-21, http://dx.doi.org/10.2340/16501977-0297.

11 

Hoefsmit, N, Houkes, I, & Nijhuis, FJ. (2012). Intervention characteristics that facilitate return to work after sickness absence:a systematic literature review. J Occup Rehabil, 22, 462-77, http://dx.doi.org/10.1007/s10926-012-9359-z.

12 

Schaafsma, FG, Whelan, K, van der Beek, AJ, van der Es-Lambeek, LC, Ojajarvi, A, & Verbeek, JH. (2013). Physical conditioning as part of a return to work strategy to reduce sickness absence for workers with back pain. Cochrane Database Syst Rev, 8, CD001822, http://dx.doi.org/10.1002/14651858.cd001822.pub3.

13 

Loisel, P, Abenhaim, L, Durand, P, Esdaile, JM, Suissa, S, Gosselin, L, et al. (1997). A population-based, randomized clinical trial on back pain management. Spine, 22, 2911-8, http://dx.doi.org/10.1097/00007632-199712150-00014.

14 

Streibelt, M, & Bethge, M. (2014). Effects of intensified work-related multidisciplinary rehabilitation on occupational participation:a randomized-controlled trial in patients with chronic musculoskeletal disorders. Int J Rehabil Res, 37, 61-6, http://dx.doi.org/10.1097/MRR.0000000000000031.

15 

Bethge, M, Herbold, D, Trowitzsch, L, & Jacobi, C. (2011). Work status and health-related quality of life following multimodal work hardening:a cluster randomised trial. J Back Musculoskelet Rehabil, 24, 161-72.

16 

Loisel, P, Buchbinder, R, Hazard, R, Keller, R, Scheel, I, van Tulder, M, et al. (2005). Prevention of work disability due to musculoskeletal disorders:the challenge of implementing evidence. J Occup Rehabil, 15, 507-24, http://dx.doi.org/10.1007/s10926-005-8031-2.

17 

van Vilsteren, M, van Oostrom, SH, de Vet, HC, Franche, RL, Boot, CR, & Anema, JR. (2015). Workplace interventions to prevent work disability in workers on sick leave. Cochrane Database Syst Rev, 10, CD006955, http://dx.doi.org/10.1002/14651858.cd006955.pub3.

18 

Krause, N, Dasinger, LK, & Neuhauser, F. (1998). Modified work and returns to work:a review of the literature. J Occup Rehabil, 8, 113-39, http://dx.doi.org/10.1023/A:1023015622987.

19 

Durand, MJ, & Loisel, P. (2001). Therapeutic return to work:rehabilitation in the workplace. Work, 17, 57-63.

20 

Yassi, A, Tate, R, Cooper, JE, Snow, C, Vallentyne, S, & Khokhar, JB. (1995). Early intervention for back-injured nurses at a large Canadian tertiary care hospital:an evaluation of the effectiveness and cost benefits of a two-year pilot project. Occup Med (Lond), 45, 209-14, http://dx.doi.org/10.1093/occmed/45.4.209.

21 

Lund, T, Kivimaki, M, Labriola, M, Villadsen, E, & Christensen, KB. (2008). Using administrative sickness absence data as a marker of future disability pension:the prospective DREAM study of Danish private sector employees. Occup Environ Med, 65, 28-31, http://dx.doi.org/10.1136/oem.2006.031393.

22 

Anema, JR, Schellart, AJ, Cassidy, JD, Loisel, P, Veerman, TJ, & van der Beek, AJ. (2009). Can cross country differences in return-to-work after chronic occupational back pain be explained? An exploratory analysis on disability policies in a six country cohort study. J Occup Rehabil, 19, 419-26, http://dx.doi.org/10.1007/s10926-009-9202-3.

23 

Bürger, W, Glaser-Möller, N, Kulick, B, Pallenberg, C, & Stapel, M. (2011). Stufenweise Wiedereingliederung zulasten der gesetzlichen Rentenversicherung:Ergebnisse umfassender Routinedatenanalysen und Teilnehmerbefragungen [Stepwise occupational reintegration under the German pension insurance scheme--results of comprehensive routine data analyses and participants surveys]. Rehabilitation, 50, 74-85, http://dx.doi.org/10.1055/s-0030-1261900.

24 

Guo, S, & Fraser, MW. (2010). Propensity score analysis:statistical methods and applications. Los Angeles: Sage Publications.

25 

Rosenbaum, PR, & Rubin, DB. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41-55, http://dx.doi.org/10.1093/biomet/70.1.41.

26 

Dehejia, RH, & Wahba, S. (2002). Propensity score-matching methods for nonexperimental causal studies. Rev Econ Stat, 84, 151-61, http://dx.doi.org/10.1162/003465302317331982.

27 

Descatha, A, Leclerc, A, & Herquelot, E. (2013). Use of propensity scores in occupational health? J Occup Environ Med, 55, 477-8, http://dx.doi.org/10.1097/JOM.0b013e31828dca2a.

28 

Saltychev, M, Laimi, K, El-Metwally, A, Oksanen, T, Pentti, J, Virtanen, M, et al. (2012). Effectiveness of multidisciplinary primary prevention in decreasing the risk of work disability in a low-risk population. Scand J Work Environ Health, 38, 27-37, http://dx.doi.org/10.5271/sjweh.3169.

29 

Saltychev, M, Laimi, K, Oksanen, T, Pentti, J, Kivimaki, M, & Vahtera, J. (2013). Does perceived work ability improve after a multidisciplinary preventive program in a population with no severe medical problems - the Finnish Public Sector Study. Scand J Work Environ Health, 39, 57-65, http://dx.doi.org/10.5271/sjweh.3298.

30 

Schelvis, RM, Oude Hengel, KM, Burdorf, A, Blatter, BM, Strijk, JE, & van der Beek, AJ. (2015). Evaluation of occupational health interventions using a randomized controlled trial:challenges and alternative research designs. Scand J Work Environ Health, 41, 491-503, http://dx.doi.org/10.5271/sjweh.3505.

31 

Rosenbaum, PR, & Rubin, DB. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. Am Stat, 39, 33-8.

32 

Kamper, SJ, Apeldoorn, AT, Chiarotto, A, Smeets, RJ, Ostelo, RW, Guzman, J, et al. (2014). Multidisciplinary biopsychosocial rehabilitation for chronic low back pain. Cochrane Database Syst Rev, 9, CD000963, http://dx.doi.org/10.1002/14651858.cd000963.pub3.

33 

Saltychev, M, Laimi, K, Oksanen, T, Pentti, J, Virtanen, M, Kivimaki, M, et al. (2012). Effect of a multidisciplinary rehabilitation program on perceived health among employees at increased risk of incapacity for work:a controlled study. Clin Rehabil, 26, 513-22, http://dx.doi.org/10.1177/0269215511425963.