Review

Scand J Work Environ Health 2019;45(2):103-113    pdf

doi:10.5271/sjweh.3775

Systematic literature review on the effects of occupational safety and health (OSH) interventions at the workplace

by Andersen JH, Malmros P, Ebbehoej NE, Flachs EM, Bengtsen E, Bonde JP

Objectives The aim of this review was to assess the evidence that occupational safety and health (OSH) legislative and regulatory policy could improve the working environment in terms of reduced levels of industrial injuries and fatalities, musculoskeletal disorders, worker complaints, sick leave and adverse occupational exposures.

Methods A systematic literature review covering the years 1966‒2017 (February) was undertaken to capture both published and gray literature studies of OSH work environment interventions with quantitative measures of intervention effects. Studies that met specified in- and exclusion criteria went through an assessment of methodological quality. Included studies were grouped into five thematic domains: (i) introduction of OHS legislation, (ii) inspection/enforcement activity, (iii) training, such as improving knowledge, (iv), campaigns, and (v) introduction of technical device, such as mechanical lifting aids. The evidence synthesis was based on meta-analysis and a modified Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach.

Results The search for peer-reviewed literature identified 14 743 journal articles of which 45 fulfilled the inclusion criteria and were eligible for meta-analysis. We identified 5181 articles and reports in the gray literature, of which 16 were evaluated qualitatively. There was moderately strong evidence for improvement by OHS legislation and inspections with respect to injuries and compliance.

Conclusions This review indicates that legislative and regulatory policy may reduce injuries and fatalities and improve compliance with OHS regulation. A major research gap was identified with respect to the effects of OSH regulation targeting psychological and musculoskeletal disorders.

This article refers to the following text of the Journal: 2007;33(2):85-95

Occupational injuries and diseases still contribute sizably to mortality and morbidity on a world-wide scale (1). More than 350 000 workers lose their lives each year due to occupational injuries (1, 2). Work-related ergonomic and psychosocial stressors are not life-threatening but can cause considerable morbidity and are major drivers of work absence. Musculoskeletal diseases and mental disorders are significant contributors to the amount of years lived with disability (3).

The Work Environment Authority (WEA) in Denmark main function is to identify workplace hazards, promulgating rules to regulate those hazards and ensuring compliance through enforcement, such as inspections, guidance, recommendations, and perhaps penalties for violations. In this context, work environment interventions are defined as actions or activities performed by or relevant to WEA with the objective of improving the work environment and employees’ health, and/or to reduce sickness absence and early retirement due to working environment exposures.

In an earlier review, Tompa et al (4) made one of the first attempts to review the effectiveness of incentives for prevention through insurance and regulations. The authors addressed challenges in defining specific inclusion and quality criteria and using best evidence synthesis. They found that the introduction of occupational safety and health (OHS) regulations did not have a clear impact on the level of occupational injuries but that penalties for violating regulations did. Tompa et al recently updated the knowledge base by reviewing the effectiveness of occupational health and safety regulatory enforcement (5). They concluded that there was strong evidence from actual inspections with penalties and moderate-to-limited evidence of no effect from inspections without penalties. There was moderate evidence that the introduction of OHS legislation had an effect on injuries and fatalities. Introduction of smoke-free workplace legislation improved proximal outcomes such as smoke exposure and cigarette consumption (strong evidence) and distal outcomes in terms of respiratory and sensory symptoms (moderate evidence). Awareness campaigns mostly showed limited evidence. In a Cochrane collaboration review on occupational safety and health enforcement tools for preventing occupational diseases and injuries from 2013 (6), the authors concluded there is evidence that inspections decrease injuries in the long- but not short term and with uncertain magnitude of effect. Moreover, focused inspections could have larger effects than inspections in general and effect of fines and penalties are uncertain. The quality of the evidence was considered low to very low and therefore conclusions are tentative and could be easily changed by future studies. A Cochrane collaboration review on interventions to reduce injuries among construction workers (7) concluded regulation alone is not effective in reducing non-fatal and fatal injuries. Continuing company-oriented interventions among management and construction workers, such as a targeted safety campaign or a drug-free workplace program, seem to have an effect in reducing injuries in the longer term. The review also concluded that there is very low-quality evidence for regulations and safety campaigns, and training for reducing fatal and non-fatal injuries in construction companies (7). In November 2015, WEA invited tenders to carry out a systematic literature review on the effects of working environment interventions on (i) harmful working environment exposures, (ii) employee health, (iii) sickness absence, and (iv) job retention. The purpose of the call was to provide an overview of the existing evidence based upon the international research literature, enabling the WEA to prioritize between different interventions based on the level of evidence. The WEA specifically called for a broader approach than the one used by the two Cochrane reviews (6, 7).

The aim of this current review was to assess the evidence that legislative and regulatory policy could improve the working environment in terms of reduced levels of industrial injuries and fatalities, musculoskeletal disorders, worker complaints, sick leave, and adverse occupational exposures.

Methods

Literature search

We reviewed the literature according to the MOOSE guidelines for systematic reviews of observational studies. We identified eligible papers for this review through two separate literature searches, one addressing peer reviewed original journal articles and one addressing the gray literature (non-journal articles and reports). Peer-reviewed papers were searched in PubMed, Web of science, HSELINE and NIOSHTIC-2 from OSH UPDATE. Gray literature was retrieved from searches in HSELINE, NIOSHTIC-2 and from OSH UPDATE. The search methodology followed a PICO (population or patient, intervention, comparison, and outcome) format. The search strategy combined sets of keywords, using AND/OR terms in Boolean logic. Keywords for the search strategy are provided in the appendix (table S2, www.sjweh.fi/show_abstract.php?abstract_id=3775). Details of the search strategy are also shown in the appendix. Six earlier reviews (49) were scanned to include additional studies.

In order to be included in this review the following criteria had to be fulfilled: (i) The study should be in English or Scandinavian language and published between 1966 and February 2017 in a peer-reviewed journal, report or on a website (gray literature). Abstracts only were excluded. (ii) The study should have investigated working environment issues. (iii) The study should report on a well-defined intervention relevant for an occupational safety and health authority such as regulatory actions that the WEA could make on OHS legislation or other regulations that could be enforced by the WEA, such as inspections, training, campaigns or the introduction of technical device. Studies of workplace interventions that do not explicitly involve OSH authorities as an active or potential player were not included. Thus, intervention studies of physical and mental health training of workers at the workplace and /or treatment studies were not eligible. (iv) The study should include a relevant outcome eg, injuries, fatalities, occupational exposure, sick leave, work-related symptoms and disease and compliance. (v) The study should at best include a control group or a reference such as before-after comparisons or other types of controlled designs. Simple before-after comparisons without a control group were included to meet the call for a broader review. (vi) The study should provide quantitative measures of intervention effects with confidence intervals (CI) or provide data enabling calculation of risk estimates and associated uncertainties.

At the title and abstract screening stage, the facilities from www.covidence.org were used. One author screened all studies identified by the search according to the eligibility criteria, and three other authors provided second screenings. Disagreements (7% of papers) between readers were resolved by consensus. Two authors screen all the gray literature from OSH and NIOSH in Covidence using the same inclusion criteria as that of journal papers except that risk estimates were not requested because most of the gray literature did not provide sufficient information to calculate risk estimates.

In an initial step, one author read the full-text of papers selected by sifting titles and abstracts; an additional author then re-reviewed the full-text of papers fulfilling the inclusion criteria. Included studies in both searches were grouped into five thematic domains: (i) introduction of OHS legislation, which considered different legislations on reduction of injuries and miscellaneous outcomes; (ii) workplace inspection with or without citations and /or penalties on injuries, compliance and compensation claims; (iii) training, such as improving knowledge of worker protection, safety and health training programs, and use of checklists and algorithms; (iv) campaigns, such as dissemination of guidelines and educational materials; and (v) introduction of technical device, such as mechanical lifting aids. See supplemental tables S3 and S4 for details of the included studies (www.sjweh.fi/show_abstract.php?abstract_id=3775).

Quality assessments

Three authors performed quality assessment and data extraction and independently scored each included study. We used a quality appraisal protocol developed by Tompa et al (4, 5) specifically for this type of review. It consists of ten items in two parts (study quality and policy lever relevance, see appendix, www.sjweh.fi/show_abstract.php?abstract_id=3775). Each item was ranked on a 5-point Likert scale. The lower of the two scores from the two raters was chosen to reach the final quality score, which was grouped into high (≥70%), medium (50–70%) and low (≤50%) as also used in the noted study (5).

We used a modified GRADE approach developed by the Swedish Council on Health Technology Assessment (SBU) for observational studies (10, 11) to categorize the level of evidence. Thus, in accordance with SBU, we classified the strength of evidence as strong (++++), moderately strong (+++0), limited (++00) and insufficient (+000). The implication of using the modified GRADE classification is relabeling “limited evidence” (GRADE) to “moderately strong evidence” (modified GRADE) in cases where consistent evidence was revealed though several observational studies of medium or high quality.

Statistical analysis

Even though the studies were heterogeneous with respect to study design, setting, interventions and outcomes, we performed a meta-analysis to summarize the result from the studies within each domain. For the domain legislation, the analysis was divided into legislation to reduce injuries and legislation to reduce miscellaneous exposures and/or outcomes. The latter was excluded in the meta-analysis because it was too heterogeneous for pooling in the analysis. For inspections, we divided the analysis into injuries, compliance and compensation claims. It was not possible to extract enough meaningful estimates from the gray literature studies. These studies were used to provide supporting or conflicting evidence for the five thematic domains noted above.

We extracted risk estimates from the studies to obtain relative risks (RR), odds ratios (OR) or effect sizes (risk difference, Cohen’s d) with 95% CI. If the relevant risk estimates were not reported but data were available, the authors of this paper computed risk estimates and CI (12,13).

Meta-analysis of the included risk estimates (with Cohen’s d estimates transformed to OR) was performed by applying a random effect model to each of the five domains separately. Estimates from random effects models are presented regardless of tests for heterogeneity since all studies are conceptually heterogeneous. We constructed funnel plots to assess evidence for publication bias and forest plots to illustrate the summary odds-ratios from the random effect models. The summary OR is the average OR across studies weighted by the inverse variance giving more weight to large studies. All analyses were performed using R v.3.2.3 (2015-12-10) and a significance level of 0.05. We also used R to create funnel and forest plots.

Results

The literature search from electronic databases identified 14 743 unique titles and abstracts after removal of duplicates. Of the 14 743 titles and abstracts, 437 passed to full-text review and, in combination with hand search, 61 studies were retrieved for the quality assessment and data extraction. See supplemental table S3 for details of the studies, of which 18 (29.5%) were included from snowballing, which is not unusual in reviews (14). The flow diagram of peer- reviewed studies retained at each stage is presented in supplementary figure S1 (www.sjweh.fi/show_abstract.php?abstract_id=3775).

Figure S2 reveals a separate flow chart for the gray literature (www.sjweh.fi/show_abstract.php?abstract_id=3775). From the gray literature, 16 studies were retrieved for full assessment, 8 on legislation (1522) and 8 on inspection (2330). The included studies are shown in supplementary table S4.

Study quality

Of the 50 peer-reviewed studies, 22 were graded as being of high quality according to the chosen quality assessment scheme, 28 of medium quality and 0 of low quality. The main reasons that studies fell below the high-quality rank were lack of adjustments and shortcomings in internal and external validity. The corresponding numbers for the gray literature reports were 2 of high quality, 7 of medium and 7 of low quality. Low quality was due to lack of confounder control, missing information of study population and lack of proper statistical methods.

Introduction of legislation

There were 16 studies retained in this domain: 11 were undertaken in the US (3141), 2 in the UK (42, 43), and 1 each in Spain (44), Canada (45) and Germany (46). Of the total, 11 studies concerned injuries and fatalities. There was moderately strong evidence that the introduction of OHS legislation has an effect on reducing injuries and fatalities based on these ten medium quality studies (table 1). Studies considered the introduction of different legislations such as broad OHS regulations (31, 44, ,46), self-regulation (45), machine regulation (32), mine safety regulation (34), needle stick regulation (38) vertical fall arrest standard (47), and standards introduced in manufacturing (35, 36). Violence-assault rates among hospital workers were assessed on a study where the Hospital Safety and Security Act in California in 1995 reduced assault rates by around 50% in the follow-up period (33). The majority of studies showed an intervention effect with a pooled estimate for all legislation to reduce injuries (OR 0.73, 95% CI 0.62–0.86). Studies with miscellaneous outcomes included ergonomic regulations on physical exposures (37), exposure to ethylene oxide (39) and the effect of workplace exposure limits for short latency respiratory disease (43), incidence of CTS following a program for ergonomics (40), regulation to reduce latex and rubber glove allergens on skin diseases (42), and finally the effect of cameras in taxis on homicide among taxicab drivers (41). The studies of miscellaneous outcomes all favored the intervention, but they were too heterogeneous for pooling them into the meta-analysis. The gray literature showed that reduction of the threshold limit value (TLV) for laughing gas reduced the exposure afterwards (15, 17). The overall findings in the gray literature were consistent with the peer-review literature. The funnel plot for the effect of legislation on injuries indicated a lack of smaller negative studies as shown by the open circles to the right in the funnel plot (supplementary figure S3, www.sjweh.fi/show_abstract.php?abstract_id=3775).

Table 1

Summary of findings and quality of evidence assessment according to a modified GRADE assessment (11). [MSD=musculoskeletal disorders]

Intervention domain Outcome GRADE assessment
Legislation Injuries/ Fatalities + + + 0 Moderately strong
Inspection Injuries + + + 0 Moderately strong
Compliance + + + 0 Moderately strong
Claims + + 0 0 Limited
Training Knowledge/practice + + 0 0 Limited
Campaign Injuries + + 0 0 Limited
Device Injuries + + 0 0 Limited
MSD + + 0 0 Limited

Workplace inspections

There were 23 studies retained in this domain, 14 high and 9 medium quality studies. Of these, 17 were from the USA (4863), and 2 from Italy (64, 65), Sweden (66, 67) and Canada (68, 69), respectively. Injuries, were examined in 14 studies, workers compensation claims in 2 studies, compliances with OSH regulation and violations in 5 studies, noise awareness and compliance in 1 study, and reducing workload and employment status as secondary prevention in 1 study. The studies considered inspection sequence (57, 63, ,70), general inspection deterrence and specific deterrence with/without penalties (61), consultative activities (48, 51, ,69), and supportive inspection (68). Several studies found that specific deterrence from inspections with penalties reduced final outcomes, most clearly for injuries and the intermediate outcome compliance (51, 5356, 58, 60). Figure 2 shows the forest plot of studies on inspections for injuries (OR 0.83, 95% CI 0.73–0.93), compliance (OR 0.65, 95% CI 0.50–0.83) and compensation claims (OR 96, 95% CI 0.94–0.98), favoring the effect of inspections on injuries and compliance. The funnel plot for injuries did not reveal major risk of publication bias (supplementary figure S4, www.sjweh.fi/show_abstract.php?abstract_id=3775), whereas the funnel plot for compliance points to large heterogeneity of included studies (supplementary figure S5, www.sjweh.fi/show_abstract.php?abstract_id=3775). The funnel plot for compensation claims is based on very few studies, but shows no major risk of publication bias (supplementary figure S6, www.sjweh.fi/show_abstract.php?abstract_id=3775). The gray literature was consistent with the overall assessment. One high quality study from the gray literature found that inspection after an accident reduces the prevalence of accidents the following years with 9% and with 13% for serious accidents with personal injury. Inspections in enterprises with no preceding accident had no effect on the prevalence of accidents the following years (28).

Figure 1

Forest plot and risk estimates of included studies on the effects of legislation on injuries.

SJWEH-45-103-g001.tif
Figure 2

Forest plot with risk estimates and funnel plot for the effect of inspections on injuries, compliance and compensation claims.

SJWEH-45-103-g002.tif

The overall evaluation of inspection/enforcement activity in GRADE showed that there is moderately strong evidence for the effect of inspections on injuries and compliance with OHS legislation, and low evidence for compensation claims and other outcomes (table 1).

Training

Different forms of training were evaluated in 6 studies: 2 high quality and 4 medium quality, of which 5 came from the US (7176) and 1 from India (77). Worker protection knowledge among vineyard workers was examined in 1 study (71) and the effect of safety and health training among construction workers in another (73). The study from India examined education and knowledge among pesticide handlers (77), and another study examined the effect of OSHA’s outreach training program for carpenters (75). Safety practices to improve machine-related safety were addressed in 1 study (74). A managerial training program to enhance awareness and compliance was studied in California (76). All the training studies favored interventions (see figure 3) with a pooled risk estimate of OR 0.29, 95% CI 0.15–0.56, because there were few studies and different types of interventions the evidence according to GRADE was limited. The funnel plot was based on few studies, but indicated a very large heterogeneity (supplementary figure S7, www.sjweh.fi/show_abstract.php?abstract_id=3775). A study not included in the pooled analysis, because no risk estimate could be extracted, showed that exposure judgment skills among hygienists could be enhanced after training and use of checklists and algorithms in a before-and-after comparison (72).

Figure 3

Forest plots and risk estimates for the effect of Training, campaigns and devices.

SJWEH-45-103-g003.tif

Campaigns

Campaigns were evaluated in 2 high- and 1 medium-quality study. An Italian study investigated the effect of written material and broadcasting in television and radio and on eye-injuries during a follow-up period with several unannounced inspections (78), and a US study evaluated injuries to children after active dissemination of the North American Guidelines for Children’s Agricultural Tasks (79). Both studies showed an effect of the interventions, see figure 3. The funnel plot is based on very few studies and publication bias could be present (supplementary figure S8, www.sjweh.fi/show_abstract.php?abstract_id=3775).

Devices

The use of mechanical lifts at hospitals and nursing homes was considered in 3 US studies (8082), 2 of which were high quality. The studies found that the interventions reduced injuries in general and musculoskeletal injuries, see figure 3. Publication bias cannot be ruled out (supplementary figure S9, www.sjweh.fi/show_abstract.php?abstract_id=3775).

Summary of findings

Table 1 summarizes findings and quality of evidence according to the modified GRADE statement. Most evidence was limited, mainly because of few studies. The assessment of moderately strong evidence for the effect of introduction of legislation on injuries/fatalities and inspection/enforcement activity on injuries/fatalities and compliance was due to several studies pointing in the same direction.

Discussion

This review indicates that OSH activities such as the introduction and enforcement of legislation and workplace inspections are effective in reducing injuries and improving compliance. For training, campaigns and the introduction of specific technical devices there are too few studies to provide stronger evidence. Even though the evidence was evaluated as limited or moderately strong in the modified GRADE system, the picture seems rather uniform, especially regarding the introduction of legislation and workplace inspections. The GRADE system weighs randomized controlled studies as the highest evidence, but very few RCT have been performed in the OSH area. This is not surprising because it is difficult and sometimes even unethical to perform RCT at the workplace level, and the complexity of many workplace interventions and contexts render RCT unfeasible in the real world. Other alternative designs for the evaluation of occupational health interventions have recently been proposed (83).

Tompa et al (5) also reviewed the literature and used a “best evidence” synthesis to assess the strength of evidence. They concluded that there is strong evidence for several OHS policy levers in terms of reducing injuries and/or increasing compliance with legislation. A Cochrane review from 2013 (6) used the GRADE approach and assessed the quality of the evidence as low to very low.

This discrepancy between the two reviews is caused by different methodology in both quality assessment of individual studies and evidence synthesis and the use of different studies. We adopted Tompa et al’s assessment of individual studies and we also used the GRADE approach, but in a modified version, where the agreement of several studies could upgrade GRADE from limited to moderately strong (11). Our use of meta-regression with pooled estimates was performed in very broad categories. The heterogeneity of studies in each of the five domains legislation, inspection, training, campaigns and device was large, with I2 values up to 100%. Part of the strong heterogeneity is due to large differences in magnitude of effect but differences in settings, content of interventions and definition of outcomes also contribute. The pooled estimates must be interpreted with caution, but they nevertheless provide an indication of direction and magnitude of the association (84). There were 17 studies of legislation from US, UK, Spain, Canada and Germany and the results may be applicable to developed countries around the world. Legislation covered more broad regulation and some specific regulations such as self-regulation and safety standards; 11 studies investigated injuries and fatalities.

For inspections we included 23 studies from US, Italy, Sweden and Canada. In these countries, the OSH administration functions by identifying workplace hazards, promulgating rules to regulate those hazards and ensuring compliance through enforcements, such as inspections, citations, and perhaps penalties for noncompliance. Initial inspections, follow-up inspections, and complaint and accident- prompted inspections resulted in higher compliance rates compared to the average effect of any other type of inspections. Inspections with citations or with more penalties resulted in fewer injuries and more compliance.

The training domain included 7 studies: 6 from the US and 1 from India. All the studies showed an effect of different forms of training. The introduction of technical devices in the form of mechanical lifts was investigated in 3 US studies, which showed a positive intervention effect. The scarcity of studies and the risk of publication bias rules out any substantive evidence statements.

In our search, we found a single study on psychosocial risk factors that was relevant according to our criteria (33). The lack of studies of interventions to prevent/reduce psychosocial risk factors and their effects on psychological health should probably be seen in the light of difficulties in both exposure assessment and valid outcomes.

A lot of effort has been put into studies about cognitive behavioral interventions, mindfulness and other individual approaches to intervene on psychological health at the workplace, but those approaches are not a part of the working environment authorities’ jurisdiction and not part of this review. We found 5 studies on MSD outcomes and intervention studies to reduce MSD. One study reported that from 1998–2003 there was a reduction in reported ergonomic exposures among workplaces in the highest hazard industries after the Washington State ergonomics rule was enacted. Following the rule’s repeal in 2003, however, hazardous exposures increased. While more workplaces reported taking steps to reduce exposures between 1998–2001, this gain was reversed in 2003 and 2005. Employers who took steps reported positive results in injury and absenteeism reduction (37). In another study from the same group, there was no evidence of MSD injury reduction following a state OSH program activity in the workplace in the year following the activity year. However, they found mixed evidence for a reduction of MSD injuries beginning in the second year following the program activity year and suggested that cases of MSD injuries respond more slowly to the intervention and need a longer and more delayed period of follow-up (51). In 2 studies introducing mechanical lifts in different care settings, a decreased rate of musculoskeletal injuries and reduction in lost workdays was shown (80, 81). An earlier Cochrane review on the effectiveness of manual material handling advice and training and the provision of assistive devices in preventing and treating back pain found no evidence for assistive devices (85). This discrepancy was due to inclusion of different studies and the few studies about MSD preclude any conclusions of strength of evidence, and further studies are warranted. Most intervention studies about MSD have included exercise therapy, behavioral change techniques, workplace adaptations and provision of additional services (86), which are outside the scope of this review. Difficulties arise in this literature in defining relevant OSH regulation and defining relevant outcomes to measure. In countries with good registers, such as the Nordic countries, there are probably opportunities to investigate a variety of outcomes (eg, inspections, MSD claims and register-based disease occurrence) in a meaningful way to gain more insight.

In Denmark as well as other Western countries, a myth that OSH activities are ineffective has been around for at least a decade or more, and opponents have proposed that voluntary efforts or consultative activities would be more effective. The results from this review indicate that general and specific legislation and workplace inspections with or without penalties are indeed effective means to improve the working environment. The recommendations for OSH would be to strengthen and improve those known instruments rather than eliminate enforcement activities.

Funding

The Danish Working Environment Authority provided funding for this project (J.nr. 20150077671). The authors remained independent of the funders in their reporting of results.

References

1 

GBD 2015 Risk Factors Collaborators, Forouzanfar, MH, Afshin, A, Alexander, LT, Anderson, HR, Bhutta, ZA, et al. (2016). Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990-2015:a systematic analysis for the Global Burden of Disease Study 2015. Lancet, 388, 1659-724, https://doi.org/10.1016/S0140-6736(16)31679-8.

2 

Haagsma, JA, Graetz, N, Bolliger, I, Naghavi, M, Higashi, H, Mullany, EC, et al. (2016). The global burden of injury:incidence, mortality, disability-adjusted life years and time trends from the Global Burden of Disease study 2013. Inj Prev, 22(1), 3-18, https://doi.org/10.1136/injuryprev-2015-041616.

3 

GBD 2015 DALYs and HALE Collaborators, Kassebaum, NJ, Arora, M, Barber, RM, Bhutta, ZA, Brown, J, Carter, A, et al. (2016). Global, regional, and national disability-adjusted life-years (DALYs) for 315 diseases and injuries and healthy life expectancy (HALE), 1990-2015:A systematic analysis for the global burden of disease study 2015. Lancet, 388, 1603-58, https://doi.org/10.1016/S0140-6736(16)31460-X.

4 

Tompa, E, Trevithick, S, & McLeod, C. (2007). Systematic review of the prevention incentives of insurance and regulatory mechanisms for occupational health and safety. Scand J Work Environ Health, 33(2), 85-95, https://doi.org/10.5271/sjweh.1111.

5 

Tompa, E, Kalcevich, C, Foley, M, McLeod, C, Hogg-Johnson, S, Cullen, K, et al. (2016). A systematic literature review of the effectiveness of occupational health and safety regulatory enforcement. Am J Ind Med, 59(11), 919-33, https://doi.org/10.1002/ajim.22605.

6 

Mischke, C, Verbeek, JH, Job, J, Morata, TC, Alvesalo-Kuusi, A, Neuvonen, K, et al. (2013, Aug). Occupational safety and health enforcement tools for preventing occupational diseases and injuries. Cochrane Database of Systematic Reviews, 30(8), CD010183, https://doi.org/10.1002/14651858.CD010183.pub2.

7 

van der, Molen HF, Basnet, P, Hoonakker, PLT, Lehtola, MM, Lappalainen, J, Frings-Dresen, MHW, Haslam, R, & Verbeek, JH. (2018). Interventions to prevent injuries in construction workers. Cochrane Database of Systematic Reviews [2], Art. No.:CD006251. https://doi.org/10.1002/14651858.CD006251.pub4.

8 

Safe work Australia. (2013). The effectiveness of work health and safety interventions by regulators:a literature review. Review. Canberra: Safe Work Australia.

9 

Hasle, P, Møller, N, Hvid, HS, Seim, R, & Scheller, VK. (2015). Hvidbog om arbejdsmiljørådgivning [White paper on Working Environment Counseling]. København: Arbejdsmiljørådgiverne.

10 

Guyatt, GH, Oxman, AD, Vist, GE, Kunz, R, Falck-Ytter, Y, Alonso-Coello, P, et al. (2008). GRADE:an emerging consensus on rating quality of evidence and strength of recommendations. BMJ, 336(7650), 924-6, https://doi.org/10.1136/bmj.39489.470347.AD.

11 

(2017, [cited 2/7/2017]). Assessment of methods in health care - A Handbook [Internet], Stockholm, Swedish agency for health technology assessment and assessment of social sciences, Available from: http://www.sbu.se/globalassets/eng_metodboken.pdf.

12 

Borenstein, M, Hedges, L, Higgins, J, & Rothstein, H. (2009). Introduction to Meta-Analysis (First ed). Chichester, West Sussex, United Kingdom: John Wiley & Sons Ltd.

13 

Altman, DG, & Bland, JM. (2011). How to obtain the confidence interval from a P value. BMJ, 343, d2090, https://doi.org/10.1136/bmj.d2090.

14 

Greenhalgh, T, & Peacock, R. (2005). Effectiveness and efficiency of search methods in systematic reviews of complex evidence:audit of primary sources. BMJ, 331, 1064-5, https://doi.org/10.1136/bmj.3↼.593461.68.

15 

Brødsgaard, SL, & Mortensen, P. (2001). [Reduction of threshold limit values for nitrogen oxide in Danish hospitals 1986-2000]. København: Arbejdstilsynet. Nedsættelse af grænseværdien for lattergas –effekt påeksponeringsforhold ved udvalgte danske sygehuse 1986-2000.

16 

Kim, KJ. (1991). The political economy of OSHA regulation:a pooled time series analysis [dissertation]. Athens (Georgia): University of Georgia.

17 

Brødsgaard, SL, & Mortensen, P. (2001). Eksponering af anæstesigasser påudvalgte danske sygehuse 1986-2000. [Exposure to anesthesia gasses in Danish hospitals 1986-2000], København, Arbejdstilsynet.

18 

Refslund, B. (2016). Reguleringspolitik og virksomhedshomogenitet –en konfigurationel komparativ analyse af arbejdsmiljøreformen i 2010 [Regulatory policy and corporate homogeneity - a configurational comparative analysis of the work environment reform in 2010]. Politika, 3, 320-39.

19 

Kvorning, LV, & Hasle, P. (2014). 11th International Symposium on Human Factors in Organisational Design and Management (ODAM) 46th Annual Nordic Ergonomics Society (NES) 2014. Santa Monica, California, USA: Denmark. Copenhagen:IEA Press. The impact of occupational health and safety policy interventions tailored to small enterprises in Denmark.

20 

Weil, D. The Impact of Osha Enforcement on Regulatory Compliance in the U.S. Construction Industry (July 1999), Available at SSRN: https://ssrn.com/abstract=171653 or http://dx.doi.org/10.2139/ssrn.171653.

21 

Jamieson, S, Reeve, B, Schofield, T, & McCallum, R. (2010). OHS Prosecutions:Do they deter other companies from offending? J Health Saf Environ, 26(3), 213-31.

22 

Biddle, EA, Newell, S, & Hendricks, S. (2008). Does a safety and health management system contribute to a safer work environment?, Pittsburgh PA, NIOSH, [Internet]. Available from: https://www.cdc.gov/niosh/noirs/2008/pdfs/NOIRS2008Abstracts.pdf.

23 

Deloitte. (2011). Dialog med virksomheder. Evaluering af Arbejdstilsynets dialog med virksomheder om arbejdsulykker [Dialogue with companies. Evaluation of the dialogue between the Danish Working Environment Authority and companies about accidents at work]. København: Deloitte Business Consulting A/S.

24 

Arbejdstilsynet. (2016). Evaluering af tilsyn med midlertidige og skiftende arbejdssteder. [Evaluation of inspection of temporary and shifting working places], København, Arbejdstilsynet.

25 

Pedersen, F, Mehlsen, S, Jensen, MF, & Nielsen, K. (2010). Evaluering af Arbejdstilsynets dialogmøder med bygherrer. [Evaluation of dialogue meetings between the Danish Working Environment Authority and building owners]. København: Grontmij.

26 

Eltard, D. (2005). Status over effektevaluering i Arbejdstilsynet 2003 og 2004 [Status evaluation of impact in the Danish Working Environment Authority 2003 and 2004], København, Arbejdstilsynet.

27 

Arbejdstilsynet. (2017). Effektanalyse af Arbejdstilsynets incidenstilsyn 2013. [Impact analysis of the incidence supervision of the Danish Working Environment Authority 2013], København, Arbejdstilsynet.

28 

Arbejdstilsynet. (2016). Effekt af tilsynsformer og reaktioner påforekomsten af arbejdsulykker. [Impact of inspection systems and reactions to the prevalence of occupational accidents], København, Arbejdstilsynet.

29 

Arbejdstilsynet. (2016). Resultaterne af målretningen af det risikobaserede tilsyn, første halvår 2016. [The results of targeting the risk-based inspection, the first six months of 2016], København, Arbejdstilsynet, Rapport nr.:20175100085.

30 

Aldrich, P. (2016). [The longer-term impact evaluation of the risk-based inspection]. København: COWI. Evalueringen af effekten af det risikobaserede påmellemlangt sigt, Rapport nr.:A060970.

31 

Bradbury, JC. (2006). Regulatory Federalism and Workplace Safety:Evidence from OSHA Enforcement, 1981–1995. J Reg Econ, 29(2), 211-24, https://doi.org/10.1007/s11149-006-6036-1.

32 

Bulzacchelli, MT, Vernick, JS, Webster, DW, & Lees, PSJ. (2007). Effects of the Occupational Safety and Health Administration's control of hazardous energy (lockout/tagout) standard on rates of machinery-related fatal occupational injury. Inj Prev, 13(5), 334-8, https://doi.org/10.1136/ip.2007.015677.

33 

Casteel, C, Peek-Asa, C, Nocera, M, Smith, JB, Blando, J, Goldmacher, S, et al. (2009). Hospital employee assault rates before and after enactment of the california hospital safety and security act. Ann Epidemiol, 19(2), 125-33, https://doi.org/10.1016/j.annepidem.2008.10.009.

34 

Monforton, Celeste, DrPH, MPH, & Windsor, Richard, PhD, MPH. (2010). An Impact Evaluation of a Federal Mine Safety Training Regulation on Injury Rates Among US Stone, Sand, and Gravel Mine Workers:An Interrupted Time-Series Analysis. Am J Public Health, 100(7), 1334-40, https://doi.org/10.2105/AJPH.2009.178301.

35 

Suruda, A, Whitaker, B, Bloswick, D, Philips, P, & Sesek, R. (2002). Impact of the OSHA Trench and Excavation Standard on Fatal Injury in the Construction Industry. J Occup Environ Med, 44(10), 902-5, https://doi.org/10.1097/00043764-200210000-00007.

36 

Yassin, AS, & Martonik, JF. (2004). The effectiveness of the revised scaffold safety standard in the construction industry. Safety Science, 42(10), 921-31, https://doi.org/10.1016/j.ssci.2004.05.001.

37 

Foley, M, Silverstein, B, Polissar, N, & Neradilek, B. (2009). Impact of implementing the washington state ergonomics rule on employer reported risk factors and hazard reduction activity. Am J Ind Med, 52(1), 1-16, https://doi.org/10.1002/ajim.20650.

38 

Jagger, J, Berguer, R, Phillips, EK, Parker, G, & Gomaa, AE. (2010). Increase in Sharps Injuries in Surgical Settings Versus Nonsurgical Settings after Passage of National Needlestick Legislation. J Am Coll Surg, 210(4), 496-502, https://doi.org/10.1016/j.jamcollsurg.2009.12.018.

39 

LaMontagne, AD, Oakes, JM, & Lopez Turley, R.N. (2004). Long-Term Ethylene Oxide Exposure Trends in US Hospitals:Relationship With OSHA Regulatory and Enforcement Actions. Am J Public Health, 94(9), 1614-9, https://doi.org/10.2105/AJPH.94.9.1614.

40 

May, DC. (2002). Results of an OSHA Ergonomic Intervention Program in New Hampshire. Appl Occup Environ Hyg, 17(11), 768-73, https://doi.org/10.1080/10473220290096014.

41 

Menéndez, CC, Amandus, H, Damadi, P, Wu, N, Konda, S, & Hendricks, S. (2014). Cities with camera-equipped taxicabs experience reduced taxicab driver homicide rates:United States, 1996–2010. Crime Science, 3(1), 4, https://doi.org/10.1186/s40163-014-0004-3.

42 

Turner, S, McNamee, R, Agius, R, Wilkinson, SM, Carder, M, & Stocks, SJ. (2012). Evaluating interventions aimed at reducing occupational exposure to latex and rubber glove allergens. Occup Environ Med, 69(12), 925-31, https://doi.org/10.1136/oemed-2012-100754.

43 

Stocks, SJ, McNamee, R, Turner, S, Carder, M, & Agius, RM. (2013). Assessing the impact of national level interventions on workplace respiratory disease in the UK:part 1—changes in workplace exposure legislation and market forces. Occup Environ Med, 70(7), 476-82, https://doi.org/10.1136/oemed-2012-101123.

44 

Arocena, P, & Nunez, I. (2009). The effect of occupational safety legislation in preventing accidents at work:traditional versus advanced manufacturing industries. Environment and Planning C:Government and Policy, 27, 159-74, https://doi.org/10.1068/c0758r.

45 

Finger, S, & Gamper-Rabindran, S. (2013). Testing the effects of self-regulation on industrial accidents. Journal Regulatory Economics, 43(2), 115-46, https://doi.org/10.1007/s11149-012-9201-8.

46 

Kötz, H, & Schäfer, H. (1993). Economic incentives to accident prevention:An empirical study of the German sugar industry. Int Rev Law Econ, 13(1), 19-33, https://doi.org/10.1016/0144-8188(93)90019-2.

47 

Lipscomb, HJ, Li, L, & Dement, J. (2003). Work-related falls among union carpenters in Washington State before and after the Vertical Fall Arrest Standard. Am J Ind Med, 44(2), 157-65, https://doi.org/10.1002/ajim.10254.

48 

Baggs, J, Silverstein, B, & Foley, M. (2003). Workplace health and safety regulations:Impact of enforcement and consultation on workers'compensation claims rates in Washington State. Am J Ind Med, 43(5), 483-94, https://doi.org/10.1002/ajim.10209.

49 

Boden, LI. (1985). Government regulation of occupational safety:underground coal mine accidents 1973-75. Am J Public Health, 75(5), 497-501, https://doi.org/10.2105/AJPH.75.5.497.

50 

Chen, GX. (2008). Impact of federal compliance reviews of trucking companies in reducing highway truck crashes. Accid Anal Prev, 40, 238-45, https://doi.org/10.1016/j.aap.2007.06.002.

51 

Foley, M, Fan, ZJ, Rauser, E, & Silverstein, B. (2012). The impact of regulatory enforcement and consultation visits on workers'compensation claims incidence rates and costs, 1999–2008. Am J Ind Med, 55(11), 976-90, https://doi.org/10.1002/ajim.22084.

52 

Gray, WB, & Jones, CA. (1991). Longitudinal Patterns of Compliance with Occupational Safety and Health Administration Health and Safety Regulations in the Manufacturing Sector. J Hum Resour, 26, 623-53, https://doi.org/10.2307/145978.

53 

Gray, WB, & Scholz, JT. (1993). Does Regulatory Enforcement Work? A Panel Analysis of OSHA Enforcement. Law & Society Review, 27(1), 177-213, https://doi.org/10.2307/3053754.

54 

Gray, WB, & Mendeloff, JM. (2005). The Declining Effects of Osha Inspections on Manufacturing Injuries, 1979–1998. Ind Labor Relat Rev, 58(4), 571-87, https://doi.org/10.1177/001979390505800403.

55 

Haviland, A, Burns, R, Gray, W, Ruder, T, & Mendeloff, J. (2010). What kinds of injuries do OSHA inspections prevent? J Safety Res, 41, 339-45, https://doi.org/10.1016/j.jsr.2010.03.005.

56 

Haviland, AM, Burns, RM, Gray, WB, Ruder, T, & Mendeloff, J. (2012). A new estimate of the impact of OSHA inspections on manufacturing injury rates, 1998–2005. Am J Ind Med, 55, 964-75, https://doi.org/10.1002/ajim.22062.

57 

Ko, K, Mendeloff, J, & Gray, W. (2010). The role of inspection sequence in compliance with the US Occupational Safety and Health Administration's (OSHA) standards:Interpretations and implications. Regul Gov, 4, 48-70, https://doi.org/10.1111/j.1748-5991.2010.01070.x.

58 

Levine, DI, Toffel, MW, & Johnson, MS. (2012). Randomized Government Safety Inspections Reduce Worker Injuries with No Detectable Job Loss. Science, 336, 907-11, https://doi.org/10.1126/science.1215191.

59 

Mendeloff, J, & Gray, WB. (2005). Inside the Black Box:How do OSHA Inspections Lead to Reductions in Workplace Injuries? Law Policy, 27, 219-37, https://doi.org/10.1111/j.1467-9930.2005.00198.x.

60 

Nelson, NA, Kaufman, J, Kalat, J, & Silverstein, B. (1997). Falls in construction:Injury rates for OSHA-inspected employers before and after citation for violating the Washington state fall protection standard. Am J Ind Med, 31, 296-302, https://doi.org/10.1002/(SICI)1097-0274(199703)31:3<296::AID-AJIM5>3.0.CO;2-W.

61 

Ruser, JW, & Smith, RS. (1991). Reestimating Osha's Effects:Have the Data Changed? J Hum Resour, 26, 212-35, https://doi.org/10.2307/145921.

62 

Smitha, MW, Kirk, KA, Oestenstad, KR, Brown, KC, & Lee, SP. (2001). Effect of State Workplace Safety Laws on Occupational Injury Rates. J Occup Environ Med, 43, 1001-10, https://doi.org/10.1097/00043764-200112000-00002.

63 

Weil, D. (2001). Assessing OSHA Performance:New Evidence from the Construction Industry. J Pol Anal Manage, 20(4), 651-74, https://doi.org/10.1002/pam.1022.

64 

Agnesi, R, Fedeli, U, Bena, A, Farina, E, Sarto, F, Veronese, M, et al. (2016). Statutory prevention of work injuries in Italy:an effectiveness evaluation with interrupted time series analysis in a sample of 5000 manufacturing plants from the Veneto region. Occup Environ Med, 73(5), 336-41, https://doi.org/10.1136/oemed-2015-103227.

65 

Farina, E, Bena, A, Fedeli, U, Mastrangelo, G, Veronese, M, & Agnesi, R. (2016). Public injury prevention system in the Italian manufacturing sector:What types of inspection are more effective? Am J Ind Med, 59(4), 315-21, https://doi.org/10.1002/ajim.22576.

66 

Björkdahl, C, Wester-Herber, M, & Hansson, SO. (2008). Effects of Workplace Inspections:The Swedish Noise Campaign. Policy and Practice in Health and Safety, 6(1), 55-63, https://doi.org/10.1080/14774003.2008.11667715.

67 

Kemmlert, K. (1996). Prevention of occupational musculo-skeletal injuries. Labour Inspectorate investigation. Scand J Rehabil Med Suppl, 35, 1-34.

68 

Burstyn, I, Jonasi, L, & Wild, TC. (2010). Obtaining compliance with occupational health and safety regulations:a multilevel study using self-determination theory. Int J Environ Health Res, 20(4), 271-87, https://doi.org/10.1080/09603121003663461.

69 

Hogg-Johnson, S, Robson, L, Cole, DC, Amick, BC, Tompa, E, Smith, PM, et al. (2012). A randomised controlled study to evaluate the effectiveness of targeted occupational health and safety consultation or inspection in Ontario manufacturing workplaces. Occup Environ Med, 69(12), 890-900, https://doi.org/10.1136/oemed-2011-100333.

70 

Gray, WB, & Jones, CA. (1991). Are Osha Health Inspections Effective?A Longitudinal Study in the Manufacturing Sector. Rev Econ Stat, 73(3), 504-8, https://doi.org/10.2307/2109575.

71 

Anger, WK, Patterson, L, Fuchs, M, Will, LL, & Rohlman, DS. (2009). Learning and Recall of Worker Protection Standard (WPS) Training in Vineyard Workers. J Agromedicine, 14(3), 336-44, https://doi.org/10.1080/10599240903042057.

72 

Arnold, SF, Stenzel, M, Drolet, D, & Ramachandran, G. (2016). Using checklists and algorithms to improve qualitative exposure judgment accuracy. J Occup Environ Hyg, 13(3), 159-8, https://doi.org/10.1080/15459624.2015.1053892.

73 

Dong, X, Entzel, PJ, Men, Y, Chowdhury, R, & Schneider, S. (2004). Effects of safety and health training on work-related injury among construction laborers. J Occup Environ Med, 46, 1222-8.

74 

Parker, DL, Brosseau, LM, Samant, Y, Xi, M, Pan, W, Haugan, D, et al. (2009). A randomized, controlled intervention of machine guarding and related safety programs in small Metal-Fabrication Businesses. Public Health Rep, 124, 90-100, https://doi.org/10.1177/00333549091244S111.

75 

Schoenfisch, AL, Lipscomb, H, Sinyai, C, & Adams, D. (2017). Effectiveness of OSHA Outreach Training on carpenters'work-related injury rates, Washington State 2000–2008. Am J Ind Med, 60(1), 45-57, https://doi.org/10.1002/ajim.22665.

76 

Stokols, D, McMahan, S, Clitheroe, HC, Jr, & Wells, M. (2001). Enhancing corporate compliance with worksite safety and health legislation. J Saf Res, 32(4), 441-63, https://doi.org/10.1016/S0022-4375(01)00063-9.

77 

Sam, KG, Andrade, HH, Pradhan, L, Pradhan, A, Sones, SJ, Rao, PGM, et al. (2008). Effectiveness of an educational program to promote pesticide safety among pesticide handlers of South India. Int Arch Occup Environ Health, 81(6), 787-95, https://doi.org/10.1007/s00420-007-0263-3.

78 

Mancini, G, Baldasseroni, A, Laffi, G, Curti, S, Mattioli, S, & Violante, FS. (2005). Prevention of Work Related Eye Injuries:Long Term Assessment of the Effectiveness of a Multicomponent Intervention among Metal Workers. Occup Environ Med, 62(12), 830-5, https://doi.org/10.1136/oem.2004.019570.

79 

Gadomski, A, Burdick, P, Jenkins, P, & Ackerman, S. (2006). Efficacy of the North American Guidelines for Children's Agricultural Tasks in Reducing Childhood Agricultural Injuries. Am J Public Health, 96(4), 722-7, https://doi.org/10.2105/AJPH.2003.035428.

80 

Evanoff, B, Wolf, L, Aton, E, Canos, J, & Collins, J. (2003). Reduction in injury rates in nursing personnel through introduction of mechanical lifts in the workplace. Am J Ind Med, 44(5), 451-7, https://doi.org/10.1002/ajim.10294.

81 

Collins, JW, Wolf, L, Bell, J, & Evanoff, B. (2004). An evaluation of a “best practices” musculoskeletal injury prevention program in nursing homes. Inj Prev, 10(4), 206-11, https://doi.org/10.1136/ip.2004.005595.

82 

Li, J, Wolf, L, & Evanoff, B. (2004). Use of mechanical patient lifts decreased musculoskeletal symptoms and injuries among health care workers. Inj Prev, 10(4), 212-6, https://doi.org/10.1136/ip.2003.004978.

83 

Schelvis, RM, Wiezer, NM, Blatter, BM, van Genabeek, JA, Oude Hengel, KM, Bohlmeijer, ET, et al. (2016). Evaluating the implementation process of a participatory organizational level occupational health intervention in schools. BMC Public Health, 16(1), 1212, https://doi.org/10.1186/s12889-016-3869-0.

84 

Guyatt, GH, Oxman, AD, Kunz, R, Woodcock, J, Brozek, J, Helfand, M, et al. (2011). GRADE guidelines:7. Rating the quality of evidence—inconsistency. J Clin Epidemiol, 64(12), 1294-302, https://doi.org/10.1016/j.jclinepi.2011.03.017.

85 

Verbeek, JH, Martimo, KP, Karppinen, J, Kuijer, PPFM, Viikari-Juntura, E, & Takala, EP. Manual material handling advice and assistive devices for preventing and treating back pain in workers. Cochrane Database of Systematic Reviews 2011, Issue 6. Art. No.:CD005958, https://doi.org/10.1002/14651858.CD005958.pub3.

86 

Palmer, KT, Harris, EC, Linaker, C, Barker, M, Lawrence, W, Cooper, C, et al. (2012). Effectiveness of community- and workplace-based interventions to manage musculoskeletal-related sickness absence and job loss:a systematic review. Rheumatology (Oxford), 51(2), 230-42, https://doi.org/10.1093/rheumatology/ker086.


Additional material