Review

Scand J Work Environ Health 2018;44(5):443-457    pdf

doi:10.5271/sjweh.3731

Content and quality of workplace guidelines developed to prevent mental health problems: results from a systematic review

by Nexø MA, Kristensen JV, Grønvad MT, Kristiansen J, Poulsen OM

Objectives A wide range of guidelines have been developed to prevent work-related mental health problems (MHP), but little is known about the quality of such guidelines. We systematically reviewed the content and quality of workplace guidelines aiming to prevent, detect, and/or manage work-related MHP.

Methods We conducted systematic online and database searches (MEDLINE; Web of Science; PsychNET; occupational safety and health databases) to identify guidelines. Eligibility criteria included guidelines recommending primary, secondary, or tertiary preventive interventions to be implemented at the workplace by employers, employees or organizational staff. A minimum of minimum three independent reviewers assessed the quality of guidelines using the Guidelines for Research and Evaluation (AGREE II). Guidelines rated ≥65% with regards to domain I, II, and III were considered to be of good developmental quality.

Results Seventeen guidelines were quality assessed. Guidelines mainly targeted employers: eight guidelines recommended primary preventive interventions (eg, reduction of psychosocial hazards by risk management procedures), three recommended tertiary (eg, stay at work or return to work procedures for management), and six recommended a combination of primary, secondary and tertiary interventions (eg, facilitate return to work by increasing mental health literacy of all staff and coordination of sick-listed employees). Four guidelines had developed recommendations of good quality, but the evidence of two guidelines was outdated and studies documenting the effect of implementation were not yet available.

Conclusions Few guidelines have been developed with sufficient rigor to help employers prevent or manage work-related MHP and evidence of their effectiveness remains scarce.

The following article refers to this text: 2018;44(5):441-442

Mental health problems (MHP) severely challenge work force productivity (1). Anxiety, depression and stress-related disorders are common and the leading causes of work disability and early retirement in most Western countries (25). The workplace plays an essential role in relieving the burden of disability due to MHP (6). Therefore several international organizations have called for new policies, regulations and accompanying guidelines to help prevent work-related MHP (7, 8).

Guidelines providing evidence-based recommendations may enable workplaces to prevent work-related MHP in at least four ways. Primary preventive interventions aim to prevent MHP before they develop, by either reducing or eliminating exposure to occupational risks (9) or promoting positive factors that make the organization, teams or the individual employee more resilient to workplace stressors (10, 11). Secondary preventive interventions target individuals at risk of developing MHP. The workplace can intervene early when an employee exhibits signs of MHP, which may relieve symptoms and prevent unnecessary sickness absence (12). Tertiary preventive interventions aim to manage and rehabilitate workers with MHP, who need sick-leave due to MHP. Workplace interventions facilitating employees return to work (RTW) may accelerate recovery and prevent prolonged or recurrent sick-leave (13). Finally, recent theoretical developments suggest that to achieve the desired work- and health-related outcomes a combination of primary along with secondary or tertiary preventive interventions is necessary to achieve the desired effects (14).

Workplace interventions involve multiple disciplines and the effect depends on the complex interplay between organizational, environmental and individual factors (15). Although the effects are highly context-dependent, a few workplace interventions have been identified in the research literature to effectively relieve or manage work-related stress (16). Guidelines can in this regard be useful instruments that convert the best available evidence into practical advice that assist employers in best practice.

The extent to which the statements in the guideline are adequately developed (eg, evidence-based) help determine whether the guideline is effective in achieving the desired occupational health outcomes (17). Although a wide range of guidelines have been developed in recent years (7), little attention has been paid to their quality.

To our knowledge, no study has yet evaluated the quality of guidelines that aim to guide employers in how to prevent work-related MHP. However, one review has systematically assessed the quality of guidelines involving multiple levels of prevention with regards to their comprehensiveness (18). They concluded that the developmental process of guidelines lacked rigor and mostly focused on individual as opposed to organizational means of prevention. Two reviews systematically assessed guidelines that facilitated RTW (19, 20). Joosen et al (19) only evaluated guidelines developed for occupational physicians and the results are therefore not applicable to interventions that can be implemented by employers. Dewa et al (20) evaluated the developmental quality of three best practice guidelines. All reviews concluded that the content of guidelines was complementary, but few met minimum standards for development and reporting quality. Since only best practice guidelines published until 2014 were eligible for inclusion, a new review is needed to enable updated information on the quality of available guidelines and identify needs for improvement.

This study aimed to: (i) systematically review the developmental quality of guidelines providing recommendations for actors at the workplace (top and first line managers, organizational staff such as HR personnel, colleagues) to prevent work related MHP, detect and manage early signs of MHP in employees, or facilitate return to work; and (ii) compare the content of recommended interventions included in guidelines and the reported evidence underpinning the expected outcomes of interventions.

Methods

This study was a systematic review following the general principles of PRISMA (21). The review was carried out at the National Research Centre for the Working Environment (NRCWE) from January to August 2016.

Systematic literature search

Since conventional database searches have previously shown to be ineffective in identifying occupational health guidelines (19), we conducted a systematic search of the grey literature in addition to a systematic database search.

Grey literature search

Two scientific assistants performed a general Google search along with a selective web search between May and July 2016.

General Google search

We searched for guidelines in English with English keywords via google.com (workplace, work, occupational, mental health, wellbeing, stress, psychological, depression, anxiety, common mental disorders, national, standard, guidelines, return to work). These keywords were combined into 24 different search strings. For each search string, the first 50 hits were examined. Only unique references were registered in each search. The primary searches often suggested links to alternative websites and, if relevant, these were further examined. We also searched specifically for guidelines in Danish, Swedish and Norwegian, using Danish, Swedish and Norwegian keywords for searches at google.dk, google.se and google.no.

Selective web search

We searched for guidelines on the websites of selected occupational health and safety organizations in the Partnership of European Research Institutions on Occupational Safety and Health (PEROSH), websites of international organizations focusing on mental health and work (eg, the International Labor Organization, the European Network for Workplace Health Promotion, the World Health Organization, OECD, the EU, the US (eg, NIOSH), Canada (eg, CCOHS) and Australia (eg, Beyond Blue).

Database search

A librarian at the NRCWE undertook a systematic literature search. The search string was defined by our inclusion/exclusion criteria (table 1) and adapted to the interfaces of five database sources: (i) Medline via the PubMed interface: www.ncbi.nlm.nih.gov/pubmed;PsycNET via the APA host interface: psycnet.apa.org; (iii) Web of Science includes the three databases Science Citation Index Expanded (SCI-EXPANDED), Social Sciences Citation Index (SSCI) & Arts & Humanities Citation Index (A&HCI) and was searched via the host interface: apps.webofknowledge.com; (iv) OSH UPDATE includes the databases CISDOC, HSELINE, NIOSHTIC, RILOSH and was searched via the host interface: www.oshupdate.com; and (v) National Guideline Clearinghouse (NGC) is a public resource for summaries of evidence-based clinical practice guidelines maintained by the American Agency for Healthcare Research and Quality. The NGC was searched via the interface: www.guideline.gov.

Table 1

Inclusion and exclusion criteria of guidelines in accordance with PIPOH (population, intervention, professionals, outcome, health setting).

Inclusion criteria Exclusion criteria
Population: Populations targeted in the recommended interventions Guidelines recommending workplace interventions for employed individuals (eg, the individual employee, specific employee groups/teams, or all employees or employee groups with specific functions such as teams at high risk of psychosocial hazards or management). Guidelines recommending interventions targeting unemployed individuals
Intervention Guidelines recommending interventions that can be implemented at the workplace. They can be at the organizational level (eg, policies, strategic and action based procedures, educational programs, psychosocial hazards, peer support) group or individual level (eg, training to increase individual health, coping or work competences that influence MH) Guidelines recommending interventions outside the workplace (eg, treatment of mental disorders)
Professionals: Individuals responsible for implementing the guideline Guidelines recommending interventions that can be implemented by actors at the workplace (eg, employers, top-management, first line managers, colleagues) or appointed people within the organizations (eg, Human Resource representatives, health and safety representatives, union representatives, employees) Interventions developed for professionals outside the workplace, eg, occupational health professionals, psychiatrists
Outcomes Guidelines recommending interventions that aim to promote MH or prevent MHP (eg, preventing incidence of work related MHP) or associated disability and work related outcomes (eg, organizational excellence, management competences, productivity, sickness absence, retention) Outcomes that only entail work outcomes
Health settinga Guidelines targeting the workplace (Occupational health) Guidelines outside workplace settings, eg, healthcare or social services

a Healthcare setting reframed to health setting.

The database search included articles published until 14 July 2016. Articles were also identified by screening the reference lists of relevant single studies and reviews for potential pertinent titles.

Consultation with experts

We consulted colleagues/experts in the field for relevant guidelines to be included in the review.

Eligibility criteria

Inclusion and exclusion criteria were developed in accordance with PIPOH (population, intervention, professional, outcomes, health setting) (22) (table 1). To be included, guidelines had to be written in English, Danish, Swedish, or Norwegian and published after 1999. The guidelines had to fulfil the definition of a guideline (23) and be systematically developed based on best available evidence or best practice. The guidelines had to recommend interventions that could be implemented by actors at the workplace (eg, employers, employees or organizational staff such as human resource personnel). Interventions at the organizational level (eg, organizational procedures, work conditions) or at the individual level (eg, competence training, stress management) had to target employed individuals. The interventions should prevent work-related MHP or improve mental health and work-related outcomes. We excluded guidelines recommending interventions outside the workplace or required implementation by professionals outside or in the periphery of the workplace. The criteria were pilot tested on ten selected documents.

Selection of guidelines (procedure)

Two research assistants and two researchers with 2−26 years of research experience carried out the review procedure.

Review procedure of documents retrieved from the grey literature

The two research assistants screened and compared the fulltext of those documents that were identified as guidelines published after 1999 for eligibility. A non-blinded second researcher assessed the eligible documents.

Review procedure of documents retrieved from the database search

One researcher performed the title/abstract and fulltext screening for potential eligibility of journal articles from the database search. The researcher first screened for eligibility by title/abstract and then fulltext. A research assistant then screened the selected articles for eligibility.

Data extraction and comparison of guidelines

For each eligible guideline, we extracted information about the type of publication; the methods applied to develop evidence based recommendations (eg, systematic review); methods to involve stakeholders (eg, Delphi study); the type of guideline; the population responsible for implementing the guideline (eg, employers); and the target population (s) intended for the interventions (eg, employees). Since the effects of implementing guidelines have not yet been evaluated, we were unable to extract the effects sizes of guidelines for comparison. However, we extracted the reported main outcomes expected by implementing the interventions. We also extracted the content of those recommendations that could be characterized as interventions. Interventions were defined as formalized activities, programs, procedures or processes at the individual level (eg, training to improve individual competences) or organizational level (eg, formalized procedures, processes to eliminate psychosocial hazards). The characteristics of guidelines and interventions were outlined and compared.

Quality assessment

The quality of each guideline was systematically evaluated following the Guidelines for Research and Evaluation II (AGREE II) (24). The AGREE II is one of the most applied tools to assess clinical guidelines in healthcare settings (2527), and it encompasses a wide variety of quality aspects compared to other tools (28). The AGREE II contains 23 items allocated across six domains: (i) scope and purpose; (ii) stakeholder involvement; (iii) rigor of development; (iv) clarity of presentation; (v) applicability; and (vi) editorial independence. Every domain contains 3−8 items with statements (eg, “the population to whom the guideline is meant to apply is specifically described”) that is scored on a scale from 1 (strongly disagree) to 7 (strongly agree) by a minimum of two independent reviewers. On the basis of the ratings, each domain is scored obtaining a scaled score from 0% (worst possible score) to 100% (best possible score).

To our knowledge, no quality evaluation tool has been developed and validated for occupational health contexts. Although the AGREE II has been developed to evaluate clinical guidelines for healthcare professionals, most of the items are generic and AGREE II has previously been applied in occupational settings (19) However, we rephrased some of the wording on five items to specify the particular populations or complex interdisciplinary interventions applied in a workplace setting. Additionally, based on problems identified at the weekly consensus meetings, we found it necessary to specify the interpretation within an occupational context on 17 of the 23 items to facilitate interrater reliability (see table 2 for a list of all the AGREE II items and adjusted items).

Table 2

AGREE II quality assessment questions. [MHP=mental health problems.] Italics indicate further specifications of items to facilitate understanding of criteria for assessment of guidelinesa

Domains Original AGREE II item Adjustments in formulation of items: Reformulated descriptionb
Scope and purpose 1. The overall objective(s) of the guideline is (are) specifically described
2. The health question(s) covered by the guideline is (are) specifically described The specific assumptions and expected effect achieved by implementing the guideline is/are specifically described
3. The population (patients, public, etc.) to whom the guideline is meant to apply is specifically described The population or groups eg, employees at risk of developing MHP, employees with MHP etc. to whom the guideline is meant to apply is specifically described. In this case the population do not refer to the groups of people who should implement the interventions
Stakeholder involvement 4. The guideline development group includes individuals from all relevant professional groups Examples of relevant professional groups: Worker representatives, employer from selected organizations, managers, occupational health professionals, representatives from the social system
5. The views and preferences of the target population (patients, public, etc.) have been sought Target population is: employees/individuals with occupational health problems, employee representatives
6. The target users of the guideline are clearly defined The appointed individuals/groups at the workplace who are responsible for implementing the guideline
Rigor of development 7. Systematic methods were used to search for evidence In case of complex interventions targeting different groups of employees, eg, primary and tertiary interventions, were systematic methods used to search for all relevant evidence?
8. The criteria for selecting the evidence are clearly described In case of selective review instead of systematic: Are the inclusion and exclusion criteria for selecting the evidence clearly described?
9. The strengths and limitations of the body of evidence are clearly described Specific focus on whether limitations of current level of underlying evidence have been clearly described eg, lack of feasibility and effectiveness evaluation of the recommended workplace interventions
10. The methods for formulating the recommendations are clearly described Description of systematic process or specific methods, for example Delphi, Glaser
11. The health benefits, side effects, and risks have been considered in formulating the recommendations Possible health or work related consequences and risks have been considered in formulating the recommendations. If not written directly: Is it reflected in the guideline, eg,, considerations about how to respect employee confidentiality
12. There is an explicit link between the recommendations and the supporting evidence
13. The guideline has been externally reviewed by experts prior to its publication
14. A procedure for updating the guideline is provided Relevant if stated in any of the published documents
Clarity of presentation 15. The recommendations are specific and unambiguous Considering complex interventions: Precise description of which intervention should be undertaken by who and how it works under which people under which circumstances
16. The different options for management of the condition or health issue are clearly presented The recommended interventions are adequate and realistic considering the targeted occupational health problem/condition
Considering complex interventions: Do the guide deliver solutions to the problems
17. Key recommendations are easily identifiable
Applicability 18. The guideline describes facilitators and barriers to its application All available documents are considered
19. The guideline provides advice and/or tools on how the recommendations can be put into practice eg, health literacy programs, dialogue tools, procedures or refer to places or human resources that aid implementation.
20. The potential resource implications of applying the recommendations have been considered eg, training of employees, external consultancy, psychological, psychiatric aid
21. The guideline presents monitoring and/ or auditing criteria The guideline presents ways to assess whether and/or how the intervention works eg, tools to evaluate cases or surveys of health related and work related outcomes.
Editorial independence 22. The views of the funding body have not influenced the content of the guideline eg, a statement of whether the financing parties have influenced the guidelines
23. Competing interests of guideline development group members have been recorded and addressed eg, a statement clarifying competing interests

a The ratings were compared and scored at weekly consensus meetings and differences in interpretations of specific items were noted. To aid similar interpretation of the items we specified the criteria.

b The occupational health interventions were complex and often used an interdisciplinary approach combining organizational, health and psychosocial aspects. The AGREE II items were not always adaptable to an occupational context and formulations had to be adjusted accordingly.

In this study, a minimum of three independent reviewers scored each guideline. In addition to the AGREE II scores, we also added a consensus score. Based on a discussion of each of the individual AGREE II ratings, a final score was achieved by reaching consensus of one score that best reflected the appropriate rating. In accordance with the AGREE II manual, we calculated scaled scores for each domain of the AGREE ratings:

SJWEH-44-443-g001.tif

The quality of all the guidelines was summarized by categorizing the scaled consensus scores of all domains into four quality levels: high ≥80%; moderate: ≤79% and ≥65%; moderately low ≤64% and ≥50%; poor: ≤49%. The developmental quality of guidelines were considered by comparing differences across all AGREE II domains, but guidelines that scored ≥65% (high or moderate) on domains i–iii were included in the synthesis. Additionally, the reported evidence underpinning the expected outcomes of recommendations (domain iii) was compared across guidelines.

Results

From the 1453 documents retrieved by the database search, 52 documents were identified via title/abstract screening (figure 1). None of the documents identified from the database search were guidelines. A few were journal articles that described the guideline development, but helped identify guidelines via the reference lists (N=13). The same guidelines that were included via the database search were also identified via a Google search or expert advice. A final of 17 guidelines were included for quality assessment.

Figure 1

Flow-chart of review process..

SJWEH-44-443-g002.tif

Comparison of the characteristics of guidelines and ­recommended interventions

The guidelines were from Australia, Canada, Denmark, England, New Zealand, Sweden, the Organization for Economic Cooperation and Development (OECD), the World Health Organization (WHO) and were all available online. [See table 3, guideline numbers: 1 (29), 2 (30), 3 (31, 32), 4 (33), 5 (34), 6 (35), 7 (36), 8 (37), 9 (38, 39), 10 (40), 11 (41), 12 (42), 13 (43), 14 (44), 15 (45), 16 (46), 17 (47).] Two were standards, the remaining were characterized as guidelines, guides or recommendations. They were primarily initiated by governmental bodies or occupational health and safety institutions and some were developed in corporation with research institutes. With a few exceptions, the guidelines were generic and intended to guide employers or managers at all types of workplaces irrespective of size or sector. Eight guidelines had focused on primary prevention, three on tertiary prevention, and six combined primary, secondary and tertiary interventions to achieve the desired effects. None of the guidelines identified in this review had focused solely on secondary prevention.

Table 3

Data extraction of characteristics of guidelines included in review (N=17) [?=not specified; Generic=all types of workplace irrespective of size or sector; OHS=occupational health service; RTW=return to work]

Guideline details Guideline type Target population (specified target groups) Target population(s) of recommended interventions Method(s) to develop evidence-based recommendations Procedure(s) to involve stakeholders Expected main effects of interventions ↓=Reduced
↑=Improved
Guidelines recommending primary preventive interventions (N=8)
1. Canadian standard, Mental Health Commission and Standards Council of Canada; Canada, 2013 Standard (3 levels: shall, should, may) Generic (mainly top management, HR, owner or senior manager if small company) All employees
All first line managers
Peer-reviewed selective review of link between occupational risk factors and MH/Review of legislation Systematic consensus process with key stakeholders ↓Work related MHP, mental injuries, accidents, costs, sickness absence.
↑MH, work culture, productivity, organizational excellency, recruitment, retention
2. CA Ontario Guide, Canadian Mental Health Association, Ontario & University of Toronto; Canada, publication year (?) Guide Generic (first line managers) All employees
All first line managers
Selective review of occupational risk factors and factors affecting, MH and work disability Informal involvement of key stakeholders ↓Work related MHP, injuries, sickness absence, stigma, costs
↑MH, MH literacy, productivity, worker morale, job satisfaction, retention, creativity, recruitment
3. AU Prevent, University of Melbourne; Australia, 2013 Guideline Generic (mainly senior and first line managers) All employees
All first line managers
Selective review of (?) Peer reviewed Delphi study with key stakeholder ↓Work related MHP
↑MH, positive psychosocial factors at work
4. NICE UK, National Institute for Health and Care Excellence, UK; 2009 Guideline Generic (mainly employers and their representatives) All employees
All first line managers
Systematic and thematic reviews of effectiveness of interventions/ cost benefit analyses/Occupational field work/ Informal consensus process with key stakeholders ↓Work related MHP, sickness absence, early retirement, turnover, costs
↑MH; job satisfaction, commitment, productivity, legal requirements, performance, organizational excellency
5. HSE UK, Health & Safety Executive, UK, publication year (?) Standard Large organizations >50 employees (Owner, board director; top management and first line managers) All employees
All first line managers
Scoping review, pilot study to test implementation (?) ↓Work related MHP, Sickness absence
↑MH; Organizational performance; productivity
6. Karolinska SW, Karolinska Institutet; Occupational health professional union; Sweden, 2015 Guideline Generic (mainly employers and OHS professionals) All employees
All first line managers
Systematic review of effect of workplace interventions; Involvement of key stakeholders in development of research questions ↓Costs, sickness absence
↑Productivity; performance; work demands, leadership; social climate; work ability, symptoms wellbeing
7. WHO Prima,, WHO PRIMA-EF consortium; World Health Organization, 2008 Guide Generic. Also focus on work with high risk of violence by third parties (employers and worker representatives) All employees
All first line managers
Selective review of standards/directives; European Council Framework Directive; Consensus process with selected OHS institutes from 2004 and 2007 ↓Work related MHP; bullying ; sickness absence; injuries; medical expenses; insurance premiums; enterprise cost;
↑MH; Innovation; productivity; quality of work; practices; communication; effectiveness, efficiency
8. WHO policy, World Health Organization; 2005 Guide Generic (policymakers, planners and top-management) All employees
Top-management (strategic and policy making level)
Expert opinion of MH and OHS practioners and researchers, business (?) ↓MHP, costs
↑mental health; MH literacy
Guidelines recommending tertiary preventive interventions (N=3)
9. CA Montreal, Laval Montreal, The Institut de recherché Robert-Sauvé et en sécurité du travail; Université Laval, Canada; 2014 Guide Generic (Company executives, managers, HR, work place union groups and OH practitioners) Sick-listed employees due to MHP All levels of Management Selective review; best practice study; Systematic consensus process with key stakeholders/30 interviews ↓Stigma
↑MH; shared and coordinated goals; commitment and positive attitudes towards workers with MHP; organizational learning: Relational skills of managers
10. OHS CA BC; Occupational Health and Safety Agency for Healthcare, Canada; 2010 Best practice guideline Generic Sick-listed employees due to MHP All levels of Management Systematic review of workplace interventions and their effectiveness (in accordance with NICE guideline development) Systematic involvement of key stakeholders ↓Costs, sickness absence
↑QOL, quality of work, retention
11. AU RTW; Center for Youth Mental Health, University of Melbourne; Australia; 2011 Guideline Generic Sick-listed employees MHP All levels of management Selective review of (?) Peer reviewed Delphi study including key stakeholders ↓Stigma, costs, sickness absence
↑Productivity
Guideline details Guideline type Target population (specified target groups) Target population(s) of recommended interventions Method(s) to develop evidence-based recommendations Procedure(s) to involve stakeholders Expected main effects of interventions ↓=Reduced
↑=Improved
Guidelines combining primary, secondary or tertiary preventive interventions (N=6)a
12. CA Vancouver; The Centre for Applied Research, Vancouver; Mental Health Commission of Canada Ontario; Canada, 2012 Best practice recommendations and guide Generic (mainly employers and HR personnel) All employees/ Employees sick-listed due to MHP/All levels of Management Selective review and analysis of models for improving workplace mental health Involvement of scientific and OHP expert opinion ↓Work related MHP, stigma, costs, sickness absence
↑Productivity; well-being; employee resilience; work environment; work/home balance
13. NRCWE CK, National Research Center of the Working Environment; Denmark, 2010 Best practice recommendations Generic All employees/ Employees sick-listed due to MHP/All levels of Management Systematic review of incidence of work related MHP, prevention of work related MHP, effect of RTW interventions Involvement of scientific and OHS experts ↓Work related MHP, sickness absence
↑MH
14. MH AU, Mental Health Commission AU, National Mental Health Commission & Mentally Healthy Workplace Alliance; Australia; 2014 Best practice recommendations Generic All employees/ Employees sick-listed due to MHP/All levels of Management Selective review with graded evidence (?) ↓Work related MHP, injuries, stigma, costs, sickness absence
↑MH; individual resilience; productivity;
15. Public Sector AU, Australian Public Service Commission; Comcare; Australia, publication year (?) Guide Managers in public sector All employees/ Employees sick-listed due to MHP/first line manager Selective review (?); Case study of selected EU countries and EU legislation (?) ↓Work related MHP; injuries; stigma, costs, sickness absence
↑MH; quality of leadership; productivity
16. OSH NZ, Occupational Safety and Health Service, Department of Labour, Wellington; New Zealand, 2003 Guideline Generic, main focus on workplaces with non-modifiable risk factors (e.g. police force, hospitals) All employees/ Employees sick-listed due to MHP/first line management Selective review (from previous guideline published in year 2000) (?) ↓Sickness absence; work related stress; injuries
17. European Commission; European Commission; 2014 Guideline Generic (employers, employees, trade unions, policy makers or professionals) All employees/ Employees sick-listed due to MHP/first line management Selective review of (?); Case study of select EU countries implementation of EU directive (?) ↓Work MHP, injuries, sickness absence, organizational costs (health and social insurers)
↑Productivity; quality of work; return to work; job-person fit; retention

a The guidelines applied the theoretical assumption that a combination of primary along with secondary or tertiary preventive interventions was necessary to achieve the effects.

Primary preventive guidelines

Recommendations for employers

All eight guidelines recommended that the employer should be responsible for implementing interventions at the organizational level (guideline numbers 1–8, table 4). The first one was a mental risk management procedure that continuously and systematically identified and eliminated psychosocial risks. Although the frameworks differed they all recommended that employers should implement a risk management procedure in following steps: (i) make a business case to ensure commitment from management and staff; (ii) develop a mental health policy including a systematic strategy to improve organizational mental health and ensure commitment from all levels in the organization; (iii) involve workers from all levels of the organization and develop a plan, appoint resources, roles and responsibilities; (iv) implement a system that systematically identifies psychosocial hazards of the workplace. These could be organizational (eg, workloads), relational (eg, conflict with manager), or work itself (eg, threats from client); (v) develop and implement a plan that promote positive factors in the work environment and eliminate or reduce the adverse. If possible, the plan should be integrated in existing Occupational Health and Safety (OHS) infrastructure; and (vi) evaluate and adjust the plan continuously.

Table 4

Overview of main interventions recommended by guidelines. [T=tools facilitating implementation of recommendations either provided in guideline or via links to external resources; F=framework explaining the theoretical mechanisms underpinning the recommendation; EVB=evidence based; RTW=return to work; 0=organization; M=management; MH= mental health; MHP=MH problem; OHP=occupational health; SMT=stress management training]

Level of prevention (responsibility for implementation) Guideline [1= CA Standard; 2=CA Ontario; 3=AU Prevent; 4=NICE UK; 5= HSE UK; 6= Karolinska SW; 7= WHO Prima; 8=WHO policy; 9=CA Montreal; 10=OHS CA; 11=AU RTW; 12=CA Vancouver; 13=NRCWE DK; 14=MH AU; 15=Public AU; 16=OHS NZ; 17=European Commission]

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
Primary preventive interventions
 OH risk management procedures of all employees (O/top M) ✓(F/ T) ✓(T) ✓(T) ✓(T) ✓(F/ T) ✓(F/ T) ✓(F) ✓(F/ T) ✓(F) ✓(F)
 MH literacy/first aid programs to all employee (O/top M) ✓(F/ T) ✓(T) ✓(T) ✓(F/ T) ✓(T) ✓(F) ✓(T)
 MH relational and communication skills of all first line M (O/top M) ✓(F/ T) ✓(T) ✓(T) ✓(T)
 Employee resilience procedures and training (O/top M/ first line M) ✓(T) ✓(F) ✓(T)
Secondary preventive interventions
 Screening of all employees (O)/M training in MHP detection of MHP and management of signs of MHP in employees (O/Top M)
Tertiary preventive interventions for employees with MHP (level of responsibility for implementation)
 Procedures to facilitate EVB treatment (O/top M/first line M) ✓(F) ✓(T) ✓(T)
 Stay at work adjustments (first line M) ✓(F) ✓(T) ✓(F)
 Employee SMT (O/top M/first line M) ✓(T) ✓(F)
 RTW policies procedures, plans (O/top M) ✓(F) ✓(F ✓(T) ✓(T) ✓(T)
 Coordinated disability management (first line M or RTW coordinator) ✓(F) ✓(F ✓(T) ✓(T)
 Work counselling (O/top M/first line M and OH/MH professional) ✓(T) ✓(F)
 Gradual RTW (first line M and/or OH/MH professional) ✓(F)
 Peer support/mentoring (first line M/colleagues) ✓(F)
Combined approach
 Guideline must combine primary along with secondary or tertiary to achieve effects a

a Guideline recommended a combined approach but only the primary preventive interventions were eligible for inclusion in this review.

Most guidelines also recommended that employers should implement educational programs to prevent the stigma commonly associated with MHP. Five guidelines also emphasized the special role that first line managers can have in preventing MHP and recommended management training to improve their relational, communicative, and job-design skills to minimize employee stress (guideline numbers 1–5, table 4). The guidelines reported that implementing these two interventions could reduce incidence of work-related MHP and following sickness absence and related costs. A few also expected an impact on organizational excellency and ability to retain workers.

Evidence of primary preventive interventions

Only two guidelines reported that their recommendations were based on a systematic review (guideline number 4 and 6, table 3). The remaining guidelines selected evidence to support statements without considering limitations or contradictory evidence. However, the content of the main recommendations was similar, and the same studies were used to validate statements. The evidence of the management procedure was mainly underpinned by epidemiological studies showing that poorly organized work (eg, job strain from low job control and high demands, stressors intrinsic to the job such as threats of violence by clients), and poor management and/or work climate (eg, workplace bullying, conflicts) increased employees’ risk of developing health problems, such as stress, depression or cardiovascular diseases. Also, evidence suggests that positive work factors (collegial support, rewards, meaning and cohesion) promote well-being (10). Although some work and health related gains could be expected from reducing modifiable adverse work factors (48), the reported effectiveness of implementing the recommended risk management procedure remained undocumented. Similarly, it is not yet possible to identify effective interventions to reduce stigma at the workplace (49). One guideline had provided a cost-benefit analysis (number 4), but the reduced organizational costs expected by most of the guidelines were not documented. Only two guidelines acknowledged the limited evidence available to document the expected effect of implementing recommendations (numbers 4 and 5).

Tertiary preventive guidelines

Recommendations for employers

Three guidelines recommended RTW interventions primarily at the organizational level (guideline numbers 9–11, table 4.). All the guidelines stated that the organization should prepare administrative procedures in case of sick-listing due to MHP. The organization should either appoint a RTW coordinator (guideline numbers 9, 10) or instruct the first line manager (number 11), who was responsible for a RTW plan, to ensure engagement of the employee and coordinate goals for RTW (eg, gradual RTW, work adjustments) shared by all relevant stakeholders (eg, representatives from health system, social system and workplace) during the sick-leave period.

To properly rehabilitate and prevent relapse, two guidelines recommended that employers implemented programs to increase health literacy of all staff and improved job design and communication competences of managers (eg, active listening skills) for the sick-listed employee and made counselling available to resolve any workplace conflicts or provide individual disability management. Despite differences of healthcare systems, most countries experienced challenges with access to evidence based treatment and guidelines therefore recommended that the organizations should facilitate access.

Recommendations for first line managers

First line managers were responsible for informing and engaging coworkers to ensure peer support or necessary mentoring. Stress management training to increase employee resilience was also recommended by one guideline.

Evidence of tertiary preventive interventions

The interventions were expected to improve retention and facilitate the RTW process by improving rehabilitation and reducing the length of sickness absence. Two guidelines sufficiently developed their recommendations on the best available evidence also considering the mixed evidence to support these effects (numbers 9 and 10). The recommendation that workplace should facilitate access to evidence-based treatments or counselling were supported by evidence showing that such interventions were effective in treating MHP (50). Recommendations with regards to RTW mainly focused on factors facilitating RTW (eg, coordination, multidisciplinary approach) (13, 51) and rehabilitation of MHP in the context of work (eg, social support) (52) and barriers in implementing RTW interventions (53). Although this was the best available evidence at the time, the guidelines were developed recent evidence contradicts the positive effects of coordinating RTW (54) and, therefore, this recommendation is no longer valid.

Guidelines combining primary, secondary, tertiary preventive interventions

Recommendations for employers and management

Six guidelines recommended interventions combining organizational and individual interventions at the primary, secondary and tertiary level (guideline numbers 12–17, table 4.). The content of the primary and tertiary interventions overlapped in content with the other guidelines (numbers 1–11), but stressed the importance of targeting a wide range of organizational (eg, risk management) and individual level factors (eg, employee resilience or competence training) to achieve the desired effects. To detect MHP early, one guideline (number 14) suggested routine screenings, another (number 15) recommended to train the first line manager to detect signs of MHP. Others (numbers 13, 14, and 17) also recommended that the employer was responsible for organizing procedures to ensure peer-support, mentoring, or forums that enabled sick-listed or employees at risk to talk to each other. One guideline (number 17) provided thorough recommendations on how the organization could consider person–job fit, by continuous skills-training and rotating work schedules in jobs where psychosocial risks cannot be eliminated (eg, police departments). Implementation of these interventions were expected to mainly prevent work-related MHP and related stigma, reduce costs and promote well-being and retention.

Evidence of a combined approach

Although combining multiple preventive interventions seemed sensible from a political and theoretical perspective (14), only one guideline based their recommendations on a systematic review (number 13) and the evidence supporting the recommendations generally lacked rigor and was highly selective. Most guidelines emphasized that staying at work had a positive effect on employee health without consideration of the context (eg, conflicts at work, bullying) and possibilities of adverse health effects. Although the literature supported the beneficial effect of stress management training or counselling (50), evidence does not support the suggested benefits of screening (55) and the effectiveness of managers detection of MHP early has not yet been evaluated in the context of work.

The quality of guidelines

The difference (from 0–100%) between the average scaled quality assessment scores and the consensus scores of all the guidelines across domains were small and differences were not significant (Mann-Whitney U test, P<0.05). However, the discussion of scores had revealed some differences in the reviewer’s conceptions of the AGREE rating manual. Consequently, the consensus scores were more valid, and these were applied in this review instead of the standard AGREE scores.

The quality of the guidelines varied considerably a cross the domains (table 5). While the quality of scope and purpose was generally high (domain i) the editorial independence (domain vi) was generally poor. The quality of stakeholder involvement (domain ii) and rigor of development (domain iii) varied according to the different levels of preventions presenting more challenges for multiple preventive guidelines. Although the quality of the clarity of presentation (domain iv) was mostly high, the quality of applicability (domain v) varied considerably. The developmental quality (domain i, ii and iii) of the guidelines varied according to the level of prevention (primary, tertiary and combined).

Table 5

Overview of the scaled AGREE II ratings and consensus ratings (0=worst possible score; 100%=best possible score) of the 17 included guidelines. [Con=consensus AGREE II scores]

Guideline number and keywords AGREE II domains scores

Scope and purpose Stakeholder involvement Rigor of development Clarity of presentation Applicability Editorial independence






Agree Con Agree Con Agree Con Agree Con Agree Con Agree Con
Guidelines at primary level of prevention
1. Canadian standard 89 94 77 77 24 23 91 94 82 89 3 0
2. CA Ontario guide 85 89 20 17 10 8 70 72 61 67 0 0
3. AU Prevent 80 67 98 96 57 48 91 89 42 33 38 0
4. Nice UK 87 100 100 100 94 90 85 83 39 33 33 50
5. HSE UK 98 100 61 100 69 73 89 89 71 71 0 0
6. Karolinska Sweden 93 89 50 50 47 75 85 83 94 96 50 50
7. WHO prima 69 67 46 36 17 17 65 50 64 54 0 0
8. WHO policy 91 78 32 44 14 13 83 89 75 79 0 0
Level of quality a/Average High/87 High/86 MLow/61 Mod/65 Poor/42 Poor/43 High/82 High/81 Mod/66 Mod/65 Poor/16 Poor/13
Guidelines at tertiary level of prevention
9. CA Montreal 89 100 91 100 64 73 96 100 49 78 17 50
10. OHS CA BA 100 100 96 100 74 75 90 89 46 42 0 0
11. AU RTW 70 78 100 100 64 62 85 94 38 43 3 0
Level of qualitya/Average High/86 High/93 High/96 High/100 Mod/67 Mod/70 High/93 High/94 Poor/44 ML/54 Poor/7 Poor/17
Guidelines at multiple level of prevention
12. CA Vancouver 82 78 72 78 18 19 86 72 79 83 0 0
13. NRCWE, DK 91 94 22 22 70 63 78 72 15 25 6 0
14. MH AU 71 89 7 6 43 42 79 78 32 46 0 0
15. Public Sector, AU 78 78 46 44 25 34 72 83 15 0 0 0
16. OSH NZ 69 17 27 8 49 11 62 11 67 19 8 2
17. European Commission 94 100 17 17 6 4 56 44 22 21 0 0
Level of qualitya/Average High/81 Mod/76 Poor/32 Poor/29 Poor/35 Poor/29 Mod/72 Mlow/60 Poor/38 Poor/32 Poor/2 Poor/1

a Levels of quality defined in this study: High ≥80%; Mod=moderate: ≤79% and ≥65%; MLow=moderately low: ≤64% and ≥50%; Poor ≤49%

Quality of primary preventive guidelines

The quality of domain i (scope and purpose) was generally high, but the quality of domain ii (stakeholder involvement) and iii (rigor of development) varied considerably (guideline numbers 1–8, table 5). Although most had involved key stakeholders only three guidelines (numbers 1, 3, and 7) specified how they had assessed their views and preferences. The quality of domain iv (clarity of presentation) was generally high and some had provided frameworks (guideline numbers 1, 6–9, table 4) to clarify the intervening mechanisms, and others had evaluated their own methods (eg, HSE management standards: number 5.). Four of the guidelines had high quality with regards to domain v (applicability) (numbers 1, 2, 5, and 6, table 5). These guidelines addressed some of the barriers related to implementation, such as access to external resources for small companies with limited resources. The quality of domain vi (editorial independence) was poor as none of the guidelines had clarified how funding partners or competing interest had influenced the development of guidelines. Only two primary preventive guidelines from England (guideline numbers 4 and 5) met all the criteria for good developmental quality (AGREE II ≥65% on domains i, ii and iii).

Quality of tertiary preventive guidelines

The quality of the three guidelines was mainly high or moderate across domains i–iv, but mostly poor with regards to applicability and editorial independence (domain v–vi) (guidelines 9–11, table 5).

Two Canadian tertiary preventive guidelines (guideline number 9 and 10) met all the criteria for good developmental quality.

Developmental quality of multiple preventive guidelines

The quality of scope and purpose was mainly high or moderate, but the stakeholder involvement and rigor of development was generally poor (guidelines 12–17, table 5). The quality of clarity of presentation and applicability ranged from high to poor, whereas the quality of editorial independence was poor.

None of the multiple preventive guidelines met all the criteria for good developmental quality.

Discussion

This systematic review identified 17 guidelines recommending workplace interventions to prevent or manage MHP. The content, expected effects and reported evidence of the recommended interventions overlapped considerably across guidelines. Only four guidelines had developed recommendations that met the criteria for good quality (AGREE II score ≥65% on domains i, ii and iii). Two guidelines from the UK [guideline number 4 (33) and 5 (34)] recommended that employers implement risk management procedures and programs to increase MH literacy of all employees and increased managers’ communication and relational competences to prevent work-related MHP. The recommendations were underpinned by best available theory and evidence and the limited evidence of the effectiveness of implementing the guidelines were acknowledged. Two Canadian guidelines recommended interventions for employers and employees to facilitate RTW and rehabilitate workers who had been sick-listed with MHP (guideline number 9 [38–39) and 10 (40)]. Although they also based their recommendations on best available theory and evidence and acknowledged the limited available evidence with regards to their effectiveness at the time they had developed the guidelines (54), recent evidence contradicted some of the recommended interventions and the evidence base of the guidelines is therefore no longer valid.

No guidelines focused exclusively on detecting or managing MHP early. Guidelines recommending interventions that combined primary, secondary and tertiary preventive interventions seemed sensible from a political and theoretical perspective (14), but none met the criteria for good quality and the evidence underpinning the recommendations were inadequate.

To our knowledge, the HSE management standards (34) and one of the two Canadian RTW guidelines (38) have not been identified in previous reviews. Menish et al (18) also reviewed the NICE UK guideline (33) with AGREE II ratings similar to ours. One of the Canadian RTW guidelines (40) was also identified in another review (20). By contrast to our AGREE II scores, the previous review had considerably lower scores on rigor of development and stakeholder involvement. For several reasons, we nevertheless found our AGREE II scores valid. The guideline was underpinned by evidence from a systematic review conducted in accordance with NICE’s review procedure and had involved stakeholders in a systematic way. To improve validity we had evaluated our ratings by a consensus score in addition to a standardized AGREE II procedure. Consequently we found the guidelines to be of good developmental quality.

Few of the guidelines considered the limited documented effect of implementing complex workplace interventions to all organizational contexts. Most guidelines recommended interventions that were not feasible without substantial financial and human resources. Although interventions were recommended to all workplaces regardless of size, lack of resources was not considered as a crucial barrier for smaller enterprises.

None of the guidelines had included sufficient statements regarding the views of the funding body or declarations of competing interests (domain vi: editorial independence items 22–23, table 2). Most of the guidelines included in this review had been developed by political, organizational and healthcare organizations – and only some in corporation with research institutes. The poor developmental quality questioned many of the claimed economic and health-related gains achieved by implementing the recommended interventions. Greater transparency of the different incentives, including political interests driving the development of guidelines could greatly improve the validity of guidelines.

One limitation of this study was the use of AGREE II as an instrument to evaluate the quality of occupational guidelines. Although, we had weekly consensus meetings to facilitate interrater reliability, the scope and target groups of the guidelines were in some cases different from clinical guidelines and were difficult to transfer to complex interventions in occupational settings. For example, the guidelines were not designed for mental health professionals and therefore simplicity was often prioritized over scientific clarification or disclaimers. Also, the applicability of guidelines was generally poor, which mostly reflected the generic nature of recommendations including broad statements designed to be applied to any employee in any organizational context.

We did a thorough literature search identifying documents from all over the world, but the scope was limited to guidelines written in English, Danish, Swedish or Norwegian. Although guidelines of better quality or content have not been identified in previous literature (1820), the majority of guidelines included in the study were from North America, Australia, New Zealand or Europe and our results were mainly generalizable to these countries.

Concluding remarks

Actors at the workplace need guidelines of better quality to help prevent, detect and manage work-related MHP. None of the 17 included guidelines met the criteria on all the specified domains of quality and transparency of potential conflicting interests and applicability needed improvement. We identified four guidelines that had developed recommendations with sufficient rigor to help employers to either prevent or manage MHP. However, recent evidence proved crucial elements of the recommendations of how to best manage the MHP invalid. Additionally, evidence from effectiveness studies was scarce and future studies need to evaluate whether employers achieve the health- and work-related gains from implementing the guidelines. We did not identify guidelines that focused exclusively on detecting MHP early. An approach combining interventions to prevent, detect and manage MHP seemed innovative, but the evidence base and rigor of recommendations needed improvement.

Acknowledgements

We thank Elizabeth Bengtsen at NRCWE for undertaking the literature search. This work was supported by governmental funding: STAR Research Fund grant. The funding source did not participate in any parts of the study.

Competing interests

Mette Andersen Nexø co-authored one of the guidelines reviewed in this study. To minimize potential bias, Mette Andersen Nexø did not participate in the ratings of the quality assessment of this guideline.

References

1 

Bodenheimer, T, Chen, E, & Bennett, HD. (2009, Jan-Feb). Confronting the growing burden of chronic disease:can the U.S. health care workforce do the job? Health Aff (Millwood), 28(1), 64-74, http://dx.doi.org/10.1377/hlthaff.28.1.64.

2 

Murray, JC, & Lopez, AD. (1996). The Global Burden of Disease:A comprehensive assesment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected on to 2020 Boston. Global Burden of Disease and Injury Series, vol 1.

3 

OECD. (2010). Sickness, Disability and Work:Breaking the Barriers:A Synthesis of Findings across OECD Countries. Paris: OECD publishing.

4 

Sanderson, K, & Andrews, G. (2006, Feb). Common mental disorders in the workforce:recent findings from descriptive and social epidemiology. Can J Psychiatry, 51(2), 63-75, http://dx.doi.org/10.1177/070674370605100202.

5 

Gjesdal, S, Ringdal, PR, Haug, K, & Maeland, JG. (2008). Long-term sickness absence and disability pension with psychiatric diagnoses:a population-based cohort study. Nord J Psychiatry, 62(4), 294-301, http://dx.doi.org/10.1080/08039480801984024.

6 

Kessler, RC, Demler, O, Frank, RG, Olfson, M, Pincus, HA, Walters, EE, et al. (2005, Jun). Prevalence and treatment of mental disorders, 1990 to 2003. N Engl J Med, 352(24), 2515-23, http://dx.doi.org/10.1056/NEJMsa043266.

7 

OECD. (2015). Fit Mind Fit Job. From Evidence To Practice in Mental Health and Work, Paris, OECD publishing.

8 

Harnois, G, & Gabriel, P. (2000). Mental health and work:Impact, issues and good practices. Geneva: WHO and ILO publishing. World Health Organization and International Labour Organization.

9 

Gordon, RS, Jr. (1983, Mar-Apr). An operational classification of disease prevention. Public Health Rep, 98(2), 107-9.

10 

Rogerson, S, Meir, R, Crowley-McHattan, Z, McEwen, K, & Pastoors, R. (2016, Apr). A Randomized Controlled Pilot Trial Investigating the Impact of a Workplace Resilience Program During a Time of Significant Organizational Change. J Occup Environ Med, 58(4), 329-34, http://dx.doi.org/10.1097/JOM.0000000000000677.

11 

Haracz, K, & Roberts, E. (2016, Feb). Workplace resilience interventions show some evidence of positive effects, particularly on mental health and wellbeing. Aust Occup Ther J, 63(1), 57-8, http://dx.doi.org/10.1111/1440-1630.12277.

12 

Sidle, SD. (2008). Workplace Stress Management Interventions:What Works Best? Acad Manage Perspect, 22(3), 111-2, http://dx.doi.org/10.5465/AMP.2008.34587999.

13 

Nieuwenhuijsen, K, Faber, B, Verbeek, JH, Neumeyer-Gromen, A, Hees, HL, Verhoeven, AC, et al. (2014, Dec). Interventions to improve return to work in depressed people. Cochrane Database Syst Rev, 3(12), CD006237.

14 

LaMontagne, AD, Martin, A, Page, KM, Reavley, NJ, Noblet, AJ, Milner, AJ, et al. (2014, May). Workplace mental health:developing an integrated intervention approach. BMC Psychiatry, 14, 131, http://dx.doi.org/10.1186/1471-244X-14-131.

15 

Wagner, SL, Koehn, C, White, MI, Harder, HG, Schultz, IZ, Williams-Whitt, K, et al. (2016, Jan). Mental Health Interventions in the Workplace and Work Outcomes:A Best-Evidence Synthesis of Systematic Reviews. Int J Occup Environ Med, 7(1), 1-14, http://dx.doi.org/10.15171/ijoem.2016.607.

16 

Joyce, S, Modini, M, Christensen, H, Mykletun, A, Bryant, R, Mitchell, PB, et al. (2016, Mar). Workplace interventions for common mental disorders:a systematic meta-review. Psychol Med, 46(4), 683-97, http://dx.doi.org/10.1017/S0033291715002408.

17 

Eccles, MP, Grimshaw, JM, Shekelle, P, Schünemann, HJ, & Woolf, S. (2012, Jul). Developing clinical practice guidelines:target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci, 7, 60, http://dx.doi.org/10.1186/1748-5908-7-60.

18 

Memish, K, Martin, A, Bartlett, L, Dawkins, S, & Sanderson, K. (2017, Aug 101). Workplace mental health:an international review of guidelines. Prev Med [213], 22, http://dx.doi.org/10.1016/j.ypmed.2017.03.017.

19 

Joosen, MC, Brouwers, EP, van Beurden, KM, Terluin, B, Ruotsalainen, JH, Woo, JM, et al. (2015, May). An international comparison of occupational health guidelines for the management of mental disorders and stress-related psychological symptoms. Occup Environ Med, 72(5), 313-22, http://dx.doi.org/10.1136/oemed-2013-101626.

20 

Dewa, CS, Trojanowski, L, Joosen, MC, & Bonato, S. (2016, Mar). Employer Best Practice Guidelines for the Return to Work of Workers on Mental Disorder-Related Disability Leave:A Systematic Review. Can J Psychiatry, 61(3), 176-85, http://dx.doi.org/10.1177/0706743716632515.

21 

Moher, D, Liberati, A, Tetzlaff, J, Altman, DG, & PRISMA Group. (2009, Oct). Preferred reporting items for systematic reviews and meta-analyses:the PRISMA statement. J Clin Epidemiol, 62(10), 1006-12, http://dx.doi.org/10.1016/j.jclinepi.2009.06.005.

22 

The Adapte Collaboration. (2009). The ADAPTE process:Resource Toolkit for guideline adaption. Version 2.0, Available from: http://www.g-i.n.net.

23 

Shekelle, P, Woolf, S, Grimshaw, JM, Schünemann, HJ, & Eccles, MP. (2012, Jul). Developing clinical practice guidelines:reviewing, reporting, and publishing guidelines;updating guidelines;and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci, 7, 62, http://dx.doi.org/10.1186/1748-5908-7-62.

24 

(2013). Appraisal of Guidelines for Research and Evaluation (AGREE II) manual, Available from: https://www.agreetrust.org/wp-content/uploads/2013/10/AGREE-II-Users-Manual-and-23-item-Instrument_2009_UPDATE_2013.pdf.

25 

Brouwers, MC, Kho, ME, Browman, GP, Burgers, JS, Cluzeau, F, Feder, G, et al. (2012, May). AGREE Next Steps Consortium. The Global Rating Scale complements the AGREE II in advancing the quality of practice guidelines. J Clin Epidemiol, 65(5), 526-34, http://dx.doi.org/10.1016/j.jclinepi.2011.10.008.

26 

Brouwers, MC, Makarski, J, Kastner, M, Hayden, L, Bhattacharyya, O, & GUIDE-M Research Team. (2015, Mar). The Guideline Implementability Decision Excellence Model (GUIDE-M):a mixed methods approach to create an international resource to advance the practice guideline field. Implement Sci, 10, 36, http://dx.doi.org/10.1186/s13012-015-0225-1.

27 

Gagliardi, AR, & Brouwers, MC. (2015, Feb). Do guidelines offer implementation advice to target users?A systematic review of guideline applicability. BMJ Open, 5(2), e007047, http://dx.doi.org/10.1136/bmjopen-2014-007047.

28 

Siering, U, Eikermann, M, Hausner, E, Hoffmann-Eßer, W, & Neugebauer, EA. (2013, Dec). Appraisal tools for clinical practice guidelines:a systematic review. PLoS One, 8(12), e82915, http://dx.doi.org/10.1371/journal.pone.0082915.

29 

Mental Health Commission of Canada. (2013). Psychological health and safety in the workplace:Prevention, Promotion, and Guidance to Staged Implementation, Toronto, Canada, Bureau de normalisation du Quebec, Retrieved from: http://www.mentalhealthcommission.ca/English/national-standard.pdf.

30 

Canadian Mental Health Association. Ontario. Workplace mental health promotion:A How-To Guide. Ontario and Dalla Lana School of public health, University of Toronto;Publication year not stated, Retrieved from: http://wmhp.cmhaontario.ca/wordpress/wp-content/uploads/2010/03/WMHP-Guide-Final1.pdf.

31 

Reavley, N. (2013). Workplace prevention of mental health problems:Guidelines for organisations, Australia, Melbourne School of Population and Global Health, University of Melbourne, Retrieved from: https://mhfa.com.au/sites/default/files/GUIDELINES-for-workplace-prevention-of-mental-health-problems.pdf.

32 

Reavley, NJ, Ross, A, Killackey, EJ, & Jorm, AF. (2012, Sep). Development of guidelines to assist organisations to support employees returning to work after an episode of anxiety, depression or a related disorder:a Delphi consensus study with Australian professionals and consumers. BMC Psychiatry, 12, 135, http://dx.doi.org/10.1186/1471-244X-12-135.

33 

National Institute for Health and Care Excellence. (2009). Mental wellbeing at work, Manchester, UK, Public Health Guideline, Retrieved from: https://www.nice.org.uk/guidance/ph22/resources/mental-wellbeing-at-work-pdf-1996233648325.

34 

Health and Safety Executive. How to tackle stress. A guide for employers on making the Management Standards Work, Suffolk, UK, Publication year not stated, Retrieved from: http://www.hse.gov.uk/pubns/indg430.pdf.

35 

Riktlinjegruppen. (2015). Riktlinjer för psykisk ohälsa påarbetsplatsen [Guidelines for psychological ill health at the workplace] Sweden:Karolinska Institutet, Sveriges företags hälsor, Retrieved from: http://ki.se/sites/default/files/riktlinjer_psykisk_ohalsa_utg_1_1_0.pdf.

36 

Leka, S, & Cox, T. (2008). PRIMA-EF:Guidance on the European framework for psychosocial risk management. A resource for employers and worker representatives. Protecting workers'health series, 9. World Health's Organization, Retrieved from: http://www.who.int/occupational_health/publications/PRIMA-EF%20Guidance_9.pdf.

37 

World Health Organization. (2005). Mental health policies and progammes in the workplace. Mental health and Service Guidance Package, Retrieved from: http://www.who.int/mental_health/policy/services/13_policies%20programs%20in%20workplace_WEB_07.pdf?ua=1.

38 

St-Arnaud, L, Corbiere, M, Durand, M, & Bourbonnais, R. (2014). Supporting a return to work after an absence for a mental health problem- design implementation, and evaluation of an integrated practices program. Quebeck, Canada:Universite Laval, Institut de recherche Robert-Sauve en sante et en securite du travail, Retrieved from: http://www.irsst.qc.ca/media/documents/PubIRSST/R-823.pdf.

39 

St-Arnaud, L. Pelletier. (2014). Guide to an integrated practices program for supporting a return to work and promoting job retention. Quebeck, Canada:Universite Laval, Institute de recherche Robert-Sauve en sante et en securite du travail, Retrieved from: http://www.irsst.qc.ca/media/documents/PubIRSST/RG-813.pdf?v=2017-07-28.

40 

Pomaki, GF, Khushrushahi, N, Murray, E, Lampinen, T, & Mah, P. (2010). Best practices for return to work/stay at work interventions for workers with mental health conditions, Vancouver, Occupational Health and Safety Agency for Healthcare in British Columbia, Retrieved from: http://www.ccohs.ca/products/webinars/best_practices_rtw.pdf.

41 

Reavley, N, & Melbourne Uo. (2011). Helping employees sucessfully return to work following depression, anxiety or a related mental health problem- guidelines for organisations. Melbourne, Australia, Centre for Youth Mental health, University of Melbourne, Retrieved from: https://www.biomedcentral.com/content/supplementary/1471-244X-12-135-S1.pdf.

42 

Center for Applied Research in Metnal Health and Addiction. (2012). Psychological health and safety. An action guide for employers, Ottowa, Mental Health Commission of Canada, Retrieved from: https://www.sfu.ca/content/dam/sfu/carmha/resources/phsguide/Workforce_Employers_Guide_ENG.pdf.

43 

Borg, V, Nexo, MA, Kolte, IV, & Andersen, MA. (2010). Hvidbog om mentalt helbred, sygefravær og tilbagevenden til arbejde[Whitepaper on mental health, sickness absence and return to work], Retrieved from: http://www.arbejdsmiljoforskning.dk/~/media/Boeger-og-rapporter/hvidbog-mentalt-helbred.pdf.

44 

Harvey, SB, Joyce, S, Tan, L, Nguyen, H, Modini, M, & Groth, M. (2014). Developing a mentally healthy workplace:A review of the literature A report for the National Mental Health Commission and the Mentally Healthy Workplace Alliance. Australia, Retrieved from: https://www.headsup.org.au/docs/default-source/resources/developing-a-mentally-healthy-workplace_final-november-2014.pdf?sfvrsn=8.

45 

Australian Government. (2012). As one-Working together:Promoting mental health and wellbeing at work. Australia, Retrieved from: http://www.comcare.gov.au/__data/assets/pdf_file/0005/127454/working-together-mental-health-wellbeing-accessible.pdf.

46 

Department of Labour. New Zealand. Healthy work. Managing Stress and fatigue in the workplace. Occupational Safety and Health Service, Department of Labour, Wellington, New Zealand, Retrieved from: http://www.worksafe.govt.nz/worksafe/information-guidance/all-guidance-items/healthy-work-managing-stress-and-fatigue-in-the-workplace/stressfatigue.pdf.

47 

Wynne, RVDB, Leka, S, Houtman, I, & McDaid, D. (2014). Promoting mental health in the workplace:Guidance to implementing a comprehensive approach, Retrieved from: http://www.ec.europa.eu/social/main.jsp?catId=716&langID=en.

48 

LaMontagne, AD. (2012, Dec). Invited commentary:job strain and health behaviors--developing a bigger picture. Am J Epidemiol, 176(12), 1090-4, http://dx.doi.org/10.1093/aje/kws337.

49 

Hanisch, SE, Twomey, CD, Szeto, AC, Birner, UW, Nowak, D, & Sabariego, C. (2016, Jan). The effectiveness of interventions targeting the stigma of mental illness at the workplace:a systematic review. BMC Psychiatry, 6(16), 1, http://dx.doi.org/10.1186/s12888-015-0706-4.

50 

Richardson, KM, & Rothstein, HR. (2008, Jan). Effects of occupational stress management intervention programs:a meta-analysis. J Occup Health Psychol, 13(1), 69-93, http://dx.doi.org/10.1037/1076-8998.13.1.69.

51 

Arends, I, Bruinvels, DJ, Rebergen, DS, Nieuwenhuijsen, K, Madan, I, Neumeyer-Gromen, A, et al. (2012, Dec). Interventions to facilitate return to work in adults with adjustment disorders. Cochrane Database Syst Rev, 12(12), CD006389.

52 

Brouwer, S, Reneman, MF, Bültmann, U, van der, Klink JJ, & Groothoff, JW. (2010, Mar). A prospective study of return to work across health conditions:perceived work attitude, self-efficacy and perceived social support. J Occup Rehabil, 20(1), 104-12, http://dx.doi.org/10.1007/s10926-009-9214-z.

53 

Blank, L, Peters, J, Pickvance, S, Wilford, J, & Macdonald, E. (2008, Mar). A systematic review of the factors which predict return to work for people suffering episodes of poor mental health. J Occup Rehabil, 18(1), 27-34, http://dx.doi.org/10.1007/s10926-008-9121-8.

54 

Vogel, N, Schandelmaier, S, Zumbrunn, T, Ebrahim, S, de, Boer WE, Busse, JW, et al. (2017, Mar). Return-to-work coordination programmes for improving return to work in workers on sick leave. Cochrane Database Syst Rev, 3(3), CD011618.

55 

Gilbody, S, Sheldon, T, & House, A. (2008, Apr). Screening and case-finding instruments for depression:a meta-analysis. CMAJ, 178(8), 997-1003, http://dx.doi.org/10.1503/cmaj.070281.