We thank Dr Rahman Shiri (1) for his careful reading of our systematic review and meta-analysis on suicide among agricultural, forestry, and fishery workers (2). Our paper had the objective of providing a pooled effect size of suicide for this occupational group.
Suicide is a crucial issue in public and occupational health. Suicide has a multifactorial etiology and recent systematic reviews and meta-analyses have pointed out the role of occupational exposures, mainly psychosocial work stressors, as risk factors for suicide (3, 4). Suicide is a very rare event in the general population and still more seldom in the working population. Indeed, unemployed and economically inactive people have a higher risk of suicide compared to employed people (5, 6). However, the total number of suicides is greater in the employed population than among the economically inactive or unemployed (6).
Shiri’s letter (1) questioned several aspects of our review and meta-analysis. One comment related to the single reference database used in our review and a suggestion that our review could not be considered to be systematic. The review was based on Medline because our main interest was in quantitative epidemiologic studies. This is the largest database for biomedical literature and we would argue the most pertinent. Furthermore, we checked the reference lists of the most recent papers and literature reviews, and Shiri did not report any paper that was missing. No review, whether searching one or more databases, can expect to be totally exhaustive. There may always be missing studies, especially if we consider grey literature. Thus we assert that our review was systematic, while acknowledging that it may not be perfectly comprehensive.
Shiri suggested an absence of quality assessment of the studies included in our meta-analysis. First, quality was considered in the context of our comments in the discussion section. Second, as suggested by Rothman et al (7), quality assessment was replaced by regression analyses of the effect of each quality item (study characteristics, ie, study design, effect measure, reference group, and adjustment). Third, because most studies included in this review were based on objective data (census, administrative, or register data), they were free of many of the sources of bias that exist in studies where information on exposure and outcome must be collected from participants. Consequently, many of the items related to quality were not pertinent, such as response and follow-up rates, coverage and representativeness of the sample, selection, etc. Contrary to what Shiri suggested, all study designs can be informative in this topic because all of them are able to provide an unbiased estimate of the effect size. In addition, the prospective and case–control studies may have shortcomings. For example, we excluded five studies including three prospective and case–control studies in the sensibility analysis because the group of interest was defined on the basis of the exposure to chemicals (pesticides) rather than job title.
Our choice to retain the least adjusted models was justified because aggregated data were used for the meta-analysis. Therefore, unless all included studies adjusted for the same covariates measured in the same way, adjusted estimates cannot be meaningfully provided in an aggregate data meta-analysis. In addition, as the objective was above all descriptive and not etiological or explanatory, and as it is the norm in the exploration of social inequalities in health (8), the results from the least (gender- and age-) adjusted models were in line with the objective. Indeed, including more adjustment variables could lead to overadjustment as they may be intermediate variables on the causal pathways between occupation and suicide. Our strategy was in line with previous meta-analyses on similar topics (9–11). Consequently, we would argue that our results are not likely to be largely due to confounding, contrary to the comment by Shiri. Indeed, the study of the contribution of underlying factors in explaining social inequalities in health outcomes is a fully-fledged topic of research (12–15), but this is relevant research to conduct after demonstrating that inequalities exist between social or occupational groups.
Several of Shiri’s comments were about statistical aspects of our analyses. First, it was suggested that we did not correctly extract the confidence intervals for the estimates of several studies. We disagree. We used the STATA metan suite of commands using log-transformed effect sizes and standard errors. Our figure 1 and the values of effect sizes and confidence intervals were provided by STATA, this explains why there may be small differences in these values compared with the results published in some studies. Using log-transformed effect sizes and confidence intervals, the analysis provided the same results. Second, our subgroup comparison was based on subsamples that were independent. As not all studies provided information for these subgroups, each subgroup was treated as a unit of analysis. This strategy allows the use of all relevant subgroups and comparisons between them (16). Third, we were also criticized for the use of random-effects models. Random-effects models are generally more plausible for meta-analysis based on studies from the published literature, because the fixed-effect model assumed that the entire corpus of literature has been obtained, ie, that every study has been or ever will be written on the topic has been included, which is an implausible assumption. We also assumed differences in effect size between studies and between subgroups, and the use of random-effects models was consistent with such an assumption. However, random-effects models produce wider confidence intervals compared to fixed-effect models (16). These models are thus more conservative, making our results all the more robust.
One of Shiri’s comments related to the reference group used in the studies for the comparison of agricultural, forestry, and fishery workers. Although we reported that the studies using a specific occupational group as reference group provided a higher effect size than the studies using other reference groups, we did not explicitly recognize and state in the paper that the results for Japan were based on two studies using a specific occupational group as reference; we concede that this may explain why we found a much more elevated effect size for Japan. Shiri’s results (1) allow to conclude that the difference between Japan and the other geographic areas could be explained by the choice of reference group—we are grateful to him for raising this point. However, we would note that the effect size of suicide was still elevated and significant for agricultural, forestry, and fishery workers even after this change in the reference group for these two studies.
Nevertheless, the choice of the optimal reference group is not obvious. If we consider the general population as the reference group, as unemployed people and economically inactive people (including people who may not be working due to illness or disability) are part of it and have a higher risk of suicide than employed people, the effect size provided by the nine studies using the general population as the reference is likely to be underestimated, which may contribute to an underestimation of the observed effect size of suicide among agricultural, forestry, and fishery workers in our study. The comparison was made in our paper with the other occupational groups (ie, the working population except the group of interest) as the reference, which was used by nine other studies, but this did not allow to determine the exact rank of the group of interest in the occupational hierarchy. Another relevant choice would have been to retain the group with the lowest suicide risk (for example, the high-skilled occupational group) as the reference, which would have led to a much higher effect size of suicide for agricultural, forestry, and fishery workers.
To conclude, as statistical power in detecting differences between subgroups may be low in subgroup analyses and meta-regression, the absence of significant results according to subgroups found in our results cannot be interpreted as evidence that the effect size is the same across subgroups. Consequently, our meta-analysis reporting a significant excess of risk of suicide among agricultural, forestry, and fishery workers may also be a good incentive for more research among this group of workers to (i) confirm this observed excess of risk using differing methodological approaches to meta-analysis and (ii) explore the potential differences within this group and the underlying factors that may explain this excess of risk.