Comparison of alternative versions of the job demand-control scales in 17 European cohort studies: the IPD-Work consortium

doi:10.1186/1471-2458-12-62

BMC Public Health. 2012; 12: 62.

Published online 2012 January 20. doi: 10.1186/1471-2458-12-62

PMCID: PMC3328260

Comparison of alternative versions of the job demand-control scales in 17 European cohort studies: the IPD-Work consortium

Eleonor I Fransson,^1,² Solja T Nyberg,³ Katriina Heikkilä,³ Lars Alfredsson,¹ De Dirk Bacquer,⁴ G David Batty,^5,⁶ Sébastien Bonenfant,⁷ Annalisa Casini,⁸ Els Clays,⁴ Marcel Goldberg,^7,⁹ France Kittel,⁸ Markku Koskenvuo,¹⁰ Anders Knutsson,¹¹ Constanze Leineweber,¹² Linda L Magnusson Hanson,¹² Maria Nordin,¹³ Archana Singh-Manoux,^5,⁹ Sakari Suominen,^14,¹⁵ Jussi Vahtera,^14,¹⁶ Peter Westerholm,¹⁷ Hugo Westerlund,^5,¹² Marie Zins,^7,⁹ Töres Theorell,^#¹² and Mika Kivimäki^#^3,^5,¹⁸

¹Institute of Environmental Medicine, Karolinska Institutet, Box 210, SE-171 77 Stockholm, Sweden

²School of Health Sciences, Jönköping University, Jönköping, Sweden

³Finnish Institute of Occupational Health, Helsinki, Finland

⁴Department of Public Health, Ghent University, Ghent, Belgium

⁵Department of Epidemiology and Public Health, University College London, London, UK

⁶MRC Centre for Cognitive Ageing and Cognitive Epidemiology, University of Edinburgh, Edinburgh, UK

⁷Versailles-Saint Quentin University, Versailles, France

⁸School of Public Health, Université Libre de Bruxelles, Brussels, Belgium

⁹Inserm U1018, Centre for Research in Epidemiology and Population Health, Villejuif, France

¹⁰Department of Public Health, University of Helsinki, Helsinki, Finland

¹¹Department of Health Sciences, Mid Sweden University, Sundsvall, Sweden

¹²Stress Research Institute, Stockholm University, Stockholm, Sweden

¹³Department of Public Health and Clinical Medicine, Occupational and Environmental Medicine, Umeå University, Umeå, Sweden

¹⁴Department of Public Health, University of Turku, Turku, Finland

¹⁵Folkhälsan Research Center, Helsinki, Finland

¹⁶Finnish Institute of Occupational Health, Turku, Finland

¹⁷Occupational and Environmental Medicine, Uppsala University, Uppsala, Sweden

¹⁸Department of Behavioral Sciences, University of Helsinki, Helsinki, Finland

Corresponding author.

^#Contributed equally.

Eleonor I Fransson: eleonor.fransson/at/ki.se; Solja T Nyberg: solja.nyberg/at/ttl.fi; Katriina Heikkilä: katriina.heikkila/at/ttl.fi; Lars Alfredsson: lars.alfredsson/at/ki.se; De Dirk Bacquer: dirk.debacquer/at/UGent.be; G David Batty: david.batty/at/ucl.ac.uk; Sébastien Bonenfant: sebastien.bonenfant/at/inserm.fr; Annalisa Casini: acasini/at/ulb.ac.be; Els Clays: Els.Clays/at/UGent.be; Marcel Goldberg: marcel.goldberg/at/inserm.fr; France Kittel: fkittel/at/ulb.ac.be; Markku Koskenvuo: markku.koskenvuo/at/helsinki.fi; Anders Knutsson: anders.knutsson/at/miun.se; Constanze Leineweber: constanze.leineweber/at/stressforskning.su.se; Linda L Magnusson Hanson: linda.hanson/at/stressforskning.su.se; Maria Nordin: maria.nordin/at/envmed.umu.se; Archana Singh-Manoux: archana.singh-manoux/at/inserm.fr; Sakari Suominen: sakari.suominen/at/utu.fi; Jussi Vahtera: Jussi.Vahtera/at/ttl.fi; Peter Westerholm: peter.westerholm/at/medsci.uu.se; Hugo Westerlund: hugo.westerlund/at/stressforskning.su.se; Marie Zins: marie.zins/at/inserm.fr; Töres Theorell: tores.theorell/at/stressforskning.su.se; Mika Kivimäki: m.kivimaki/at/ucl.ac.uk

Received July 15, 2011; Accepted January 20, 2012.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article has been cited by other articles in PMC.

Abstract

Background

Job strain (i.e., high job demands combined with low job control) is a frequently used indicator of harmful work stress, but studies have often used partial versions of the complete multi-item job demands and control scales. Understanding whether the different instruments assess the same underlying concepts has crucial implications for the interpretation of findings across studies, harmonisation of multi-cohort data for pooled analyses, and design of future studies. As part of the 'IPD-Work' (Individual-participant-data meta-analysis in working populations) consortium, we compared different versions of the demands and control scales available in 17 European cohort studies.

Methods

Six of the 17 studies had information on the complete scales and 11 on partial scales. Here, we analyse individual level data from 70 751 participants of the studies which had complete scales (5 demand items, 6 job control items).

Results

We found high Pearson correlation coefficients between complete scales of job demands and control relative to scales with at least three items (r > 0.90) and for partial scales with two items only (r = 0.76-0.88). In comparison with scores from the complete scales, the agreement between job strain definitions was very good when only one item was missing in either the demands or the control scale (kappa > 0.80); good for job strain assessed with three demand items and all six control items (kappa > 0.68) and moderate to good when items were missing from both scales (kappa = 0.54-0.76). The sensitivity was > 0.80 when only one item was missing from either scale, decreasing when several items were missing in one or both job strain subscales.

Conclusions

Partial job demand and job control scales with at least half of the items of the complete scales, and job strain indices based on one complete and one partial scale, seemed to assess the same underlying concepts as the complete survey instruments.

Keywords: Job demands, Job control, Job strain, Work stress, Agreement

Background

Work-related psychosocial factors or "stressors at work" have been linked to increased risk of ill health and mortality in some [1-8] but not all studies [9-12]. The reasons behind these inconsistencies may include differences in the socio-demographic characteristics of the study populations, variations in the stability of the work stressors during the follow-up, selection bias, and imprecise measurement, particularly of the exposure [13,14]. Surprisingly little attention has been paid to the fact that the operationalisation of work-related stressors have varied between cohort studies.

A frequently used measure of work stress is the two-dimensional job strain model, originally described by Karasek [15] and further developed, both empirically and psychometrically, by Karasek and Theorell [16]. This model postulates that jobs characterised by a combination of high psychological demands and low control (or low decision latitude), that is, job strain, are likely to elicit work-related psychosocial stress. High psychological demands in the workplace mean that the employee has to work intensively or rapidly, and may experience conflicting expectations. Job control, in turn, refers to the degree of decision-making authority (for example, having an influence on what task to do and how to carry it out) and skill discretion (e.g., the use of personal skills on the job).

The two standardised, widely used questionnaires developed to measure the demand and control dimensions, and hence job strain, are: the Job Content Questionnaire (JCQ) [17] and the Demand Control Questionnaire (DCQ) [18,19]. The number of demand (five in both the JCQ and DCQ) and control items (nine in the JCQ and six in the DCQ) vary somewhat, as do the enquiries, and their response scales differ. Most of the JCQ items are expressed as statements and the respondents are asked to report if they agree or disagree with the statement on a four level Likert scale, while DCQ items are expressed as questions with the response options being frequency based (e.g., "Do you have to work very fast?" - Often, sometimes, seldom, never).

Investigators examining the relationship between job strain and health outcomes have often used partial versions of the questionnaires. Study-specific questionnaires have also been developed which can differ from the JCQ or DCQ in terms of the number of items, content and wording of the questions, and response alternatives. It is important to understand whether the different survey instruments assess the same underlying concepts, as this has implications for the interpretation of findings across studies, harmonisation of multi-cohort data for pooled analyses, and design of future studies [20].

Accordingly, the aim of the present analyses was to evaluate the comparability of alternative job demands, job control and job strain measures by assessing agreement against the complete scale. To do so, we use data from six studies together with information from additional 11 European cohort studies that comprise the "Individual-participant-data meta-analysis in working populations" (IPD-Work) Consortium.

Methods

Study population

This study is part of the "Individual-participant-data meta-analysis in working populations" (IPD-Work) consortium of European cohort studies. This collaboration was established at a workshop, the annual Four Centers Meeting in London, in November, 2008. New cohort studies have subsequently been added. The overall aim of the IPD-Work consortium is to aggregate raw data from a series of studies in order to obtain reliable estimates of the influence of psychosocial risk factors at work on chronic diseases, mental health, disability, and mortality.

In IPD-Work, a pre-defined two-stage data acquisition protocol is being used. The first stage involves the acquisition of baseline data on work stress as well as socio-demographic and lifestyle factors and the definition and harmonisation of these baseline characteristics across the studies. The second stage involves the acquisition of data on disease outcomes ascertained subsequent to the baseline survey. The present analyses were based on stage one only and were thus conducted before any linkage to disease data, planned for the second stage.

We examined the agreement between complete and partial psychological demands and control scales separately in the six cohort studies of the IPD-Work consortium that had the complete job demands and job control scales. These were: the Job Stress Study I (Belstress, Belgium) [21]; the Gaz et Electricité Cohort Study (GAZEL, France) [22]; the Health and Social Support in Finland Study (HeSSup, Finland) [23]; the Swedish Longitudinal Occupational Survey of Health (SLOSH, Sweden) [24,25]; the Work, Lipids and Fibrinogen Study Norrland (WOLF N, Sweden) [26]; and the Work, Lipids and Fibrinogen Study Stockholm (WOLF S, Sweden) [26]. This resulted in an analytic sample of 70 751 participants. The IPD-Work cohort studies where only partial scales were available were: the Copenhagen Psychosocial Questionnaire Study, Denmark [27]; Danish Work Environment Cohort Study, Denmark [28]; Still Working study, Finland [29]; Finnish Public Sector study, Finland [30]; Heinz Nixdorf Recall Study, Germany [31]; Intervention Project on Absence and Well-being Study, Denmark [32]; KORA-Cooperative Health Research in the Region Augsburg/MONICA, Germany [33]; Netherlands Working Condition Survey, the Netherlands [34]; Permanent Onderzoek Leefsituatie/Continuous Survey on Living Conditions, the Netherlands [35]; PUMA-Copenhagen Burnout Inventory Study, Denmark [36]; and Whitehall II study, the United Kingdom [37]. We used the information on available job demands and control items in these 11 cohort studies to identify partial scales relevant to compare with the complete scales. The details of the design and participants in all 17 IPD-Work studies have been published previously [21-37] and are briefly described in Additional file 1.

The studies from which data was used in the present analysis were approved by the ethics committees of the University Hospital of Ghent and the Faculty of Medicine of the Université Libre de Bruxelles (Belstress); the National Commission Overseeing Ethical Data Collection in France (Commission Nationale Informatique et Liberté) (GAZEL); the Turku University Central Hospital Ethics Committee (HeSSup); the Regional Research Ethics Board in Stockholm (SLOSH); and the ethics committee at Karolinska Institutet, Stockholm (WOLF N and WOLF S). All studies adhered to the Helsinki Declaration on ethical principles for medical research involving human subjects. Details of ethical approval of all the IPD-Work studies are described in Additional file 1.

Definition of the complete and partial scales of job demands and control

Complete scale measures of job demands and job control were based on five items from the psychological demands scales and six items from the control scales from the JCQ and DCQ (referred to hereafter as the "complete scales" - see table table1).1). This represented our referent. We omitted the three additional control items in the JCQ that did not have a corresponding item in the DCQ as a means of improving the harmonisation of the control scale across studies. We constructed partial scales based on the JCQ/DCQ items that were available in each of the IPD-work studies that did not have the complete scales. This resulted in a total of six partial demand scales; five partial control scales; and 10 partial job strain scales. The individual questionnaire items available in each study are presented in table table22.

Table 1

Items from the Job Content Questionnaire (JCQ) and Demand Control Questionnaire (DCQ) included in the IPD-Work

Table 2

Job demand and control items in the cohorts included in the IPD-Work meta-analysis (questionnaire used in study)*

All studies included in the IPD-Work Consortium were designed and initiated before the IPD-Work Consortium began; the choice of instrument to measure job strain therefore varies between studies. In some studies, the wording of the job strain items differed from those in the original JCQ or DCQ, but was judged by the study coordinating authors (EF, SN, KH, TT and MiK) to sufficiently resemble the original questions such that they could be used as proxy items. For example, the question on conflicting demands in Still Working study was expressed as "Do your superiors or workmates give you contradictory orders or instructions?" as compared with the corresponding item in the DCQ "Does your work often involve conflicting demands?"; and in POLS the item "Do you have to work under great time pressure?" was judged to capture the same content as "Do you have enough time to do everything?" in the DCQ. The scales with proxy items are labelled as "other" in table table2.2. Some scales were very similar to the JCQ or DCQ and only differed from them in minor aspects; they are labelled as "mainly JCQ" or "mainly DCQ" in table table22.

Using our analytical sample from the six studies with the complete scales, mean response scores for job demands items and for job control items were calculated for each study participant, for both the complete and the different partial scales. For each scale, the mean response score was calculated for participants who had answered half or more of the demand or control questions in that specific scale. However, where only two items were used in a partial scale, both items had to have non-missing values for the mean score to be calculated.

The presence of job strain was defined as having high demands (i.e., higher than the study-specific median of the demands scores) and a low control score (i.e., lower than the study-specific median of the control scores). This definition of job strain based on the quadrant approach has been widely used and will be the main method to define job strain in the IPD-Work consortium, including the present analyses. However, other approaches to derive measures of job strain from the demands and control scores have also been proposed, including the quotient method (job demands/job control); the logarithmic approach (log[job demands/job control]); and the subtraction approach (job demands minus job control) [38]. As a subsidiary analysis, we evaluated the agreement between the complete and partial job strain scales when applying these alternative job strain definitions, shown in Additional file 2.

Statistical analysis

The relationship between the complete and partial scales for the demands and control scales was ascertained using Pearson correlation coefficients with accompanying 95% confidence intervals. These were computed using Fisher's transformation. Sensitivity, specificity and Kappa (κ) statistics were calculated to evaluate the agreement between the job strain definitions based on the complete versus partial scales. The following interpretations of the Kappa statistic were utilised [39]: 0.00-0.20 indicates slight agreement, 0.21-0.40 fair, 0.41-0.60 moderate, 0.61-0.80 good/substantial strength of agreement, and 0.81-1.00 a very good/almost perfect agreement. All analyses were performed using SAS version 9.1 (SAS Institute Inc., Cary, NC, USA).

Results

Pearson's correlation coefficients between the complete demand scale and partial scales are shown in table table3.3. In all six studies included in the present analysis, the correlation coefficient was r > 0.94 for partial scales comprising four items, and r > 0.90 when the partial scale was based on three items. For partial scales with only two items, the correlation coefficient was somewhat lower (r = 0.76 to 0.88), depending on the cohort and item content.

Table 3

Correlation between the complete psychological job demands scale vs. shorter versions of the scale

Table Table44 shows that a largely similar pattern of correlations was observed for the control scale. The correlation coefficients between the complete scale with six items and the partial scales comprising five items were very high (r ≥ 0.96), whereas the relationship between the complete scale and partial scales with two items were slightly lower in magnitude (r = 0.81 to 0.87).

Table 4

Correlation between the complete job control scale vs. shorter versions of the scale

Table Table55 presents the sensitivity, specificity and Kappa statistics comparing the job strain definition based on complete and partial job demands and control scales. There was a consistent pattern across the studies, with the agreement between job strain definitions based on complete and partial scales being very good (k > 0.80), and sensitivity > 0.80 in 14 of 18 analyses, when only one item of either job demands scale or job control scale was missing. When the job strain definition was based on three demand items and all six control items, the agreement varied between good and very good (κ > 0.68). This was also seen, with one exception, for job strain definitions based on only two demand items but all six control items. When one or more items were missing in both the demands and control scales, most Kappa statistics (n = 18/24) indicated at least good agreement (κ > 0.60), although for some comparisons (n = 6/24) the agreement was moderate (κ = 0.54 to 0.60). As expected, the sensitivity decreased when several items were missing in one or both scales. The subsidiary analyses using alternative methods to define job strain yielded a similar pattern of results as the main analysis defining job strain by the quadrant approach (Additional file 2, tables tables44 and and55).

Table 5

The agreement between job strain definitions using the complete vs. partial scales

Discussion

The aim of the present analyses was to evaluate the comparability of alternative job demands, job control and job strain measures by assessing agreement against the complete scales. To do so, we analysed data from a total of 70 751 participants in six European cohort studies with complete data on five job demand and six control items. We found very high correlation coefficients between the complete and partial job demands and control scales, which included a minimum of three items. The agreement for the dichotomised job strain measure was 'good' to 'very good' when at least one of the underlying subscales was complete. When one or more of the items of the underlying scales were excluded, this agreement ranged from moderate to good, depending on the specific items left out in the partial versions.

Strengths and weaknesses

The main strength of the present study is the utilisation of data from multiple independent cohort studies which collectively comprised a very large analytical sample, so providing a high level of statistical precision. Despite slight variation in the exact wording of the questionnaire items between these studies, our findings were remarkably consistent across the six cohort studies drawn from Belgium, France, Finland and Sweden. This supports the generalisability of the present analysis across different settings in four European countries. However, in the studies included in the IPD-Work Consortium, no standardised procedure had been followed to translate the original job strain questionnaire across all studies. Thus, cross-cultural adaptation of the job strain instrument remains a source of error for an individual-participant data meta-analysis project on job strain. Based on a review of job demand and control questions used in 17 European cohort studies, our tests were limited to a total of 10 different partial scales that were available in these studies. It is therefore unclear how other scale modifications, including those with additional study-specific questions, agree with the complete scales. These differences, as well as those related to translation and cultural meaning of the wording, may affect the assessment of demands and control in international comparative studies [40].

Comparison with previous studies

Previously, a comparison of JCQ and DCQ-like questionnaires has been conducted in 682 participants in the JACE study [20]. The investigators in that study found a moderate agreement between median-based job strain classification using a 14-item JCQ (five demand items, nine control items) compared with the 11-item DCQ (five demand items, six control items). Attempts were made to increase the comparability between the scales by developing comparability-facilitating algorithms, as well as using regression models, in order to convert the DCQ scores to the same scale as the JCQ scores. However, with regard to the median based job strain classification, these transformations did not meaningfully improve the agreement between the JCQ and DCQ [20]. We chose a different approach to harmonise the JCQ and DCQ scales, and used the five and six comparable items in the JCQ and DCQ as the "complete" scales. These provided us a reference measurement to examine the validity of partial versions available in the existing cohort studies.

Implications

In epidemiological studies, researchers often have to make a trade-off between the amount of data they would like to collect and the amount of data it is possible to collect without increasing the non-response due to overly burdensome inventories. In these circumstances, it is not uncommon for the original scales to be abbreviated. Research using job strain as the exposure measure has not always been based on validated standardised protocols and modifications in the questionnaire may have contributed to inconsistencies in the observed job strain-disease association across various studies. For example, in a recent meta-analysis of ten prospective cohort studies, the authors reported a pooled relative risk of 1.4 (95% confidence intervals 1.1-1.8) for incident coronary heart disease among participants with job strain compared to those without [41]. However, there was significant heterogeneity among datasets, with effect estimates close to the null value, or even opposite to the expected direction, in some studies [41]. Even though our study showed reasonable agreement for all the investigated partial scales with the complete scale, the agreement as well as the sensitivity decreased when several items were missing in the two sub scales of the job strain measure. Lower sensitivity implies increased risk of misclassification of job strain when using abbreviated scales, which may attenuate or inflate a true relationship between job strain and an outcome of interest. When using abbreviated scales the item content is important to consider. The control scale in the job strain index is composed of two dimensions -skill discretion and decision authority- and both these dimensions should be covered in a partial scale to measure the same construct as the complete JCQ/DCQ scale. This was the case in all the 17 studies comprising IPD-Work.

Conclusions

Information on the agreement between alternative operationalisations of job strain may help with the interpretation of previous findings, and harmonisation of multi-cohort data for pooled analyses. Our study provides information on the agreement between complete and partial job strain scales based on existing data from several European cohort studies. A high agreement for partial scales with at least half of the items of the complete scales, and an accurate classification of job strain when at least one of the scales has no missing items, suggest that these abbreviated scales assess the same underlying concepts as the complete survey instrument. However, all the partial scales in the present study (including the subscales comprising only two items), showed high to reasonable agreement with the complete scales. In order to capture the theoretical background for job strain and to measure the same construct as the complete JCQ/DCQ, it is important that the abbreviated control scales cover both the skill discretion and the decision authority dimensions.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All authors participated in designing the study, generating hypotheses, interpreting the data and writing or critically reviewing the paper. Eleonor I Fransson, Töres Theorell and Mika Kivimäki analysed the data and wrote the first draft. All authors read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2458/12/62/prepub

Supplementary Material

Additional file 1

Description of the studies included in IPD-Work Consortium.

Click here for file^{(46K, DOC)}

Additional file 2

Appendix tables tables1,1, ,2,2, ,3,3, ,4,4, ,5,5, correlations, sensitivity, specificity and Kappa statistics for complete and partial job strain scales defined by the quotient, logarithmic, and subtraction approaches.

Click here for file^{(172K, DOC)}

Acknowledgements

The authors would like to thank Tuula Oksanen, Jaana Pentti, Paula Salo, Marianna Virtanen, (Finnish Public Sector study), Nico Dragano, Thorsten Lunau, Johannes Siegrist, Raimund Erbel, Karl-Heinz Jöckel (Heinz Nixdorf Recall (HNR) study), Ida E.H. Madsen, Reiner Rugulies, Hermann Burr, Marianne Borritz, Martin L. Nielsen (Copenhagen Psychosocial Questionnaire (COPSOQ); Danish Work Environment Cohort Study (DWECS); Intervention Project on Absence and Well-being (IPAW); and Burnout, Motivation and Job Satisfaction (PUMA) studies), Jane E. Ferrie, Michael G. Marmot (Whitehall II study), Goedele A. Geuskens, Wendela E. Hooftman, Irene L. Houtman (Permanent Onderzoek Leefsituatie (POLS); Netherlands Working Conditions Survey (NWCS)), Matti Joensuu, Aki Koskinen, Anne Kouvonen, Ari Väänänen (Still Working study), for IPD-Work Consortium collaboration and providing information on job strain items available in the respective studies.

The IPD work consortium is supported by the EU New OSH ERA research programme (funded by the Finnish Work Environment Fund, Finland, the Swedish Council for Working Life and Social Research, Sweden (2009-2126), the German Social Accident Insurance, Germany, the Danish National Research Centre for the Working Environment), the Academy of Finland (grant #132944), the BUPA Foundation (grant #22094477) and the Ministry of Social Affairs and Employment, the Netherlands. EIF is supported by the Swedish council for working life and social research (2009-2126, 2010-1823). STN and KH are funded by the Academy of Finland and the Finnish Work Environment Foundation. LA is funded by the Swedish Council for Working Life and Social Research (2007-0740). DdB, AC, EC, FK and the Belstress studies are supported by the Belgian Federal Science Policy Office, the National Research Foundation (FWO/FNRS) and the Belgian Federal Public Service of Employment, Labour and Social Dialogue and the European Social Fund. GDB is a Wellcome Trust Fellow. CL is funded by the Swedish Council for Working Life and Social Research (2005-0734) and the Swedish Research Council (825-2009-6192). LLMH is supported by the Swedish Council for Working Life and Social Research (2008-1077). ASM is supported by a "European Young Investigator Award" from the European Science Foundation and the National Institute of Aging, NIH (R01AG013196 (PI); R01AG034454) (PI)). HW is financed by a research program grant from the Swedish Council for Working Life and Social Research (2007-1143). MiK is funded by the Academy of Finland, the UK BUPA Foundation, the Medical Research Council, UK, and the US National Institutes of Health (R01HL036310; R01AG034454). The funders of the consortium had no role in the study design, data collection and analysis or writing of the manuscript, or in the decision to submit the manuscript for publication.

References

de Jonge J, van Vegchel N, Shimazu A, Schaufeli W, Dormann C. A longitudinal test of the demand-control model using specific job demands and specific job control. Int J Behav Med. 2010;17(2):125–133. doi: 10.1007/s12529-010-9081-1. [PMC free article] [PubMed] [Cross Ref]
Heraclides A, Chandola T, Witte DR, Brunner EJ. Psychosocial stress at work doubles the risk of type 2 diabetes in middle-aged women: evidence from the Whitehall II study. Diabetes Care. 2009;32(12):2230–2235. doi: 10.2337/dc09-0132. [PMC free article] [PubMed] [Cross Ref]
Jansson C, Jeding K, Lagergren J. Job strain and risk of esophageal and cardia cancers. Cancer Epidemiol. 2009;33(6):473–475. doi: 10.1016/j.canep.2009.10.008. [PubMed] [Cross Ref]
Kivimaki M, Leino-Arjas P, Luukkonen R, Riihimaki H, Vahtera J, Kirjonen J. Work stress and risk of cardiovascular mortality: prospective cohort study of industrial employees. BMJ. 2002;325(7369):857. doi: 10.1136/bmj.325.7369.857. [PMC free article] [PubMed] [Cross Ref]
Laszlo KD, Ahnve S, Hallqvist J, Ahlbom A, Janszky I. Job strain predicts recurrent events after a first acute myocardial infarction: the Stockholm Heart Epidemiology Program. J Intern Med. 2010;267(6):599–611. [PubMed]
Lindeberg SI, Rosvall M, Choi B, Canivet C, Isacsson SO, Karasek R, Ostergren PO. Psychosocial working conditions and exhaustion in a working population sample of Swedish middle-aged men and women. Eur J Public Health. 2011;21(2):190–196. doi: 10.1093/eurpub/ckq039. [PubMed] [Cross Ref]
Netterstrom B, Kristensen TS, Sjol A. Psychological job demands increase the risk of ischaemic heart disease: a 14-year cohort study of employed Danish men. Eur J Cardiovasc Prev Rehabil. 2006;13(3):414–420. [PubMed]
Tsutsumi A, Kayaba K, Kario K, Ishikawa S. Prospective study on occupational stress and risk of stroke. Arch Intern Med. 2009;169(1):56–61. doi: 10.1001/archinternmed.2008.503. [PubMed] [Cross Ref]
Eaker ED, Sullivan LM, Kelly-Hayes M, D'Agostino RB Sr, Benjamin EJ. Does job strain increase the risk for coronary heart disease or death in men and women? The Framingham Offspring Study. Am J Epidemiol. 2004;159(10):950–958. doi: 10.1093/aje/kwh127. [PubMed] [Cross Ref]
Greenlund KJ, Kiefe CI, Giles WH, Liu K. Associations of job strain and occupation with subclinical atherosclerosis: The CARDIA Study. Ann Epidemiol. 2010;20(5):323–331. doi: 10.1016/j.annepidem.2010.02.007. [PMC free article] [PubMed] [Cross Ref]
Kuper H, Adami HO, Theorell T, Weiderpass E. The socioeconomic gradient in the incidence of stroke: a prospective study in middle-aged women in Sweden. Stroke. 2007;38(1):27–33. [PubMed]
Lee S, Colditz G, Berkman L, Kawachi I. A prospective study of job strain and coronary heart disease in US women. Int J Epidemiol. 2002;31(6):1147–1153. doi: 10.1093/ije/31.6.1147. discussion 1154. [PubMed] [Cross Ref]
Kivimaki M, Head J, Ferrie JE, Brunner E, Marmot MG, Vahtera J, Shipley MJ. Why is evidence on job strain and coronary heart disease mixed? An illustration of measurement challenges in the Whitehall II study. Psychosom Med. 2006;68(3):398–401. doi: 10.1097/01.psy.0000221252.84351.e2. [PubMed] [Cross Ref]
Kivimaki M, Vahtera J, Elovainio M, Keltikangas-Jarvinen L, Virtanen M, Hintsanen M, Vaananen A, Singh-Manoux A, Ferrie JE. What are the next steps for research on work stress and coronary heart disease? SJWEH Suppl. 2008;6:33–40.
Karasek R. Job demands, job decision latitude, and mental strain: Implications for job redesign. Adm Sci Q. 1979;24:285–308. doi: 10.2307/2392498. [Cross Ref]
Karasek R, Theorell T. Healthy Work: Stress, productivity and the reconstruction of working life. New York: Basic Books, Inc; 1990.
Job Content Questionnaire, Recommended format. http://www.jcqcenter.org/
Theorell T. In: Behavioral medicine approaches to cardiovascular disease prevention. Orth-Gomér K, Schneiderman N, editor. Mahwah, NJ: Lawrence Erlbaum Associates; 1996. The demand-control-support model for studying health in relation to the work environment - an interactive model; pp. 69–85.
Theorell T, Perski A, Akerstedt T, Sigala F, Ahlberg-Hulten G, Svensson J, Eneroth P. Changes in job strain in relation to changes in physiological state. A longitudinal study Scand J Work Environ Health. 1988;14(3):189–196. [PubMed]
Karasek R, Choi B, Ostergren PO, Ferrario M, De Smet P. Testing two methods to create comparable scale scores between the Job Content Questionnaire (JCQ) and JCQ-like questionnaires in the European JACE Study. Int J Behav Med. 2007;14(4):189–201. doi: 10.1007/BF03002993. [PubMed] [Cross Ref]
Coetsier P, De Backer G, De Corte W, Hellemans C, Karnas G, Kornitzer M, Pelfrenen E, Stam M, Vlerick P. Etude belge du stress au travail: Aperçu du modèle de recherche et des outils d'investigation [Belgian job stress study (BELSTRESS): overview of the study model and research methods.] Rev Psychol Psychom. 1996;17:17–35.
Goldberg M, Leclerc A, Bonenfant S, Chastang JF, Schmaus A, Kaniewski N, Zins M. Cohort profile: the GAZEL Cohort Study. Int J Epidemiol. 2007;36(1):32–39. [PMC free article] [PubMed]
Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001;17(11):991–999. doi: 10.1023/A:1020016922473. [PubMed] [Cross Ref]
Hasson D, Theorell T, Westerlund H, Canlon B. Prevalence and characteristics of hearing problems in a working and non-working Swedish population. J Epidemiol Community Health. 2010;64(5):453–460. doi: 10.1136/jech.2009.095430. [PubMed] [Cross Ref]
Magnusson Hanson LL, Theorell T, Oxenstierna G, Hyde M, Westerlund H. Demand, control and social climate as predictors of emotional exhaustion symptoms in working Swedish men and women. Scand J Public Health. 2008;36(7):737–743. doi: 10.1177/1403494808090164. [PubMed] [Cross Ref]
Alfredsson L, Hammar N, Fransson E, de Faire U, Hallqvist J, Knutsson A, Nilsson T, Theorell T, Westerholm P. Job strain and major risk factors for coronary heart disease among employed males and females in a Swedish study on work, lipids and fibrinogen. Scand J Work Environ Health. 2002;28(4):238–248. doi: 10.5271/sjweh.671. [PubMed] [Cross Ref]
Kristensen TS, Hannerz H, Hogh A, Borg V. The Copenhagen Psychosocial Questionnaire-a tool for the assessment and improvement of the psychosocial work environment. Scand J Work Environ Health. 2005;31(6):438–449. doi: 10.5271/sjweh.948. [PubMed] [Cross Ref]
Burr H, Bjorner JB, Kristensen TS, Tuchsen F, Bach E. Trends in the Danish work environment in 1990-2000 and their associations with labor-force changes. Scand J Work Environ Health. 2003;29(4):270–279. doi: 10.5271/sjweh.731. [PubMed] [Cross Ref]
Vaananen A, Murray M, Koskinen A, Vahtera J, Kouvonen A, Kivimaki M. Engagement in cultural activities and cause-specific mortality: prospective cohort study. Prev Med. 2009;49(2-3):142–147. doi: 10.1016/j.ypmed.2009.06.026. [PubMed] [Cross Ref]
Kivimaki M, Lawlor DA, Davey Smith G, Kouvonen A, Virtanen M, Elovainio M, Vahtera J. Socioeconomic position, co-occurrence of behavior-related risk factors, and coronary heart disease: the Finnish Public Sector study. Am J Public Health. 2007;97(5):874–879. doi: 10.2105/AJPH.2005.078691. [PubMed] [Cross Ref]
Stang A, Moebus S, Dragano N, Beck EM, Mohlenkamp S, Schmermund A, Siegrist J, Erbel R, Jockel KH. Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf Recall Study: identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005;20(6):489–496. doi: 10.1007/s10654-005-5529-z. [PubMed] [Cross Ref]
Nielsen ML, Kristensen TS, Smith-Hansen L. The Intervention Project on Absence and Well-being (IPAW): Design and results from the baseline of a 5-year study. Work Stress. 2002;16(3):191–206. doi: 10.1080/02678370210164003. [Cross Ref]
Holle R, Happich M, Lowel H, Wichmann HE. KORA-a research platform for population based health research. Gesundheitswesen. 2005;67(Suppl 1):S19–S25. [PubMed]
van den Bossche SNJ, Hupkens CLH, de Ree SJM, Smulders PGW. Nationale Enquête Arbeidsomstandigheden 2005: methodologie en globale resultaten. [Netherlands Working Conditions Survey, methodology and overall results. Hoofddorp: TNO Work & Employment; 2005. 2006.
de Groot W, Dekker R. EuReporting Working Paper No 30. Mannheim: Mannheim Centre for European Social Research; 2001. The Dutch System of Official Social Surveys.
Borritz M, Rugulies R, Christensen KB, Villadsen E, Kristensen TS. Burnout as a predictor of self-reported sickness absence among human service workers: prospective findings from three year follow up of the PUMA study. Occup Environ Med. 2006;63(2):98–106. doi: 10.1136/oem.2004.019364. [PMC free article] [PubMed] [Cross Ref]
Marmot MG, Smith GD, Stansfeld S, Patel C, North F, Head J, White I, Brunner E, Feeney A. Health inequalities among British civil servants: the Whitehall II study. Lancet. 1991;337(8754):1387–1393. doi: 10.1016/0140-6736(91)93068-K. [PubMed] [Cross Ref]
Courvoisier DS, Perneger TV. Validation of alternative formulations of job strain. [Erratum in: J Occup Health. 2010, 52(4):E4] J Occup Health. 2010;52(1):5–13. doi: 10.1539/joh.L9084. [PubMed] [Cross Ref]
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–174. doi: 10.2307/2529310. [PubMed] [Cross Ref]
Choi B, Bjorner JB, Ostergren PO, Clays E, Houtman I, Punnett L, Rosengren A, De Bacquer D, Ferrario M, Bilau M. et al. Cross-language differential item functioning of the job content questionnaire among European countries: the JACE study. Int J Behav Med. 2009;16(2):136–147. doi: 10.1007/s12529-009-9048-2. [PMC free article] [PubMed] [Cross Ref]
Kivimaki M, Virtanen M, Elovainio M, Kouvonen A, Vaananen A, Vahtera J. Work stress in the etiology of coronary heart disease-a meta-analysis. Scand J Work Environ Health. 2006;32(6):431–442. doi: 10.5271/sjweh.1049. [PubMed] [Cross Ref]

Articles from BMC Public Health are provided here courtesy of
BioMed Central