Psychometric assessment of a scale to measure bonding workplace social capital

PLOS ONE, Jun 2017

Objectives Workplace social capital (WSC) has attracted increasing attention as an organizational and psychosocial factor related to worker health. This study aimed to assess the psychometric properties of a newly developed WSC scale for use in work environments, where bonding social capital is important. Methods We assessed the psychometric properties of a newly developed 6-item scale to measure bonding WSC using two data sources. Participants were 1,650 randomly selected workers who completed an online survey. Exploratory factor analyses were conducted. We examined the item–item and item–total correlations, internal consistency, and associations between scale scores and a previous 8-item measure of WSC. We evaluated test–retest reliability by repeating the survey with 900 of the respondents 2 weeks later. The overall scale reliability was quantified by an intraclass coefficient and the standard error of measurement. We evaluated convergent validity by examining the association with several relevant workplace psychosocial factors using a dataset from workers employed by an electrical components company (n = 2,975). Results The scale was unidimensional. The item–item and item–total correlations ranged from 0.52 to 0.78 (p < 0.01) and from 0.79 to 0.89 (p < 0.01), respectively. Internal consistency was good (Cronbach’s α coefficient: 0.93). The correlation with the 8-item scale indicated high criterion validity (r = 0.81) and the scale showed high test–retest reliability (r = 0.74, p < 0.01). The intraclass coefficient and standard error of measurement were 0.74 (95% confidence intervals: 0.71–0.77) and 4.04 (95% confidence intervals: 1.86–6.20), respectively. Correlations with relevant workplace psychosocial factors showed convergent validity. Conclusions The results confirmed that the newly developed WSC scale has adequate psychometric properties.

A PDF file should load here. If you do not see its contents the file may be temporarily unavailable at the journal website or you do not have a PDF plug-in installed and enabled in your browser.

Alternatively, you can download the file locally and open with any standalone PDF reader:

http://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0179461&type=printable

Psychometric assessment of a scale to measure bonding workplace social capital

June Psychometric assessment of a scale to measure bonding workplace social capital Hisashi Eguchi 0 1 Akizumi Tsutsumi 0 1 Akiomi Inoue 1 Yuko Odagiri 1 0 Department of Public Health, Kitasato University School of Medicine, Kanagawa, Japan, 2 Department of Mental Health, Institute of Industrial Ecological Sciences, University of Occupational and Environmental Health, Japan , Kitakyushu , Japan , 3 Department of Preventive Medicine and Public Health, Tokyo Medical University , Tokyo , Japan 1 Editor: Toshiyuki Ojima , Hamamatsu Ika Daigaku , JAPAN Workplace social capital (WSC) has attracted increasing attention as an organizational and psychosocial factor related to worker health. This study aimed to assess the psychometric properties of a newly developed WSC scale for use in work environments, where bonding social capital is important. We assessed the psychometric properties of a newly developed 6-item scale to measure bonding WSC using two data sources. Participants were 1,650 randomly selected workers who completed an online survey. Exploratory factor analyses were conducted. We examined the item±item and item±total correlations, internal consistency, and associations between scale scores and a previous 8-item measure of WSC. We evaluated test±retest reliability by repeating the survey with 900 of the respondents 2 weeks later. The overall scale reliability was quantified by an intraclass coefficient and the standard error of measurement. We evaluated convergent validity by examining the association with several relevant workplace psychosocial factors using a dataset from workers employed by an electrical components company (n = 2,975). - Data Availability Statement: Data is not suitable for public deposition due to ethical concerns. The data set is under processing to be suitable for public deposition to meet the revised Japanese Ethical Guidelines for Medical and Health Research Involving Human Subjects. The data set is managed by the data management committee on J-SHINE and J-HOPE. Researchers who have an interest in the analysis using J-HOPE data, please contact Prof. Akizumi Tsutsumi, who is one of the data managing committee members and are responsible for the J-HOPE data, . Objectives Methods Results The scale was unidimensional. The item±item and item±total correlations ranged from 0.52 to 0.78 (p < 0.01) and from 0.79 to 0.89 (p < 0.01), respectively. Internal consistency was good (Cronbach's α coefficient: 0.93). The correlation with the 8-item scale indicated high criterion validity (r = 0.81) and the scale showed high test±retest reliability (r = 0.74, p < 0.01). The intraclass coefficient and standard error of measurement were 0.74 (95% confidence intervals: 0.71±0.77) and 4.04 (95% confidence intervals: 1.86±6.20), respectively. Correlations with relevant workplace psychosocial factors showed convergent validity. Funding: The present study was supported by a Grant-in-Aid for Scientific Research on Innovative Areas (Research in a Proposed Research Area) 2009±2013 (No. 4102-21119001) from the Ministry of Education, Culture, Sports, Science and Technology, Japan, a KAKENHI Grant Number 26253042 from the Japan Society for the Promotion of Science, and a Health and Labour Sciences Research Grant 2015±2017 (H27-RodoIppan-004) from the Ministry of Health, Labour and Welfare, Japan. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Conclusions The results confirmed that the newly developed WSC scale has adequate psychometric properties. Introduction Workplace social capital (WSC) has attracted increasing attention as an organizational and psychosocial factor related to workers' health. There are several aspects of WSC, such as the extent and intensity of associational links or activities, and perceptions of support, reciprocity, and trust in the workplace [ 1 ]. A growing body of research has identified WSC as a determinant of employee health [ 2 ]. Empirical studies have found associations between low WSC and depression [ 3, 4 ], hypertension [ 5, 6 ], poor self-rated health [ 4, 7 ], smoking [ 4, 8 ], and high mortality [ 9 ]. On the other hand, a meta-analysis showed no association between most social capital dimensions and all-cause mortality, cardiovascular disease or cancer [ 10 ]. Thus, further studies are necessary to explore the health effects of WSC. Several WSC scales have been used in Western countries. Trust and mutual aid in the workplace have been measured in the United States [ 11 ]. A 6-item scale was developed in Germany to examine personal aspects of social capital, such as shared values, support, aggregation, and recognition of trust within an organization [ 12, 13 ]. In Finland, Kouvonen et al. developed an 8-item scale to measure a multifaceted concept that included reciprocity, mutual aid, and cooperative interpersonal relationships beyond differences in workplace position [14]. Currently, Kouvonen et al.'s scale is the most frequently cited instrument in the occupational stress research field [6, 9, 15]. The separate and combined effects of the three types of social capital (i.e., bonding, bridg ing, and linking social capital) have attracted broad interest [ 16 ]. Bonding refers to the value assigned to social relationships among individuals with similar socioeconomic attributes. Bridging describes relationships between dissimilar persons at the same hierarchical levels. Linking refers to relationships between persons across different hierarchical levels. These constructs are relevant in specifying how WSC inheres in relationships between individuals in similar social contexts and different levels of society [14, 16]. Bonding WSC is of particular importance in Japanese society because Japanese culture is group-oriented; altruism, teamwork, and group cohesiveness are all strongly emphasized in Japanese society, and individual identity is defined by the social group [17±19]. Trust and reci procity are a key factor in Japanese society. Previous studies from Japan showed the association of trust and reciprocity with worker's health [ 4, 20 ]. The use of well-validated questionnaires is indispensable for measurement across diverse cultural settings. However, there are currently no original scales that measure bonding, trust and reciprocity of WSC in consideration of Japanese context. This study aimed to analyze a newly developed scale for measuring bonding WSC and to assess the psychometric properties in a Japanese working population. The development of the scale was based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) [21]. 2 / 13 Materials and methods Scale development The measurement theory underlying the scale development was based on the reflective model (COSMIN Box E-1). Fourteen items were generated for the scale during the process of developing the New Brief Job Stress Questionnaire [ 22 ]. These items were collected from previous questionnaires based on relevant occupational stress theories and through a series of meetings with experts and stakeholders. The stakeholder meeting comprised researchers from five institutes or departments of occupational safety and health, occupational health personnel (physicians, nurses, and hygienists), and representatives of two employer associations and one employee organization. As previously mentioned, bonding WSC is of particular relevance to Japanese society [23]; therefore, we selected items relevant to bonding WSC to measure the network, trust, and reciprocity aspects of WSC. The items assessing the network aspects of WSC were adapted from Kouvonen et al. [14] and included three items that measured bonding WSC. The trust and reciprocity items were taken from previous Japanese studies that used the social cohesion approach to conceptualizing social capital [4, 11, 19, 20, 24±26]. These studies examined individuals' perceptions of the trustworthiness of others, as well as the norms of solidarity and reciprocity that exist within the groups to which individuals belong. Norms and social trust represent features of social relationships that facilitate collective action for mutual benefit at workplaces [ 11 ]. Content validity, including face validity, was checked via item analyses and stakeholder discussions, and a consensus was reached that six items would be retained for the scale. All items were answered using a 4-point scale (1 = strongly disagree to 4 = strongly agree). Ratings for all items were summed to provide a single index. The scale is the following (COSMIN Box A-1, D-1, D-3, D-4). Item 1. People keep each other informed about work-related issues in the work unit. Item 2. We have a ªwe are togetherº attitude. Item 3. People feel understood and accepted by each other. Item 4. In our workplace, there is an atmosphere of helping each other. Item 5. In our workplace, we trust each other. Item 6. Our workplace is a place of laughter and smiles. Study design and population Online survey. We conducted a new survey to confirm the reliability and validity of the WSC scale. A series of online surveys was conducted in February 2016 with participants registered with a Japanese online survey company. In total, 581,660 working people (excluding those who were self-employed, unemployed, or students) aged 20±69 years, of both sexes and all ages, were randomly invited to participate in the survey. Participants were selected with a random number generator; the study population comprised individuals interested in participating in a survey that provided a financial incentive for responding. The online survey company contacted selected registrants to answer the survey and ceased recruitment when the total number of participants reached the target number. The sex ratio was 1:1 and there were an equal number of participants in each age group (20±29, 30±39, 40±49, 50±59, and 60±69 years). The financial incentive for participants was modest, valued at approximately a few US dollars. For economic reasons, recruitment ceased when the number of participants exceeded 1,650; this was a moderate sample size based on a previous study [27] (COSMIN Box A-4, A-6, 3 / 13 B-3, C-3, E-4, H-3, J-3). At least 301 participants were considered necessary to detect an intraclass correlation efficient (ICC) (2,1) 0.50 (error α = 0.05 and β = 0.20) between the first and second survey[ 28 ]. We repeated the survey with 900 of the respondents using the same WSC questionnaire 2 weeks later (COSMIN Box B-4, B-5, B-6, B-9, C-4, C-5, C-6, C-9). The second survey respondents were recruited on a first-come, first-served basis until the number of participants achieved 900. A time interval of about 2 weeks is considered appropriate for the evaluation of instruments [ 29 ] (COSMIN Box B-8, C-8). There were no differences in WSC and participant demographic characteristics between the two survey periods (COSMIN Box Generalisability-4, -5, -7). Because our online survey required participants to answer all the questions, no participants had missing items (COSMIN Box A-2, A-3, B-1, B-2, C-1, C-2, H-1, H-2, Generalisability-8). Company survey. We used the existing database to confirm the convergent validity of the WSC scale. We used part of a cross-sectional dataset collected from a baseline survey of an occupational cohort study on social class and health in Japan (Japanese Study of Health, Occupation, and Psychosocial Factors Related Equity: J-HOPE), which was conducted from April to June 2011. We selected workers employed by an electrical components company at two manufacturing sites. The total number of employees in the company was about 15,000. This dataset comprised information from 3,461 workers who completed a self-administered questionnaire. This contained scales that measured a broad range of relevant workplace psychosocial factors and psychological distress together with the WSC scale (response rate = 95.3%). After excluding 486 workers who had at least one missing response on the questionnaire, the final number of respondents was 2,975 (2,204 men and 771 women: valid response rate = 86.0%), which was a moderate sample size based on a previous study [ 27 ] (COSMIN Box A-4, A-6, B-3, C-3, E-4, F-3, H-3, J-3). We compared the final respondents of the study population (n = 2,975) with participants with at least one missing response on the questionnaire (n = 486). There were no significant differences between these groups in job demands, coworker support, effort±reward imbalance (ERI), penetration of management philosophy, work engagement, psychological distress, or education. However, job control, supervisor support, procedural justice, interactional justice, the proportion of men, number of younger individuals, number of regular workers, and number of less skilled workers were lower in the missing response group (COSMIN Box Generalisability-4, -5, -7, -8). Among participants with at least one missing response on the WSC scale, 69% had only one missing response. There were no large differences in the number of missing responses between individual items related to WSC: item 1 (n = 14), item 2 (n = 19), item 3 (n = 18), item 4 (n = 16), item 5 (n = 17), and item 6 (n = 13) (COSMIN Box F-2). Measures Online survey. Kouvonen et al.'s [ 14 ] WSC scale:To evaluate criterion validity, we used a Japanese version of Kouvonen et al.'s WSC scale [ 14 ] (COSMIN Box H-4). This measure is a reliable and valid indicator of WSC, and shows strong associations with self-rated health [ 14 ], depression [ 30 ], hypertension [ 6 ], and mortality [ 9 ]. Using a 5-point Likert scale, participants report their perceptions of the following issues: ªWe have a `we are together' attitude,º ªPeople feel understood and accepted by each other,º ªPeople keep each other informed about workrelated issues in the work unit,º ªMembers of the work unit build on each other's ideas in order to achieve the best possible outcome,º ªPeople in the work unit cooperate in order to help develop and apply new ideas,º ªWe can trust our supervisor,º ªOur supervisor treats us with kindness and consideration,º and ªOur supervisor shows concern for our rights as an employee.º Odagiri et al. [ 31 ] have found acceptable internal consistency, reliability, and 4 / 13 validity for the Japanese version of the WSC. In our online survey, Cronbach's α coefficient was 0.94. Company survey. Job demands, job control, supervisor support, and coworker support: We used the scales measuring job demands, job control, supervisor support, and coworker support from the Japanese version of the Job Content Questionnaire [ 32 ]. The Job Content Questionnaire, developed by Karasek, is based on the job demands±control (or demand±control±support) model and includes scales for job demands (five items), job control (nine items), supervisor support (four items), and coworker support (four items) rated on a 4-point scale (1 = strongly disagree to 4 = strongly agree). The reliability and validity of the Japanese version of the Job Content Questionnaire are acceptable, as shown by Kawakami et al. [ 33 ]. In the present study sample, Cronbach's α coefficients were 0.68, 0.82, 0.90, and 0.79 for the job demands, job control, supervisor support, and coworker support scales, respectively (COSMIN Box F-7, F-8). Effort±reward imbalance (ERI). To assess ERI, we used data collected from a simplified Japanese version of the ERI Questionnaire [34]. This version includes scales for effort (three items) and reward (seven items) rated on a 4-point scale (1 = strongly disagree to 4 = strongly agree). Kurioka et al. [ 35 ] have reported acceptable reliability and validity for the simplified Japanese version of the ERI Questionnaire. In the present study sample, Cronbach's α coeffi cients were 0.78 and 0.72 for the effort and reward scales, respectively. We calculated the effort/reward ratio to measure the extent of the ERI (COSMIN Box F-7, F-8). Procedural and interactional justice. Two aspects of organizational justice (i.e., proce dural and interactional) were assessed using the Japanese version of the Organizational Justice Questionnaire. This instrument was developed by Moorman [36] and was modified by Elova nio et al. [ 37 ]. It comprises a 7-item scale that measures procedural justice, and a 6-item scale that measures interactional justice, both of which are rated on a 5-point scale (1 = strongly disagree to 5 = strongly agree). Inoue et al. [ 38 ] have confirmed the reliability and validity of the Japanese version of the scale. In the present study sample, Cronbach's α coefficients were 0.88 and 0.94 for procedural and interactional justice scales, respectively (COSMIN Box F-7, F-8). Penetration of management philosophy. Penetration of management philosophy was assessed using three questions derived from previous studies [ 39 ]. Participants reported their perceptions of the following issues: ªI understand my company management philosophy," ªMy company management philosophy has a strong effect on my attitudes towards my work," and ªMy company management philosophy fits my sense of value." Responses were measured on a 5-point scale (1 = completely disagree to 5 = completely agree). Item scores were summed and greater scores indicated greater penetration of management philosophy. In the present study sample, Cronbach's α coefficient was 0.86 for the penetration of management philosophy scale (COSMIN Box F-7, F-8). Work engagement. Work engagement was assessed using the short form of the Utrecht Work Engagement Scale (UWES) [40]. The UWES includes three subscales that reflect the underlying dimensions of engagement: vigor, dedication, and absorption (three items for each). All items were scored on a 7-point Likert scale ranging from 0 (never) to 6 (always). The validation study of the Japanese version of the UWES [ 41 ] recommends that work engagement should be treated as a unitary construct owing to high correlations among the three components. In the present study sample, Cronbach's α coefficient was 0.93 for the UWES (COSMIN Box F-7, F-8). Psychological distress. The K6 scale, developed by Kessler et al. [42], consists of six items that measure the extent of psychological distress using a 5-point response option (0 = none of the time to 4 = all of the time). The Japanese version of the K6 scale has acceptable reliability and validity [43]. The item scores are summed to calculate a total score; higher scores indicate 5 / 13 greater psychological distress. In the present study sample, Cronbach's α coefficient was 0.88 for the K6 scale (COSMIN Box F-7, F-8). Demographic variables. In both the online and company surveys, we measured sex, age group (18±29, 30±39, 40±49, 50±59, and 60±69 years), educational attainment (more than 12 years or not greater than 12 years), employment contract (regular or part-time), and job types to describe the study population (COSMIN Box D-2). Hypothesis testing According to COSMIN, hypothesis testing must be used when a gold standard is not available. WSC is theoretically related to other psychosocial factors in the workplace [14]. We hypothe sized that WSC might be negatively correlated with job demands (r −0.05), ERI (r −0.20), and psychological distress (r −0.05), and positively correlated with job control (r 0.20), procedural justice (r 0.50), interactional justice (r 0.50), work engagement (r 0.30), and penetration of management philosophy (r 0.30). These hypothesized effect sizes were estimated from previous studies [ 14, 44, 45 ] (COSMIN boxes F-4, F-5, F-6, F-7). Statistical analysis (COSMIN Box F-10) Online survey. We used classical test theory to measure bonding WSC. Mean values and standard deviations were calculated for each item of the WSC scale. We tested sex, age, education, employment contract, and occupational differences in the WSC scale with analysis of variance. Item±item and item±total Spearman's correlations were examined. Exploratory factor analyses were conducted, and all six items were entered using the unweighted least squares method. Factors with eigenvalues of more than 1.0 were extracted, and the Promax rotation method was used to obtain clear factorial structures (COSMIN Box E-6). The survey was repeated using the same WSC scale for 900 of the respondents after 2 weeks to assess the replicability of the WSC scale using the test±retest method (COSMIN Box B-4, B-5, B-6, B-9). The overall scale reliability was quantified by both an intraclass correlation coefficient (ICC) (2,1) based on a single measurement two-way random effects model of absolute agreement [ 46 ] (COSMIN Box B-11) and the standard error of measurement (SEM) (COSMIN Box C-11). ICC (2,1) was interpreted in accordance with published recommendations: an ICC (2,1) of 0.90 or higher was considered excellent, 0.75 or higher good, 0.50 or higher moderate, and lower than 0.50 poor [ 46 ]. The larger the SEM, the lower the test reliability and the less precision in the measures and scores obtained [ 47 ]. To evaluate internal consistency, Cronbach's α coefficient was calculated (COSMIN Box A-7, A-9). To confirm criterion validity, Pearson's correlation was computed between our scale scores and scores from Kouvonen et al.'s scale (COSMIN Box H-6). Company survey. To evaluate convergent validity, we calculated the Pearson's correlation coefficients between the WSC and job demands, job control, supervisor support, coworker support, ERI, procedural justice, interactional justice, penetration of management philosophy, work engagement, and psychological distress based on the hypothesis testing. The level of significance used was 0.05 (two-tailed). IBM SPSS Statistics for Windows, Version 23 (IBM Corp., Armonk, NY, USA) was used for the statistical analyses. Ethics review and approval The study aims and protocol were reviewed and approved by the Research Ethics Committee of the Graduate School of Medicine and Faculty of Medicine, The University of Tokyo (No. 2772), the Kitasato University Medical Ethics Organization (Nos. B12-103 and B15-132), and 6 / 13 the Ethics Committee of the University of Occupational and Environmental Health, Japan (No. 10±004). Written consent was obtained from participants. Results Participants' demographic characteristics and means and standard deviations of total WSC score by the characteristics for the two databases are shown in Table 1 (COSMIN Box J-4, J-7, Generalisability-2). Means of total WSC were significantly different between ages, educations, and occupations in the online survey and between ages and occupations in the company survey. Online survey (4.00) (4.10) (4.17) (3.93) SD, standard deviation. b, Item±item correlations and item±total correlations: all Spearman correlations; p < 0.001 in all cases. Item 1b Item 2b Item 3b Item 4b Item 5b between the WSC scores of the two survey rounds indicated high test±retest reliability (r = 0.74, p < 0.01). The ICC (2,1) and SEM for WSC were 0.74 (95% confidence intervals [CI]: 0.71±0.77) and 4.04 (95% CI: 1.86±6.20). The mean of the time variation for WSC was 0.06 ± 2.92. The internal consistency of the scale was good, with a Cronbach's α coefficient of 0.93. The presence or removal of any of the items did not materially alter the internal reliability of the scale. The scale score was highly correlated with that of Kouvonen et al.'s scale (r = 0.81, p < 0.01). Company survey An aspect of convergent validity was tested by exploring the associations between the WSC score and the theoretically related constructs of job demands, job control, supervisor support, coworker support, ERI, procedural justice, interactional justice, penetration of management philosophy, work engagement, and psychological distress. Table 3 shows that, as expected, high WSC scores were significantly negatively associated with job demands, ERI, and psychological distress; and positively associated with job control, supervisor support, coworker support, procedural justice, interactional justice, penetration of management philosophy, and work engagement (all p < 0.01). Correlation coef®cientsa −0.10 0.21 0.45 0.63 −0.24 0.52 0.51 0.31 0.36 −0.30 8 / 13 Discussion We assessed the psychometric properties of our new WSC scale, which was developed to reflect the importance of bonding social capital in work environments in Japan. Following the COS MIN model, we demonstrated acceptable levels of internal consistency (Box A), reliability (Box B), measurement error (Box C), content validity (Box D), structural validity (Box E), hypothesis testing (convergent validity) (Box F), criterion validity (Box H), and generalizability among diverse populations. However, we did not examine cross-cultural validity (Box G), responsiveness (Box I), or interpretability (Box J). We examined bonding rather than bridging or linking social capital. As mentioned above, bonding is important in the cultural context of the Japanese workplace [ 23 ]. Bridging social capital is defined as respect and mutuality between people who know that they are not alike in some sociodemographic (or social identity) sense (differing by age, ethnic group, or socioeconomic class). Linking social capital refers to relationships among people who are interacting across explicit, formal, or institutionalized power or authority gradients, which might lead to top-down management in the workplace. In the previous study in the Japanese workplaces, the results of bonding WSC were consistent with previous studies, whereas linking and bridging WSC were not consistent with previous studies [ 48 ]. Because workers in Japan are from less diverse backgrounds (e.g., ethnic group or social class) and top-down management styles are less common than in Western countries [49], the bonding social capital might make more effect on the workers' health than linking and bridging in Japanese workplaces. Previous studies using our scale showed significant associations between WSC score and psychological distress, as expected [ 50, 51 ]. These results were consistent with previous studies using other WSC measures [ 3, 7 ] and provide evidence for the validity of our scale. However, the health benefits of social capital can be observed both at the individual and aggregated (workplace) level [ 14 ]. As our study only demonstrated psychometric properties at the individual level, further studies are needed to evaluate the association between workplace-level WSC and workers' health. The present study has some limitations. First, participants in the company survey were workers employed by an electrical components company at two manufacturing sites or internet users in Japan. It is unclear how much the reported psychometric properties can be generalized to other industries and non-internet users. Therefore, more research with participants of differing backgrounds is needed to validate the measure further. Second, our scale was constructed using a relatively small number of items. However, as the items were selected based on the conventional core concepts of social capital, such as "trust," "reciprocity,º and ªcollective efficacyº [4, 11, 19, 20, 24±26], as well as through discussion between experts, occupational health professionals and practitioners, we consider our new WSC scale to have a certain level of content validity. Third, this scale was originally developed in Japanese. We assumed that this scale was used in the Japanese workplace. However, there are some countries with similar working cultural background such as collectivism, allocentrism and non-diverse in east Asia[ 23, 52 ]. Therefore, this concise scale could be useful in work environments other than Japan to see the health effect of bonding workplace social capital by confirming the crosscultural validity (COSMIN Box G). Fourth, COSMIN requires a further test for responsiveness, which refers to the ability of an instrument to detect change over time in the construct to be measured (COSMIN Box I). Fifth, we could not calculate the minimal important change or the minimal important difference, which is used to define meaningful change (COSMIN Box J-8). 9 / 13 Conclusion Although further validation tests are required, the findings show that the newly developed WSC scale has adequate psychometric properties. We expect this concise scale to be useful in measuring WSC at workplaces where bonding social capital is relevant. Acknowledgments The present study was supported by a Grant-in-Aid for Scientific Research on Innovative Areas (Research in a Proposed Research Area) 2009±2013 (No. 4102±21119001) from the Min istry of Education, Culture, Sports, Science and Technology, Japan, a KAKENHI Grant Number 26253042 from the Japan Society for the Promotion of Science, and a Health and Labour Sciences Research Grant 2015±2017 (H27-Rodo-Ippan-004) from the Ministry of Health, Labour and Welfare, Japan. Author Contributions Conceptualization: AT AI YO. Data curation: HE AT AI. Formal analysis: HE. Funding acquisition: AT. Investigation: HE AT AI. Methodology: HE AT AI YO. Project administration: HE AT AI. Resources: HE AT AI. Software: HE. Supervision: AT AI YO. Validation: HE AT AI YO. Visualization: HE. Writing ± original draft: HE. Writing ± review & editing: HE AT AI YO. 10 / 13 11 / 13 12 / 13 1. Kawachi I , Berkman L . Social cohesion, social capital, and health . Social Epidemiology . 2014 ; 290 ± 319 . 2. Kawachi I , Takao S , Subramanian SV . Global perspectives on social capital and health . New York: Springer; 2013 . 3. Kouvonen A , Oksanen T , Vahtera J , Stafford M , Wilkinson R , Schneider J , et al. Low workplace social capital as a predictor of depression: The Finnish Public Sector Study . Am J Epidemiol . 2008 ; 167 ( 10 ): 1143 ± 1151 . https://doi.org/10.1093/aje/kwn067 PMID: 18413361 4. Suzuki E , Takao S , Subramanian SV , Komatsu H , Doi H , Kawachi I. Does low workplace social capital have detrimental effect on workers' health? Soc Sci Med . 2010 ; 70 ( 9 ): 1367 ± 1372 . https://doi.org/10. 1016/j.socscimed. 2010 . 01 .014 PMID: 20176429 5. Oksanen T , Kawachi I , Jokela M , Kouvonen A , Suzuki E , Takao S , et al. Workplace social capital and risk of chronic and severe hypertension: A cohort study . J Hypertens . 2012 ; 30 ( 6 ): 1129 ± 1136 . https:// doi.org/10.1097/HJH.0b013e32835377ed PMID: 22525202 6. Oksanen T , Kawachi I , Kouvonen A , Suzuki E , Takao S , Sjosten N , et al. Workplace social capital and adherence to antihypertensive medication: A cohort study . PloS One . 2011 ; 6 ( 9 ): e24732. https://doi. org/10.1371/journal.pone. 0024732 PMID: 21931836 7. Oksanen T , Kouvonen A , Vahtera J , Virtanen M , KivimaÈki M. Prospective study of workplace social capital and depression: Are vertical and horizontal components equally important? J Epidemiol Community Health . 2010 ; 64 ( 8 ): 684 ± 689 . https://doi.org/10.1136/jech. 2008 .086074 PMID: 19692720 8. Kouvonen A , Oksanen T , Vahtera J , VaÈaÈnaÈnen A , De Vogli R , Elovainio M , et al. Work-place social capital and smoking cessation: The Finnish Public Sector Study . Addiction . 2008 ; 103 ( 11 ): 1857 ± 1865 . https://doi.org/10.1111/j.1360- 0443 . 2008 . 02315 . x PMID : 18705683 9. Oksanen T , KivimaÈki M , Kawachi I , Subramanian SV , Takao S , Suzuki E , et al. Workplace social capital and all-cause mortality: A prospective cohort study of 28,043 public-sector employees in Finland . Am J Public Health . 2011 ; 101 ( 9 ): 1742 ± 1748 . https://doi.org/10.2105/AJPH. 2011 .300166 PMID: 21778502 10. Choi M , Mesa-Frias M , Nuesch E , Hargreaves J , Prieto-Merino D , Bowling A , et al. Social capital, mortality, cardiovascular events and cancer: a systematic review of prospective studies . Int J Epidemiol . 2014 ; 43 ( 6 ): 1895 ±920. https://doi.org/10.1093/ije/dyu212 PMID: 25369975 11. Kawachi I , Subramanian S , Kim D. Social capital and health: A decade of progress and beyond . In: Kawachi I , Subramanian S , Kim D , editors. Social capital and health , New York: Springer; 2008 . pp. 1 ± 26 . 12. Jung J , Nitzsche A , Ernstmann N , Driller E , Wasem J , Stieler-Lorenz B , et al. The relationship between perceived social capital and the health promotion willingness of companies: A systematic telephone survey with chief executive officers in the information and communication technology sector . J Occup Environ Med . 2011 ; 53 ( 3 ): 318 ± 323 . https://doi.org/10.1097/JOM.0b013e31820d103f PMID: 21346632 13. Jung J , Ernstmann N , Nitzsche A , Driller E , Kowalski C , Lehner B , et al. Exploring the association between social capital and depressive symptoms: Results of a survey in German information and communication technology companies . J Occup Environ Med . 2012 ; 54 ( 1 ): 23 ± 30 . https://doi.org/10.1097/ JOM.0b013e318237a1b6 PMID: 22157802 14. Kouvonen A , KivimaÈki M , Vahtera J , Oksanen T , Elovainio M , Cox T , et al. Psychometric evaluation of a short measure of social capital at work . BMC Public Health . 2006 ; 6 : 251 . https://doi.org/10.1186/ 1471 - 2458-6-251 PMID: 17038200 15. Oksanen T , Kawachi I , Kouvonen A , Takao S , Suzuki E , Virtanen M , et al. Workplace determinants of social capital: Cross-sectional and longitudinal evidence from a Finnish cohort study . PLoS One . 2013 ; 8 ( 6 ): e65846. https://doi.org/10.1371/journal.pone. 0065846 PMID: 23776555 16. Szreter S , Woolcock M. Health by association? Social capital, social theory, and the political economy of public health . Int J Epidemiol . 2004 ; 33 ( 4 ): 650 ± 667 . https://doi.org/10.1093/ije/dyh013 PMID: 15282219 17. Oyserman D , Coon HM , Kemmelmeier M. Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses . Psychol Bull . 2002 ; 128 ( 1 ): 3± 72 . PMID: 11843547 18. Brislin RW , MacNab B , Worthley R , Kabigting F , Zukis B . Evolving perceptions of Japanese workplace motivation: An employee-manager comparison . Int J Cross Cult Manag . 2005 ; 5 ( 1 ): 87 ± 104 . 19. Suzuki E , Yamamoto E , Takao S , Kawachi I , Subramanian SV . Clarifying the use of aggregated exposures in multilevel models: Self-included vs. self-excluded measures . PloS One . 2012 ; 7 ( 12 ): e51717. https://doi.org/10.1371/journal.pone. 0051717 PMID: 23251609 20. Suzuki E , Fujiwara T , Takao S , Subramanian SV , Yamamoto E , Kawachi I. Multi-level, cross-sectional study of workplace social capital and smoking among Japanese employees . BMC Public Health . 2010 ; 10 : 489 . https://doi.org/10.1186/ 1471 -2458-10-489 PMID: 20716334 21. Mokkink LB , Terwee CB , Patrick DL , Alonso J , Stratford PW , Knol DL , et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study . Qual Life Res . 2010 ; 19 ( 4 ): 539 ± 49 . https://doi.org/10. 1007/s11136-010 -9606-8 PMID: 20169472 22. Inoue A , Kawakami N , Shimomitsu T , Tsutsumi A , Haratani T , Yoshikawa T , et al. Development of a short questionnaire to measure an extended set of job demands, job resources, and positive health outcomes: The New Brief Job Stress Questionnaire . Ind Health . 2014 ; 52 ( 3 ): 175 ± 189 . https://doi.org/10. 2486/indhealth.2013-0185 PMID: 24492763 23. Oyserman D , Coon HM , Kemmelmeier M. Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses . Psychol Bull . 2002 ; 128 ( 1 ): 3± 72 . PMID: 11843547 24. Fujino Y , Kubo T , Kunimoto M , Tabata H , Tsuchiya T , Kadowaki K , et al. A cross-sectional study of workplace social capital and blood pressure: A multilevel analysis at Japanese manufacturing companies . BMJ Open . 2013 ; 3 ( 2 ): pii: e002215. https://doi.org/10.1136/bmjopen-2012 -002215 PMID: 23386581 25. Fujisawa Y , Hamano T , Takegawa S. Social capital and perceived health in Japan: An ecological and multilevel analysis . Soc Sci Med . 2009 ; 69 ( 4 ): 500 ± 505 . https://doi.org/10.1016/j.socscimed. 2009 . 05 . 046 PMID: 19577353 26. Ichida Y , Kondo K , Hirai H , Hanibuchi T , Yoshikawa G , Murata C . Social capital, income inequality and self-rated health in Chita peninsula, Japan: A multilevel analysis of older people in 25 communities . Soc Sci Med . 2009 ; 69 ( 4 ): 489 ± 499 . https://doi.org/10.1016/j.socscimed. 2009 . 05 .006 PMID: 19523728 27. Terwee CB , Mokkink LB , Knol DL , Ostelo RWJG , Bouter LM , de Vet HCW. Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist . Qual Life Res . 2012 ; 21 ( 4 ): 651 ± 657 . https://doi.org/10.1007/s11136-011 -9960-1 PMID: 21732199 28. Walter SD , Eliasziw M , Donner A . Sample size and optimal designs for reliability studies . Stat Med . 1998 ; 17 ( 1 ): 101 ± 10 . PMID: 9463853 29. Streiner DL , Norman GR , Cairney J . Health measurement scales: A practical guide to their development and use . USA: Oxford University Press; 2014 . 30. Gao J , Weaver SR , Dai J , Jia Y , Liu X , Jin K , et al. Workplace social capital and mental health among Chinese employees: A multi-level, cross-sectional study . PloS One . 2014 ; 9 ( 1 ): e85005. https://doi.org/ 10.1371/journal.pone. 0085005 PMID: 24404199 31. Odagiri Y , Ohya Y , Inoue S , Hayashi T , Uchiyama A , Takamiya T , et al. [ Reliablity and validation of the Japanese version of the measure of workplace social capital scale] . San Ei Shi. 2010 ; 52 ( Suppl .): 631 . Japanese . 32. Karasek RA . Job content questionnaire and user's guide . Lowell: University of Massachusetts; 1985 . 33. Kawakami N , Kobayashi F , Araki S , Haratani T , Furui H . Assessment of job stress dimensions based on the job demands-control model of employees of telecommunication and electric power companies in Japan: Reliability and validity of the Japanese version of the Job Content Questionnaire . Int J Behav Med . 1995 ; 2 ( 4 ): 358 ± 375 . https://doi.org/10.1207/s15327558ijbm0204_5 PMID: 16250773 34. Siegrist J , Wege N , PuÈhlhofer F , Wahrendorf M. A short generic measure of work stress in the era of globalization: Effort-reward imbalance . Int Arch Occup Environ Health . 2009 ; 82 ( 8 ): 1005 ± 1013 . https:// doi.org/10.1007/s00420-008 -0384-3 PMID: 19018554 35. Kurioka S , Inoue A , Tsutsumi A . Optimum cut-off point of the Japanese short version of the EffortReward Imbalance Questionnaire . J Occup Health . 2013 ; 55 ( 5 ): 340 ± 348 . PMID: 23892637 36. Moorman RH . Relationship between organizational justice and organizational citizenship behaviors: Do fairness perceptions influence employee citizenship ? J Appl Psychol . 1991 ; 76 ( 6 ): 845 . 37. Elovainio M , KivimaÈki M , Vahtera J . Organizational justice: Evidence of a new psychosocial predictor of health . Am J Public Health . 2002 ; 92 ( 1 ): 105 ± 108 . PMID: 11772771 38. Inoue A , Kawakami N , Tsutsumi A , Shimazu A , Tsuchiya M , Ishizaki M , et al. Reliability and validity of the Japanese version of the Organizational Justice Questionnaire . J Occup Health . 2009 ; 51 : 74 ± 83 . PMID: 19096197 39. Wang Y . Mission-driven organizations in Japan: Management philosophy and individual outcomes . J Bus Ethics . 2011 ; 101 ( 1 ): 111 ± 126 . https://doi.org/10.1007/s10551-010-0712-x 40. Schaufeli WB , Bakker AB , Salanova M. The measurement of work engagement with a short questionnaire: A cross-national study . Educ Psychol Meas . 2006 ; 66 : 701 ± 716 . 41. Shimazu A , Schaufeli W , Kosugi S , Suzuki A , Nashiwa H , Kato A , et al. Work engagement in Japan: Validation of the Japanese version of the Utrecht Work Engagement Scale . Appl Psychol . 2008 ; 57 : 510 ± 523 . https://doi.org/10.1111/j.1464- 0597 . 2008 . 00333 .x 42. Kessler RC , Andrews G , Colpe LJ , Hiripi E , Mroczek DK , Normand SL , et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress . Psychol Med . 2002 ; 32 : 959 ± 976 . PMID: 12214795 43. Furukawa TA , Kawakami N , Saitoh M , Ono Y , Nakane Y , Nakamura Y , et al. The performance of the Japanese version of the K6 and K10 in the World Mental Health Survey Japan . Int J Methods Psychiatr Res . 2008 ; 17 : 152 ± 158 . https://doi.org/10.1002/mpr.257 PMID: 18763695 44. Van Bogaert P , van Heusden D , Timmermans O , Franck E. Nurse work engagement impacts job outcome and nurse-assessed quality of care: Model testing with nurse practice environment and nurse work characteristics as predictors . Front Psychol . 2014 ; 5 ( 1261 ). https://doi.org/10.3389/fpsyg. 2014 . 01261 PMID: 25431563 45. Oshio T. The association between individual-level social capital and health: Cross-sectional, prospective cohort and fixed-effects models . J Epidemiol Community Health . 2016 ; 70 ( 1 ): 25 ± 30 . https://doi. org/10.1136/jech-2015 -205962 PMID: 26219887 46. Shrout PE , Fleiss JL . Intraclass correlations: Uses in assessing rater reliability . Psychol Bull . 1979 ; 86 ( 2 ): 420 ± 428 . PMID: 18839484 47. de Vet HC , Beckerman H , Terwee CB , Terluin B , Bouter LM . Definition of clinical differences . J Rheumatol . 2006 ; 33 ( 2 ): 434 . PMID: 16465677 48. Kobayashi T , Suzuki E , Oksanen T , Kawachi I , Takao S. The bright side and dark side of workplace social capital: opposing effects of gender on overweight among Japanese employees . PLoS One . 2014 ; 9 ( 1 ):e88084. https://doi.org/10.1371/journal.pone. 0088084 PMID: 24498248 49. Bae K , Chung C . Cultural values and work attitudes of Korean industrial workers in comparison with those of the United States and Japan . Work Occup . 1997 ; 24 ( 1 ): 80 ± 96 . 50. Tsuboya T , Tsutsumi A , Kawachi I. Change in psychological distress following change in workplace social capital: Results from the panel surveys of the J-HOPE study . Occup Environ Med . 2015 ; 72 ( 3 ): 188 ± 194 . https://doi.org/10.1136/oemed-2014 -102427 PMID: 25472019 51. Oshio T , Inoue A , Tsutsumi A . The mediating and moderating effects of workplace social capital on the associations between adverse work characteristics and psychological distress among Japanese workers . Ind Health . 2014 ; 52 ( 4 ): 313 ± 323 . https://doi.org/10.2486/indhealth.2014-0032 PMID: 24705803 52. Schaubroeck J , Lam SSK , Xie JL . Collective efficacy versus self-efficacy in coping responses to stressors and control: A cross-cultural study . J Appl Psychol . 2000 ; 85 ( 4 ): 512 ± 25 . https://doi.org/10.1037/ 0021 - 9010 . 85 .4.512 PMID: 10948796


This is a preview of a remote PDF: http://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0179461&type=printable

Hisashi Eguchi, Akizumi Tsutsumi, Akiomi Inoue, Yuko Odagiri. Psychometric assessment of a scale to measure bonding workplace social capital, PLOS ONE, 2017, DOI: 10.1371/journal.pone.0179461