• Asian Journal for Public Opinion Research
• /
• 제7권1호
• /
• pp.57-74
• /
• 2019

Researchers usually examine the quality of survey data by several conventional measures of reliability and validity. However, those measures are mainly designed to examine the quality of an individual measurement, rather than the quality of a data set as a whole. There is a relative lack of methods for evaluation of the overall data quality. This paper attempts to fill this gap. We propose using interviewers' assessments as one of criteria for evaluating the overall data quality. Interviewers are the ones who literally conduct and thus directly observe interviews. Taiwan's Election and Democratization Studies (TEDS) have required interviewers to assess how trustworthy the responses of each of their interviewees are, and to provide several descriptions about the process and environment of the interviews. We use this information to evaluate the data quality of TEDS surveys and compare it with the results from the conventional test-retest method. The findings are that the interviewer assessment is a fair indicator of the overall reliability of attitudinal questions but not a good indicator when factual questions are examined. Regarding the evaluation of data validity, more data is required to see whether or not interviewers' assessment is informative in terms of data quality.

• 대한영양사협회학술지
• /
• 제3권1호
• /
• pp.1-8
• /
• 1997

The purpose of the study is to evaluate the differential effects caused by the interviewers and the days of the week using the 24-hour dietary recall method on the dietary evaluation of nutrient intakes. Thirteen subjects were interviewed by three trained interviewers on a Monday, Wednesday, and Friday. The consumption of nutrients by the subjects during each day was assessed. The average intake of nutrients was found to be sufficient except in calcium, iron, and vitamin A. there was a significant difference between the food intake on the weekdays and that o the weekend. However, the were no significant differences between the interviewers assessments on the intake of nutrients consumed by the subjects. The standardization of the portion size, interview skill and experience may be a few of the reasons explaining the elimination of the potential error created by variations among the interviewers. This study suggests that repeated 24-hour recalls during weekdays and weekends may be a better method for estimating the nutrients consumed by the subjects.

• 의학교육논단
• /
• 제12권2호
• /
• pp.13-18
• /
• 2010

This study is aimed to reflect non-cognitive traits that should be assessed in admissions interviews for medical school applicants, with the goal being to increase the reliability of the admissions interview. The admissions interview is valued for its ability to assess noncognitive and nonteachable attributes of good doctors, especially which cannot be evaluated with other admission assessment tools. Various characteristics of applicants including age, gender, exam scores, and nonverbal communication were found to have influenced the interview results. Bias from interviewers was a significant factor in the results of the interview. A Structured interview in multiple stations such as the Multiple Mini-Interview showed the highest reliability and validity. To make the interview fair, no information about the applicants was provided to the interviewers and interviewers were recruited from different backgrounds. There have been few research papers on admission interviews in Korea. Active research on the qualities of good doctors and effective and reliable admission interview methods should be encouraged. A strategy should be developed to overcome the philosophical obstacles that medical school professors want to admit academically excellent applicants.

• 대한인간공학회지
• /
• 제35권2호
• /
• pp.75-84
• /
• 2016

Objective: The aim of this study is to suggest some improvement ideas based on the validity and the reliability analyses of the current safety culture measurement method applied to the Korean nuclear power industry. Background: Wrong safety culture is known as one of the major causes of the disasters such as the space shuttle Columbia disaster or the Fukushima Nuclear Power Plant accident. Assessment of safety culture of an organization is important to build a safer organizational environment as well as to identify the risks hidden in the organization. Method: A face validity of the current safety culture measurement method was analyzed by comparison of the key factors of safety culture in the Korean nuclear power industry with those factors reviewed in the previous studies. The current interview method was analyzed to identify the problems which degrade the consistency of evaluation. Results: Most safety culture factors reviewed in the literatures are covered in the list of the Korean nuclear power industry safety culture factors. However the unstructured questions used in the interview may result in inconsistency of safety culture evaluation among interviewers. Conclusion: This study suggests some examples which might improve the consistency of interviewers' evaluation on safety culture such as a post interview evaluation form. Application: An extended post interview evaluation form might help to increase the accuracy of the interviewing method for Korean nuclear industry safety culture evaluation.

• Journal of the Korean Academy of Child and Adolescent Psychiatry
• /
• 제29권4호
• /
• pp.161-171
• /
• 2018

Objectives: This study aimed to identify the process of psychosocial assessment, the experience of intervention, and the improvement after the disaster that Danwon high school students survived from the sinking of the Motor Vessel (MV) Sewol in South Korea on April 16, 2014. Methods: We conducted in-depth qualitative research using individual interviews from January to February 2017. Twenty-one of 75 Danwon high school students survived by the MV Sewol disaster were studied. Two interviewers participated in the in-depth interview. Interviews were transcribed verbatim, coded, and analyzed through content analysis based on psychosocial assessment and intervention after the disaster. Results: Twenty-one participants were 20 years old, where 10 were male (47.62%), and 11 were female (52.38%). More than 75% of the interviewed students felt that mental health services were needed, and more than 85% required mental health assessments. Regarding psychiatric symptoms, the students reported that they suffered depression and insomnia (19.05%), anxiety (14.29%), nightmares and phobias (9.52%), and difficulties regarding concentration, aggression, and game addiction (4.76%). Conclusion: Despite survivors experiencing the same disaster, there were differences in their responses to mental health assessments and interventions experienced during the three years, and conflicting opinions were reported. In planning future evaluations and interventions, it is necessary for strategies to cope with flexibly to consider the characteristics and symptoms of the survivors while maintaining principles.

• 대한물리의학회지
• /
• 제6권4호
• /
• pp.475-488
• /
• 2011

Purpose: The aims of the study were to develop and to establish reliability in Korean versions of World Health Organization Disability Assessment Schedule 2.0(KWHODAS 2.0): 12 item-self(12-self) and 12 item-interviewer(12-interviewer) versions. Methods: KWHODAS 2.0: 12-item versions were developed in idiomatic modern Korean with a process involving independent translation, synthesis of the translations, independent back translation, and review by an expert committee to achieve equivalence with the original English. 88 participants were included in the study. 33 of participants filled the 12-self version twice to examine test-retest reliability and 55 of participants were assessed simultaneously by four interviewers using the 12-interviewer version. Intra-rater reliability was evaluated using the intra-class correlation coefficient(ICC) and inter-rater reliability was evaluated using both the ICC and k statistic. Results: Test-retest reliability for the 12-self version was excellent with $ICC_{(2,1)}$ value ranged from 0.94(CI 0.88-0.98) to 0.96(CI 0.90-0.98). Inter-rater reliability for the 12-interviewer version showed excellent agreement with $ICC_{(2,1)}$ from 0.94(CI 0.91-0.96) to 1(CI 1.0-1.0). K value was observed from 0.95 to 1. Conclusion: KWHODAS 2.0: 12-self and 12-interviewer versions were successfully translated and both scales showed excellent reliability. It is now suitable for use in clinical and research applications.

• Safety and Health at Work
• /
• 제4권2호
• /
• pp.111-116
• /
• 2013

Background: The aim of this study was to evaluate the quality of the Second Korean Working Conditions Survey (KWCS), focusing on its validity and reliability. Methods: The external validity was evaluated by the assessment of sampling procedures and the response rate, in order to investigate the representativeness of the sample. The content validity was evaluated by the assessment of the development of the questionnaire, and the consistency of questions for the selected construct. The test-retest method was used to evaluate the reliability by means of a phone call survey of 30% of the respondents, who were randomly selected. The respondents' satisfaction regarding the survey procedures and interview time were analyzed to evaluate the quality of survey data. Results: The external validity was assured by an acceptable sampling procedure, rigid multi-stage stratified cluster random sampling. The content validity was also guaranteed by a reasonable procedure for the development of the questionnaire with a pretest. The internal consistency of the questions for work autonomy was maintained, with 0.738 of Cronbach's alpha. The response rate of 36% was lower than that of the European Working Conditions Survey (EWCS), with a contact rate of 66%, compared to 76% for the EWCS. The matching rates of the five retested questions were more than 98% reliable. Conclusion: The quality of the second KWCS was assured by the high external and content validity and reliability. The rigid sampling procedure and development of the questionnaire contributed to quality assurance. The high level of reliability may be guaranteed by the sophisticated field survey procedures and the development of a technical manual for interviewers. The technical strategies for a high response rate should be developed for future surveys.

• Asian Pacific Journal of Cancer Prevention
• /
• 제14권10호
• /
• pp.5877-5882
• /
• 2013

Background: The aim of the study was to determine breast cancer risk and early diagnosis applications in women aged ${\geq}50$. Materials and Methods: This cross-sectional, descriptive field study focused on a population of 4,815 in Mansuro$\breve{g}$lu with a 55.1% participation rate in screening. In the study, body mass index (BMI) was also evaluated in the calculation of breast cancer risk by the Breast Cancer Risk Assessment Tool (BCRA) (also called the "Gail Risk Assessment Tool"). The interviewers had a three-hour training provided by the researchers, during which interactive training methods were used and applications were supported with role-plays. Results: The mean age of the women participating in the study was $60.1{\pm}8.80$. Of these women, 57.3% were in the 50-59 age group, 71.7% were married, 57.3% were primary school graduates and 61.7% were housewives. Breast-cancer development rate was 7.4% in the women participating in the study. When they were evaluated according to their relationship with those with breast cancer, it was determined that 73.0% of them had firstdegree relatives with breast cancer. According to the assessment based on the Gail method, the women's breast cancer development risk within the next 5 years was 17.6%, whereas their calculated lifetime risk was found to be as low as 0.2%. Statistically significant differences (P=0.000) were determined between performing BSE-CBE and socio-demographic factors. Conclusions: It was determined that 17.6% of the participants had breast cancer risk. There was no statistically significant difference between the women with and without breast cancer risk in terms of early diagnosis practices, which can be regarded as a remarkable finding. It was planned to provide training about the early diagnosis and treatment of breast cancer for people with high-risk scores, and to conduct population-based breast cancer screening programs.

• 지역사회간호학회지
• /
• 제12권2호
• /
• pp.417-427
• /
• 2001

Purpose: The aim of this study is to identify the influence of visual and hearing impairment on the activities of daily living of community dwelling elderly. Methods: Data were collected by home visiting interviewers from 452 older people aged 65 years or older living in community. Resident Assessment Instrument MDS-HC(2.0version) was used for data collection. Data analysis for descriptive statistics, Chi-square test and multiple regression was made by SAS 6.2 Results: 34.7% of the subject had hearing impairment and 64.3% had visual impairment Among IADL. one half of them were dependent in ordinary house work and meal preparation. In the case of ADL. 13.9% of subjects were dependent in bathing and 8.9% in personal hygiene. There was significant difference in IADL performance by visual and hearing impairment On the other hand, ADL performance showed the significant difference. only in the case of hearing impairment. As the result of input of visual and hearing impairment in the process of regression. variances were increased from 3% to 11%. Conclusions: Large proportions of older people living in the community have visual and hearing impairment. It could be confirmed that hearing and vision were significant factors influencing on IADL performance of older people. Intervention and support policy for elderly needs to focus on improvement of visual and hearing impairment.

• 대한지역사회영양학회지
• /
• 제11권6호
• /
• pp.725-739
• /
• 2006

This study was performed to assess socioeconomic status and physical health status of middle-aged men ($40's{\sim}60's$) in Ganghwa country. We interviewed 1,267 middle-aged men (602 male, 665 female) by trained interviewers using structured questionnaires including demographic information, general health status, and anthro-pometric measurements. And all the data were analyzed by chi-square test, Student's t-test and one-way ANOVA using SPSS 12.0 version at p<0.05. These results were that males were higher than females in educational levels (p = 0.000) and most of them decreased according to age in educational levels (p =0.000) and family income (p =0.000), and prevalence of chronic diseases (p =0.000): stomach-duodenum disease, fracture, arthritis, or hypertension. They took to the health information on TV and radio and their health managing methods were exercise and walking and resting and diet regulation. Body Mass Index (BMI) was decreased in oder males (p =0.024) but increased in older females (p=0.001). In females, obesity prevalence of 40's, 50's and 60's was 31.3%. 49.7% and 48.0%, respectively. Waist circumference was the highest in 50's males (p=0.015), but hip circumference was the highest in 50's females (p =0.015). Waist-hip ratio (WHR) increased in older males (p = 0.028) and females (p= 0.000). In spite of the subjects were engaged in agriculture and fishery and had desirable lifestyles obesity rate especially abdominal obesity, was the serious problem. Socioeconomic status, especially education and income were related to SRH (p=0.006, p=0.000), chronic disease (p=0.000) and BMI (p=0.028, p=0.000). Therefore, it is necessary that the public health policy and nutrition education programs to alter lifestyles and to improve health preservation and health promotion in the farming and fishing communities.