• Title/Summary/Keyword: Instrument validation

Search Result 219, Processing Time 0.03 seconds

The Development and Validation of Instrument for Measuring High School Students' STEM Career Motivation (고등학생들을 위한 이공계 진로동기 검사도구 개발 및 타당화)

  • Shin, Sein;Ha, Minsu;Lee, Jun-Ki
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.1
    • /
    • pp.75-86
    • /
    • 2016
  • The purpose of the present study is to develop and validate an instrument to assess STEM career motivation. We developed 32 items for 7 constructs (i.e. education experience, career value, academic self-efficacy, career self-efficacy, career interest, parents' support, and career motivation) on STEM career motivation based on Social Cognitive Career Theory (SCCT; Lent et al.,1994). 767 first year high school students participated in this study. The items were validated by Messick's framework (1995). In this study, we examined the validity of items in four aspects (i.e. content, substantive, structural and generalizability of validity). Methodologically, we used Rasch analysis, Exploratory factor analysis, confirmative factor analysis based on structural equation modelling. We confirmed that our instrument with 32 items as valid and reliable for measuring the STEM career motivation. In addition, we tested the STEM career motivation model based on SCCT. Our model explained the data well, suggesting that external factors (education experience and parents' support) and cognitive factors (perception of value, self-efficacy and interest) were significantly related to STEM career motivation.

Development of a Breast Cancer Awareness Scale for Thai Women: Moving towards a Validated Measure

  • Rakkapao, Nitchamon;Promthet, Supannee;Moore, Malcolm A;Hurst, Cameron P
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.2
    • /
    • pp.851-856
    • /
    • 2016
  • Background: Breast cancer is a major health problem among women around the world. Recent developments in screening and treatment have greatly improved the prognosis of patients with breast cancer in developed countries. However, in developing countries breast cancer mortality remains high.Breast cancer awareness is a first and important step in reducing breast cancer mortality. The development of a validated instrument to measure breast cancer awareness is crucial for the understanding and implementation of suitable health education programs to facilitate early deletion and minimize mortality. Objective: The objective of this study was to develop an instrument for the assessment of breast cancer awareness in Thai women. Materials and Methods: This methodological study was conducted in two stages: (1) literature searches and semi-structured interviews were conducted to generate items of the breast cancer awareness scale (B-CAS) which were subsequently examined for content and face validity, and (2) an exploration of the factor structure of the resulting instrument and an examination of its reliability. Data were collected using a self-administered questionnaire in Thai women aged 20-64 in August, 2015. Results: A total of 219 women (response rate 97.4 %) participated in this validation study. The B-CAS contains five domains with 53 items on breast cancer awareness: 1) knowledge of risk factors, 2) knowledge of signs and symptoms, 3) attitude to breast cancer prevention, 4) barriers of breast screening, and 5) health behavior related to breast cancer awareness. Items with a content validity index < 0.80 were excluded, and factor structure for the remaining items reflected the hypothesized five factor model. The scales based on all retained items was shown to have strongly internal consistency reliability (Cronbach's ${\alpha}=0.86$). Conclusions: The B-CAS provides good psychometric properties to assess breast cancer awareness in women. It can be used to examine breast cancer awareness in Thai women and it could lead to the development and evaluation of suitable educational interventions for raising breast cancer awareness. Future research should focus on further validating the B-CAS including an assessment of construct and criterion-based validity.

An Empirical Study of the Clinically Reportable Range in Clinical Chemistry (임상보고 가능범위의 실증적 연구)

  • Chang, Sang-Wu;Lee, Sang-Gon;Choi, Ho-Seong;Song, Eun-Young;Park, Yong-Won;Lee, In-Ae
    • Korean Journal of Clinical Laboratory Science
    • /
    • v.39 no.1
    • /
    • pp.31-36
    • /
    • 2007
  • The purpose of the clinically reportable range (CRR) in clinical chemistry is to estimate linearity in working range. The reportable range includes all results that may be reliably reported, and embraces two types of ranges: the analytical measurement range (AMR) is the range of analyte values that a method can directly measure on the specimen without any dilution, concentration, or other pretreatment not part of the usual assay process. CAP and JCAHO require linearity on analyzers every six months. The clinically reportable range is the range of analyte values that a method can measure, allowing for specimen dilution, concentration, or other pretreatment used to extend the direct analytical measurement range. The AMR cannot exceed the manufacturer's limits. Establishing AMR is easily accomplished with Calibration Verification Assessment and experimental Linearity. For example: The manufacturer states that the limits of the AST on their instrument are 0-1100. The lowest level that could be verified is 2. The upper level is 1241. The verified AMR of the instrument is 2-1241. The lower limit of the range is 2, because that is the lowest level that could be verified by the laboratory. The laboratory could not use the manufacturer's lower limit of 2 because they have not proven that the instrument values below 2 are valid. The upper limit of the range is 1241, because although the lab has shown that the instrument is linear to 1241, the manufacturer does not make that claim. The laboratory needs to demonstrate the accuracy and precision of the analyzer, as well the validation of the patient AMR. Linearity requirements have been eliminated from the CLIA regulations and from the CAP inspection criteria, however, many inspectors continue to feel that linearity studies are a part of good lab practice and should be encouraged. If a lab chooses to continue linearity studies, these studies must fully comply with the calibration/calibration verification requirements of CLIA and/or CAP. The results of lower limit and upper limit of clinically reportable range were total protein (2.1 - 79.9), albumin (1.3 - 39), total bilirubin (0.2 - 106.2), alkaline phosphatase (13 - 6928.2), aspartate aminotransferase (24 - 7446), alanine aminotransferase (13 - 6724.2), gamma glutamyl transpeptidase (16.64 - 9904.2), creatine kinase (15.26 - 4723.8), lactate dehydrogenase (127.66 - 13231.8), creatinine (0.4 - 129.6), blood urea nitrogen (8.67 - 925.8), uric acid (1.6 - 151.2), total cholesterol (48.52 - 3162), triglycerides (36.91 - 3367.8), glucose (31 - 4218), amylase (21 - 6694.2), calcium (3.1 - 118.2), inorganic phosphorus (1.11 - 108), HDL (11.74 - 666), NA (58.3 - 1800), K (1.0 - 69.6), CL (38 - 1230).

  • PDF

DETERMINATION OF MOISTURE AND NITROGEN ON UNDRIED FORAGES BY NEAR INFRARED REFLECTANCE SPECTROSCOPY(NIRS)

  • Cozzolino, D.;Labandera, M.;Inia La Estanzuela
    • Proceedings of the Korean Society of Near Infrared Spectroscopy Conference
    • /
    • 2001.06a
    • /
    • pp.1620-1620
    • /
    • 2001
  • Forages, both grazed and conserved, provide the basis of ruminant production systems throughout the world. More than 90 per cent of the feed energy consumed by herbivorous animals world - wide were provided by forages. With such world - wide dependence on forages, the economic and nutritional necessity of been able to characterize them in a meaningful way is vital. The characterization of forages for productive animals is becoming important for several reasons. Relative to conventional laboratory procedures, Near Infrared Reflectance Spectroscopy (NIRS) offers advantages of simplicity, speed, reduced chemical waste, and more cost-effective prediction of product functionality. NIR spectroscopy represents a radical departure from conventional analytical methods, in that entire sample of forage is characterized in terms of its absorption properties in the near infrared region, rather than separate subsamples being treated with various chemicals to isolate specific components. This forces the analyst to abandon his/her traditional narrow focus on the sample (one analyte at a time) and to take a broader view of the relationship between components within the sample and between the sample and the population from which it comes. forage is usually analysed by NIRS in dry and ground presentation. Initial success of NIRS analysis of coarse forages suggest a need to better understand the potential for analysis of minimally processed samples. Preparation costs and possible compositional alterations could be reduced by samples presented to the instrument in undried and unground conditions. NIRS has gained widespread acceptance for the analysis of forage quality constituents on dry material, however little attention has been given to the use of NIRS for chemical determinations on undried and unground forages. Relatively few works reported the use of NIRS to determine quality parameters on undried materials, most of them on both grass and corn silage. Only two works have been found on the determination of quality parameters on fresh forages. The objectives of this paper were (1) to evaluate the use of NIRS for determination of nitrogen and moisture on undried and unground forage samples and (2) to explore two mathematical treatments and two NIR regions to predict chemical parameters on fresh forage. Four hundred forage samples (n: 400) were analysed in a NIRS 6500 instrument (NIR Systems, PA, USA) in reflectance mode. Two mathematical treatments were applied: 1,4,4,1 and 2,5,5,2. Predictive equations were developed using modified partial least squares (MPLS) with internal cross - validation. Coefficient of determination in calibration (${R^2}_{CAL}$) and standard error in cross-validation (SECV) for moisture were 0.92 (12.4) and 0.92 (12.4) for 1,4,4,1 and 2,5,5,2 respectively, on g $kg^{-1}$ dry weight. For crude protein NIRS calibration statistics yield a (${R^2}_{CAL}$) and (SECV) of 0.85 (19.8) and 0.85 (19.6) for 1,4,4,1 and 2,5,5,2 respectively, on a dry weight. It was concluded that NIRS is a suitable method to predict moisture and nitrogen on fresh forage without samples preparation.

  • PDF

First-time estimation of HCHO column in major cities over Asia using multiple regression with satellite data (위성자료와 다중회귀분석법을 이용한 아시아 주요도시의 포름알데하이드 칼럼농도 추정연구)

  • Choi, Wonei;Hong, Hyunkee;Park, Junsung;Lee, Hanlim
    • Korean Journal of Remote Sensing
    • /
    • v.31 no.6
    • /
    • pp.523-530
    • /
    • 2015
  • A Multiple Regression Method (MRM) is used for the first time with Ozone Monitoring Instrument (OMI) and Moderate Resolution Imaging Spectroradiometer (MODIS) data to estimate formaldehyde (HCHO) Vertical Column Density (VCD). For a 3.5-year period from January 2005 through July 2008, HCHO VCD estimation is investigated in cities over Asia in two categorized areas: (1) Major cities in Northeast Asia (Beijing, Seoul, and Tokyo), (2) Major cities in Southeast Asia (New Delhi, Dhaka, and Bangkok). In the Major cities in Northeast Asia, there are good agreements between HCHO estimated by the multiple linear regression method ($HCHO_{MRM}$) and HCHO measured by OMI ($HCHO_{OMI}$) (0.78 < $R^2$ < 0.82). However, in Major cities in Southeast Asia, there were poor agreements between $HCHO_{OMI}$ and $HCHO_{MRM}$ (0.24 < $R^2$ < 0.39). In addition, an unbiased assessment of the MRM performance using modeling and validation groups shows that the performance of the MRM based on separate modeling and validation groups is comparable to that using all the data for deriving Multiple Regression Equations (MREs). This study demonstrates that MRM can be an alternative tool for HCHO estimation in certain areas over Asia.

Development and validation of the Korean Nursing Delirium Scale (한국어판 간호 섬망 선별 도구 개발 및 검증)

  • Kim, Kyoung-Nam;Kim, Cheol-Ho;Kim, Kwang-Il;Yoo, Hyun-Jung;Park, Si-Young;Park, Yeon-Hwan
    • Journal of Korean Academy of Nursing
    • /
    • v.42 no.3
    • /
    • pp.414-423
    • /
    • 2012
  • Purpose: The aims of this study were to develop and test the validity of the Korean Nursing Delirium Scale (Nu-DESC) for older patients in hospital. Methods: The Korean Nu-DESC was developed based on the Nu-DESC (Gaudreau, 2005), and revised according to nursing records related to signs and symptoms of older patients with delirium (n=361) and the results of a pilot study (n=42) in one general hospital. To test the validity of the Korean Nu-DESC, 75 older patients whom nurses suspected of delirium from 731 older patients from 12 nursing units were assessed by bedside nurses using the Korean Nu-DESC. A Receiver Operating Characteristic Curve of the Korean Nu-DESC was constructed with an accompanying Area Under the Curve (AUC). Results: Specific examples such as irritable, kidding, sleeping tendency, which were observed by bedside nurses in Korea, were identified in the five features of signs and symptoms of delirium in the instrument. The Korean Nu-DESC was psycho-metrically valid and had a sensitivity and specificity of .81-.76 and .97-.73, respectively. The AUC were .89, .74. Conclusion: Results of this study indicate that the Korean Nu-DESC is well-suited for widespread clinical use in busy inpatients settings and shows promise as a research instrument.

A Study on Validation by the Development of a Science Process Skills Test with Science Experiments (과학 실험 평가 도구 개발을 통한 탐구 능력 평가의 타당화에 관한 연구)

  • Woo, Jong-Ok;Lee, Hang-Ro;Kim, Seung-Hun
    • Journal of The Korean Association For Science Education
    • /
    • v.17 no.1
    • /
    • pp.65-73
    • /
    • 1997
  • The purpose of this study is to develop a valid and reliable instrument, applicable to high school Earth Science class experiment. In advance of developing items, I was selected 14 inquiry process skills and specified evaluative objectives for each of them to develop scales and criteria for them. I developed 28 evaluation items for 5 experiment subjects among those of high school Earth Science class. The first field trial was performed a sample of 5 high school students, and the second one using a sample of 25 high school students. The results are as follows. (1) The content validity and reliability(Cronbach $\alpha$) of the developed items were 82.7% and .86, respectively, the developed instrument in this study is considered valid and reliable. (2) The average difficulty index was .69 and the discrimination index was .30. (3) Answer sheets based on the reported results were rated 5 teachers and Inter-rater Reliabilitiy and Inter-rater Consistency were analyzed, its indices were .80 and .76, respectively. (4) The developed items show a low coefficient of .45 with TESIS, a set of paper-and-pencil test items developed by Lee, Hang-Ro(1991). That the experiment assessment is solely subject to the rater's viewpoint has been one of the major problems raised concerning the matter. This research, however, shows that a set of more specified scales and criteria for the evaluation will make it more valid, reliable and efficient.

  • PDF

Development and Validation of Spatial Visualization Tests for Elementary School Children (초등학생용 공간 시각화 검사지 개발 및 표준화)

  • Park, Sungsun
    • Education of Primary School Mathematics
    • /
    • v.17 no.2
    • /
    • pp.159-171
    • /
    • 2014
  • Spatial ability has been valued as one component of intelligence and as an talented domain. And it is associated with the achievements in science, technology, engineering, and mathematics (STEM) disciplines. So, the instrument for measuring spatial ability is very important. The purpose of this study is to develop Spatial Visualization Tests for Elementary School Children and examine internal consistency reliability evidence and construct validity evidence on confirmatory factor analysis of that instrument. For this purpose, 'The Spatial Visualization Tests for Elementary School Children was administered to 1482 Korean elementary school students. As a result, this study show that internal consistency reliability evidence using Cronbach' alpha showed item consistency and construct validity evidence from confirmatory factor analysis in the Spatial Visualization Tests for Elementary School Children. And also, this study show ed that item difficulty and item discrimination of the Spatial Visualization Tests for Elementary School Children were within an acceptable range.

Evaluation of the Validity of a Simple Screening Test Developed for Identifying Korean Elderly at Risk of Undernutrition (우리 나라 노인의 영양부족위험 진단을 위해 개발된 간이조사표의 타당성 평가)

  • 이정원;김경은;김기남;현태선;현화진;박영숙
    • Journal of Nutrition and Health
    • /
    • v.33 no.8
    • /
    • pp.864-872
    • /
    • 2000
  • This study intended to evaluate the validity of the simple nutrition screening test that had been developed with the elderly living in Cheongju as a subject. Nutrition screening score(NSS) and reference standards for nutritional and health status(nutrient intakes, mean adequacy ratio, perceive health, and serum albumin, hematocrit, and hemoglobin) were estimated by using the date obtained in 1996 from the 174 elderly living in Taejon, Statistical analysis showed significant correlations between mean adequacy ratio(MAR) and NSS(r=0.341) and also between NSS and biological indices such as albumin and hematocrit, Around 65-75% of the elderly with perceive health and low level of serum albumin, hemoglobin and hematocrit had NSS$\leq$ll. Sensitivity, specificity, and positive predictive values(PPV) were calculated from the crosstabulation of the three categories of NSS(high, moderate, and low nutritional risk) and low categories MAR(< 0.75, undernutrition;$\geq$0.75, normal) to validate the cut-off point for high or low nutritional risk by NSS. It was suggested that point l1 was appropriate as a criterion to determine high risk of undernutrition, but point 16 was better than 17 as criterion to determine low nutritional risk in the Taejon elderly. When point ll was used as a criterion of high nutritional risk, sensitivity, specificity, and PPV are 59.5, 60.5 and 82.1 respectively. When point 16 was used as a criterion of low nutritional risk, sensitivity, specificity, and PPV are 25.6, 95.4, and 64.7%, respectively. In conclusion, nutrition screening test that had been developed can be a simple, easy, and proper instrument to classify the high risk group of undernutrition. A further validation study seems to be required among other groups of individuals for the screening test to the finalized as a more valid instrument identifying Korean elderly at nutrition and health risk(Korean J Nutrition 33(8) : 864-872, 2000)

  • PDF

Reliability and Validity of the Korean version of Short-Form Health Literacy Scale for Adults (성인 대상 한국어판 단축형 건강정보이해능력 측정도구의 타당도와 신뢰도 검증)

  • Seo, Young Joo;Kwak, Eun-Mi;Jo, Mirae;Ko, A-Ra;Kim, Soon Hwan;Oh, Heeyoung
    • Research in Community and Public Health Nursing
    • /
    • v.31 no.4
    • /
    • pp.416-426
    • /
    • 2020
  • Purpose: The aim of this study was to evaluate the validity and reliability of the Korean version of Short-form Health Literacy Scale (HLS-SF-K12) for Adults. Methods: The English HLS-SF12 was translated into Korean with forward and backward translation. Survey data were collected from 204 adults who visited two hospitals in Korea. Content validity, construct validity, and known-groups validity were evaluated. Cronbach's α for internal consistency and test-retest were used to assess reliability. SPSS 21.0 and AMOS 21.0 software were used for data analysis. Results: The HLS-SF-K12 was composed of 12 items, and three subscales (health care, disease prevention, and health promotion). The instrument explained reliable internal consistency with Cronbach's α for the total scale of .89, and .74~.81 for subscales. The model of three subscales for the HLS-SF-K12 was validated by confirmatory factor analysis (Normed χ2=2.14 (p<.001), GFI=.92, RMR=.04, RMSEA=.08, CFI=.94, TLI=.92, IFI=.94). The hypothesis testing which analyzed the differences in health literacy by age and education level was satisfied. Conclusion: The HLS-SF-K12 is a valid and reliable instrument for measuring health information comprehension for adults in Korea.