• The Korean Journal of Nuclear Medicine Technology
• /
• v.20 no.1
• /
• pp.13-19
• /
• 2016

Purpose In order to calculate the left ventricular ejection fraction (LVEF) accurately, it is important to acquire the best septal view of left ventricle in the multi-gated cardiac blood pool scan (GBP). This study aims to acquire the best septal view by measuring angle of ventricular septal wall (${\theta}$) using enhanced CT scan and compare with conventional method using left anterior oblique (LAO) 45 view. Materials and Methods From March to July in 2015, we analyzed the 253 patients who underwent both enhanced chest CT and GBP scan in the department of nuclear medicine at National Cancer Center. Angle (${\theta}$) between ventricular septum and imaginary midline was measured in transverse image of enhanced chest CT scan, and the patients whose difference between the angle of ${\theta}$ and 45 degree was more than 10 degrees were included. GBP scan was acquired using both LAO 45 and LAO ${\theta}$ views, and LVEFs measured by automated and manual region of interest (Auto-ROI and Manual-ROI) modes respectively were analyzed. Results $Mean{\pm}SD$ of ${\theta}$ on total 253 patients was $37.0{\pm}8.5^{\circ}$. Among them, the patients whose difference between 45 and ${\theta}$ degrees were more than ${\pm}10$ degrees were 88 patients ($29.3{\pm}6.1^{\circ}$). In Auto-ROI mode, there was statistically significant difference between LAO 45 and LAO ${\theta}$ (LVEF $45=62.0{\pm}6.6%$ vs. LVEF ${\theta}=64.0{\pm}5.6%$; P = 0.001). In Manual-ROI mode, there was also statistically significant difference between LAO 45 and LAO ${\theta}$ (LVEF $45=66.7{\pm}7.2%$ vs. LVEF ${\theta}=69.0{\pm}6.4%$; P < 0.001). Intraclass correlation coefficients of both methods were more than 95%. In case of comparison between Auto-ROI and Manual ROI of each LAO 45 and LAO ${\theta}$, there was no significant difference statistically. Conclusion We could measure the angle of ventricular septal wall accurately by using transverse image of enhanced chest CT and applied to LAO acquisition in the GBP scan. It might be the alternative method to acquire the best septal view of LAO effectively. We could notify significant difference between conventional LAO 45 and LAO ${\theta}$ view.

• Information Systems Review
• /
• v.16 no.3
• /
• pp.161-177
• /
• 2014

Corporate credit rating assessment consists of complicated processes in which various factors describing a company are taken into consideration. Such assessment is known to be very expensive since domain experts should be employed to assess the ratings. As a result, the data-driven corporate credit rating prediction using statistical and artificial intelligence (AI) techniques has received considerable attention from researchers and practitioners. In particular, statistical methods such as multiple discriminant analysis (MDA) and multinomial logistic regression analysis (MLOGIT), and AI methods including case-based reasoning (CBR), artificial neural network (ANN), and multiclass support vector machine (MSVM) have been applied to corporate credit rating.2) Among them, MSVM has recently become popular because of its robustness and high prediction accuracy. In this study, we propose a novel optimized MSVM model, and appy it to corporate credit rating prediction in order to enhance the accuracy. Our model, named 'GAMSVM (Genetic Algorithm-optimized Multiclass Support Vector Machine),' is designed to simultaneously optimize the kernel parameters and the feature subset selection. Prior studies like Lorena and de Carvalho (2008), and Chatterjee (2013) show that proper kernel parameters may improve the performance of MSVMs. Also, the results from the studies such as Shieh and Yang (2008) and Chatterjee (2013) imply that appropriate feature selection may lead to higher prediction accuracy. Based on these prior studies, we propose to apply GAMSVM to corporate credit rating prediction. As a tool for optimizing the kernel parameters and the feature subset selection, we suggest genetic algorithm (GA). GA is known as an efficient and effective search method that attempts to simulate the biological evolution phenomenon. By applying genetic operations such as selection, crossover, and mutation, it is designed to gradually improve the search results. Especially, mutation operator prevents GA from falling into the local optima, thus we can find the globally optimal or near-optimal solution using it. GA has popularly been applied to search optimal parameters or feature subset selections of AI techniques including MSVM. With these reasons, we also adopt GA as an optimization tool. To empirically validate the usefulness of GAMSVM, we applied it to a real-world case of credit rating in Korea. Our application is in bond rating, which is the most frequently studied area of credit rating for specific debt issues or other financial obligations. The experimental dataset was collected from a large credit rating company in South Korea. It contained 39 financial ratios of 1,295 companies in the manufacturing industry, and their credit ratings. Using various statistical methods including the one-way ANOVA and the stepwise MDA, we selected 14 financial ratios as the candidate independent variables. The dependent variable, i.e. credit rating, was labeled as four classes: 1(A1); 2(A2); 3(A3); 4(B and C). 80 percent of total data for each class was used for training, and remaining 20 percent was used for validation. And, to overcome small sample size, we applied five-fold cross validation to our dataset. In order to examine the competitiveness of the proposed model, we also experimented several comparative models including MDA, MLOGIT, CBR, ANN and MSVM. In case of MSVM, we adopted One-Against-One (OAO) and DAGSVM (Directed Acyclic Graph SVM) approaches because they are known to be the most accurate approaches among various MSVM approaches. GAMSVM was implemented using LIBSVM-an open-source software, and Evolver 5.5-a commercial software enables GA. Other comparative models were experimented using various statistical and AI packages such as SPSS for Windows, Neuroshell, and Microsoft Excel VBA (Visual Basic for Applications). Experimental results showed that the proposed model-GAMSVM-outperformed all the competitive models. In addition, the model was found to use less independent variables, but to show higher accuracy. In our experiments, five variables such as X7 (total debt), X9 (sales per employee), X13 (years after founded), X15 (accumulated earning to total asset), and X39 (the index related to the cash flows from operating activity) were found to be the most important factors in predicting the corporate credit ratings. However, the values of the finally selected kernel parameters were found to be almost same among the data subsets. To examine whether the predictive performance of GAMSVM was significantly greater than those of other models, we used the McNemar test. As a result, we found that GAMSVM was better than MDA, MLOGIT, CBR, and ANN at the 1% significance level, and better than OAO and DAGSVM at the 5% significance level.

• Radiation Oncology Journal
• /
• v.14 no.1
• /
• pp.41-52
• /
• 1996

Purpose : This paper reports a dosimetric study of 88 patients treated with a combination of external radiotherapy and high dose rate ICR for FIGO stage IIB carcinoma of the cervix. The purpose is to investigate the correlation between the radiation doses to the rectum, external radiation dose to the whole pelvis, ICR reference volume, TDF BED and the incidence of late rectal complications, retrospectively. Materials and Methods : From November 1989 through December 1992, 88 patients with stage IIB cervical carcinoma received radical radiotherapy at Department of Radiation Oncology in Yonsei University Hospital. Radiotherapy consisted of 44-54 Gy(median 49 Gy) external beam irradiation plus high dose rate intracavitary brachytherapy with 5 Gy per fraction twice a week to a total dose of 30 Gy on point A. The maximum dose to the rectum by contrast(r, R) and reference rectal dose by ICRU 38(dr, DR) were calculated. The ICR reference volume was calculated by Gamma Dot 3.11 HDR planning system, retrospectively The time-dose factor(TDF) and the biologically effective dose (BED) were calculated. Results : Twenty seven($30.7\%$) of the 88 patients developed late rectal complications:12 patients($13.6\%$) for grade 1, 12 patients($13.6\%$) for grade 2 and 3 patients($3.4\%$) for grade 3. We found a significant correlation between the external whole pelvis irradiation dose and grade 2, 3 rectal complication. The mean dose to the whole pelvis for the group of patients with grade 2, 3 complication was Higher, $4093.3\pm453.1$ cGy, than that for the patients without complication, $3873.8\pm415.6$ (0.05$7163.0\pm838.5$ cGy, than that for the Patients without rectal complication, $0772.7\pm884.0$ (p<0.05). There was no correlation of the rate of grade 2, 3 rectal complication with the iCR rectal doses(r, dr), ICR reference volume, TDF and BED. Conclusion : This investigation has revealed a significant correlation between the dose calculated at the rectal dose by ICRU 38(DR) or the most anterior rectal dose by contrast(R) dose to the whole pelvis and the incidence of grade 2, 3 late rectal complications in patients with stage IIB cervical cancer undergoing external beam radiotherapy and HOR ICR. Thus these rectal reference points doses and whole pelvis dose appear to be useful Prognostic indicators of late rectal complication in high dose rate ICR treatment in cervical carcinoma.

• Radiation Oncology Journal
• /
• v.27 no.3
• /
• pp.126-132
• /
• 2009

Purpose: We wanted to evaluate the prognostic factors for the pathologic N2 non-small cell lung cancer (NSCLC) patients who were treated by postoperative radiotherapy. Materials and Methods: We retrospectively reviewed 112 pN2 NSCLC patients who underwent surgery and postoperative radiotherapy (PORT) From January 1999 to February 2008. Seventy-five (67%) patients received segmentectomy or lobectomy and 37 (33%) patients received pneumonectomy. The resection margin was negative in 94 patients, and it was positive or close in 18 patients. Chemotherapy was administered to 103 (92%) patients. Nine (8%) patients received PORT alone. The median radiation dose was 54 Gy (range, 45 to 66), and the fraction size was 1.8~2 Gy. Results: The 2-year overall survival (OS) rate was 60.2% and the disease free survival (DFS) rate was 44.7% for all the patients. Univariate analysis showed that the patients with multiple-station N2 disease had significantly reduced OS and DFS (p=0.047, p=0.007) and the patients with an advanced T stage ($\geq$T3) had significantly reduced OS and DFS (p<0.001, p=0.025). A large tumor size ($\geq$5 cm) and positive lymphovascular invasion reduced the OS (p=0.035, 0.034). Using multivariate analysis, we found that multiple-station N2 disease and an advanced T stage ($\geq$T3) significantly reduced the OS and DFS. Seventy one patients (63.4%) had recurrence of disease. The patterns of failure were loco-regional in 23 (20.5%) patients, distant failure in 62 (55.4%) and combined loco-regional and distant failure in 14 (12.5%) patients. Conclusion: Multiple involvement of mediastinal nodal stations for the pN2 NSCLC patients with PORT was a poor prognostic factor in this study. A prospective study is necessary to evaluate the N2 subclassification and to optimize the adjuvant treatment.

• Magazine of the Korean Society of Agricultural Engineers
• /
• v.11 no.1
• /
• pp.1561-1579
• /
• 1969

In Korea, the duty of water in paddy fields was measured at the Agricultural Experimental Station in Suwon about 60 years ago. After that time some testing has been made in several places, but the key points in its experiment were the water depth of evapo-transpiration. Improved breeds, progress in cultivation and management techniques as well as development of measuring apparatus in recent years have necessitated the review of the duty of water in paddy fields. The necessity of reviewing the conventional methods has become even more important, as no source of information has been made available through survey of water utilization on a soil use basis which requires data on peculiar features of the water depth of evapo-transpiration. For example, the duty of water in paddy field is largely affected by the water depth of evapo-transpiration in connection with the wetted paddy field, whereas in connection with the normal paddy fields without this characteristic the vertical percolation become the predominant factor in measuring the decreasing depth of water. Therefore, it becomes important. that not only the water depth of evapotranspiration but also the vertical percolation process should also be observed in order to arrive at a realistic conclusion. As the vertical percolation has aclose relationship to the height of the underground water, the change of the latter can be measured. As the conclusion of this experiment, the following subjects are indicated. 1. In order to determine the economic duty of water in paddy fields on a basis of varying soil features, the varying soil features in the benifited area should be investigated thoroughly. The water depths of evapo-transpiration(ET) ratio to evaporation in the evaporator(V) on a basis of the varying soil features are as follows: clay loam ET/V = 1.11, loam ET/V = 1.64, sandy loam ET.V = 1.63 2. The decreasing depth of water consists of the water depth of evapotranspiration, the vertical per colation and the percolation of foot path. Among these three, the percolation of foot path can be utilized again. 3. As the result of this experiment, it shows the decreasing depth of water as follows. clay loam 9.3 mm/day, loam 13.5mm/daty, sandy loam 15.3mm/day 4. On a basis of the varying soil features and the height of the underground water, the vertical percolation varies. 5. The change of the vertical percolation on a basis of the varying soil features shows as follows: clay loam $1{\sim}2$ mm/day, loam $2{\sim}3$mm/day, sandy loam $3{\sim}4$mm/day 6. The level of the underground water changes sensibly by priority of clay loam, loam, sandy loam. When it rains, the level of the underground water rises fast and falls down slowly. 7. The level of the underground water changes within the scope of 25cm 8. The transpiration ratio is given in table 8 and their value are as follows: clay loam 168.8, loam 255.6, sandy loam 272.5

• KOREAN JOURNAL OF CROP SCIENCE
• /
• v.24 no.1
• /
• pp.11-24
• /
• 1979

To characterize elastic and plastic chilling injury, rice seedlings grown at 28/$16^{\circ}C$ day/night temp. under 20K lux (13hrs.) in a phytotron were subjected to a 11/$6^{\circ}C$, 20K lux condition for 2, 4, 6 or 8 days at 1, 2, 3, 4 or 5th leaf-stage, respectively, followed by further growth under 28/$16^{\circ}C$condition till 30th day after seeding. Japonica variety Jinheung and Chulwon No.1 survived almost 100% without any significant , discoloration and death of leaves due to chilling even under the chilling of 8 days at all seedling ages tested. Tongil and Yushin, varieties from Indica x Japonica cross, showed increasing discoloration of leaves and death of plants with increase in chilling intensity. The longest chilling duration shown seedling death less than 5% was 4, 6, 1, 4, 8 days for Tongil, and 6, 6, 1, 2, 2, days for Yushin at 1, 2, 3, 5th leaf-stage, respectively. The degree of discoloration and death of leaves or suppression of height growth was not explicitly related to seedling death or the dry weight reduction. The degree of seedling death or dry weight reduction could differentiate chilling tolerance of varieties and seedling ages, but somewhat differently. Reduction in dry weight due to chilling occurred even without any visible injury or seedling death. These suggest that both the degree of seedling death and reduction in dry weight should be considered in the test of varieties for chilling tolerance. Combined evaluation of seedling death and dry weight reduction indicated the most susceptible seedling age to chilling injury to be 1 to 2nd leaf-stage for Jinheung, 2 to 3rd leaf-stage for Chulwon No.1, 3rd leaf- stage for Tongil and Yushin, respectively.

• Journal of Internet Computing and Services
• /
• v.16 no.1
• /
• pp.67-74
• /
• 2015

In recent years, frequent itemset mining for considering the importance of each item has been intensively studied as one of important issues in the data mining field. According to strategies utilizing the item importance, itemset mining approaches for discovering itemsets based on the item importance are classified as follows: weighted frequent itemset mining, frequent itemset mining using transactional weights, and utility itemset mining. In this paper, we perform empirical analysis with respect to frequent itemset mining algorithms based on transactional weights. The mining algorithms compute transactional weights by utilizing the weight for each item in large databases. In addition, these algorithms discover weighted frequent itemsets on the basis of the item frequency and weight of each transaction. Consequently, we can see the importance of a certain transaction through the database analysis because the weight for the transaction has higher value if it contains many items with high values. We not only analyze the advantages and disadvantages but also compare the performance of the most famous algorithms in the frequent itemset mining field based on the transactional weights. As a representative of the frequent itemset mining using transactional weights, WIS introduces the concept and strategies of transactional weights. In addition, there are various other state-of-the-art algorithms, WIT-FWIs, WIT-FWIs-MODIFY, and WIT-FWIs-DIFF, for extracting itemsets with the weight information. To efficiently conduct processes for mining weighted frequent itemsets, three algorithms use the special Lattice-like data structure, called WIT-tree. The algorithms do not need to an additional database scanning operation after the construction of WIT-tree is finished since each node of WIT-tree has item information such as item and transaction IDs. In particular, the traditional algorithms conduct a number of database scanning operations to mine weighted itemsets, whereas the algorithms based on WIT-tree solve the overhead problem that can occur in the mining processes by reading databases only one time. Additionally, the algorithms use the technique for generating each new itemset of length N+1 on the basis of two different itemsets of length N. To discover new weighted itemsets, WIT-FWIs performs the itemset combination processes by using the information of transactions that contain all the itemsets. WIT-FWIs-MODIFY has a unique feature decreasing operations for calculating the frequency of the new itemset. WIT-FWIs-DIFF utilizes a technique using the difference of two itemsets. To compare and analyze the performance of the algorithms in various environments, we use real datasets of two types (i.e., dense and sparse) in terms of the runtime and maximum memory usage. Moreover, a scalability test is conducted to evaluate the stability for each algorithm when the size of a database is changed. As a result, WIT-FWIs and WIT-FWIs-MODIFY show the best performance in the dense dataset, and in sparse dataset, WIT-FWI-DIFF has mining efficiency better than the other algorithms. Compared to the algorithms using WIT-tree, WIS based on the Apriori technique has the worst efficiency because it requires a large number of computations more than the others on average.

• Tuberculosis and Respiratory Diseases
• /
• v.53 no.3
• /
• pp.294-308
• /
• 2002

Background : The cell-mediated immune response plays an important role in tuberculosis. After being activated by mycobacterial antigens, T lymphocytes express a high affinity receptor (IL-2R) for interleukin-2 (IL-2) on their own surface and release a soluble fraction of the IL-2 receptor (sIL-2R) from the cell membrane into the circulation. Neopterin is a metabolite of guanosine-triphosphate, which is produced by stimulated macrophages under the influence of IFN-$\gamma$ with a T lymphocyte origin. Therefore, the utility of sIL-2R, IFN-$\gamma$ and the neopterin levels as immunologic indices of the cell-mediated immune response and severity of disease in patients with pulmonary tuberculosis was assessed. Methods : The serum sIL-2R, IFN-$\gamma$ and neopterin levels were measured in 39 patients with pulmonary tuberculosis, 6 patients with tuberculous lymphadenitis prior to treatment and 10 healthy subjects. The serum and pleural sIL-2R, neopterin and ADA levels were measured in 22 patients with tuberculous pleurisy. The patients with pulmonary tuberculosis were divided into a mild, moderate and severe group according to the severity by ATS guidelines. To compare the results from these patients with those of the pretreatment levels, the sIL-2R, IFN-$\gamma$ and neopterin levels were measured in 36 of the 39 patients(1 patient, expired; 2 patients were referred to a sanitarium) with pulmonary tuberculosis after 2 months of treatment. Results : 1) the serum sIL-2R and IFN-$\gamma$ levels were elevated in patients with tuberculosis when compared to those of healthy subjects (p>0.05). The neopterin concentration in the serum was significantly lower in patients with pulmonary tuberculosis($2967{\pm}2132.8$ pg/ml) than in healthy controls($4949{\pm}1242.1$ pg/ml)(p<0.05). 2) In the pulmonary tuberculosis group, the serum sIL-2R and IFN-$\gamma$ levels were higher in patients with severe disease than those in patients with mild and moderate disease. However, the neopterin levels declined as the pulmonary tuberculosis became more severe (p<0.01). 3) The mean serum sIL-2R and IFN-$\gamma$ levels declined from $1071{\pm}1139.4$ U/ml to $1023{\pm}1920.9$ U/ml(p>0.05), $41{\pm}52.8$ pg/ml to $22{\pm}23.9$ gm/ml(p<0.05), respectively, after 2 month of treatment. The mean serum neopterin levels increased from $3158{\pm}2272.6$ pg/ml to $3737{\pm}2307.5$ pg/ml(p>0.05) after a 2 month of treatment. These findings were remarkable in the severe group of pulmonary tuberculosis with a clinical correlation. 4) In the patients with tuberculous pleurisy, the serum sIL-2R and ADA were significantly higher than those in the pleural fluid, However, the neopterin levels in the sera and pleural effusion were similar. Conclusion : On the basis of this study, sIL-2R, IFN-$\gamma$ and neopterin measurements may not only provide an insight into the present state of the cell-mediated immune response, but also serve as parameters monitoring of the prognosis of the disease, particularly in patients with severe pulmonary tuberculosis. In addition, an assay of the pleural sIL-2R levels might signal a stimulated local immunity including T cell activation in the tuberculous pleural effusion.

• Tuberculosis and Respiratory Diseases
• /
• v.44 no.2
• /
• pp.280-289
• /
• 1997

Background : Bronchioloalveolar carcinoma (BAC) has been reported to diveres spectrum of chinical presentations and radiologic patterns. The three representative radiologic patterns are followings ; 1) a solitary nodule or mass, 2) a localized consolidation, and 3) multicentric or diffuse disease. While, the localized consolidation and solitary nodular patterns has favorable prognosis, the multicentric of diffuse pattern has worse prognosis regardless of treatment. BAC presenting as a solitary pulmonary nodule is often misdiagnosed as other benign disease such as tuberculoma. Therefore it is very important to make proper diagnosis of BAC with solitary nodular pattern, since this pattern of BAC is usually curable with a surgical resection. Methods : We reviewed the clinical and radiologic features of patients with pathologically-proven BAC with solitary nodular pattern from January 1995 to September 1996 at Samsung Medical Center. Results : Total 11 patients were identified. 6 were men and 5 were women. Age ranged from 37 to 69. Median age was 60. Most patients with BAC with solitary nodular pattern were asymptomatic and were detected by incidental radiologic abnormality. The chest radiograph showed poorly defined opacity or nodule and computed tomography showed consolidation, ground glass appearance, internal bubble-like lucencies, air bronchogram, open bronchus sign, spiculated margin or pleural tag in most patients. The initial diagnosis on chest X-ray were pulmonary tuberculosis in 4 patients, benign nodule in 2 patients and malignant nodule in 5 patients. The FDG-positron emission tomogram was performed in eight patients. The FDG-PET revealed suggestive findings of malignancy in only 3 patients. The pathologic diagnosis was obtained by transbronchial lung biopsy in 1 patient, by CT guided percutaneous needle aspiration in 2 patients, and by lung biopsy via video-assited thoracocopy in 8 patients. Lobectomy was performed in all patients and postoperative pathologic staging were $T_1N_0N_0$ in 8 patients and $T_2N_0M_0$ in 3 patients. Conclusion : Patients of BAC presenting with solitary nodular pattern were most often asymptomatic and incidentally detected by radiologic abnormality. The chest X-ray showed poorly defined nodule or opacity and these findings were often regarded as benign lesion. If poorly nodule or opacity does not disappear on follow up chest X-ray, computed tomography should be performed. If consolidation, ground glass appearance, open bronchus sign, air bronchogram, internal bubble like lucency, pleural tag or spiculated margin are found on computed tomography, further diagnostic procedures, including open thoracotomy, should be performed to exclude the possiblity of BAC with solitary nodular pattern.

• Tuberculosis and Respiratory Diseases
• /
• v.45 no.1
• /
• pp.57-67
• /
• 1998

Purpose : This study was undertaken to determine the preoperative predictors of mortality and morbidity after lung cancer resection. Method: During the period from October 1, 1995 to August 31, 1996, a prospective study was conducted in 92 lung resection candidates diagnosed as lung cancer. For preoperative predictors of nonpulmonary factors, we considered age, sex, weight loss, hematocrit, serum albumin, EKG and concomitant illness, and for those of pulmonary factors, smoking history, presence of pneumonia, dyspnea scale(1 to 4), arterial blood gas analysis with room air breathing, routine pulmonary function test. And predicted postoperative(ppo) pulmonary factors such as PPO-$FEV_1$, ppo-diffusing capacity(DLco), predicted postoperative product(PPP) of ppo-$FEV_1%{\times}ppo$-DLco% and ppo-maximal $O_2$ uptake($VO_2$max) were also considered. Results: There were 78 men and 14 women with a median age of 62 years(range 42 to 82) and a mean $FEV_1$ of $2.37\pm0.06L$. Twenty nine patients had a decreased $FEV_1$ less than 2.0L. Pneumonectomy was performed in 26 patients, bilobectomy in 12, lobectomy in 54. Pulmonary complications developed in 10 patients, cardiac complications in 9, other complications(empyema, air leak, bleeding) in 11, and 16 patients were managed in intensive care unit for more than 48hours. Three patients died within 30 days after operation. The ppo-$VO_2$max was less than 10ml/kg/min in these three patients, but its statistical significance could not be determined due to small number of patients. In multivariate analysis, the predictor related to postoperative death was weight loss(p<0.05), and as for pulmonary complications, weight loss, dyspnea scale, ppo-DLco and extent of resection(p<0.05). Conclusions: Based on this study, preoperative nonpulmonary factors such as weight loss and dyspnea scale are more important than the pulmonary factors in the prediction of postoperative mortality and/or morbodity in lung resection candidates, but exercise pulmonary fuction test may be useful Our study suggests that ppo-$VO_2$max value less than 10ml/kg/min is associated with death after lung cancer resection but further studies are needed to validate this result.