• Title/Summary/Keyword: Pretreatment techniques

Search Result 82, Processing Time 0.025 seconds

A Comparative Analysis of the Pre-Processing in the Kaggle Titanic Competition

  • Tai-Sung, Hur;Suyoung, Bang
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.3
    • /
    • pp.17-24
    • /
    • 2023
  • Based on the problem of 'Tatanic - Machine Learning from Disaster', a representative competition of Kaggle that presents challenges related to data science and solves them, we want to see how data preprocessing and model construction affect prediction accuracy and score. We compare and analyze the features by selecting seven top-ranked solutions with high scores, except when using redundant models or ensemble techniques. It was confirmed that most of the pretreatment has unique and differentiated characteristics, and although the pretreatment process was almost the same, there were differences in scores depending on the type of model. The comparative analysis study in this paper is expected to help participants in the kaggle competition and data science beginners by understanding the characteristics and analysis flow of the preprocessing methods of the top score participants.

Grain Size Analysis Using Morphological Properties of Grains (입자의 형태적 특성을 활용한 퇴적물 입도분석)

  • Choi, Kwang Hee
    • Journal of The Geomorphological Association of Korea
    • /
    • v.27 no.2
    • /
    • pp.19-28
    • /
    • 2020
  • Grain size analysis is the most basic procedure for identifying the origin, transport and sedimentation processes of sediments, and is widely used in geomorphology and sedimentology. Traditionally, grain size was determined by a sieve-pippette method, but the use of automated analyzers is increasing in recent years. These analyzers have many advantages over traditional techniques, but the measurement results are not always the same. It is still difficult to solve the pretreatment problem such as incomplete diffusion and residual organic matter, and inappropriate results may be obtained. This study compared image-based grain size analysis and sieve analysis to verify its statistical reliability, and conducted experiments to enhance the measurement accuracy using shape parameters. The results showed that the image-based analysis overestimated the grain size of sand dunes by about 7% compared to the sieve analysis, but the two measurements were not statistically different. In addition, by using shape parameters, such as aspect ratio, sphericity, and convexity, improved statistics were obtained compared to the original data. Using the morphological properties of the individual grains is a complementary method to the incomplete pretreatment of the grain size analysis process, and at the same time, it will contribute to improving the accuracy and reliability of the results.

DETERMINATION OF THE APPARENT ILEAL DIGESTIBILITY OF PROTEIN AND AMINO ACIDS IN FEEDSTUFFS AND MIXED DIETS FOR GROWIG-FINSHING PIGS WITH THE MOBILE NYLON BAG TECHNIQUE

  • Yin, Y.L.;Zhong, H.Y.;Huang, R.L.
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.8 no.5
    • /
    • pp.433-441
    • /
    • 1995
  • A series of experiments was conducted to determine the influence of various pepsin-HCL pretreatment factor, hereby the factors of duration of washing for the retrieved bags, inherent to the mobile nylon bag technique (MNBT), on apparent ileal digestibility of crude protein (AIDCP) and apparent ileal digestibility of dry matter (AIDDM). At last, the AIDCP and apparent ileal digestibility of amino acids (AIDAA) in maize, barley, wheat, rapeseed meal, cottonseed meal and three mixed diets were determined with the MNBT and ileo-rectal anastomis pigs (IRAT). For the MNBT techniques, bag measuring $25{\times}40$ MM and containing 0.75 g feedstuff samples, after pre-digestion in vitro, were introduced into the ileo-rectal anastomis pigs (IRAT) gastrointestinal tract through a duodenal cannula and recovered in the ileal digesta between 6 and 12 h. later. 1. The apparent ileal digestibility of dry matter (AIDDM) and crude protein (AIDCP) of the tested samples, with the exception of fish meal, determined by MNBT were not affected by the different pepsin-HCL pretreatment times in vitro between 2.5 h. and 4 h. 2. There was no significant (p > 0.05) difference of the AIDCP and AIDDM of maize determined by the MNBT among different pepsin concentration (0.03%, 0.07% and 0.1 %) treatment in vitro. 3. The AIDCP determined with the MNBT was affected by the washed and unwashed recovered bags from the ileal digesta. 4. The AIDCP and AID amino acids (AIDAA) of maize, barley, wheat, rapeseed meal, soya-bean meal, cottonseed meal and three mixed diets from the MNBT, with a solution of 0.01N HCL (PH 2) and 0.1% of pepsin concentration, a pepsin-HCL pretreatment time in vitro or 4h. and a washing time of the recovered bag from the ileal digesta compared well with those from the IRAT. The linear regression analysis showed a significant correlation (p < 0.01) of AIDCP and AIDDA between the IRAT and MNBT.

Influences of Cold Pretreatment, Dark Condition, and Ficoll on the Callus Formation and Organ Differentiation in Anther Culture of Carnation (카네이션 약배양에 있어서 저온전처리, 암처리 및 Ficoll처리가 캘러스 형성 및 기관분화에 미치는 영향)

  • Lee, Su-Young;Kim, Jae-Yeong;Kim, Tae-Il;Ko, Jae-Young;Kim, Ki Sun
    • Horticultural Science & Technology
    • /
    • v.17 no.2
    • /
    • pp.138-140
    • /
    • 1999
  • These studies were carried out to investigate the effects of cold pretreatment, dark condition, and Ficoll on the callus formation and organ differentiation in anther culture of carnation for the purpose of settling the techniques of anther culture of 'Rony' carnation. Diameter of flower buds containing anthers with microspores before or after uniuncleated stage was between 4 and 6 mm. A high percentage of callus formation and responding anthers were achieved by low temperature pretreatment at $4^{\circ}C$ for 7 days. Callus formation was promoted under dark condition. Roots were differentiated from calli formed under darkness. Ficoll didn't promote callus formation but promoted differentiation of shoots and roots.

  • PDF

Classification of Red Wines by Near Infrared Transflectance Spectroscopy

  • W.Guggenbichler;Huck, C.W.;M.Popp;G.K.Bonn
    • Proceedings of the Korean Society of Near Infrared Spectroscopy Conference
    • /
    • 2001.06a
    • /
    • pp.1516-1516
    • /
    • 2001
  • During the recent years, wine analysis has played an increasing role due the health benefits of phenolic ingredients in red wine [1]. On the other hand there is the need to be able to distinguish between different wine varieties. Consumers want to know if a wine is an adulterated one or if it is based on the pure grape. Producers need to certificate their wines in order to ensure compliance with legal regulations. Up to now, the attempts to investigate the origin of wines were based on high-performance liquid chromatography (HPLC), gas chromatography (GC) and pyrolysis mass spectrometry (PMS) [l,2,3]. These methods need sample pretreatment, long analysis times and therefore lack of high sample throughput. In contradiction to these techniques using near infrared spectroscopy (NIRS), no sample pretreatment is necessary and the analysis time for one sample is only about 10 seconds. Hence, a near infrared spectroscopic method is presented that allows a fast classification of wine varieties in bottled red wines. For this, the spectra of 50 bottles of Cabernet Sauvignon, Lagrein and Sangiovese (Chianti) were recorded without any sample pretreatment over a wavelength range from 1000 to 2500 nm with a resolution of 12 cm$\^$-1/. 10 scans were used for an average spectrum. In order to yield best reproducibility, wines were thermostated at 23$^{\circ}C$ and a optical layer thickness of 3 mm was used. All recorded spectra were partitioned into a calibration and validation set (70% and 30%). Finally, a 3d scatter plot of the different investigated varieties allowed to distinguish between Cabernet Sauvignon, Lagrein and Sangiovese (Chianti). Considering the short analysis times this NRS-method will be an interesting tool for the quality control of wine verification and also for experienced sommeliers.

  • PDF

Biological stability in the ozone and peroxone pretreatment systems in river water (하천수 내 생물학적 안정성에 따른 유기물 특성변화와 오존산화기반 전처리 연구)

  • Park, Se-Hee;Noh, Jin-Hyung;Park, Ji-Won;Maeng, Sung-Kyu
    • Journal of Korean Society of Water and Wastewater
    • /
    • v.32 no.2
    • /
    • pp.159-168
    • /
    • 2018
  • Climate change is believed to increase the amount of dissolved organic matter in surface water, as a result of the release of bulk organic matter, which make difficult to achieve a high quality of drinking water via conventional water treatment techniques. Therefore, the natural water treatment techniques, such as managed aquifer recharge (MAR), can be proposed as a alternative method to improve water quality greatly. Removal of bulk organic matter using managed aquifer recharge system is mainly achieved by biodegradation. Biodegradable dissolved organic carbon (BDOC) and assimilable organic carbon (AOC) can be used as water quality indicators for biological stability of drinking water. In this study, we compared the change of BDOC and AOC with respect to pretreatment methods (i.e., ozone or peroxone). The oxidative pretreatment can transform the recalcitrant organic matter into readily biodegradable one (i.e., BDOC and AOC). We also investigated the differences of organic matter characteristics between BDOC and AOC. We observed the decreases in dissolved organic carbon (DOC) and the tryptophan-like fluorescence intensities. Liquid chromatographic - organic carbon detection (LC-OCD) analysis also showed the reduction of the low molecular weight (LMW) fraction (15% removed, less than 500 Da), which is known to be easily biodegradable, and the biopolymers, high molecular weight fractions (66%). Therefore, BDOC consists of a broad range of organic matter characteristics with respect to molecular weight. In AOC, low molecular weight organic matter and biopolymers fraction was reduced by 11 and 6%, respectively. It confirmed that biodegradation by microorganisms as the main removal mechanism in AOC, while BDOC has biodegradation by microorganism as well as the sorption effects from the sand. $O_3$ and $O_3+H_2O_2$ were compared with respect to biological stability and dissolved organic matter characteristics. BDOC and AOC were determined to be about 1.9 times for $O_3$ and about 1.4 times for $O_3+H_2O_2$. It was confirmed that $O_3$ enhanced the biodegradability by increasing LMW dissolved organic matter.

An Improvement on the Analysis Techniques of Environmental Radioactivity Around Nuclear Power Plants (원전주변 환경방사능 분석기술의 개선(I))

  • Kim, Soong-Pyung;Chae, Gyung-Sun;Chung, Woon-Kwan
    • Journal of Radiation Protection and Research
    • /
    • v.20 no.1
    • /
    • pp.8-15
    • /
    • 1995
  • An estimate of a change in radioactivity's circumstances around the nuclear power plant is validated with the results of the radioactivity measurements are compared. In this study, to further enhance the reliability of the results obtained from the environmental radioactivity measurements and analysis around the nuclear power plants that have been carried out up to the present. In the korea standard, there is the technical analysis guide for general stable chemical element's, but there is not the technical analysis guide for the radionuclei. therefore the environmental sample collection, the pretreatment of the sample and radionuclide analysis in the sample, the result's of the environmental radioactivity measurements by each organization, etc. are different. It is not sufficient for the database to forecasting a change in radioactivity's circumstances. A comparative study of collection and pretreatment techniques for the soil sample, the results by comparison, the method of minimizing the relative error are proposed. At one side of sample collection, there are going to considered that the surroundings of sample collection like the lay of the land, the provision of the selection standard for the area and pathway of radionuclide adhesion, the coherence of sample collection, etc.. at another side of pretreatment of the sample and measurement in the case of soil sample, how to do homogeneously the soil particle size and the standard tools, i.e. kinds of meshes, must to be selected.

  • PDF

Existing Forms of Heavy Metals in the Vicinity of a Smelter (제련소 주변토양 중금속 존재형태)

  • Woo, Sang-Duck;Kim, Geon-Ha;Kim, Young-Jin;Nam, Kyoung-Phile
    • Journal of Soil and Groundwater Environment
    • /
    • v.15 no.5
    • /
    • pp.16-22
    • /
    • 2010
  • Heavy metals in soils exist in various forms dependent upon surrounding conditions. As the Janghang smelter area is of concern for its high elevated heavy metal concentrations, Korean government decided to remediate the area. Main objectives of this research were; to analyze heavy metal concentrations and their existing forms in the vicinity of the smelter; and to understand differences made by analysis techniques of heavy metals. Top soils of rice field, crop field, bare field, and forestry in the area were sampled and analyzed for their physicochemical characteristics. Concentrations of Cu, Cd, Pb, and As were analyzed with two pretreatment techniques adopted using 0.1 N HCl and aqua regia. To analyze existing forms of heavy metals, Tessier's schemes for sequential extraction technique were adopted. Exchangeable fraction and carbonate bound fraction of heavy metals may pose potential threat to environment and were in the order of Pb > As > Cu > Cd. If assessing mobile fraction of heavy metals by land uses, the order was forestry > bare land > crop field > rice field. When analyzed using Tessier's scheme, high ratio of residual fractions to total arsenic concentration should be considered for remediation design of the area.

Nanometrology and its perspectives in environmental research

  • Kim, Hyun-A;Seo, Jung-Kwan;Kim, Taksoo;Lee, Byung-Tae
    • Environmental Analysis Health and Toxicology
    • /
    • v.29
    • /
    • pp.16.1-16.9
    • /
    • 2014
  • Objectives Rapid increase in engineered nanoparticles (ENPs) in many goods has raised significant concern about their environmental safety. Proper methodologies are therefore needed to conduct toxicity and exposure assessment of nanoparticles in the environment. This study reviews several analytical techniques for nanoparticles and summarizes their principles, advantages and disadvantages, reviews the state of the art, and offers the perspectives of nanometrology in relation to ENP studies. Methods Nanometrology is divided into five techniques with regard to the instrumental principle: microscopy, light scattering, spectroscopy, separation, and single particle inductively coupled plasma-mass spectrometry. Results Each analytical method has its own drawbacks, such as detection limit, ability to quantify or qualify ENPs, and matrix effects. More than two different analytical methods should be used to better characterize ENPs. Conclusions In characterizing ENPs, the researchers should understand the nanometrology and its demerits, as well as its merits, to properly interpret their experimental results. Challenges lie in the nanometrology and pretreatment of ENPs from various matrices; in the extraction without dissolution or aggregation, and concentration of ENPs to satisfy the instrumental detection limit.

An Experimental study on the bond strength according to the surface treatment of metal alloy for porcelain fused metal crown (-금속(金屬) 표면처리방법(表面處理方法)에 따른 비귀금속합금(非貴金屬合金)과 도재(陶材)와의 결합강도(結合强度)에 관(關)한 실험적(實驗的) 연구(硏究)-)

  • Chung, In-Sung
    • Journal of Technologic Dentistry
    • /
    • v.11 no.1
    • /
    • pp.83-88
    • /
    • 1989
  • This investigation was performed to evaluate the effect of four different preteatment techniques on the bond strength of porcelain to non-precious metal alloy. Samples of total of 40 were divided into 4 groups according to the 4 variables which included the 50$\mu$alumina oxide air abrasion, method, the as retention bead method, the L-retention bead method, the Etching method. The completed metal-porcelain samples were compressed in Instron loading machine until gross fracture occured to examine the effect of the complex variables on the bond strength of porcelain to non precious metal alloy. The result obtained were as follows : 1. The difference of bond strength according to four different pretreatment techniques was statistically significant(p<0.01). 2. The difference of bond strength between the ss-retention bead method and the L-retention bead method was not significant statistically(p>0.05) 3. The difference of bond strength between the retention bead method and the etching method was statistically significant(p<0.01). 4. The difference of bond strength between the retention bead method and the 50$\mu$alumina oxide air abrasion method was statistically significant(p<0.01). 5. The difference of bond strength between the etching method and the 50$\mu$alumina oxide air abrasion method was statistically significant(p<0.01).

  • PDF