• Title/Summary/Keyword: batch processing

Search Result 292, Processing Time 0.024 seconds

Improving Multi-DNN Computational Performance of Embedded Multicore Processors through a Global Queue (글로벌 큐를 통한 임베디드 멀티코어 프로세서의 멀티 DNN 연산 성능 향상)

  • Cho, Ho-jin;Kim, Myung-sun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.6
    • /
    • pp.714-721
    • /
    • 2020
  • DNN is expanding its use in embedded systems such as robots and autonomous vehicles. For high recognition accuracy, computational complexity is greatly increased, and multiple DNNs are running aperiodically. Therefore, the ability processing multiple DNNs in embedded environments is a crucial issue. Accordingly, multicore based platforms are being released. However, most DNN models are operated in a batch process, and when multiple DNNs are operated in multicore together, the execution time deviation between each DNN may be large and the end-to-end execution time of the whole DNNs could be long depending on how they are allocated to the cores. In this paper, we solve these problems by providing a framework that decompose each DNN into individual layers and then distribute to multicores through a global queue. As a result of the experiment, the total DNN execution time was reduced by 31%, and when operating multiple identical DNNs, the deviation in execution time was reduced by up to 95.1%.

A Study on Establishment of Connecting Information Conversion Criteria for Mobile Electronic Notification Service of Private Institutions (민간기관 모바일 전자고지서비스를 위한 연계정보 변환기준 수립에 대한 연구)

  • Kim, JongBae
    • The Journal of the Convergence on Culture Technology
    • /
    • v.7 no.4
    • /
    • pp.735-743
    • /
    • 2021
  • The mobile electronic notice service (MENS) is a service that delivers a mobile electronic notice to a smartphone in the person's name through an authorized electronic document intermediary instead of a bill that was delivered by mail using paper. In order to provide the MENS, information is needed to identify the same user between the sending agency and the authorized electronic document relay. In this paper, we propose a standard for safe conversion and utilization of Connecting Information (CI) used as user identification information for MENS. In the proposed method, it is necessary for the requesting institution to send the electronic notice to provide the resident registration number to the identity verification institution and convert it into the CI. In this case, a safe and efficient MENS will be possible by proposing a review standard and processing method to verify the appropriateness of the conversion of CI. By applying the proposed method to the MENS, it can contribute to service activation and reinforcement of user privacy protection.

Introduction and Utilization of Time Series Data Integration Framework with Different Characteristics (서로 다른 특성의 시계열 데이터 통합 프레임워크 제안 및 활용)

  • Jisoo, Hwanga;Jaewon, Moon
    • Journal of Broadcast Engineering
    • /
    • v.27 no.6
    • /
    • pp.872-884
    • /
    • 2022
  • With the development of the IoT industry, different types of time series data are being generated in various industries, and it is evolving into research that reproduces and utilizes it through re-integration. In addition, due to data processing speed and issues of the utilization system in the actual industry, there is a growing tendency to compress the size of data when using time series data and integrate it. However, since the guidelines for integrating time series data are not clear and each characteristic such as data description time interval and time section is different, it is difficult to use it after batch integration. In this paper, two integration methods are proposed based on the integration criteria setting method and the problems that arise during integration of time series data. Based on this, integration framework of a heterogeneous time series data was constructed that is considered the characteristics of time series data, and it was confirmed that different heterogeneous time series data compressed can be used for integration and various machine learning.

Efficiency and Mechanism of Pb(II) Removal from Aqueous Solutions Using Cornus controversa and Quercus mongolica Biomass Waste (층층나무와 신갈나무 폐바이오매스를 활용한 수용액 중 납 제거 효율 및 기작)

  • Choi, Si Young;Jeong, Seok Soon;Yang, Jae E.;Kim, Hyuck Soo;Cho, Jun Hyung
    • Korean Journal of Environmental Agriculture
    • /
    • v.40 no.4
    • /
    • pp.239-247
    • /
    • 2021
  • BACKGROUND: Enormous amounts of the wood biomass wastes have been produced through various wood processing. This study characterizes the surface characteristics of biomass powders of Cornus controversa (CC) and Quercus mongolica (QM) and investigates their removal efficiency and mechanism for Pb (II) in aqueous solution on which to base potential recycling alternative of the wood biomass. METHODS AND RESULTS: Batch experiments were conducted under different conditions of Pb concentrations, temperatures, time and solid/solution ratios. Adsorption isotherm of Pb by CC and QM biomass was explained significantly by the Langmuir model, indicating Pb was likely adsorbed on the monolayer of the surfaces. The adsorption kinetics were fitted significantly to the double first-order model consisting of rapid and slow steps. The respective rate constants (k1) of CC and QM for the rapid adsorption kinetic steps were 0.051 and 0.177 min-1, and most of the sorption reactions proceeded rapidly within 6-20 minutes. The maximum adsorption quantities (qmax) of Pb were 17.25 and 23.47 mg/g for CC and QM, respectively. Thermodynamic parameters revealed that adsorption of Pb on the biomass of CC and QM was a spontaneous endothermic reaction. CONCLUSION(S): Results demonstrate that biomass wastes of CC and QM can be used as Pb adsorbents judging from adsorption isotherm, kinetics, and thermodynamic parameters.

A streamlined pipeline based on HmmUFOtu for microbial community profiling using 16S rRNA amplicon sequencing

  • Hyeonwoo Kim;Jiwon Kim;Ji Won Cho;Kwang-Sung Ahn;Dong-Il Park;Sangsoo Kim
    • Genomics & Informatics
    • /
    • v.21 no.3
    • /
    • pp.40.1-40.11
    • /
    • 2023
  • Microbial community profiling using 16S rRNA amplicon sequencing allows for taxonomic characterization of diverse microorganisms. While amplicon sequence variant (ASV) methods are increasingly favored for their fine-grained resolution of sequence variants, they often discard substantial portions of sequencing reads during quality control, particularly in datasets with large number samples. We present a streamlined pipeline that integrates FastP for read trimming, HmmUFOtu for operational taxonomic units (OTU) clustering, Vsearch for chimera checking, and Kraken2 for taxonomic assignment. To assess the pipeline's performance, we reprocessed two published stool datasets of normal Korean populations: one with 890 and the other with 1,462 independent samples. In the first dataset, HmmUFOtu retained 93.2% of over 104 million read pairs after quality trimming, discarding chimeric or unclassifiable reads, while DADA2, a commonly used ASV method, retained only 44.6% of the reads. Nonetheless, both methods yielded qualitatively similar β-diversity plots. For the second dataset, HmmUFOtu retained 89.2% of read pairs, while DADA2 retained a mere 18.4% of the reads. HmmUFOtu, being a closed-reference clustering method, facilitates merging separately processed datasets, with shared OTUs between the two datasets exhibiting a correlation coefficient of 0.92 in total abundance (log scale). While the first two dimensions of the β-diversity plot exhibited a cohesive mixture of the two datasets, the third dimension revealed the presence of a batch effect. Our comparative evaluation of ASV and OTU methods within this streamlined pipeline provides valuable insights into their performance when processing large-scale microbial 16S rRNA amplicon sequencing data. The strengths of HmmUFOtu and its potential for dataset merging are highlighted.

The Effects of Salt and $NaNO_2$ on Physico-Chemical Characteristics of Dry-cured Ham (소금과 아질산염 처리수준에 따른 건염햄의 이화학적 특성)

  • Seong, Pil-Nam;Kim, Jin-Hyoung;Cho, Soo-Hyun;Lee, Chang-Hyun;Kang, Dong-Woo;Hah, Kyoung-Hee;Lim, Dong-Gyun;Park, Beom-Young;Kim, Dong-Hoon;Lee, Jong-Moon;Ahn, Chong-Nam
    • the MEAT Journal
    • /
    • s.36 summer
    • /
    • pp.61-71
    • /
    • 2009
  • The aim of this work was to analyze the effects of salt and NaNO2 on weight loss, proximate compositions, chemical parameters and texture characteristics of dry-cured ham processed using Korean methods. Four different treatments were considered: The H8 group of 3 hams (11.30 kg) was salted with 9.2 g/kg salt (w/w) (high salt batch), the HS+NaNO2 group of 3 hams (10.65 kg) was salted same as HS group and added 100 ppm NaNO2. The LS group of 3 hams (11.42 kg) was salted with 6.2 g/kg salt (w/w) (Low salt batch), the LS+NaNO2 group of 3 hams (10.62 kg) was salted same as L8 group and added 100 ppm NaNO2. The highest weight losses took place at the drying stage (27.46, 28.25, 26.99, and 28.42%). However, there were no significant differences in the weight losses between treatments (p>0.05). The moisture content was significantly affected with addition of NaNO2 (p<0.05), the L8 hams had significantly higher moisture content than HS + NaNO2 and L8 + NaNO2 (p<0.05). The level of salt and NaNO2 did not affect the fat, protein and ash contents. The hardness and chewiness in biceps femoris muscle from L8 hams were significantly lower than in the muscles from HS + NaNO2 hams (p<0.05). The NaNO2 did not affect the texture characteristics of dry-cured hams. The processing conditions significantly affected the chemical parameters of biceps femoris muscle (p<0.05). The water activity in biceps femoris muscle from L8 hams was significantly higher than in muscles from HS and H8+NaNO2 hams (p<0.04). The salt content in biceps femoris muscles from LS + NaNO2 hams was significantly lower than in the muscles from HS and HS + NaNO2 hams (p<0.05). The NaNO2 treatment did not affect the NaNO2 content in biceps femoris muscles (p>0.05). The processing conditions did not significantly affect the lightness (L), redness (a), and $h^{\circ}$ of biceps femoris muscles (p>0.05). The yellowness (b) and chroma in biceps femoris muscle from HS + NaNO2 hams were significantly higher than in the muscles from HS and LS hams.

  • PDF

The Effects of Salt and NaNO2 on Physico-Chemical Characteristics of Dry-cured Ham (소금과 아질산염 처리수준에 따른 건염햄의 이화학적 특성)

  • Seong, Pil-Nam;Kim, Jin-Hyoung;Cho, Soo-Hyun;Lee, Chang-Hyun;Kang, Dong-Woo;Hah, Kyoung-Hee;Lim, Dong-Gyun;Park, Beom-Young;Kim, Dong-Hoon;Lee, Jong-Moon;Ahn, Chong-Nam
    • Food Science of Animal Resources
    • /
    • v.28 no.4
    • /
    • pp.493-498
    • /
    • 2008
  • The aim of this work was to analyze the effects of salt and $NaNO_2$ on weight loss, proximate compositions. chemical parameters and texture characteristics of dry-cured ham processed using Korean methods. Four different treatments were considered: The HS group of 3 hams (11.30 kg) was salted with 9.2 g/kg salt (w/w) (high salt batch), the HS+$NaNO_2$ group of 3 hams (10.65 kg) was salted same as HS group and added 100 ppm $NaNO_2$. The LS group of 3 hams (11.42 kg) was salted with 6.2 g/kg salt (w/w) (Low salt batch), the LS+$NaNO_2$ group of 3 hams (10.62 kg) was salted same as LS group and added 100 ppm $NaNO_2$. The highest weight losses took place at the drying stage (27.46, 28.25, 26.99, and 28.42%). However, there were no significant differences in the weight losses between treatments (p>0.05). The moisture content was significantly affected with addition of $NaNO_2$ (p<0.05), the LS hams had significantly higher moisture content than HS+$NaNO_2$ and LS+$NaNO_2$ (p<0.05). The level of salt and $NaNO_2$ did not affect the fat, protein and ash contents. The hardness and chewiness in biceps femoris muscle from LS hams were significantly lower than in the muscles from HS+$NaNO_2$ hams (p<0.05). The $NaNO_2$ did not affect the texture characteristics of dry-cured hams. The processing conditions significantly affected the chemical parameters of biceps femoris muscle (p<0.05). The water activity in biceps femoris muscle from LS hams was significantly higher than in muscles from HS and HS+$NaNO_2$ hams (p<0.05). The salt content in biceps femoris muscles from LS+$NaNO_2$ hams was significantly lower than in the muscles from HS and HS+$NaNO_2$ hams (p<0.05). The $NaNO_2$ treatment did not affect the $NaNO_2$ content in biceps femoris muscles (p>0.05). The processing conditions did not significantly affect the lightness (L), redness (a), and $h^{\circ}$ of biceps femoris muscles (p>0.05). The yellowness (b) and chroma in biceps femoris muscle from HS+$NaNO_2$ hams were significantly higher than in the muscles from HS and LS hams.

Development of System for Real-Time Object Recognition and Matching using Deep Learning at Simulated Lunar Surface Environment (딥러닝 기반 달 표면 모사 환경 실시간 객체 인식 및 매칭 시스템 개발)

  • Jong-Ho Na;Jun-Ho Gong;Su-Deuk Lee;Hyu-Soung Shin
    • Tunnel and Underground Space
    • /
    • v.33 no.4
    • /
    • pp.281-298
    • /
    • 2023
  • Continuous research efforts are being devoted to unmanned mobile platforms for lunar exploration. There is an ongoing demand for real-time information processing to accurately determine the positioning and mapping of areas of interest on the lunar surface. To apply deep learning processing and analysis techniques to practical rovers, research on software integration and optimization is imperative. In this study, a foundational investigation has been conducted on real-time analysis of virtual lunar base construction site images, aimed at automatically quantifying spatial information of key objects. This study involved transitioning from an existing region-based object recognition algorithm to a boundary box-based algorithm, thus enhancing object recognition accuracy and inference speed. To facilitate extensive data-based object matching training, the Batch Hard Triplet Mining technique was introduced, and research was conducted to optimize both training and inference processes. Furthermore, an improved software system for object recognition and identical object matching was integrated, accompanied by the development of visualization software for the automatic matching of identical objects within input images. Leveraging satellite simulative captured video data for training objects and moving object-captured video data for inference, training and inference for identical object matching were successfully executed. The outcomes of this research suggest the feasibility of implementing 3D spatial information based on continuous-capture video data of mobile platforms and utilizing it for positioning objects within regions of interest. As a result, these findings are expected to contribute to the integration of an automated on-site system for video-based construction monitoring and control of significant target objects within future lunar base construction sites.

On Flexibility Analysis of Real-Time Control System Using Processor Utilization Function (프로세서 활용도 함수를 이용한 실시간 제어시스템 유연성 분석)

  • Chae Jung-Wha;Yoo Cheol-Jung
    • The KIPS Transactions:PartA
    • /
    • v.12A no.1 s.91
    • /
    • pp.53-58
    • /
    • 2005
  • The use of computers for control and monitoring of industrial process has expanded greatly in recent years. The computer used in such applications is shared between a certain number of time-critical control and monitor function and non time-critical batch processing job stream. Embedded systems encompass a variety of hardware and software components which perform specific function in host computer. Many embedded system must respond to external events under certain timing constraints. Failure to respond to certain events on time may either seriously degrade system performance or even result in a catastrophe. In the design of real-time embedded system, decisions made at the architectural design phase greatly affect the final implementation and performance of the system. Flexibility indicates how well a particular system architecture can tolerate with respect to satisfying real-time requirements. The degree of flexibility of real-time system architecture indicates the capability of the system to tolerate perturbations in timing related specifications. Given degree of flexibility, one may compare and rank different implementations. A system with a higher degree of flexibility is more desirable. Flexibility is also an important factor in the trade-off studies between cost and performance. In this paper, it is identified the need for flexibility function and shows that the existing real-time analysis result can be effective. This paper motivated the need for a flexibility for the efficient analysis of potential design candidates in the architectural design exploration or real time embedded system.

Incremental Generation of A Decision Tree Using Global Discretization For Large Data (대용량 데이터를 위한 전역적 범주화를 이용한 결정 트리의 순차적 생성)

  • Han, Kyong-Sik;Lee, Soo-Won
    • The KIPS Transactions:PartB
    • /
    • v.12B no.4 s.100
    • /
    • pp.487-498
    • /
    • 2005
  • Recently, It has focused on decision tree algorithm that can handle large dataset. However, because most of these algorithms for large datasets process data in a batch mode, if new data is added, they have to rebuild the tree from scratch. h more efficient approach to reducing the cost problem of rebuilding is an approach that builds a tree incrementally. Representative algorithms for incremental tree construction methods are BOAT and ITI and most of these algorithms use a local discretization method to handle the numeric data type. However, because a discretization requires sorted numeric data in situation of processing large data sets, a global discretization method that sorts all data only once is more suitable than a local discretization method that sorts in every node. This paper proposes an incremental tree construction method that efficiently rebuilds a tree using a global discretization method to handle the numeric data type. When new data is added, new categories influenced by the data should be recreated, and then the tree structure should be changed in accordance with category changes. This paper proposes a method that extracts sample points and performs discretiration from these sample points to recreate categories efficiently and uses confidence intervals and a tree restructuring method to adjust tree structure to category changes. In this study, an experiment using people database was made to compare the proposed method with the existing one that uses a local discretization.