• Title/Summary/Keyword: Generate Data

Search Result 3,065, Processing Time 0.03 seconds

A Deep Learning Based Over-Sampling Scheme for Imbalanced Data Classification (불균형 데이터 분류를 위한 딥러닝 기반 오버샘플링 기법)

  • Son, Min Jae;Jung, Seung Won;Hwang, Een Jun
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.8 no.7
    • /
    • pp.311-316
    • /
    • 2019
  • Classification problem is to predict the class to which an input data belongs. One of the most popular methods to do this is training a machine learning algorithm using the given dataset. In this case, the dataset should have a well-balanced class distribution for the best performance. However, when the dataset has an imbalanced class distribution, its classification performance could be very poor. To overcome this problem, we propose an over-sampling scheme that balances the number of data by using Conditional Generative Adversarial Networks (CGAN). CGAN is a generative model developed from Generative Adversarial Networks (GAN), which can learn data characteristics and generate data that is similar to real data. Therefore, CGAN can generate data of a class which has a small number of data so that the problem induced by imbalanced class distribution can be mitigated, and classification performance can be improved. Experiments using actual collected data show that the over-sampling technique using CGAN is effective and that it is superior to existing over-sampling techniques.

Development of IoT Sensor Data Generation Emulator for Smart Marine Logistics (스마트 해상 물류를 위한 IoT 센서 데이터 생성 에뮬레이터 개발)

  • Park Chae Rim;Kim Tae Hoon;Lee Eun Kyu
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.10
    • /
    • pp.545-552
    • /
    • 2024
  • As the 4th Industrial Revolution progresses, the shipping logistics sector is becoming smarter by utilizing various core technologies such as AI, IoT, and Bigdata. In particular, the collected marine Bigdata plays a significant role in providing various services like vessel operation monitoring analysis and greenhouse gas emission evaluation, and it is also essential in shipping logistics. Although this maritime Bigdata is collected during actual vessel operations, there are instances where data is lost due to temporal and environmental factors. While It is important to identify and address the fundamental cause of such losses, it is also necessary to generate data through the utilization and analysis of the collected data. This paper develops an Emulator that repeatedly generates new location data, speed values, etc., using maritime transport data collected through empirical tests. The location data is generated by calculating the standard deviation from the collected position information, and the speed values are extracted from the generated location data. The generated data is accumulated by being inserted into the database in real-time. To demonstrate the performance of the Emulator, evperiments were conducted using 5 routes, providing its excellence.

A Study on Development Deep Learning Based Learning System for Enhancing the Data Analytical Thinking (데이터 분석적 사고력 향상을 위한 딥러닝 기반 학습 시스템 개발 연구)

  • Lee, Young-ho;Koo, Duk-hoi
    • Journal of The Korean Association of Information Education
    • /
    • v.21 no.4
    • /
    • pp.393-401
    • /
    • 2017
  • The purpose of this study is to develop a deep learning based learning system for improving learner's data analytical thinking ability. The contents of the study are as follows. First, deep learning was applied to the discovery learning model to improve data analytical thinking ability. This is a learning method that can generate a model showing the relationship of given data by using the deep learning method, then apply the model to new data to obtain the result. Second, we developed a deep learning based system for DBD learning model. Specifically, we developed a system to generate a model of data using the deep learning method and to apply this model. The research of deep learning based learning system will be a new approach to improve learner's data analytical thinking ability in future society where data becomes more important.

Data Processing of AutoML-based Classification Models for Improving Performance in Unbalanced Classes (불균형 클래스에서 AutoML 기반 분류 모델의 성능 향상을 위한 데이터 처리)

  • Lee, Dong-Joon;Kang, Ji-Soo;Chung, Kyungyong
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.6
    • /
    • pp.49-54
    • /
    • 2021
  • With the recent development of smart healthcare technology, interest in daily diseases is increasing. However, healthcare data has an imbalance between positive and negative data. This is caused by the difficulty of collecting data because there are relatively many people who are not patients compared to patients with certain diseases. Data imbalances need to be adjusted because they affect performance in ongoing learning during disease prediction and analysis. Therefore, in this paper, We replace missing values through multiple imputation in detection models to determine whether they are prevalent or not, and resolve data imbalances through over-sampling. Based on AutoML using preprocessed data, We generate several models and select top 3 models to generate ensemble models.

Stress-strain behavior and toughness of high-performance steel fiber reinforced concrete in compression

  • Ramadoss, P.;Nagamani, K.
    • Computers and Concrete
    • /
    • v.11 no.2
    • /
    • pp.149-167
    • /
    • 2013
  • The complete stress-strain behavior of steel fiber reinforced concrete in compression is needed for the analysis and design of structures. An experimental investigation was carried out to generate the complete stress-strain curve of high-performance steel fiber reinforced concrete (HPSFRC) with a strength range of 52-80 MPa. The variation in concrete strength was achieved by varying the water-to-cementitious materials ratio of 0.40-0.25 and steel fiber content (Vf = 0.5, 1.0 and 1.5% with l/d = 80 and 55) in terms of fiber reinforcing parameter, at 10% silica fume replacement. The effects of these parameters on the shape of stress-strain curves are presented. Based on the test data, a simple model is proposed to generate the complete stress-strain relationship for HPSFRC. The proposed model has been found to give good correlation with the stress-strain curves generated experimentally. Inclusion of fibers into HPC improved the ductility considerably. Equations to quantify the effect of fibers on compressive strength, strain at peak stress and toughness of concrete in terms of fiber reinforcing index are also proposed, which predicted the test data quite accurately. Compressive strength prediction model was validated with the strength data of earlier researchers with an absolute variation of 2.1%.

A Method for Generating a Plant Model Based on Log Data for Control Level Simulation (제어시뮬레이션을 위한 생산시스템 로그데이터 기반 플랜트 모델 생성 방법)

  • Ko, Minsuk;Cheon, Sang Uk;Park, Sang Chul
    • Korean Journal of Computational Design and Engineering
    • /
    • v.18 no.1
    • /
    • pp.21-27
    • /
    • 2013
  • Presented in the paper is a log data based modeling method for effective construction of a virtual plant model which can be used for the virtual PLC (Programmable Logic Controller) simulation. For the PLC simulation, the corresponding virtual plant, consisting of virtual devices, is required to interact with the input and output symbols of a PLC. In other words, the behavior of a virtual device should be the same as that of the real device. Conventionally, the DEVS (Discrete Event Systems Specifications) formalism has been used to represent the behavior a virtual device. The modeling using DEVS formalism, however, requires in-depth knowledge in the simulation area, as well as the significant amount of time and efforts. One of the key ideas of the proposed method is to generate a plant model based on the log data obtained from the production system. The proposed method is very intuitive, and it can be used to generate the full behavior model of a virtual device. The proposed approach was applied to an AGV (Automated Guided Vehicle).

The Development of the Application Program Generator based on Meta-Data (메타데이터를 이용한 응용프로그램 생성기의 개발)

  • Kim Chi-Su
    • The KIPS Transactions:PartD
    • /
    • v.13D no.1 s.104
    • /
    • pp.97-102
    • /
    • 2006
  • Generally, a software development process is composed with requirements analysis, design, coding, test and maintenance. However, some changes of the design step are difficult to complicate the next step in the development process. It always causes the disagreement between design and implementation step. In this paper, we have developed a tool which can generate an application program. The tool can reduce the disagreement between system design and implementation and recognize the business logic to develop the software rapidly and flexibly In addition, we proposed a non-program-based application program system approach was proposed, In. We can generate and modify an application program with this method which can edit the meta data of a system design by the dynamic method for the execution time.

Design and Measurement of an SFQ OR gate composed of a D Flip-Flop and a Confluence Buffer (D Flip-Flop과 Confluence Buffer로 구성된 단자속 양자 OR gate의 설계와 측정)

  • 정구락;박종혁;임해용;장영록;강준희;한택상
    • Progress in Superconductivity
    • /
    • v.4 no.2
    • /
    • pp.127-131
    • /
    • 2003
  • We have designed and measured an SFQ(Single Flux Quantum) OR gate for a superconducting ALU (Arithmetic Logic Unit). To optimize the circuit, we used WRspice, XIC and Lmeter for simulations and layouts. The OR gate was consisted of a Confluence Buffer and a D Flip-Flop. When a pulse enters into the OR gate, the pulse does not propagate to the other input port because of the Confluence Buffer. A role of D Flip-Flip is expelling the data when the clock is entered into D Flip-Flop. For the measurement of the OR gate operation, we attached three DC/SFQs, three SFQ/DCs and one RS Flip -Flop to the OR gate. DC/SFQ circuits were used to generate the data pulses and clock pulses. Input frequency of 10kHz and 1MHzwere used to generate the SFQ pulses from DC/SFQ circuits. Output data from OR gate moved to RS flip -Flop to display the output on the oscilloscope. We obtained bias margins of the D Flip -Flop and the Confluence Buffer from the measurements. The measured bias margins $\pm$38.6% and $\pm$23.2% for D Flip-Flop and Confluence Buffer, respectively The circuit was measured at the liquid helium temperature.

  • PDF

Generation of 3 Dimensional Image Model from Multiple Digital Photographs (다중 디지털 사진을 이용한 3차원 이미지 모델 생성)

  • 정태은;석정민;신효철;류재평
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2003.06a
    • /
    • pp.1634-1637
    • /
    • 2003
  • Any given object on the motor-driven turntable is pictured from 8 to 72 different views with a digital camera. 3D shape reconstruction is performed with the integrated software called by Scanware from these multiple digital photographs. There are several steps such as configuration, calibration, capturing, segmentation, shape creation, texturing and merging process during the shape reconstruction process. 3D geometry data can be exported to cad data such as Autocad input file. Also 3D image model is generated from 3D geometry and texture data, and is used to advertise the model in the internet environment. Consumers can see the object realistically from wanted views by rotating or zooming in the internet browsers with Scanbull spx plug-in. The spx format allows a compact saving of 3D objects to handle or download. There are many types of scan equipments such as laser scanners and photogrammetric scanners. Line or point scan methods by laser can generate precise 3D geometry but cannot obtain color textures in general. Reversely, 3D image modeling with photogrammetry can generate not only geometries but also textures from associated polygons. We got various 3D image models and introduced the process of getting 3D image model of an internet-connected watchdog robot.

  • PDF

Application of Video Photogrammetry for Generating and Updating Digital Maps (수치지도 생성 및 갱신을 위한 Video Photogrammetry 적용)

  • Yoo, Hwan-Hee;Sung, Jae-Ryeol
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.6 no.2 s.12
    • /
    • pp.11-20
    • /
    • 1998
  • Although aerial photogrammetry has been used to generate or update digital maps. It is difficult to make the spatial and attribute data for all kinds of objects on the ground with only aerial photogrammetry. Therefore, we are getting informations of the object on the ground through an on-the-spot survey In order to improve accuracy and reliability of on-the-spot survey in this study, we obtained stereo images from high resolution digital camera (1152*864 pixels) and developed the video photogrammetry which was able to determine the three dimensional coordinates from stereo images by applying DLT(Direct Linear Transformation). Also, the developed video photogrammetry could generate and update the spatial and attribute data in digital maps by using a function that could connect three dimensional coordinates with the attribute data.

  • PDF