• 제목/요약/키워드: Data processing

검색결과 16,488건 처리시간 0.102초

차량 통신 기술을 위한 WME 모듈과 MLME 모듈 간의 상호 메시지 처리과정 설계 및 구현 (The Design and Implementation of the Mutual Message Processing between WME Module and MLME Module for Vehicle Communication Technology)

  • 장청룡;이대식;이용권
    • 디지털산업정보학회논문지
    • /
    • 제9권2호
    • /
    • pp.63-71
    • /
    • 2013
  • WAVE(Wireless Access for Vehicular Environment) System is a communication technology to monitor system failure and vehicle functions and management services to prevent possible incidents of driving a vehicle. In this paper, we have designed and implemented the mutual message processing through parameter between WME management module that manages WAVE system and MLME that manages the upper layer MAC(Media Access Control) module. Also, in order to verify the validity, we have carried out experiments to compare the speed of data processing by dividing data of 1Mbyte, 2Mbyte, 3Mbyte into the packets of 2KByte and 4KByte. Experiments data processing speed of 2KByte packet were shown about 173.62ms in 1MByte, 2MByte about 352.61ms, 3MByte about 550.13ms and, data processing speed of 4KByte packet, 1MByte approximately 87.56ms, 2MByte about 177.94ms, 3MByte about 277.18ms. Therefore, in WAVE system, the mutual messages processing through the parameters between WME and MLME module can be utilized in the various service of ITS(Intelligent Transportation Systems) depending on the speed of data processing.

어군에 의한 광대역 음향산란신호의 시간-주파수 분석을 위한 chirp 데이터 수록 및 처리 시스템의 성능특성 (Performance Characteristics of a Chirp Data Acquisition and Processing System for the Time-frequency Analysis of Broadband Acoustic Scattering Signals from Fish Schools)

  • 이대재
    • 한국수산과학회지
    • /
    • 제51권2호
    • /
    • pp.178-186
    • /
    • 2018
  • A chirp-echo data acquisition and processing system was developed for use as a simplified, PC-based chirp echo-sounder with some data processing software modules. The design of the software and hardware system was implemented via a field-programmable gate array (FPGA). Digital signal processing algorithms for driving a single-channel chirp transmitter and dual-channel receivers with independent TVG (time varied gain) amplifier modules were incorporated into the FPGA for better real-time performance. The chirp-echo data acquisition and processing system consisted of a notebook PC, an FPGA board, and chirp sonar transmitter and receiver modules, which were constructed using three chirp transducers operating over a frequency range of 35-210 kHz. The functionality of this PC-based chirp echo-sounder was tested in various field experiments. The results of these experiments showed that the developed PC-based chirp echo-sounder could be used in the acquisition, processing and analysis of broadband acoustic echoes related to fish species identification.

맵리듀스 온라인 프레임워크에서 공간 데이터 스트림 처리를 위한 동적 부하 관리 기법 (Dynamic Load Management Method for Spatial Data Stream Processing on MapReduce Online Frameworks)

  • 정원일
    • 한국산학기술학회논문지
    • /
    • 제19권8호
    • /
    • pp.535-544
    • /
    • 2018
  • 다양한 센서를 내장하고 고품질의 무선 네트워크 통신 기능을 탑재한 이동 장치의 보급이 확대됨에 따라 다양한 서비스 환경에서 이동 장치로부터 생성되는 시공간 데이터 량도 빠르게 증가하고 있다. 이와 같이 실시간 특성을 갖는 대량의 공간 데이터 스트림을 처리하기 위한 기존의 연구에서 하둡 기반의 공간 빅 데이터 시스템은 일괄 처리 방식의 플랫폼으로 공간 데이터 스트림에 대한 실시간 서비스에 적용하기에는 매우 어렵다. 이에 본 논문에서는 맵리듀스 온라인 프레임워크를 확장하여 연속적으로 입력되는 공간 데이터 스트림에 대한 실시간 질의 처리를 지원하고, 질의 처리 과정에서 야기될 수 있는 부하 문제를 효과적으로 분산하는 부하 관리 기법을 제안한다. 제안 기법에서는 공간 분할 영역을 기반으로 입력 데이터의 유입율과 부하율을 이용하여 노드들에 대해 동적으로 부하를 분산하는 기법을 제시하였다. 실험에서는 특정 공간 영역에서의 부하 관리가 요구될 때 해당 영역에서의 공간 데이터 스트림을 공유하는 자원들에게 분배함으로써 효과적인 질의 처리를 지원할 수 있음을 보인다.

A Study on Distributed System Construction and Numerical Calculation Using Raspberry Pi

  • Ko, Young-ho;Heo, Gyu-Seong;Lee, Sang-Hyun
    • International journal of advanced smart convergence
    • /
    • 제8권4호
    • /
    • pp.194-199
    • /
    • 2019
  • As the performance of the system increases, more parallelized data is being processed than single processing of data. Today's cpu structure has been developed to leverage multicore, and hence data processing methods are being developed to enable parallel processing. In recent years desktop cpu has increased multicore, data is growing exponentially, and there is also a growing need for data processing as artificial intelligence develops. This neural network of artificial intelligence consists of a matrix, making it advantageous for parallel processing. This paper aims to speed up the processing of the system by using raspberrypi to implement the cluster building and parallel processing system against the backdrop of the foregoing discussion. Raspberrypi is a credit card-sized single computer made by the raspberrypi Foundation in England, developed for education in schools and developing countries. It is cheap and easy to get the information you need because many people use it. Distributed processing systems should be supported by programs that connected multiple computers in parallel and operate on a built-in system. RaspberryPi is connected to switchhub, each connected raspberrypi communicates using the internal network, and internally implements parallel processing using the Message Passing Interface (MPI). Parallel processing programs can be programmed in python and can also use C or Fortran. The system was tested for parallel processing as a result of multiplying the two-dimensional arrangement of 10000 size by 0.1. Tests have shown a reduction in computational time and that parallelism can be reduced to the maximum number of cores in the system. The systems in this paper are manufactured on a Linux-based single computer and are thought to require testing on systems in different environments.

다중 빔 음향측심 자료의 CUBE 필터링 (CUBE Filtering of Multibeam Echo Sounder Data)

  • 김주연;이광수;김대철;서영교;이희일
    • 한국수산과학회지
    • /
    • 제44권3호
    • /
    • pp.308-317
    • /
    • 2011
  • A MBES (multibeam echo sounder) survey around Yokji Island, Korea, was conducted to find an effective method for removing error data. Two post-processing software programs, PDS2000 (RESON) and HIPS (CARIS), were used to remove the error data using an interactive editing method and the CUBE algorithm filter. The post-processing with the PDS2000 and HIPS programs, using the interactive editing method, took 120 and 168 hours, respectively, and there was little difference in the seafloor images. The processing time of the PDS2000 and HIPS programs using the CUBE algorithm filter was 36 and 60 hours, respectively. Nevertheless, there was little difference in the seafloor images because of differences in the factor parameters in each of the post-processing programs. Therefore, post-processing using CUBE filtering can save time in data processing and provide consistent results, excluding the subjective decisions of the operator. This method is more effective than other methods for rejecting erroneous multibeam echo sounder data.

변전소내 Bad Data Processing어 관한 연구 (A study of bad data processing application in the substation)

  • 진보건;최인선;현승호;이승재
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2004년도 하계학술대회 논문집 A
    • /
    • pp.406-408
    • /
    • 2004
  • It is very necessary to adopt bad data processing in order to maintain the security and the reliability of data acquisition and management in the substation. This paper presents a bad data processing method of per module unit by using rule based system. The propriety of this method has been verified by the case study

  • PDF

Advanced Big Data Analysis, Artificial Intelligence & Communication Systems

  • Jeong, Young-Sik;Park, Jong Hyuk
    • Journal of Information Processing Systems
    • /
    • 제15권1호
    • /
    • pp.1-6
    • /
    • 2019
  • Recently, big data and artificial intelligence (AI) based on communication systems have become one of the hottest issues in the technology sector, and methods of analyzing big data using AI approaches are now considered essential. This paper presents diverse paradigms to subjects which deal with diverse research areas, such as image segmentation, fingerprint matching, human tracking techniques, malware distribution networks, methods of intrusion detection, digital image watermarking, wireless sensor networks, probabilistic neural networks, query processing of encrypted data, the semantic web, decision-making, software engineering, and so on.

상태감시용 센서를 내장한 배전용 변압기 및 데이터 처리장치 개발 (Development of Distribution Transformer with Condition Monitoring Sensors and Data Processing Unit)

  • 정준홍;유남철
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2009년도 제40회 하계학술대회
    • /
    • pp.201_202
    • /
    • 2009
  • This paper presents a design methodology of a distribution transformer with condition monitoring sensors and its data processing unit. The proposed distribution transformer includes various type of condition monitoring sensors such as load current/voltage, temperature and heat aging of insulating oil. The data processing unit is installed at the distribution transformer site. It integrates sensed data and transmits these to a central server system. The proposed distribution transformer and its data processing unit will help an on-line condition monitoring system for distribution transformers.

  • PDF

레이다 정보처리용 통합 정보처리 시스템 셜계에 관한 연구 (A Study on the Design of the Radar Data Integrating System)

  • 이상웅;최진일;라극환;양기덕;조동래
    • 전자공학회논문지B
    • /
    • 제32B권5호
    • /
    • pp.798-811
    • /
    • 1995
  • In this study, radar data integrating and processing systems were designed for the data processing of various information from many kinds of radar in a single data processing system. The characteristics of the data integrating system were analyzed by the system simulation with the queueing theory. The designed data integrating systems can be divided into a centralized and a distributed type. In the system structure, we used UNIX message que as the real time processor and the queueing theory for the performance evaluation of the information flow in the systems. For the analysis of the performance of inforamtion flow in both models, queueing theory was applied to and implemented with the simulation package, OPNET system and C language. From the simulation result we could understand the system factors which effect the system performance and characteristics on the data processing.

  • PDF

HIGH-SPEED SOFTWARE FRAME SYNCHRONIZER USING SSE2 TECHNOLOGY

  • Koo, In-Hoi;Ahn, Sang-Il;Kim, Tae-Hoon;Sakong, Young-Ho
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2007년도 Proceedings of ISRS 2007
    • /
    • pp.522-525
    • /
    • 2007
  • Frame Synchronization is applied to not only digital data transmission for data synchronization between transmitter and receiver but also data communication with satellite. When satellite image data with high resolution and mass storage is transmitted, hardware frame synchronizer for real-time processing or software frame synchronizer for post-processing is used. In case of hardware, processing with high speed is available but data loss may happen for Search of Frame Synchronization. In case of software, data loss does not happen but speed is relatively slow. In this paper, Pending Buffer concept was proposed to cope with data loss according to processing status of Frame Synchronization. Algorithm to process Frame synchronization with high speed using bit threshold search algorithm with pattern search technique and SIMD is also proposed.

  • PDF