• IEMEK Journal of Embedded Systems and Applications
• /
• v.8 no.1
• /
• pp.17-24
• /
• 2013

In this paper, we present a multi-core processor including multimedia specific instructions to process multimedia data efficiently in the mobile environment. Multimedia specific instructions exploit subword level parallelism (SLP), while the multi-core processor exploits data level parallelism (DLP). These combined parallelisms improve the performance of multimedia processing applications. The proposed multi-core processor including multimedia specific instructions is implemented and tested using a Xilinx ISE 10.1 tool and SoCMaster3 testbed system including Vertex 4 FPGA. Experimental results using a fire detection algorithm show that multimedia specific instructions outperform baseline instructions in the same multi-core architecture in terms of performance (1.2x better), energy efficiency (1.37x better), and area efficiency (1.23x better).

• Journal of Korea Multimedia Society
• /
• v.22 no.2
• /
• pp.167-177
• /
• 2019

Even though so much progresses have been achieved in Multiple Object Tracking (MOT), most of reported MOT methods are not still satisfactory for commercial embedded products like Pan-Tilt-Zoom (PTZ) camera. In this paper, we propose a real-time multiple pedestrians tracking method for embedded environments. First, we design a new light weight convolutional neural network(CNN)-based pedestrian detector, which is constructed to detect even small size pedestrians, as well. For further saving of processing time, the designed detector is applied for every other frame, and Kalman filter is employed to predict pedestrians' positions in frames where the designed CNN-based detector is not applied. The pose orientation information is incorporated to enhance object association for tracking pedestrians without further computational cost. Through experiments on Nvidia's embedded computing board, Jetson TX2, it is verified that the designed pedestrian detector detects even small size pedestrians fast and well, compared to many state-of-the-art detectors, and that the proposed tracking method can track pedestrians in real-time and show accuracy performance comparably to performances of many state-of-the-art tracking methods, which do not target for operation in embedded systems.

• JSTS:Journal of Semiconductor Technology and Science
• /
• v.11 no.3
• /
• pp.207-220
• /
• 2011

Coarse-grained reconfigurable architecture (CGRA) based embedded systems aims to achieve high system performance with sufficient flexibility to map a variety of applications. However, the CGRA has been considered as prohibitive one due to its significant area/power overhead and performance bottleneck. In this work, I propose reconfigurable multi-array architecture to reduce power/area and enhance performance in configurable embedded systems. The CGRA-based embedded systems that consist of hierarchical configurable computing arrays with varying size and communication speed were examined for multimedia and other applications. Experimental results show that the proposed approach reduces on-chip area by 22%, execution time by up to 72% and reduces power consumption by up to 55% when compared with the conventional CGRA-based architectures.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2013.05a
• /
• pp.618-619
• /
• 2013

This paper presents a method of constructing the embedded systems based on hardware/software co-design approach that was key methodology. The proposed method was important technology enable to implement advanced multimedia systems and digital contents creating that are rapidly growing of the new information technology.

• Journal of Digital Contents Society
• /
• v.5 no.1
• /
• pp.61-65
• /
• 2004

This paper presents a method of constructing the embedded systems based on hardware/software co-design approach that was key methodology. The proposed method was important technology enable to implement advanced multimedia systems and digital contents creating that are rapidly growing of the new information technology.

• Journal of Korea Multimedia Society
• /
• v.19 no.8
• /
• pp.1329-1336
• /
• 2016

This paper develops a 360 degree video system using multiple off-the-shelf webcams and a set of embedded boards. Existing 360 degree cameras have shortcomings that they do not support real-time video generation since recorded videos should be copied to computers or smartphones which then provide stitching. Another shortcoming is that wide FoV(Field of View) cameras are not able to provide sufficiently high resolution. Moreover, resulting images are visually distorted bending straight lines. By employing an array of 65 degree FoV webcams, we were able to generate videos on the spot and achieve over 6K resolution with much less distortion. We describe the configuration and algorithms of the proposed system. The performance evaluation results of our early stage prototype system are presented.

• Journal of Korea Multimedia Society
• /
• v.8 no.9
• /
• pp.1153-1162
• /
• 2005

In this paper, we developed an XML Document Data Synchronization System for java(XDS4j) based on both SyncML(Synchronization Markup Language) framework Sync4j and embedded database system Berkeley DB XML. Because most existing data synchronization systems are based on file systems, data synchronization times at Fast Sync in those systems are very delayed. In the XDS4j, however, XML documents data produced at SyncML client and SyncML server are managed by embedded database system, and also synchronization time at Fast Sync is reduced because only partial elements are accessed by applying to XPath.

• Journal of Korea Multimedia Society
• /
• v.25 no.1
• /
• pp.39-51
• /
• 2022

Image-based gender classification and age estimation of human are classic problems in computer vision. Most of researches in this field focus just only one task of either gender classification or age estimation and most of the reported methods for each task focus on accuracy performance and are not computationally light. Thus, running both tasks together simultaneously on low cost mobile or embedded systems with limited cpu processing speed and memory capacity are practically prohibited. In this paper, we propose a novel light-weight gender classification and age estimation method based on ensemble multitasking deep learning with light-weight processing neural network architecture, which processes both gender classification and age estimation simultaneously and in real-time even for embedded systems. Through experiments over various well-known datasets, it is shown that the proposed method performs comparably to the state-of-the-art gender classification and/or age estimation methods with respect to accuracy and runs fast enough (average 14fps) on a Jestson Nano embedded board.

• Journal of Korea Multimedia Society
• /
• v.12 no.2
• /
• pp.231-243
• /
• 2009

Currently interests of embedded software in various areas such as automotive field, ship field, robot field is increasing according to expand market of embedded systems. Various researches such as embedded operating systems, embedded software modeling technique, embedded software testing, and so on are going in progress. However systematic engineering approach in embedded system development is poor because embedded areas focus on hardware parts until now. Furthermore, framework-based de sign technique considering reusability is not reflected in embedded system development. Those development results in many of dead codes scattered in system, and results in poor reusability of system. This paper suggests a framework of embedded system for reusability and a static meta-model for reuse framework. Proposed meta-model expresses not only the structure of reuse framework, but also allows a designer to extend and design easily models of embedded system based on reuse framework according to various embedded system types.

• Journal of Korea Multimedia Society
• /
• v.18 no.6
• /
• pp.723-733
• /
• 2015

High availability is of utmost importance in real-time embedded systems. Temporary failures due to software or hardware faults should not result in a system crash. To achieve high availability, embedded systems typically use a combination of hardware and software techniques. A watchdog timer is a hardware component in embedded microprocessors that can be used to automatically reset the processor if software anomalies are detected. The embedded system relies on a single watchdog timer, however, can be permanently disabled if the timer is not properly configured, e.g. falling into an indefinite loop. STM32F4 provides two different types of watchdog timer in terms of timing accuracy and robustness. In this paper, we propose a hybrid approach, called long-tail watchdog timer, to utilize both timers to achieve self-reliance in embedded systems even though one of timers fails. Experimental results confirm that the proposed approach successfully handles various failure scenarios and present performance comparisons between single watchdog timer and hybrid approach in terms of configuration parameters of watchdog timers in STM32F4, counter value and window size.