• IEMEK Journal of Embedded Systems and Applications
• /
• v.19 no.2
• /
• pp.107-114
• /
• 2024

Mobile ad hoc networks represent self-configuring networks of mobile devices that communicate without relying on a fixed infrastructure. However, traditional routing protocols in such networks encounter challenges in selecting efficient and reliable routes due to dynamic nature of these networks caused by unpredictable mobility of nodes. This often results in a failure to meet the low-delay and low-energy consumption requirements crucial for such networks. In order to overcome such challenges, our paper introduces a novel multi-objective and adaptive routing scheme based on the Q-learning reinforcement learning algorithm. The proposed routing scheme dynamically adjusts itself based on measured network states, such as traffic congestion and mobility. The proposed approach utilizes Q-learning to select routes in a decentralized manner, considering factors like energy consumption, load balancing, and the selection of stable links. We present a formulation of the multi-objective optimization problem and discuss adaptive adjustments of the Q-learning parameters to handle the dynamic nature of the network. To speed up the learning process, our scheme incorporates informative shaped rewards, providing additional guidance to the learning agents for better solutions. Implemented on the widely-used AODV routing protocol, our proposed approaches demonstrate better performance in terms of energy efficiency and improved message delivery delay, even in highly dynamic network environments, when compared to the traditional AODV. These findings show the potential of leveraging reinforcement learning for efficient routing in ad hoc networks, making the way for future advancements in the field of mobile ad hoc networking.

• Asia pacific journal of information systems
• /
• v.33 no.3
• /
• pp.737-767
• /
• 2023

With the availability of big customer data and advances in machine learning techniques, the prediction of customer behavior at the session-level has attracted considerable attention from marketing practitioners and scholars. This study aims to predict customer purchase conversion at the session-level by employing customer profile, transaction, and clickstream data. For this purpose, we develop a multimodal deep learning fusion model with dynamic and static features (i.e., DS-fusion). Specifically, we base page views within focal visist and recency, frequency, monetary value, and clumpiness (RFMC) for dynamic and static features, respectively, to comprehensively capture customer characteristics for buying behaviors. Our model with deep learning architectures combines these features for conversion prediction. We validate the proposed model using real-world e-commerce data. The experimental results reveal that our model outperforms unimodal classifiers with each feature and the classical machine learning models with dynamic and static features, including random forest and logistic regression. In this regard, this study sheds light on the promise of the machine learning approach with the complementary method for different modalities in predicting customer behaviors.

• 제어로봇시스템학회:학술대회논문집
• /
• 1997.10a
• /
• pp.552-555
• /
• 1997

Recently, increasing attention has been paid to the application of learning control method to robot manipulator control. Because the learning control method does not require an exact dynamic model, it is flexible and easy to implement. In this paper, we implement a learning control scheme which consists of a unique feedforward learning controller and a linear feedback controller. The learning control method does not require acceleration terms that are sensitive to noise and has the capability of rejecting unknown disturbances and adapting itself to time-varying system parameters. The feasibility of the learning control scheme is soon by implementing the control scheme to a commercial robot manipulator and the performance of which is also compared with the conventional linear PID control method.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.53 no.5
• /
• pp.353-360
• /
• 2004

This paper considers reinforcement learning control with the self-organizing map. Reinforcement learning uses the observable states of objective system and signals from interaction of the system and environment as input data. For fast learning in neural network training, it is necessary to reduce learning data. In this paper, we use the self-organizing map to partition the observable states. Partitioning states reduces the number of learning data which is used for training neural networks. And neural dynamic programming design method is used for the controller. For evaluating the designed reinforcement learning controller, an inverted pendulum on the cart system is simulated. The designed controller is composed of serial connection of self-organizing map and two Multi-layer Feed-Forward Neural Networks.

• Journal of Korea Multimedia Society
• /
• v.9 no.5
• /
• pp.658-670
• /
• 2006

As the educational media tends to be more digitalized and individualized, the learning paradigm is dramatically changing into e-learning. Existing on-line courseware gives a learner more chances to learn when they are home with their own PCs. However, it is of little use when they are away from their digital media. Also, it is very labor-intensive to convert the original off-line contents to on-line contents. This paper proposes education mobile contents(EMC) that can supply the learners with dynamic interactions using various multimedia information by recognizing real images of off-line contents using mobile devices. Content-based image retrieval based on object shapes is used to recognize the real image, and shapes are represented by differential chain code with estimated new starting points to obtain rotation-invariant representation, which is fitted to computational resources of mobile devices with low resolution camera. Moreover we use a dynamic time warping method to recognize the object shape, which compensates scale variations of an object. The EMC can provide learners with quick and accurate on-line contents on off-line ones using mobile devices without limitations of space.

• Journal of Electrical Engineering and Technology
• /
• v.12 no.2
• /
• pp.890-903
• /
• 2017

The problem of determining a smooth and collision-free path with maximum possible speed for a Mobile Robot (MR) which is chasing a moving target in a dynamic environment is addressed in this paper. Genetic Network Programming with Reinforcement Learning (GNP-RL) has several important features over other evolutionary algorithms such as it combines offline and online learning on the one hand, and it combines diversified and intensified search on the other hand, but it was used in solving the problem of MR navigation in static environment only. This paper presents GNP-RL based on predicting collision positions as a first attempt to apply it for MR navigation in dynamic environment. The combination between features of the proposed collision prediction and that of GNP-RL provides safe navigation (effective obstacle avoidance) in dynamic environment, smooth movement, and reducing the obstacle avoidance latency time. Simulation in dynamic environment is used to evaluate the performance of collision prediction based GNP-RL compared with that of two state-of-the art navigation approaches, namely, Q-Learning (QL) and Artificial Potential Field (APF). The simulation results show that the proposed GNP-RL outperforms both QL and APF in terms of smooth movement and safer navigation. In addition, it outperforms APF in terms of preserving maximum possible speed during obstacle avoidance.

• International Area Studies Review
• /
• v.14 no.3
• /
• pp.388-419
• /
• 2010

The aim of the study is to create a theoretical model and hypotheses on competitive advantages of exporting SMEs. For this we have proposed an integrated model in which learning competences and dynamic capabilities should have an influence on competitive advantages of the SMEs. This study have examined the influence of integrating and reconfigurating capability respectively. As a result, the learning competences had positive influences in dynamic capabilities and to the cost and service competitive advantage. To integrating capabilities had positive influences in competitive advantage. Besides, dynamic capabilities playing significant intermediate role only for the cost advantage through the analysis of intermediate effects of learning competence to the dynamic capabilities.

• Proceedings of the KIEE Conference
• /
• 1998.07g
• /
• pp.2363-2366
• /
• 1998

The intent of this paper is to describe a neural network structure called dynamic neural processor(DNP), and examine how it can be used in developing a learning scheme for computing robot inverse kinematic transformations. The architecture and learning algorithm of the proposed dynamic neural network structure, the DNP, are described. Computer simulations are provided to demonstrate the effectiveness of the proposed learning using the DNP.

• The Journal of the Korea Contents Association
• /
• v.9 no.7
• /
• pp.371-378
• /
• 2009

A lot of learning systems are applying and verify evaluating the item difficulty to increase learner's learning effect. But most of this methods ware calculated the item difficulty when it analyze the learning result before or after learning. So, it is hard to support learning contents with changing item difficulty during learning to learner. In this research, we proposed the method that system can support learning contents to next learning to fit leaner's level immediately as apply to calculate item difficulty during the proceed learning. Through this method, learner could supported learning contents by calculated difficulty through pre-test and it caused this method was helped learner to increase learning effect.

• Journal of The Korean Association of Information Education
• /
• v.16 no.3
• /
• pp.275-282
• /
• 2012

Existing web based learning system provides various instruction paths. However, learners are provided with the same instruction content with little consideration of each learner's learning style. Therefore, Current Web based learning is lacking as a system that encourages individual learning, by failing to provide for proper instruction methods for each learner. This prototype system can find the most effective way of learning for each learner by analyzing a learner's learning. It also provides content based on the most effective instruction method for the learner taking into consideration learning style. Especially, this proposed adaptive learning system supporting dynamic link by learning style by evaluation for each steps of leaning process.