• KIPS Transactions on Software and Data Engineering
• /
• v.3 no.9
• /
• pp.369-374
• /
• 2014

Path generation methods are required for safe and efficient driving in unmanned autonomous vehicles. There are two kinds of paths: global and local. A global path consists of all the way points including the source and the destination. A local path is the trajectory that a vehicle needs to follow from a way point to the next in the global path. In this paper, we propose a novel method for local path generation through machine learning, with an effective curve function used for initializing the trajectory. First, reinforcement learning is applied to a set of candidate paths to produce the best trajectory with maximal reward. Then the optimal steering angle with respect to the trajectory is determined by training an artificial neural network. Our method outperformed existing approaches and successfully found quality paths in various experimental settings, including the cases with obstacles.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2020.05a
• /
• pp.559-562
• /
• 2020

시각-언어 이동 문제는 시각 이해와 언어 이해 능력을 함께 요구하는 복합 지능 문제이다. 본 논문에서는 시각-언어 이동 에이전트를 위한 새로운 학습 모델을 제안한다. 이 모델은 데모 데이터에 기초한 모방 학습과 행동 보상에 기초한 강화 학습을 함께 결합한 복합 학습을 채택하고 있다. 따라서 이 모델은 데모 데이타에 편향될 수 있는 모방 학습의 문제와 상대적으로 낮은 데이터 효율성을 갖는 강화 학습의 문제를 상호 보완적으로 해소할 수 있다. 또한, 제안 모델은 서로 다른 두 학습 간에 발생 가능한 학습 불균형도 고려하여 손실 정규화를 포함하고 있다. 또, 제안 모델에서는 기존 연구들에서 사용되어온 목적지 기반 보상 함수의 문제점을 발견하고, 이를 해결하기 위해 설계된 새로은 최적 경로 기반 보상 함수를 이용한다. 본 논문에서는 Matterport3D 시뮬레이션 환경과 R2R 벤치마크 데이터 집합을 이용한 다양한 실들을 통해, 제안 모델의 높은 성능을 입증하였다.

• Asia Marketing Journal
• /
• v.14 no.2
• /
• pp.39-63
• /
• 2012

Previous studies of reward programs have generally focused on designing the best programs for consumers and suggested that consumers' perception of the value of reward programs can vary according to the type of reward program (e.g., hedonic vs. utilitarian and direct vs. indirect) and its timing (e.g., immediate vs. delayed). These studies have typically assumed that consumers' preference for reward programs has a positive effect on brand loyalty. However, Dowling and Uncles (1997) pointed out that this preference does not necessarily foster brand loyalty. In this regard, the present study verifies this assumption by examining the effects of consumers' perception of the value of reward programs on their brand loyalty. Although reward programs are widely used by online shopping malls, most studies have examined the conditions under which consumers are most likely to value loyalty programs in the context of offline shopping. In the context of online shopping, however, consumers' preferences may have little effect on their brand loyalty because they have more opportunities for comparing diverse reward programs offered by many online shopping malls. That is, in online shopping, finding attractive reward programs may require little effort on the part of consumers, who are likely to switch to other online shopping malls. Accordingly, this study empirically examines whether consumers' perception of the value of reward programs influences their brand loyalty in the context of online shopping. Meanwhile, consumers seek utilitarian and/or hedonic value from their online shopping activity(Jones et al., 2006; Barbin et al., 1994). They visit online shopping malls to buy something necessary (utilitarian value) and/or enjoy the process of shopping itself (hedonic value). In this sense, reward programs may reinforce utilitarian as well as hedonic value, and their effect may vary according to the type of reward (utilitarian vs. hedonic). According to Chaudhuri and Holbrook (2001), consumers' perception of the value of a brand can influence their brand loyalty through brand trust and affect. Utilitarian value influences brand loyalty through brand trust, whereas hedonic value influences it through brand affect. This indicates that the effect of this perception on brand trust or affect may be moderated by the type of reward program. Specifically, this perception may have a greater effect on brand trust for utilitarian reward programs than for hedonic ones, whereas the opposite may be true for brand affect. Given the above discussion, the present study is conducted with three objectives in order to provide practical implications for online shopping malls to strategically use reward program for establishing profitable relationship with customers. First, the present study examines whether reward programs can be an effective marketing tool for increasing brand loyalty in the context of online shopping. Second, it investigates the paths through which consumers' perception of the value of reward programs influences their brand loyalty. Third, it analyzes the effects of this perception on brand trust and affect by considering the type of reward program as a moderator. This study suggests and empirically analyzes a new research model for examining how consumers' perception of the value of reward programs influences their brand loyalty in the context of online shopping. The model postulates the following 10 hypotheses about the structural relationships between five constructs: (H1) Consumers' perception of the value of reward programs has a positive effect on their program loyalty; (H2) Program loyalty has a positive effect on brand loyalty; (H3) Consumers' perception of the value of reward programs has a positive effect on their brand trust; (H4) Consumers' perception of the value of reward programs has a positive effect on their brand affect; (H5) Brand trust has a positive effect on program loyalty; (H6) Brand affect has a positive effect on program loyalty; (H7) Brand trust has a positive effect on brand loyalty; (H8) Brand affect has a positive effect on brand loyalty; (H9) Consumers' perception of the value of reward programs is more likely to influence their brand trust for utilitarian reward programs than for hedonic ones; and (H10) Consumers' perception of the value of reward programs is more likely to influence their brand affect for hedonic reward programs than for utilitarian ones. To test the hypotheses, we considered a sample of 220 undergraduate students in Korea (male:113). We randomly assigned these participants to one of two groups based on the type of reward program (utilitarian: transportation card, hedonic: movie ticket). We instructed the participants to imagine that they were offered these reward programs while visiting an online shopping mall. We then asked them to answer some questions about their perception of the value of the reward programs, program loyalty, brand loyalty, brand trust, and brand affect, in that order. We also asked some questions about their demographic backgrounds and then debriefed them. We employed the structural equation modeling (SEM) method with AMOS 18.0. The results provide support for some hypotheses (H1, H3, H4, H7, H8, and H9) while providing no support for others (H2, H5, H6, H10) (see Figure 1). Noteworthy is that the path proposed by previous studies, "value perception → program loyalty → brand loyalty," was not significant in the context of online shopping, whereas this study's proposed path, "value perception → brand trust/brand affect → brand loyalty," was significant. In addition, the results indicate that the type of reward program moderated the relationship between consumers' value perception and brand trust but not the relationship between their value perception and brand affect. These results have some important implications. First, this study is one of the first to examine how consumers' perception of the value of reward programs influences their brand loyalty in the context of online shopping. In particular, the results indicate that the proposed path, "value perception → brand trust/brand affect → brand loyalty," can better explain the effects of reward programs on brand loyalty than existing paths. Furthermore, these results suggest that online shopping malls should place greater emphasis on the type of reward program when devising reward programs. To foster brand loyalty, they should reinforce the type of shopping value that consumers emphasize by providing them with appropriate reward programs. If consumers prefer utilitarian value to hedonic value, then online shopping malls should offer utilitarian reward programs and vice versa.

• Journal of Internet of Things and Convergence
• /
• v.9 no.6
• /
• pp.11-16
• /
• 2023

The technology of 3D reconstruction, primarily relying on point cloud data, is essential for digitizing objects or spaces. This paper aims to utilize reinforcement learning to achieve the acquisition of point clouds in a given environment. To accomplish this, a simulation environment is constructed using Unity, and reinforcement learning is implemented using the Unity package known as ML-Agents. The process of point cloud acquisition involves initially setting a goal and calculating a traversable path around the goal. The traversal path is segmented at regular intervals, with rewards assigned at each step. To prevent the agent from deviating from the path, rewards are increased. Additionally, rewards are granted each time the agent fixates on the goal during traversal, facilitating the learning of optimal points for point cloud acquisition at each traversal step. Experimental results demonstrate that despite the variability in traversal paths, the approach enables the acquisition of relatively accurate point clouds.

• Journal of the Korean Institute of Telematics and Electronics S
• /
• v.35S no.10
• /
• pp.19-26
• /
• 1998

In this paper, we studied the design and implementation of fading compensation systems at aspects of narrowband mobile communication using TTIB SSB. The mobile radio channel with multipath fading places fundamental limitations on the performance of wireless communication systems. The multipath fading is compensated using pilot tone in TTIB SSB. The TTIB transceiver was implemented using the prevailing digital signal processing (DSP) techniques and compensation for the multipath fading was incorporated in the receiver in the form of DSP algorithm. In order to evaluate fading compensation performance in TTIB transceiver, we first used computer simulation. In the simulation results, we found that the TTIB transceiver could compensate for the multipath fading as expected. Second, we carried out some experiments on TTIB transceiver implementation with DSP boards and later with hardwares including RF circuits with center frequency of 145MHz. Through these experiments, we found that fading compensation performance in TTIB transceiver was almost as good as that obtained from simulation.

• The Journal of Korean Institute of Electromagnetic Engineering and Science
• /
• v.21 no.8
• /
• pp.857-864
• /
• 2010

In this paper, we analyse the effect of the path imbalances(gain and phase mismatches) in LINC(LInear amplification with Nonlinear Component) system, and propose a simple scheme using LUTs(Look Up Table) to compensate the path imbalances. The EVM(Error Vector Magnitude) and ACPR(Adjacent Channel Power Ratio) of the LINC system are degraded significantly by the path imbalances because it adopts an outphasing technique. The EVM and ACPR are theoretically extracted for two variables(gain and phase mismatch factors) and 2-D LUTs for those are generated based on the analysis. The efficient and simple compensation scheme for the path imbalances is proposed using the 2-D LUTs. A LINC system with the suggested compensation scheme is implemented, and the proposed method is verified with an experiment. A 16-QAM signal with 1.5 MHz bandwidth is used. Before the compensation, the path gain ratio was 95 % and phase error was $19.33^{\circ}$. The proposed scheme adjusts those values with 99 % and $0.5^{\circ}$, and improves ACPR about 18.1 dB.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2003.05a
• /
• pp.157-161
• /
• 2003

본 논문에서는 차량의 주행경로 최적화를 위해 강화학습 개념을 적용하고자 한다. 강화학습의 특징은 관심 대상에 대한 구체적인 지배 규칙의 정보 없이도 최적화된 행동 방식을 학습시킬 수 있는 특징이 있어서, 실제 차량의 주행경로와 같이 여러 교통정보 및 시간에 따른 변화 등에 대한 복잡한 고려가 필요한 시스템에 적합하다. 또한 학습을 위한 강화(보상, 벌칙)의 정도 및 기준을 조절해 즘으로써 다양한 최적주행경로를 제공할 수 있다. 따라서, 본 논문에서는 강화학습 알고리즘을 이용하여 다양한 최적주행경로를 제공해 주는 시스템을 구현한다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.1
• /
• pp.50-55
• /
• 2021

Multi-path system is a system in which utilizes various networks simultaneously. It is expected that multi-path system can enhance communication speed, reliability, security of network. In this paper, we focus on path selection in multi-path system. To select optimal path, we propose deep reinforcement learning algorithm which is rewarded by the round-trip-time (RTT) of each networks. Unlike multi-armed bandit model, deep Q learning is applied to consider rapidly changing situations. Due to the delay of RTT data, we also suggest compensation algorithm of the delayed reward. Moreover, we implement testbed learning server to evaluate the performance of proposed algorithm. The learning server contains distributed database and tensorflow module to efficiently operate deep learning algorithm. By means of simulation, we showed that the proposed algorithm has better performance than lowest RTT about 20%.

• Proceedings of the IEEK Conference
• /
• 2000.11a
• /
• pp.233-236
• /
• 2000

본 논문에서는 다중 경로 페이딩에 의한 성능의 손실을 보상하기 위하여 간단한 equal gain combining diversity를 갖는 802.11a 무선 LAN용 OFDM 시스템의 HER 성능을 다중경로 환경 하에서 분석하였다. 모의 실험 결과에 따르면, 다중경로채널에서 전송 파워를 살펴보면, 2branch equal gain combining diversity를 사용한 무선 LAN용 OFDM시스템이 diversity를 사용하지 않는 OFDM 시스템보다 BER 10/sup -3/에서 3㏈ 정도의 이득을 줄 수 있었다. Branch 수를 3개를 사용한 경우에는 BER 10/sup -3/에서 branch 2개를 사용한 경우보다 약 2㏈정도 이득을 줄 수 있었다.

• Management & Information Systems Review
• /
• v.30 no.3
• /
• pp.133-151
• /
• 2011

This study investigates the moderating effect of customer type(deal prone/promotion insensitives) on the relationship between perceived values on the reward program of tele-communication firms and customer satisfaction. To test moderating effect, Difference test for distinct parameters in Amos 18.0 program was used. Results show that there is no the moderating effect of customer variable. But both kind of perceived values(utilitarian value and hedonic value) have a significant effect on customer satisfaction. For all customer, utilitarian reward has influenced on the customer satisfaction more than hedonic reward. And for utilitarian reward, promotion insensitives customer has influenced on the customer satisfaction more than deal prone customer.