• Title/Summary/Keyword: stochastic control

Search Result 474, Processing Time 0.026 seconds

Color Landmark Based Self-Localization for Indoor Mobile Robots (이동 로봇을 위한 컬러 표식 기반 자기 위치 추정 기법)

  • Yoon, Kuk-Jin;Jang, Gi-Jeong;Kim, Sung-Ho;Kweon, In-So
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.7 no.9
    • /
    • pp.749-757
    • /
    • 2001
  • We present a simple artificial landmark model and robust landmark tracking algorithm for mobile robot localization. The landmark model, consisting of symmetric and repetitive color patches, produces color histograms that are invariant under the geometric and photometric distortions. A stochastic approach based on the CONDENSATION tracks the landmark model robustly even under the varying illumination conditions. After the landmark detection, relative position of the mobile robot to the landmark is calculated. Experimental results show that the proposed landmark model is effective and can be detected and tracked in a clustered scene robustly. With the tracked single landmark, we extract geometrical information than achieve accurate localization.

  • PDF

Improving Loss Recovery Performance of TCP SACK by Retransmission Loss Recovery (재전송 손실 복구를 통한 TCP SACK의 성능 향상 모델링 및 분석)

  • 김범준;김동민;이재용
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.7B
    • /
    • pp.667-674
    • /
    • 2004
  • The performance of transmission control protocol (TCP) is largely dependent upon its loss recovery. Therefore, it is a very important issue whether the packet losses may be recovered without retransmission timeout (RTO) or not. Although TCP SACK can recover multiple packet losses in a window, it cannot avoid RTO if a retransmitted packet is lost again. In order to alleviate this problem, we propose a simple change to TCP SACK, which is called TCP SACK+ in simple. We use a stochastic model to evaluate the performance of TCP SACK+, and compare it with TCP SACK. Numerical results evaluated by simulations show that SACK+ can improve the loss recovery of TCP SACK significantly in presence of random losses.

A Cost-Effective and Accurate COA Defuzzifier Without Multipliers and Dividers (승산기 및 제산기 없는 저비용 고정밀 COA 비퍼지화기)

  • 김대진;이한별;강대성
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.8 no.2
    • /
    • pp.70-81
    • /
    • 1998
  • This paper proposes an accurate and cost-effective COA defuzzifier of fuzzy logic controller (FLC). The accuracy of the proposed COA defuzzifier is obtained by involving both membership values and spans of membership functions in calculating a crisp value. The cost-effectiveness of the proposed COA defuzzifier is obtained by replacing the division in the COA defuzzifier by finding an equilibrium point of both the left and right moments. The proposed COA defuzzifier has two disadvantages that it ncreases the hardware complexity due to the additional multipliers and it takes a lot of computation time to find the moment equilibrium point. The first disadvantage is overcome by replacing the multipliers with the stochastic AND operations. The second disadvantage is alleviated by using a coarse-to-fine searching algorithm that accelerates the finding of moment equilibrium point. Application of the proposed COA defuzzifier to the truck backer-upper control problem is performed in the VHDL simulation and the control accuracy of the proposed COA defuzzifier is compared with that of the conventional COA defuzzifier in terms of average tracing distance.

  • PDF

Robot Locomotion via RLS-based Actor-Critic Learning (RLS 기반 Actor-Critic 학습을 이용한 로봇이동)

  • Kim, Jong-Ho;Kang, Dae-Sung;Park, Joo-Young
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.7
    • /
    • pp.893-898
    • /
    • 2005
  • Due to the merits that only a small amount of computation is needed for solutions and stochastic policies can be handled explicitly, the actor-critic algorithm, which is a class of reinforcement learning methods, has recently attracted a lot of interests in the area of artificial intelligence. The actor-critic network composes of tile actor network for selecting control inputs and the critic network for estimating value functions, and in its training stage, the actor and critic networks take the strategy, of changing their parameters adaptively in order to select excellent control inputs and yield accurate approximation for value functions as fast as possible. In this paper, we consider a new actor-critic algorithm employing an RLS(Recursive Least Square) method for critic learning, and policy gradients for actor learning. The applicability of the considered algorithm is illustrated with experiments on the two linked robot arm.

Performance Analysis of a Congestion cControl Mechanism Based on Active-WRED Under Multi-classes Traffic (멀티클래스 서비스 환경에서 Active-WRED 기반의 혼잡 제어 메커니즘 및 성능 분석)

  • Kim, Hyun-Jong;Kim, Jong-Chan;Choi, Seong-Gon
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.45 no.5
    • /
    • pp.125-133
    • /
    • 2008
  • In this paper, we propose active queue management mechanism (Active-WRED) to guarantee quality of the high priority service class in multi-class traffic service environment. In congestion situation, this mechanism increases drop probability of low priority traffic and reduces the drop probability of the high priority traffic, therefore it can improve the quality of the high priority service. In order to analyze the performance of our mechanism we introduce the stochastic analysis of a discrete-time queueing systems for the performance evaluation of the Active Queue Management (AQM) based congestion control mechanism called Weighted Random Early Detection (WRED) using a two-state Markov-Modulated Bernoulli arrival process (MMBP-2) as the traffic source. A two-dimensional discrete-time Harkov chain is introduced to model the Active-WRED mechanism for two traffic classes (Guaranteed Service and Best Effort Service) where each dimension corresponds to a traffic class with its own parameters.

Comparison between Cournot-Nash and Stackelberg Game in Bi-level Program (Bi-level program에서 Cournot-Nash게임과 Stackelberg게임의 비교연구)

  • Lim, Yong-Taek;Lim, Kang-Won
    • Journal of Korean Society of Transportation
    • /
    • v.22 no.7 s.78
    • /
    • pp.99-106
    • /
    • 2004
  • This paper presents some comparisons between Cournot-Nash and Stackelberg game in bi-level program, composed of both upper level program and lower level one. The upper level can be formulated to optimize a specific objective function, while the lower formulated to express travelers' behavior patterns corresponding to the design parameter of upper level problem. This kind of hi-level program is to determine a design parameter, which leads the road network to an optimal state. Bi-level program includes traffic signal control, traffic information provision, congestion charge and new transportation mode introduction as well as road expansion. From the view point of game theory, many existing algorithms for bi-level program such as IOA (Iterative Optimization Assignment) or IEA (Iterative Estimation Assignment) belong to Cournot-Nash game. But sensitivity-based algorithms belongs to Stackelberg one because they consider the reaction of the lower level program. These two game models would be compared by using an example network and show some results that there is no superiority between the models in deterministic case, but in stochastic case Stackelberg approach is better than that of Cournot-Nash one as we expect.

소비효율성 개념을 이용한 혁신의 이해

  • 박찬수;이정동;오동현
    • Proceedings of the Technology Innovation Conference
    • /
    • 2003.06a
    • /
    • pp.41-56
    • /
    • 2003
  • 다양한 제품들이 존재하는 시장에는 타 제품에 비하여 품질대비 가격이 낮은 혁신적인 경쟁력있는 제품과 그렇지 못한 제품들이 혼재하고 있다. 그러나 정보의 부족(limited information), 제한적 합리성(bounded rationality) 등 여러 가지 원인으로 인하여 혁신적인 제품들만이 소비자들에게 선택되어 소비되는 것은 아니다. 본 연구에서는 이러한 현상을 설명하기 위하여 소비효율성(consumption efficiency)라는 개념을 도입, 제시하고자 한다. 만약 소비효율성이 극도로 낮다면 혁신적인 제품을 내어놓는다 하더라도 소비자들에게 선택되어 이윤이 발생될 확률이 낮기 때문에 생산자 입장에서는 혁신의 유인(innovation incentive)이 낮아질 수밖에 없게 된다. 이처럼 소비효율성의 문제는 혁신의 유인과 결과를 이해하는데 중요한 단초를 제공할 수 있게 된다. 이에 반하여 혁신을 이해하기 위한 기존의 분석틀은 생산경제이론(production economics)에 기반하고 있고, 효율성의 개념도 생산효율성(production efficiency) 혹은 기술적 효율성(technical efficiency)의 범주에서 다루어져 왔다. 본 연구에서 제시하는 소비효율성의 개념은 효용이론에 근거하고 있다는 점에서 기존 연구와 차별화된다. 본 연구는 효용함수 극대화이론에서 출발하여 경계헤도닉함수(frontier hedomic function)을 도출하는 이론적 유도과정을 제시한다. 실증분석을 위해서는 SFA(Stochastic Frontier Analysis)의 방법론 체계를 적용하였다. 제시된 분석틀은 국내 PC산업의 데이터에 적용되었다. 분석의 결과 몇 가지 가정하에 국내 PC산업이 약 13%정도의 비효율성을 안고 있는 것으로 판단할 수 있으며, 초기혁신구매자(early adopter)들은 일정 정도의 비효율성을 기꺼이 감수할 것으로 분석되었다. 궤적 분석에서는 각 산업별 기술의 특성을 분석하는 것으로, 특정 기술 지식의 활용 기간을 통해 기술 주기를 도출하고, 산업 내 평균 권리 청구 항목 수를 이용하여 각 산업의 기술 범위를 비교하였다. 각각의 동적 분석을 통해 시간에 따른 변화 양상이 관찰하였고, ANOVA 분석을 이용하여 통계적 유의성을 검증하였다. 본 연구는 현재의 기술 패러다임 내에서 Pavitt이 제시한 산업 분류의 근거를 보충 설명하였고 특허 정보를 이용하여 기술혁신의 산업별 유형에 대한 폭넓은 분석방법을 제시하였다.별 시간대별 효과분석을 통하여 정책의 시행여부가 결정되어야 할 것이다. 한편, 화물전용차선의 설치로 인한 물류비용의 절감을 보다 효과적으로 달성하기 위해서는 종합류류 전산망의 시급한 구축과 함께 화물차의 적재율을 높이고 공차율을 낮출 수 있는 운송체계의 수립이 필요한 것으로 판단된다. 그라나 이러한 화물전용차선의 효과는 단기적인 치유책일 수밖에 없기 때문에 물류유통 시설의 확충을 위한 사회간접자본의 구축을 서둘러 시행하여야 할 것이다.으로 처리한 Machine oil, Phenthoate EC 및 Trichlorfon WP는 비교적 약효가 낮았다.>$^{\circ}$E/$\leq$30$^{\circ}$NW 단열군이 연구지역 내에서 지하수 유동성이 가장 높은 단열군으로 추정된다. 이러한 사실은 3개 시추공을 대상으로 실시한 시추공 내 물리검층과 정압주입시험에서도 확인된다.. It was resulted from increase of weight of single cocoon. "Manta"2.5ppm produced 22.2kg of cocoon. It is equal to 9% increase in index, as compared to that of control. In case of R-20458, the increasing

  • PDF

TGC-based Fish Growth Estimation Model using Gaussian Process Regression Approach (가우시안 프로세스 회귀를 통한 열 성장 계수 기반의 어류 성장 예측 모델)

  • Juhyoung Sung;Sungyoon Cho;Da-Eun Jung;Jongwon Kim;Jeonghwan Park;Kiwon Kwon;Young Myoung Ko
    • Journal of Internet Computing and Services
    • /
    • v.24 no.1
    • /
    • pp.61-69
    • /
    • 2023
  • Recently, as the fishery resources are depleted, expectations for productivity improvement by 'rearing fishery' in land farms are greatly rising. In the case of land farms, unlike ocean environments, it is easy to control and manage environmental and breeding factors, and has the advantage of being able to adjust production according to the production plan. On the other hand, unlike in the natural environment, there is a disadvantage in that operation costs may significantly increase due to the artificial management for fish growth. Therefore, profit maximization can be pursued by efficiently operating the farm in accordance with the planned target shipment. In order to operate such an efficient farm and nurture fish, an accurate growth prediction model according to the target fish species is absolutely required. Most of the growth prediction models are mainly numerical results based on statistical analysis using farm data. In this paper, we present a growth prediction model from a stochastic point of view to overcome the difficulties in securing data and the difficulty in providing quantitative expected values for inaccuracies that existing growth prediction models from a statistical point of view may have. For a stochastic approach, modeling is performed by introducing a Gaussian process regression method based on water temperature, which is the most important factor in positive growth. From the corresponding results, it is expected that it will be able to provide reference values for more efficient farm operation by simultaneously providing the average value of the predicted growth value at a specific point in time and the confidence interval for that value.

A Stochastic Analysis of the Water Quality on the Basin of Soyang River with Discharge Variation (유량변동에 따른 소양강유역 수질의 통계학적 해석)

  • Choi, Han-Kyu;Baek, Kyung-Won;Choi, Yong-Mook;Choi, Jin-Woo
    • Journal of Industrial Technology
    • /
    • v.21 no.B
    • /
    • pp.233-240
    • /
    • 2001
  • This research was conducted with the aim of efficiently managing large scale of rivers such like Songyang-river through predicting water quality change with analyzing the characteristics of the flowing in nutrients and pollutants. The main result will be used as basic data for effectively operating reservoirs through controling water quality and quantity. The relationship between quantity of flow and water quality was analyzed and pollution loading into the basin was estimated. Three areas of Soyang-river upstream and one area of Suip-cheon in Yanggu-gun were selected as research sites. Flow and water quality were measured simultaneously. The relation between quantity of discharge and pollution concentration and between quantity of discharge and pollution loading were analyzed by statistical method, respectively. We provided a rating curve through measuring quantity of discharge(collecting quantity of discharge) and pollutograph and pollution loading curve through water quality data. Also, we analyzed the correlation between quantity of discharge per unit area and pollution loading per unit area in each basin. As resurt of this research, Buk-cheon spot revealed an excellent first grade water quality for the items including $BOD_5$, DO, and SS. The correlation coefficient between Buk-cheon spot's quantity of discharge and pollution loading was 0.896~0.996, showing the validity of analysis applying correlation curve formula of quantity of discharge and pollution loading in the same spot. Also, pollution loading per unit area of the items including $BOD_5$, COD, DO, SS, T-N, T-P increased as the area of basins get increased following the sequence of Buk-cheon, Suip-cheon, Naelin-cheon spots.

  • PDF

Single Outlier Removal Technology for TWR based High Precision Localization (TWR 기반 고정밀 측위를 위한 단일 이상측정치 제거 기술)

  • Lee, Chang-Eun;Sung, Tae-Kyung
    • The Journal of Korea Robotics Society
    • /
    • v.12 no.3
    • /
    • pp.350-355
    • /
    • 2017
  • UWB (Ultra Wide Band) refers to a system with a bandwidth of over 500 MHz or a bandwidth of 20% of the center frequency. It is robust against channel fading and has a wide signal bandwidth. Using the IR-UWB based ranging system, it is possible to obtain decimeter-level ranging accuracy. Furthermore, IR-UWB system enables acquisition over glass or cement with high resolution. In recent years, IR-UWB-based ranging chipsets have become cheap and popular, and it has become possible to implement positioning systems of several tens of centimeters. The system can be configured as one-way ranging (OWR) positioning system for fast ranging and TWR (two-way ranging) positioning system for cheap and robust ranging. On the other hand, the ranging based positioning system has a limitation on the number of terminals for localization because it takes time to perform a communication procedure to perform ranging. To overcome this problem, code multiplexing and channel multiplexing are performed. However, errors occur in measurement due to interference between channels and code, multipath, and so on. The measurement filtering is used to reduce the measurement error, but more fundamentally, techniques for removing these measurements should be studied. First, the TWR based positioning was analyzed from a stochastic point of view and the effects of outlier measurements were summarized. The positioning algorithm for analytically identifying and removing single outlier is summarized and extended to three dimensions. Through the simulation, we have verified the algorithm to detect and remove single outliers.