• Title/Summary/Keyword: Limited Decision Policy

Search Result 100, Processing Time 0.025 seconds

Partially Observable Markov Decision Processes (POMDPs) and Wireless Body Area Networks (WBAN): A Survey

  • Mohammed, Yahaya Onimisi;Baroudi, Uthman A.
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.7 no.5
    • /
    • pp.1036-1057
    • /
    • 2013
  • Wireless body area network (WBAN) is a promising candidate for future health monitoring system. Nevertheless, the path to mature solutions is still facing a lot of challenges that need to be overcome. Energy efficient scheduling is one of these challenges given the scarcity of available energy of biosensors and the lack of portability. Therefore, researchers from academia, industry and health sectors are working together to realize practical solutions for these challenges. The main difficulty in WBAN is the uncertainty in the state of the monitored system. Intelligent learning approaches such as a Markov Decision Process (MDP) were proposed to tackle this issue. A Markov Decision Process (MDP) is a form of Markov Chain in which the transition matrix depends on the action taken by the decision maker (agent) at each time step. The agent receives a reward, which depends on the action and the state. The goal is to find a function, called a policy, which specifies which action to take in each state, so as to maximize some utility functions (e.g., the mean or expected discounted sum) of the sequence of rewards. A partially Observable Markov Decision Processes (POMDP) is a generalization of Markov decision processes that allows for the incomplete information regarding the state of the system. In this case, the state is not visible to the agent. This has many applications in operations research and artificial intelligence. Due to incomplete knowledge of the system, this uncertainty makes formulating and solving POMDP models mathematically complex and computationally expensive. Limited progress has been made in terms of applying POMPD to real applications. In this paper, we surveyed the existing methods and algorithms for solving POMDP in the general domain and in particular in Wireless body area network (WBAN). In addition, the papers discussed recent real implementation of POMDP on practical problems of WBAN. We believe that this work will provide valuable insights for the newcomers who would like to pursue related research in the domain of WBAN.

A Review of Ecosystem Service Studies: Concept, Approach and Future Work in Korea

  • Chung, Min Gon;Kang, Hojeong
    • Journal of Ecology and Environment
    • /
    • v.36 no.1
    • /
    • pp.1-9
    • /
    • 2013
  • In South Korea, the conflict between development and conservation policy still exist among government ministries, and conventional development plan often has priority over conservation policy. Establishment of sustainable development and comprehensive management policy employing the results of ecosystem service studies are highly warranted, but researchers in South Korea are still limited and often misuse the concept of ecosystem services. Thus, we aimed to introduce the concept of Ecosystem Service (ES) and related terminologies such as Social-Ecological Systems (SESs), ecosystem function, trade-off, and human well-being in this paper. Additionally, this article reviewed and arranged key approaches in ES studies as follows: 1) field works, 2) mapping ecosystem services, 3) valuing ES, 4) quantifying trade-offs between ES and 5) understanding SESs. Based on those results, we suggest that field works for basic information have the first priority to be conducted among ES studies. Once basic information is sufficiently accumulated, researchers can perform applied ES research with accuracy. Finally, results of ES studies conducted by five approaches allow decision makers to consider both natural system and society simultaneously, and hence the results can be utilized for sustainable development and conservation policy based on ecosystem-based management.

Traffic Prediction based Multi-Stage Virtual Topology Reconfiguration Policy in Multi-wavelength Routed Optical Networks (다중 파장 광 네트워크 상에서 트래픽 예상 기법 기반 다단계 가상망 재구성 정책)

  • Lin Zhang;Lee, Kyung-hee;Youn, Chan-Hyun;Shim, Eun-Bo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.27 no.8C
    • /
    • pp.729-740
    • /
    • 2002
  • This paper studies the issues arising in the virtual topology reconfiguration phase of Multi-wavelength Routed Optical Networks. This reconfiguration process means to change the virtual topology in response to the changing traffic patterns in the higher layer. We formulate the optimal reconfiguration policy as a multi-stage decision-making problem to maximize the expected reward and cost function over an infinite horizon. Then we propose a new heuristic algorithm based on node-exchange to reconfigure the virtual topology to meet the traffic requirement. To counter the continual approximation problem brought by heuristic approach, we take the traffic prediction into consideration. We further propose a new heuristic reconfiguration algorithm called Prediction based Multi-stage Reconfiguration approach to realize the optimal reconfiguration policy based on predicted traffic. Simulation results show that our reconfiguration policy significantly outperforms the conventional one, while the required physical resources are limited.

Opportunistic Spectrum Access Based on a Constrained Multi-Armed Bandit Formulation

  • Ai, Jing;Abouzeid, Alhussein A.
    • Journal of Communications and Networks
    • /
    • v.11 no.2
    • /
    • pp.134-147
    • /
    • 2009
  • Tracking and exploiting instantaneous spectrum opportunities are fundamental challenges in opportunistic spectrum access (OSA) in presence of the bursty traffic of primary users and the limited spectrum sensing capability of secondary users. In order to take advantage of the history of spectrum sensing and access decisions, a sequential decision framework is widely used to design optimal policies. However, many existing schemes, based on a partially observed Markov decision process (POMDP) framework, reveal that optimal policies are non-stationary in nature which renders them difficult to calculate and implement. Therefore, this work pursues stationary OSA policies, which are thereby efficient yet low-complexity, while still incorporating many practical factors, such as spectrum sensing errors and a priori unknown statistical spectrum knowledge. First, with an approximation on channel evolution, OSA is formulated in a multi-armed bandit (MAB) framework. As a result, the optimal policy is specified by the wellknown Gittins index rule, where the channel with the largest Gittins index is always selected. Then, closed-form formulas are derived for the Gittins indices with tunable approximation, and the design of a reinforcement learning algorithm is presented for calculating the Gittins indices, depending on whether the Markovian channel parameters are available a priori or not. Finally, the superiority of the scheme is presented via extensive experiments compared to other existing schemes in terms of the quality of policies and optimality.

Duty-Free Electronic Commerce and The Rules of The WTO (전자상거래 무관세화와 WTO 규범)

  • 정순태
    • The Journal of Information Technology
    • /
    • v.4 no.2
    • /
    • pp.103-115
    • /
    • 2001
  • This paper seek to clarify a narrow set of policy issues relating to the international trade aspects of electronic commerce. It focuses, in particular, on the WTO decision not impose customs duties on electronically delivered products. The decision on duty-free commerce is intended to contribute to the growth of electronic commerce by providing a guarantee of open trading conditions, but the significance of the decision may have been exaggerated. In particular, the prohibition of customs duties does not ensure continued open market access for electronically delivered products and may even prompt recourse to inferior instruments of protection. Accordingly, barrier-free electronic commerce would be more effectively secured by deepening and widening the limited cross-border trade commitments under the GATS and by clarifying and strengthening certain GATS disciplines.

  • PDF

Comparative Analysis of Stem Cell Research Policy Changes in UK, US, and South Korea: Application of Advocacy Coalition Framework Model (영국, 미국, 한국의 줄기세포연구에 관한 정책변동 비교 분석: Advocacy Coalition Framework 모형의 적용)

  • Bae, Green;Kang, Minah
    • Health Policy and Management
    • /
    • v.23 no.4
    • /
    • pp.314-325
    • /
    • 2013
  • Background: Stem cell research competition is accelerating globally since President Obama signed an executive order, repealing Bush-era policy that limited use of federal tax dollars for embryonic stem cell research. Methods: In this paper, we conducted a comparative analysis of stem cell research policy changes in three countries, including the Human Fertilisation Embryology Act (HFEA) of UK, executive order 13,505 (removing barriers to responsible scientific research involving human stem cells) of USA, and Bioethics and Safety Act of South Korea. Debates on stem cell research are based on conflicts of fundamental beliefs that exist in the supporting and opposing coalitions. We compared regional characteristics of the advocacy coalitions in three countries and presented various factors that might be related to the policy changes. Results: The UK government, parliament, and the HFEA have sought expert consultations and public opinions to establish guidelines. UK has made social consensus through continued discussion for a long time. US President's veto power was one strongest factors influencing policy. South Korean policy was influenced by public opinion and policy brokers. Also, South Korea has not made social consensus. UK had a strong leadership and strong adjustment of coalitions but US and South Korea had not. Dr. Hwang's scandal has had one of the greatest impacts on policy decision in South Korea. Conclusion: The power of public opinion was critical in all three countries. In particular, the influence of public opinion was noticeable in South Korea. Also it turned out that in US and South Korea, the presence of a policy broker who could pursue his or her goals was the most powerful factor among the advocacy coalition factors.

Evaluating Chronic Care of Public Health Centers in a Metropolitan City (만성질환 관리 평가도구를 이용한 보건소 만성질환 관리수준 평가)

  • Choi, Yong-Jun;Shin, Dong-Soo;Kang, Minah;Bae, Sang-Soo;Kim, Jaiyong
    • Health Policy and Management
    • /
    • v.24 no.4
    • /
    • pp.312-321
    • /
    • 2014
  • Background: To evaluate the quality of chronic care provided by public health centers located in a South Korean metropolitan city using a modified Assessment of Chronic Illness Care (ACIC). Methods: We conducted self-evaluation surveys and collected data using a modified ACIC from twenty five public health centers. Cultural validity of the original ACIC was examined by the public health and nursing science experts. Based on expert reviews, cognitive interviews, pre-test results, five items of the original ACIC that were not relevant were deleted. The response scale was changed from twelve-point Likert scale to Guttman scale but its scoring system was maintained. Results: Eighty eight percent of public health centers in this study reported that their overall quality of chronic care was at a limited or basic level. About 68% of the centers reported that the organization was as reasonably good or fully developed to provide chronic care. On the other hand, 96% of the public health centers reported that the clinical information system was at a very limited or basic support level. The decision support, the integration of Chronic Care Model components, the delivery system design, the community linkages, and the self-management support were evaluated as limited or basic level of support by more than half of the public health centers, respectively. Conclusion: In a metropolitan area of South Korea, quality of chronic care in public health centers was not found to reach acceptable levels of services. It is critical to enhance the quality of chronic care in public health centers.

Development of Inventory Control System for Large-scale Retailers using Neural Network and (s*,S*) Policy (신경회로망과 (s*,S*) 정책을 이용한 대규모 유통업을 위한 재고 관리 시스템의 개발)

  • 김우주
    • The Journal of Information Systems
    • /
    • v.6 no.1
    • /
    • pp.223-256
    • /
    • 1997
  • Since the business scales of retailing companies become to be very large and the number of items dealt increases explosively, automation of inventory management becomes one of the most important issues to solve in retailing industry. In order to accomplish this automation of inventory management, there must be a great need to a method which can perform real-time decision making on inventory control in an automatic fashion, while communicating with inventory information systems like POS system and automatic warehousing system. But even in this circumstance, there are also many obstructions to such automation like varying demands, limited capacity of warehouse and exhibition room, need for strategic consideration on inventory control, etc., in a real sense. Due to these reasons, it seems very difficult that most large-scaled retailing companies get fully automated inventory management system. To overcome those difficulties and reflect them into inventory control, we propose a automated inventory control methodology for retailing industry based on neural network and policy model. Especially, policy model is devised to deal with dynamic varying demands and using this model, strategic goals on inventory can be considered into inventory control mechanism. Our proposed approach is implemented in workstation and its performance is also empirically verified also against to real case of one of the major retailing firm in Korea.

  • PDF

FRM: Foundation-policy Recommendation Model to Improve the Performance of NAND Flash Memory

  • Won Ho Lee;Jun-Hyeong Choi;Jong Wook Kwak
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.8
    • /
    • pp.1-10
    • /
    • 2023
  • Recently, NAND flash memories have replaced magnetic disks due to non-volatility, high capacity and high resistance, in various computer systems but it has disadvantages which are the limited lifespan and imbalanced operation latency. Therefore, many page replacement policies have been studied to overcome the disadvantages of NAND flash memories. Although it is clear that these policies reflect execution characteristics of various environments and applications, researches on the foundation-policy decision for disk buffer management are insufficient. Thus, in this paper, we propose a foundation-policy recommendation model, called FRM for effectively utilizing NAND flash memories. FRM proposes a suitable page replacement policy by classifying and analyzing characteristics of workloads through machine learning. As an implementation case, we introduce FRM with a disk buffer management policy and in experiment results, prediction accuracy and weighted average of FRM shows 92.85% and 88.97%, by training dataset and validation dataset for foundation disk buffer management policy, respectively.

A Study on the Constructing Database and Its Utilization Direction of Old Building using GIS (GIS를 이용한 노후건축물 DB구축과 활용방안에 관한 연구)

  • Kim, Heung-Kwan
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.11 no.4
    • /
    • pp.172-181
    • /
    • 2008
  • Life of building repeats removal and new construction continuously because it is limited like living things. But, because the physical standard is subjective and abstract, saying too much is not even though it had been influenced by policy decision of the government. To solve these problem clear data about superannuation degree of building after construction accordingly decision relationship necessity continuously rise. To above background, this study on the Constructing Database Based and Improvement of Old Building using GIS in Busan. The results are as following. First, presented necessity of knowledge information gap mitigation. Second, present Busan's ordinance detailed Contents of old-badness building and production-consequences.

  • PDF