• Title/Summary/Keyword: 강화 학습

Search Result 1,608, Processing Time 0.031 seconds

A method for automatically generating a route consisting of line segments and arcs for autonomous vehicle driving test (자율이동체의 주행 시험을 위한 선분과 원호로 이루어진 경로 자동 생성 방법)

  • Se-Hyoung Cho
    • Journal of IKEEE
    • /
    • v.27 no.1
    • /
    • pp.1-11
    • /
    • 2023
  • Path driving tests are necessary for the development of self-driving cars or robots. These tests are being conducted in simulation as well as real environments. In particular, for development using reinforcement learning and deep learning, development through simulators is also being carried out when data of various environments are needed. To this end, it is necessary to utilize not only manually designed paths but also various randomly and automatically designed paths. This test site design can be used for actual construction and manufacturing. In this paper, we introduce a method for randomly generating a driving test path consisting of a combination of arcs and segments. This consists of a method of determining whether there is a collision by obtaining the distance between an arc and a line segment, and an algorithm that deletes part of the path and recreates an appropriate path if it is impossible to continue the path.

Applicability of Artificial Intelligence Techniques to Forecast Rainfall and Flood Damage in Future (미래 강우량 및 홍수피해 전망을 위한 인공지능 기법의 적용성 검토)

  • Lee, Hoyong;Kim, Jongsung;Seo, Jaeseung;Kim, Sameun;Kim, Soojun
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2021.06a
    • /
    • pp.184-184
    • /
    • 2021
  • 2020년의 경우 대기 상층 제트기류가 크게 강화됨에 따라 작은 규모의 저기압의 발달이 평년보다 두 배 이상 증가하였고, 그로 인해 장마가 최대 54일가량 지속되며 1조 371억 원 가량의 대규모 침수피해가 발생하였다. 이와 같이 최근 기후변화로 인한 이상 기후가 빈번하게 발생하고 있으며, 그로 인해 홍수, 태풍과 같은 재난의 강도 및 파급되는 재산피해가 점차 증가하고 있는 추세이다. 따라서 본 연구에서는 기후변화를 고려하여 향후 30년간 강우량 변화 추이를 파악하고, 이에 따라 파급되는 재난피해 규모의 증가 추세를 확인하고자 하였다. 기후변화 시나리오는 IPCC AR6(Intergovernmental Panel on Climate Change - Sixth Assessment Report)에서 제시하고 있는 시나리오 중 극한 시나리오인 SSP5-8.5와 안정화 시나리오인 SSP2-4.5 시나리오를 활용하고자 하였다. GCM(General Circulation Model) 자료는 전 지구적 모형으로 공간적 해상도가 낮은 문제가 있기 때문에, 국내 적용을 위해서는 축소기법을 적용해야 한다. 본 연구에서는 공간적 축소를 위해 통계학적 기법 중 인공지능 기법을 적용하고 Reference data와 종관기상관측(ASOS)의 실측 강우 자료(1905 ~ 2014년)를 통해 학습된 모형의 정확도 검증을 수행하였다. 또한 연 강수량과 연도별 홍수피해의 규모 및 빈도를 확인하여 연도별 강수량 증가에 따른 피해 규모의 증가를 관계식을 도출하였다. 이후 최종적인 축소기법으로 모형을 통해 향후 2050년까지 부산광역시의 예측 강우량을 전망하여 연 강수량의 증가량과 피해 규모의 증가량을 전망해보고자 하였다. 본 연구 결과는 부산광역시의 예방단계 재난관리의 일환으로 적응형 기후변화 대책 수립에 기초 자료로써 활용될 수 있을 것이다.

  • PDF

A Study on User Satisfaction Research about Spacial Composition before and after Remodeling University Library Focused on C University Library (대학도서관 리모델링 전.후의 공간구성에 관한 이용자 만족도 조사 연구 - C대학교 중앙도서관을 중심으로 -)

  • Nam, Young-Joon;Moon, Jung-Hyun;Yi, Hyun-Jung
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.20 no.4
    • /
    • pp.205-222
    • /
    • 2009
  • University libraries are involved in college education and college education is also involved in university libraries. To the knowledge information society increases the competitive power of the university and the academic library which national competitive power strengthens further must be operated developmentally. Professors and students to support research and learning activities appropriate facilities and systems must be equipped with features and the role of university libraries will be fulfilled properly. In this study, we analyze changes in the configuration space, and accordingly remodel before and after the user satisfaction survey of spatial configuration on the users' satisfaction and the results are to analyze based on C University Library. As a result of this study, the library space was utilized to determine the importance of purpose in the future, these results increase the quality of library service or library user satisfaction survey. Study will be a good reference for researchers.

Exploring the Operating and Supporting Direction of AI Curriculum by Analyzing A High School Case Study

  • Sungryong Ju;Seulgi Song;Seung-Bo Park
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.4
    • /
    • pp.175-186
    • /
    • 2023
  • This study was conducted to explore the necessary conditions and support for stable operation of an expanded AI curriculum in education. A high school that has implemented an AI curriculum since 2020 was targeted, and students and teachers were surveyed on their perceptions of the AI curriculum, implementation and support strategies. The survey items were categorized into 1) experience with AI education, 2) implementation direction of AI education, and 3) expected effects through AI education, and the results were derived focusing on frequency analysis to identify trends. The analysis resulted in three implications. First, it was suggested that the activation of AI education. Second, the need to develop a hands-on AI curriculum and incorporate AI throughout the entire curriculum was highlighted. Third, it was emphasized that efforts to enhance the capabilities of teachers to implement AI teaching and learning, along with the expansion of physical infrastructure for hands-on education, are necessary.

Brainstorming using TextRank algorithms and Artificial Intelligence (TextRank 알고리즘 및 인공지능을 활용한 브레인스토밍)

  • Sang-Yeong Lee;Chang-Min Yoo;Gi-Beom Hong;Jun-Hyuk Oh;Il-young Moon
    • Journal of Practical Engineering Education
    • /
    • v.15 no.2
    • /
    • pp.509-517
    • /
    • 2023
  • The reactive web service provides a related word recommendation system using the TextRank algorithm and a word-based idea generation service selected by the user. In the related word recommendation system, the method of weighting each word using the TextRank algorithm and the probability output method using SoftMax are discussed. The idea generation service discusses the idea generation method and the artificial intelligence reinforce-learning method using mini-GPT. The reactive web discusses the linkage process between React, Spring Boot, and Flask, and describes the overall operation method. When the user enters the desired topic, it provides the associated word. The user constructs a mind map by selecting a related word or adding a desired word. When a user selects a word to combine from a constructed mind-map, it provides newly generated ideas and related patents. This web service can share generated ideas with other users, and improves artificial intelligence by receiving user feedback as a horoscope.

Analysis of Effects of Small School Space Innovation (소규모 학교공간혁신 효과성 분석)

  • Kwon, Soon-Chul;Lee, Yong-Hwan
    • The Journal of Sustainable Design and Educational Environment Research
    • /
    • v.22 no.4
    • /
    • pp.1-8
    • /
    • 2023
  • The downsizing of schools is accelerating due to a rapid decline in the school-age population, and as the crisis over regional and school disappearance increases, the need for smaller schools to respond to future educational needs is increasing. Through flexible curricula and digital/artificial intelligence-based classroom teaching improvements, students' satisfaction with school life, student creativity and character development, improved academic achievement, and strengthened cooperative communication capabilities will be observed, and teachers' teaching and learning methods will change. Educational effects such as these are important, and transforming school facilities into future-oriented spaces, including school space innovation, is required to accomplish them. This study examined the future of education systems in small schools, focusing on analyzing the educational effects and awareness of the sustainability of spatial innovation, in terms of school space changes, school education correlation, and smart environment, to develop innovation projects in small schools. A desirable direction for implementation is presented.

Task offloading scheme based on the DRL of Connected Home using MEC (MEC를 활용한 커넥티드 홈의 DRL 기반 태스크 오프로딩 기법)

  • Ducsun Lim;Kyu-Seek Sohn
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.23 no.6
    • /
    • pp.61-67
    • /
    • 2023
  • The rise of 5G and the proliferation of smart devices have underscored the significance of multi-access edge computing (MEC). Amidst this trend, interest in effectively processing computation-intensive and latency-sensitive applications has increased. This study investigated a novel task offloading strategy considering the probabilistic MEC environment to address these challenges. Initially, we considered the frequency of dynamic task requests and the unstable conditions of wireless channels to propose a method for minimizing vehicle power consumption and latency. Subsequently, our research delved into a deep reinforcement learning (DRL) based offloading technique, offering a way to achieve equilibrium between local computation and offloading transmission power. We analyzed the power consumption and queuing latency of vehicles using the deep deterministic policy gradient (DDPG) and deep Q-network (DQN) techniques. Finally, we derived and validated the optimal performance enhancement strategy in a vehicle based MEC environment.

Analyzing Teachers' Educational Needs to Strengthen AI Convergence Education Capabilities (AI 융합교육 역량 강화를 위한 교사의 교육요구도 분석)

  • JaMee Kim;Yong Kim
    • Journal of Internet Computing and Services
    • /
    • v.24 no.5
    • /
    • pp.121-130
    • /
    • 2023
  • In the school field, AI convergence education is recommended, which utilizes AI in education to change the paradigm of society. This study was conducted to define the terms of AI and AI convergence education to minimize the confusion of terms and to analyze the educational needs of teachers from the perspective of conducting AI convergence education. To achieve the purpose, 19 experts' opinions were collected, and a self-administered questionnaire was administered to 125 secondary school teachers enrolled in the AI convergence major at the Graduate School of Education. As a result of the analysis, the experts defined AI convergence education as a methodology for problem solving, not AI-based or utilization education. In the analysis of teachers' educational needs, "AI and big data" was ranked first, followed by "AI convergence education methodology" and "learning practice using AI". The significance of this study is that it defined the terminology by collecting the opinions of experts amidst the confusion of various terms related to AI, and presented the educational direction of AI convergence education for in-service teachers.

A Study of Reinforcement Learning-based Cyber Attack Prediction using Network Attack Simulator (NASim) (네트워크 공격 시뮬레이터를 이용한 강화학습 기반 사이버 공격 예측 연구)

  • Bum-Sok Kim;Jung-Hyun Kim;Min-Suk Kim
    • Journal of the Semiconductor & Display Technology
    • /
    • v.22 no.3
    • /
    • pp.112-118
    • /
    • 2023
  • As technology advances, the need for enhanced preparedness against cyber-attacks becomes an increasingly critical problem. Therefore, it is imperative to consider various circumstances and to prepare for cyber-attack strategic technology. This paper proposes a method to solve network security problems by applying reinforcement learning to cyber-security. In general, traditional static cyber-security methods have difficulty effectively responding to modern dynamic attack patterns. To address this, we implement cyber-attack scenarios such as 'Tiny Alpha' and 'Small Alpha' and evaluate the performance of various reinforcement learning methods using Network Attack Simulator, which is a cyber-attack simulation environment based on the gymnasium (formerly Open AI gym) interface. In addition, we experimented with different RL algorithms such as value-based methods (Q-Learning, Deep-Q-Network, and Double Deep-Q-Network) and policy-based methods (Actor-Critic). As a result, we observed that value-based methods with discrete action spaces consistently outperformed policy-based methods with continuous action spaces, demonstrating a performance difference ranging from a minimum of 20.9% to a maximum of 53.2%. This result shows that the scheme not only suggests opportunities for enhancing cybersecurity strategies, but also indicates potential applications in cyber-security education and system validation across a large number of domains such as military, government, and corporate sectors.

  • PDF

A Technique for Accurate Detection of Container Attacks with eBPF and AdaBoost

  • Hyeonseok Shin;Minjung Jo;Hosang Yoo;Yongwon Lee;Byungchul Tak
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.6
    • /
    • pp.39-51
    • /
    • 2024
  • This paper proposes a novel approach to enhance the security of container-based systems by analyzing system calls to dynamically detect race conditions without modifying the kernel. Container escape attacks allow attackers to break out of a container's isolation and access other systems, utilizing vulnerabilities such as race conditions that can occur in parallel computing environments. To effectively detect and defend against such attacks, this study utilizes eBPF to observe system call patterns during attack attempts and employs a AdaBoost model to detect them. For this purpose, system calls invoked during the attacks such as Dirty COW and Dirty Cred from popular applications such as MongoDB, PostgreSQL, and Redis, were used as training data. The experimental results show that this method achieved a precision of 99.55%, a recall of 99.68%, and an F1-score of 99.62%, with the system overhead of 8%.