• Title/Summary/Keyword: Meta-Learning

Search Result 328, Processing Time 0.022 seconds

A Survey on Open Source based Large Language Models (오픈 소스 기반의 거대 언어 모델 연구 동향: 서베이)

  • Ha-Young Joo;Hyeontaek Oh;Jinhong Yang
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.16 no.4
    • /
    • pp.193-202
    • /
    • 2023
  • In recent years, the outstanding performance of large language models (LLMs) trained on extensive datasets has become a hot topic. Since studies on LLMs are available on open-source approaches, the ecosystem is expanding rapidly. Models that are task-specific, lightweight, and high-performing are being actively disseminated using additional training techniques using pre-trained LLMs as foundation models. On the other hand, the performance of LLMs for Korean is subpar because English comprises a significant proportion of the training dataset of existing LLMs. Therefore, research is being carried out on Korean-specific LLMs that allow for further learning with Korean language data. This paper identifies trends of open source based LLMs and introduces research on Korean specific large language models; moreover, the applications and limitations of large language models are described.

Comparison of Fire Detection Performance according to the Number of Bounding Boxes for YOLOv5 (YOLOv5 학습 시 바운딩 박스 개수에 따른 화재 탐지 성능 비교)

  • Sung, YoungA;Yi, Hyoun-Sup;Jang, Si-Woong
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.10a
    • /
    • pp.50-53
    • /
    • 2022
  • In order to detect an object in yolv5, a process of annotating location information on an existing image is required when learning an image. The most representative method is to draw a bounding box on an image to store location information as meta information. However, if the boundary of the object is ambiguous, it will be difficult to make a bounding box. A representative example would be to classify parts that are not fire and parts that are fire. Therefore, in this paper, images of 100 samples judged to have caught fire were learned by varying the number of boxes. The results showed better fire detection performance in the model where the bounding box was trained by annotating it with three boxes by segmenting it slightly more than annotating it with one box by holding the edge as large as possible during annotating it with one box.

  • PDF

Meta-heuristic optimization algorithms for prediction of fly-rock in the blasting operation of open-pit mines

  • Mahmoodzadeh, Arsalan;Nejati, Hamid Reza;Mohammadi, Mokhtar;Ibrahim, Hawkar Hashim;Rashidi, Shima;Mohammed, Adil Hussein
    • Geomechanics and Engineering
    • /
    • v.30 no.6
    • /
    • pp.489-502
    • /
    • 2022
  • In this study, a Gaussian process regression (GPR) model as well as six GPR-based metaheuristic optimization models, including GPR-PSO, GPR-GWO, GPR-MVO, GPR-MFO, GPR-SCA, and GPR-SSO, were developed to predict fly-rock distance in the blasting operation of open pit mines. These models included GPR-SCA, GPR-SSO, GPR-MVO, and GPR. In the models that were obtained from the Soungun copper mine in Iran, a total of 300 datasets were used. These datasets included six input parameters and one output parameter (fly-rock). In order to conduct the assessment of the prediction outcomes, many statistical evaluation indices were used. In the end, it was determined that the performance prediction of the ML models to predict the fly-rock from high to low is GPR-PSO, GPR-GWO, GPR-MVO, GPR-MFO, GPR-SCA, GPR-SSO, and GPR with ranking scores of 66, 60, 54, 46, 43, 38, and 30 (for 5-fold method), respectively. These scores correspond in conclusion, the GPR-PSO model generated the most accurate findings, hence it was suggested that this model be used to forecast the fly-rock. In addition, the mutual information test, also known as MIT, was used in order to investigate the influence that each input parameter had on the fly-rock. In the end, it was determined that the stemming (T) parameter was the most effective of all the parameters on the fly-rock.

An Overview on Importance of Writing in Mathematics Education (수학교육에서 글쓰기의 중요성에 관한 소고)

  • Kim, Jeonghyeon;Choi-Koh, Sangsook
    • Communications of Mathematical Education
    • /
    • v.37 no.4
    • /
    • pp.591-614
    • /
    • 2023
  • For a long time, mathematics education institutions such as NCTM(National Council of Teachers of Mathematics) have emphasized the essential role of writing, and recent surveys by the Ministry of Education report a decline in foundational academic skills in the post-COVID19 period. The purpose of this study is to redefine the significance of mathematics writing in mathematics education, focusing on competencies highlighted in the field, particularly in the areas of problem-solving, communication, and reasoning. The research findings indicate that writing in problem-solving enhances cognitive organization, fostering the ability to grasp concepts and methods. Writing in communication builds confidence through the meta-cognitive process, and writing in inference allows self-awareness of step-by-step identification of areas lacking understanding. Particularly in the future society where artificial intelligence(AI) is utilized, changes in the learning environment necessitate research for the establishment of authenticity judgment through writing and the cultivation of a proper writing culture.

A Bibliometric Analysis of Global Research Trends in Digital Therapeutics (디지털 치료기기의 글로벌 연구 동향에 대한 계량서지학적 분석)

  • Dae Jin Kim;Hyeon Su Kim;Byung Gwan Kim;Ki Chang Nam
    • Journal of Biomedical Engineering Research
    • /
    • v.45 no.4
    • /
    • pp.162-172
    • /
    • 2024
  • To analyse the overall research trends in digital therapeutics, this study conducted a quantitative bibliometric analysis of articles published in the last 10 years from 2014 to 2023. We extracted bibliographic information of studies related to digital therapeutics from the Web of Science (WOS) database and performed publication status, citation analysis and keyword analysis using R (version 4.3.1) and VOSviewer (version 1.6.18) software. A total of 1,114 articles were included in the study, and the annual publication growth rate for digital therapeutics was 66.1%, a very rapid increase. "health" is the most used keyword based on Keyword Plus, and "cognitive-behavioral therapy", "depression", "healthcare", "mental-health", "meta-analysis" and "randomized controlled-trial" are the research keywords that have driven the development and impact of digital therapeutic devices over the long term. A total of five clusters were observed in the co-occurrence network analysis, with new research keywords such as "artificial intelligence", "machine learning" and "regulation" being observed in recent years. In our analysis of research trends in digital therapeutics, keywords related to mental health, such as depression, anxiety, and disorder, were the top keywords by occurrences and total link strength. While many studies have shown the positive effects of digital therapeutics, low engagement and high dropout rates remain a concern, and much research is being done to evaluate and improve them. Future studies should expand the search terms to ensure the representativeness of the results.

The Change in Modeling Ability of Science-Gifted Students through the Co-construction of Scientific Model (과학적 모델의 사회적 구성 수업을 통한 과학 영재 학생들의 모델링 능력 변화)

  • Park, Hee-Kyung;Choi, Jong-Rim;Kim, Chan-Jong;Kim, Heui-Baik;Yoo, Junehee;Jang, Shinho;Choe, Seung-Urn
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.1
    • /
    • pp.15-28
    • /
    • 2016
  • The purpose of this study is to investigate the changes of students' modeling ability in terms of 'meta-modeling knowledge' and 'modeling practice' through co-construction of scientific model. Co-construction of scientific model instructions about astronomy were given to 41 middle-school students. The students were given a before and after instruction modeling ability tests. The results show that students' 'meta-modeling knowledge' has changed into a more scientifically advanced thinking about models and modeling after the instruction. Students were able to be aware that 'they could express their thoughts using models', 'many models could be used to explain a single phenomena' and 'scientific models may change' through co-construction modeling process. The change in the 'modeling practice' of the students was divided into four cases (the level improving, the level lowering, the high-level maintaining, the low-level maintaining) depending on the change of pre-posttest levels. The modeling practice level of most students has improved through the instruction. These changes were influenced by co-construction process that provides opportunities to compete and compare their models to other models. Meanwhile, the modeling practice level of few students has lowered or maintained low level. Science score of these students at school was relatively high and they thought that the goal of learning is to get a higher score in exams by finding the correct answer. This means that students who were kept well under traditional instruction may feel harder to adapt to co-construction of scientific model instruction, which focuses more on the process of constructing knowledge based on evidences.

Influence of Motivational, Social, and Environmental Factors on the Learning of Hackers (동기적, 사회적, 그리고 환경적 요인이 해커의 기술 습득에 미치는 영향)

  • Jang, Jaeyoung;Kim, Beomsoo
    • Information Systems Review
    • /
    • v.18 no.1
    • /
    • pp.57-78
    • /
    • 2016
  • Hacking has raised many critical issues in the modern world, particularly because the size and cost of the damages caused by this disruptive activity have steadily increased. Accordingly, many significant studies have been conducted by behavioral scientists to understand hackers and their practices. Nonetheless, only qualitative methods, such as interviews, meta-studies, and media studies, have been employed in such studies because of hacker sampling limitations. Existing studies have determined that intrinsic motivation was the dominant factor influencing hackers, and that their techniques were mainly acquired from online hacking communities. However, such results have yet to be causally proven. This study attempted to identify the causal factors influencing the motivational and environmental factors encouraging hackers to learn hacking skills. To this end, hacker community members using the theory of planned behavior were observed to identify the causal factors of their learning of hacking skills. We selected a group of students who were developing their hacking skills. The survey was conducted over a two-week period in May 2015 with a total of 227 students as respondents. After list-wise deletion, 215 of the responses were deemed usable (94.7 percent). In summary, the hackers were aware that hacking skills are considered socially unethical, and their attitudes toward the learning of hacking skills were affected by both intrinsic and extrinsic motivations. In addition, the characteristics of the online hacking community affected their perceived behavioral control. This study introduced new concepts in the process of conducting a causal relationship analysis on a hacker sample. Moreover, this research expanded the discussion on the causal direction of subjective norms in unethical research, and empirically confirmed that both intrinsic and extrinsic motivations affect the learning of hacking skills. This study also made a practical contribution by raising the educational and policy response issues for ethical hackers and demonstrating the necessity to intensify the punishment for hacking.

A Research in Applying Big Data and Artificial Intelligence on Defense Metadata using Multi Repository Meta-Data Management (MRMM) (국방 빅데이터/인공지능 활성화를 위한 다중메타데이터 저장소 관리시스템(MRMM) 기술 연구)

  • Shin, Philip Wootaek;Lee, Jinhee;Kim, Jeongwoo;Shin, Dongsun;Lee, Youngsang;Hwang, Seung Ho
    • Journal of Internet Computing and Services
    • /
    • v.21 no.1
    • /
    • pp.169-178
    • /
    • 2020
  • The reductions of troops/human resources, and improvement in combat power have made Korean Department of Defense actively adapt 4th Industrial Revolution technology (Artificial Intelligence, Big Data). The defense information system has been developed in various ways according to the task and the uniqueness of each military. In order to take full advantage of the 4th Industrial Revolution technology, it is necessary to improve the closed defense datamanagement system.However, the establishment and usage of data standards in all information systems for the utilization of defense big data and artificial intelligence has limitations due to security issues, business characteristics of each military, anddifficulty in standardizing large-scale systems. Based on the interworking requirements of each system, data sharing is limited through direct linkage through interoperability agreement between systems. In order to implement smart defense using the 4th Industrial Revolution technology, it is urgent to prepare a system that can share defense data and make good use of it. To technically support the defense, it is critical to develop Multi Repository Meta-Data Management (MRMM) that supports systematic standard management of defense data that manages enterprise standard and standard mapping for each system and promotes data interoperability through linkage between standards which obeys the Defense Interoperability Management Development Guidelines. We introduced MRMM, and implemented by using vocabulary similarity using machine learning and statistical approach. Based on MRMM, We expect to simplify the standardization integration of all military databases using artificial intelligence and bigdata. This will lead to huge reduction of defense budget while increasing combat power for implementing smart defense.

Investigating the Cognitive Process of a Student's Modeling on a Modeling-Emphasized Argument-Based General Chemistry Experiment (모델링을 강조한 논의 기반 일반화학실험에서 학생들의 모델링에 대한 인지과정 탐색)

  • Lee, Dongwon;Cho, Hey Sook;Nam, Jeonghee
    • Journal of The Korean Association For Science Education
    • /
    • v.35 no.2
    • /
    • pp.313-323
    • /
    • 2015
  • The purpose of this study is to investigate the cognitive process of student's modeling on a modeling-emphasized argument-based general chemistry experiment. The participants were twenty-one freshman students. Six topics were carried out during the first semester and semi-structured interview was implemented at the end of the semester. Semi-structured interview questions were used to elicit elements of effective model, modeling strategies, difficulties that students have experienced during modeling, and resolving the difficulties that students have experienced during modeling. All student interview data were collected and transcribed. The results of this study are summarized as follows: (1) Elements of effective model were considered to be visual expression, persuasive explanation, and rhetorical structure. (2) Modeling strategies included arranging important keywords or writing the outline, and during the modeling process, students used various data, suggested data after reconstructing, suggested definitions and explanations of core concepts, used meta-cognition, and considering rhetorical structure. (3) Difficulties students have experienced during modeling could be categorized as lack of modeling strategy and understanding. (4) Resolving difficulties students have experienced during modeling could be categorized as modeling strategy and understanding. Students learn the strategy by feedback, modeling experience, evaluation of experimental report, models which they constructed previously and references, and the understanding of contents were achieved through arguments which occurred during classes and during the process of writing the experimental reports. These results suggest that when using modeling in teaching and learning, the argument-based learning strategy can be effective in enhancing students' modeling by helping them to understand meta-modeling with scientific concepts.

A Study on the Development of Pedagogical Content Knowledge on Fraction in the Elementary School Mathematics (초등수학에서 분수에 관한 교수학적 내용 지식 개발 연구)

  • Lee, Dae-Hyun
    • Journal of the Korean School Mathematics Society
    • /
    • v.10 no.2
    • /
    • pp.149-171
    • /
    • 2007
  • This study is aimed at development of pedagogical content knowledge on fraction in the elementary school mathematics. Elementary students regard fraction as the difficult topic in school mathematics. Furthermore, fraction is the fundamentally important concept in studying mathematics. So it is important to develop the pedagogical content knowledge on fraction. The reason of attention to the pedagogical content knowledge is that improving the quality of teaching is the central focus of a high quality mathematics education. Shulman suggested that various knowledges are required for teacher to improve their classes. Of course, pedagogical content knowledge is the most valuable in teaching mathematics. Pedagogical content knowledge is related to the promotion of students' understanding about the learning. Pedagogical content knowledges are categorized by five factors in this study. These are understanding about curriculum, understanding about students and students' knowledge, understanding about teachers and teachers' knowledge, understanding about the methods, contents, and management of class, and understanding about methods of assessments. I develop the pedagogical content knowledge on fraction according to the these categories. I concentrate on the two types of pedagogical content knowledges in developing. That is, I present knowledges which teachers have to know for teaching fraction effectively and materials which teachers can use during the teaching fraction. Pedagogical content knowledges guarantee teachers as the professionalists. Teachers should not teach only content knowledges but teach various knowledges including the meta-knowledges which have relation to fraction.

  • PDF