• Title/Summary/Keyword: Reliability of artificial intelligence

Search Result 177, Processing Time 0.025 seconds

A Study on the Quantitative Evaluation Method of Quality Control using Ultrasound Phantom in Ultrasound Imaging System based on Artificial Intelligence (인공지능을 활용한 초음파영상진단장치에서 초음파 팬텀 영상을 이용한 정도관리의 정량적 평가방법 연구)

  • Yeon Jin, Im;Ho Seong, Hwang;Dong Hyun, Kim;Ho Chul, Kim
    • Journal of Biomedical Engineering Research
    • /
    • v.43 no.6
    • /
    • pp.390-398
    • /
    • 2022
  • Ultrasound examination using ultrasound equipment is an ultrasound device that images human organs using sound waves and is used in various areas such as diagnosis, follow-up, and treatment of diseases. However, if the quality of ultrasound equipment is not guaranteed, the possibility of misdiagnosis increases, and the diagnosis rate decreases. Accordingly, The Korean Society of Radiology and Korea society of Ultrasound in Medicine presented guidelines for quality management of ultrasound equipment using ATS-539 phantom. The DenseNet201 classification algorithm shows 99.25% accuracy and 5.17% loss in the Dead Zone, 97.52% loss in Axial/Lateral Resolution, 96.98% accuracy and 20.64% loss in Sensitivity, 93.44% accuracy and 22.07% loss in the Gray scale and Dynamic Range. As a result, it is the best and is judged to be an algorithm that can be used for quantitative evaluation. Through this study, it can be seen that if quantitative evaluation using artificial intelligence is conducted in the qualitative evaluation item of ultrasonic equipment, the reliability of ultrasonic equipment can be increased with high accuracy.

Analysis of unfairness of artificial intelligence-based speaker identification technology (인공지능 기반 화자 식별 기술의 불공정성 분석)

  • Shin Na Yeon;Lee Jin Min;No Hyeon;Lee Il Gu
    • Convergence Security Journal
    • /
    • v.23 no.1
    • /
    • pp.27-33
    • /
    • 2023
  • Digitalization due to COVID-19 has rapidly developed artificial intelligence-based voice recognition technology. However, this technology causes unfair social problems, such as race and gender discrimination if datasets are biased against some groups, and degrades the reliability and security of artificial intelligence services. In this work, we compare and analyze accuracy-based unfairness in biased data environments using VGGNet (Visual Geometry Group Network), ResNet (Residual Neural Network), and MobileNet, which are representative CNN (Convolutional Neural Network) models of artificial intelligence. Experimental results show that ResNet34 showed the highest accuracy for women and men at 91% and 89.9%in Top1-accuracy, while ResNet18 showed the slightest accuracy difference between genders at 1.8%. The difference in accuracy between genders by model causes differences in service quality and unfair results between men and women when using the service.

Research on the evaluation model for the impact of AI services

  • Soonduck Yoo
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.15 no.3
    • /
    • pp.191-202
    • /
    • 2023
  • This study aims to propose a framework for evaluating the impact of artificial intelligence (AI) services, based on the concept of AI service impact. It also suggests a model for evaluating this impact and identifies relevant factors and measurement approaches for each item of the model. The study classifies the impact of AI services into five categories: ethics, safety and reliability, compliance, user rights, and environmental friendliness. It discusses these five categories from a broad perspective and provides 21 detailed factors for evaluating each category. In terms of ethics, the study introduces three additional factors-accessibility, openness, and fairness-to the ten items initially developed by KISDI. In the safety and reliability category, the study excludes factors such as dependability, policy, compliance, and awareness improvement as they can be better addressed from a technical perspective. The compliance category includes factors such as human rights protection, privacy protection, non-infringement, publicness, accountability, safety, transparency, policy compliance, and explainability.For the user rights category, the study excludes factors such as publicness, data management, policy compliance, awareness improvement, recoverability, openness, and accuracy. The environmental friendliness category encompasses diversity, publicness, dependability, transparency, awareness improvement, recoverability, and openness.This study lays the foundation for further related research and contributes to the establishment of relevant policies by establishing a model for evaluating the impact of AI services. Future research is required to assess the validity of the developed indicators and provide specific evaluation items for practical use, based on expert evaluations.

Implementation of Algorithm to Write Articles by Stock Robot

  • Sim, Da Hun;Shin, Seung Jung
    • International journal of advanced smart convergence
    • /
    • v.5 no.4
    • /
    • pp.40-47
    • /
    • 2016
  • Journalism robot by using a computer algorithm, while maintaining the precision and reliability of the existing media refers to an article which is automatically created. In this paper, we introduce 'stock robot' of robot journalism which writes securities articles and describe artificial intelligence algorithms in stages. Key steps of stock robot implemented artificial intelligence algorithm through four steps of data collection and storage, key event extraction, article content production, and article production. This research has developed a stock robot that collects and analyzes data on social issues and stock indexes for the last 2 years. In the future, as the algorithm is further developed, it becomes possible to write securities articles quickly and accurately through social issues. It will also provide customized information tailored to the user's preferences.

A Study on Factors Influencing AI Learning Continuity : Focused on Business Major Students

  • Park, So Hyun
    • The Journal of Information Systems
    • /
    • v.32 no.4
    • /
    • pp.189-210
    • /
    • 2023
  • Purpose This study aims to investigate factors that positively influence the continuous Artificial Intelligence(AI) Learning Continuity of business major students. Design/methodology/approach To evaluate the impact of AI education, a survey was conducted among 119 business-related majors who completed a software/AI course. Frequency analysis was employed to examine the general characteristics of the sample. Furthermore, factor analysis using Varimax rotation was conducted to validate the derived variables from the survey items, and Cronbach's α coefficient was used to measure the reliability of the variables. Findings Positive correlations were observed between business major students' AI Learning Continuity and their AI Interest, AI Awareness, and Data Analysis Capability related to their majors. Additionally, the study identified that AI Project Awareness and AI Literacy Capability play pivotal roles as mediators in fostering AI Learning Continuity. Students who acquired problem-solving skills and related technologies through AI Projects Awareness showed increased motivation for AI Learning Continuity. Lastly, AI Self-Efficacy significantly influences students' AI Learning Continuity.

Status and Implications of Policies on Intelligent Robotics in Major Countries (주요국의 지능로봇 정책 추진 현황과 시사점)

  • S.J. Koh
    • Electronics and Telecommunications Trends
    • /
    • v.39 no.3
    • /
    • pp.25-35
    • /
    • 2024
  • As artificial intelligence advances, major countries are actively promoting the use of intelligent robots to improve industrial productivity and enhance the quality of life. As robots become more capable of interacting with humans, they are being increasingly integrated into the human realm. Accordingly, major countries are actively implementing policies to lead intelligent robot technology and secure market leadership. We examine the status of policies related to intelligent robots in five countries: United States, China, Japan, Germany, and South Korea. These countries apply 1) government-led intelligent robot policies, 2) investments to secure core robot technologies and promote the convergence of artificial intelligence and robots, 3) programs for research and development on intelligent robots, 4) strengthened human-centered human-robot interaction and collaboration, and 5) ethics, stability, and reliability in the development and use of robot technologies. For Korea to compete with major countries and promote the intelligent robot industry, high-risk, high-performance innovation projects should be prioritized.

Determining the reliability of diagnosis and treatment using artificial intelligence software with panoramic radiographs

  • Kaan Orhan;Ceren Aktuna Belgin;David Manulis;Maria Golitsyna;Seval Bayrak;Secil Aksoy;Alex Sanders;Merve Onder;Matvey Ezhov;Mamat Shamshiev;Maxim Gusarev;Vladislav Shlenskii
    • Imaging Science in Dentistry
    • /
    • v.53 no.3
    • /
    • pp.199-207
    • /
    • 2023
  • Purpose: The objective of this study was to evaluate the accuracy and effectiveness of an artificial intelligence (AI) program in identifying dental conditions using panoramic radiographs(PRs), as well as to assess the appropriateness of its treatment recommendations. Materials and Methods: PRs from 100 patients(representing 4497 teeth) with known clinical examination findings were randomly selected from a university database. Three dentomaxillofacial radiologists and the Diagnocat AI software evaluated these PRs. The evaluations were focused on various dental conditions and treatments, including canal filling, caries, cast post and core, dental calculus, fillings, furcation lesions, implants, lack of interproximal tooth contact, open margins, overhangs, periapical lesions, periodontal bone loss, short fillings, voids in root fillings, overfillings, pontics, root fragments, impacted teeth, artificial crowns, missing teeth, and healthy teeth. Results: The AI demonstrated almost perfect agreement (exceeding 0.81) in most of the assessments when compared to the ground truth. The sensitivity was very high (above 0.8) for the evaluation of healthy teeth, artificial crowns, dental calculus, missing teeth, fillings, lack of interproximal contact, periodontal bone loss, and implants. However, the sensitivity was low for the assessment of caries, periapical lesions, pontic voids in the root canal, and overhangs. Conclusion: Despite the limitations of this study, the synthesized data suggest that AI-based decision support systems can serve as a valuable tool in detecting dental conditions, when used with PR for clinical dental applications.

A Study on the Development of Service Quality Scale in Traditional Market for Big Data Analysis

  • HWANG, Moon-Young
    • Korean Journal of Artificial Intelligence
    • /
    • v.7 no.1
    • /
    • pp.23-59
    • /
    • 2019
  • The purpose of this study is to develop a measure of service quality in the traditional market by examining previous research on the service quality of the traditional market studied so far. After defining basic concepts through definition of traditional market and existing studies, 5 categories of configuration items for SERVQUAL measurement in traditional market were made up based on existing researches related to definition of service quality and service quality of traditional market. A survey was conducted on the items that fit the intention of this study and various statistical analyzes were conducted. Statistical analysis was performed using SPSS 22.0 and AMOS 22.0. The reliability of the items was measured by the reliability test, and the predictability and accuracy of the items were examined. The validity of the measured variables was verified through confirmatory factor analysis. Reliability, empathy, responsiveness, certainty, and tangibility were the most important factors in this study. Responsiveness factors include communication, time reduction, real time, promptness. Assurance factors include the assurance of delivery, prompt answers, product knowledge items. Tangibility factors include, convenient device systems, location information, presence as a fact, and as a result, the latest modern items are adopted. The quality of service in the traditional market developed in this study was found to be good in reliability and validity test. Confirmatory factor analysis result using structural equation model also met the conformity index standard. If service satisfaction is measured based on this research, basic data can be presented to policy makers who implement policies on traditional markets to make the right decisions. In addition, it will be able to provide traditional market operators with operational strategy and marketing data. In the future, based on the traditional market service quality scale developed in this study, it is necessary to grasp the factors to be continuously managed to improve the service quality of the traditional market, user satisfaction, and intention to use.

Exploratory Analysis of AI-based Policy Decision-making Implementation

  • SunYoung SHIN
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.16 no.1
    • /
    • pp.203-214
    • /
    • 2024
  • This study seeks to provide implications for domestic-related policies through exploratory analysis research to support AI-based policy decision-making. The following should be considered when establishing an AI-based decision-making model in Korea. First, we need to understand the impact that the use of AI will have on policy and the service sector. The positive and negative impacts of AI use need to be better understood, guided by a public value perspective, and take into account the existence of different levels of governance and interests across public policy and service sectors. Second, reliability is essential for implementing innovative AI systems. In most organizations today, comprehensive AI model frameworks to enable and operationalize trust, accountability, and transparency are often insufficient or absent, with limited access to effective guidance, key practices, or government regulations. Third, the AI system is accountable. The OECD AI Principles set out five value-based principles for responsible management of trustworthy AI: inclusive growth, sustainable development and wellbeing, human-centered values and fairness values and fairness, transparency and explainability, robustness, security and safety, and accountability. Based on this, we need to build an AI-based decision-making system in Korea, and efforts should be made to build a system that can support policies by reflecting this. The limiting factor of this study is that it is an exploratory study of existing research data, and we would like to suggest future research plans by collecting opinions from experts in related fields. The expected effect of this study is analytical research on artificial intelligence-based decision-making systems, which will contribute to policy establishment and research in related fields.

Knowledge Extraction Methodology and Framework from Wikipedia Articles for Construction of Knowledge-Base (지식베이스 구축을 위한 한국어 위키피디아의 학습 기반 지식추출 방법론 및 플랫폼 연구)

  • Kim, JaeHun;Lee, Myungjin
    • Journal of Intelligence and Information Systems
    • /
    • v.25 no.1
    • /
    • pp.43-61
    • /
    • 2019
  • Development of technologies in artificial intelligence has been rapidly increasing with the Fourth Industrial Revolution, and researches related to AI have been actively conducted in a variety of fields such as autonomous vehicles, natural language processing, and robotics. These researches have been focused on solving cognitive problems such as learning and problem solving related to human intelligence from the 1950s. The field of artificial intelligence has achieved more technological advance than ever, due to recent interest in technology and research on various algorithms. The knowledge-based system is a sub-domain of artificial intelligence, and it aims to enable artificial intelligence agents to make decisions by using machine-readable and processible knowledge constructed from complex and informal human knowledge and rules in various fields. A knowledge base is used to optimize information collection, organization, and retrieval, and recently it is used with statistical artificial intelligence such as machine learning. Recently, the purpose of the knowledge base is to express, publish, and share knowledge on the web by describing and connecting web resources such as pages and data. These knowledge bases are used for intelligent processing in various fields of artificial intelligence such as question answering system of the smart speaker. However, building a useful knowledge base is a time-consuming task and still requires a lot of effort of the experts. In recent years, many kinds of research and technologies of knowledge based artificial intelligence use DBpedia that is one of the biggest knowledge base aiming to extract structured content from the various information of Wikipedia. DBpedia contains various information extracted from Wikipedia such as a title, categories, and links, but the most useful knowledge is from infobox of Wikipedia that presents a summary of some unifying aspect created by users. These knowledge are created by the mapping rule between infobox structures and DBpedia ontology schema defined in DBpedia Extraction Framework. In this way, DBpedia can expect high reliability in terms of accuracy of knowledge by using the method of generating knowledge from semi-structured infobox data created by users. However, since only about 50% of all wiki pages contain infobox in Korean Wikipedia, DBpedia has limitations in term of knowledge scalability. This paper proposes a method to extract knowledge from text documents according to the ontology schema using machine learning. In order to demonstrate the appropriateness of this method, we explain a knowledge extraction model according to the DBpedia ontology schema by learning Wikipedia infoboxes. Our knowledge extraction model consists of three steps, document classification as ontology classes, proper sentence classification to extract triples, and value selection and transformation into RDF triple structure. The structure of Wikipedia infobox are defined as infobox templates that provide standardized information across related articles, and DBpedia ontology schema can be mapped these infobox templates. Based on these mapping relations, we classify the input document according to infobox categories which means ontology classes. After determining the classification of the input document, we classify the appropriate sentence according to attributes belonging to the classification. Finally, we extract knowledge from sentences that are classified as appropriate, and we convert knowledge into a form of triples. In order to train models, we generated training data set from Wikipedia dump using a method to add BIO tags to sentences, so we trained about 200 classes and about 2,500 relations for extracting knowledge. Furthermore, we evaluated comparative experiments of CRF and Bi-LSTM-CRF for the knowledge extraction process. Through this proposed process, it is possible to utilize structured knowledge by extracting knowledge according to the ontology schema from text documents. In addition, this methodology can significantly reduce the effort of the experts to construct instances according to the ontology schema.