• 제목/요약/키워드: On-Device AI

검색결과 158건 처리시간 0.023초

Comparison of On-Device AI Software Tools

  • Song, Hong-Jong
    • International Journal of Advanced Culture Technology
    • /
    • 제10권2호
    • /
    • pp.246-251
    • /
    • 2022
  • As the number of data and devices explodes, centralized data processing and AI analysis have limitations due to the load on the network and cloud. On-device AI technology can provide intelligent services without overloading the network and cloud because the device itself performs AI models. Accordingly, the need for on-device AI technology is emerging. Many smartphones are equipped with On-Device AI technology to support the use of related functions. In this paper, we compare software tools that implement On-Device AI.

IoT 온디바이스 AI 실현을 위한 AI 모델 레포지토리 (AI Model Repository for Realizing IoT On-device AI)

  • 이석준;최충재;성낙명
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2022년도 추계학술대회
    • /
    • pp.597-599
    • /
    • 2022
  • IoT 디바이스에서 on-device AI를 수행할 때, 타겟 서비스나 디바이스의 환경에 따라 필요한 AI 모델이 달라질 수 있다. 또한, 기존 AI 모델도 federated learning과 같이 추가적인 데이터를 이용해 트레이닝을 하거나 보다 향상된 새로운 기법을 사용하는 등 업데이트가 일어날 수 있다. 이에 따라 IoT 디바이스에서 양질의 AI 서비스를 수행하기 위해서는 상황에 따라 필요한 AI 모델을 선택적으로 사용하거나 최적화된 최신 버전의 AI 모델로 업데이트 할 수 있어야 한다. 본 논문에서는 이를 지원하기 위한 AI 모델 레포지토리를 제안한다. 레포지토리는 AI 모델의 등록, 검색, 관리 및 배포를 지원하며 실사용을 위한 웹 포털을 포함한다. 제안하는 시스템의 실효성 확인을 위해 Node.js와 Vue.js로 구현하여 동작을 확인하였다.

  • PDF

온디바이스 AI 비전 모델이 탑재된 지능형 엣지 컴퓨팅 기기 개발 (Development of an intelligent edge computing device equipped with on-device AI vision model)

  • 강남희
    • 한국인터넷방송통신학회논문지
    • /
    • 제22권5호
    • /
    • pp.17-22
    • /
    • 2022
  • 본 논문에서는 지능형 엣지 컴퓨팅을 지원할 수 있는 경량 임베디드 기기를 설계하고, 영상 기기로부터 입력되는 이미지에서 객체를 실시간으로 빠르게 검출할 수 있음을 보인다. 제안하는 시스템은 산업 현장이나 군 지역과 같이 사전에 설치된 인프라가 없는 환경에 적용되는 지능형 영상 관제 시스템이나 드론과 같은 자율이동체에 탑재된 영상 보안 시스템에 적용될 수 있다. 지능형 비전 인지 시스템이 확산 적용되기 위해 온디바이스 AI(On-Device Artificial intelligence) 기술 적용 필요성이 증대되고 있다. 영상 데이터 취득 장치에서 가까운 엣지 기기로의 컴퓨팅 오프 로딩은 클라우드를 중심으로 수행되는 인공지능 서비스 대비 적은 네트워크 및 시스템 자원으로도 빠른 서비스 제공이 가능하다. 또한, 다양한 해킹 공격에 취약한 공격 표면의 감소와 민감한 데이터의 유출을 최소화 할 수 있어 다양한 산업에 안전하게 적용될 수 있을것으로 기대된다.

지능형 엣지 컴퓨팅 기기를 위한 온디바이스 AI 비전 모델의 경량화 방식 분석 (Analysis on Lightweight Methods of On-Device AI Vision Model for Intelligent Edge Computing Devices)

  • 주혜현;강남희
    • 한국인터넷방송통신학회논문지
    • /
    • 제24권1호
    • /
    • pp.1-8
    • /
    • 2024
  • 실시간 처리 및 프라이버시 강화를 위해 인공지능 모델을 엣지에서 동작시킬 수 있는 온디바이스 AI 기술이 각광받고 있다. 지능형 사물인터넷 기술이 다양한 산업에 적용되면서 온디바이스 AI 기술을 활용한 서비스가 크게 증가하고 있다. 그러나 일반적인 딥러닝 모델은 추론 및 학습을 위해 많은 연산 자원을 요구하고 있다. 따라서 엣지에 적용되는 경량 기기에서 딥러닝 모델을 동작시키기 위해 양자화나 가지치기와 같은 다양한 경량화 기법들이 적용되어야 한다. 본 논문에서는 다양한 경량화 기법 중 가지치기 기술을 중심으로 엣지 컴퓨팅 기기에서 딥러닝 모델을 경량화하여 적용할 수 있는 방안을 분석한다. 특히, 동적 및 정적 가지치기 기법을 적용하여 경량화된 비전 모델의 추론 속도, 정확도 그리고 메모리 사용량을 시험한다. 논문에서 분석된 내용은 실시간 특성이 중요한 지능형 영상 관제 시스템이나 자율 이동체의 영상 보안 시스템에 적용될 수 있다. 또한 사물인터넷 기술이 적용되는 다양한 서비스와 산업에 더욱 효과적으로 활용될 수 있을 것으로 기대된다.

Key Principles of Clinical Validation, Device Approval, and Insurance Coverage Decisions of Artificial Intelligence

  • Seong Ho Park;Jaesoon Choi;Jeong-Sik Byeon
    • Korean Journal of Radiology
    • /
    • 제22권3호
    • /
    • pp.442-453
    • /
    • 2021
  • Artificial intelligence (AI) will likely affect various fields of medicine. This article aims to explain the fundamental principles of clinical validation, device approval, and insurance coverage decisions of AI algorithms for medical diagnosis and prediction. Discrimination accuracy of AI algorithms is often evaluated with the Dice similarity coefficient, sensitivity, specificity, and traditional or free-response receiver operating characteristic curves. Calibration accuracy should also be assessed, especially for algorithms that provide probabilities to users. As current AI algorithms have limited generalizability to real-world practice, clinical validation of AI should put it to proper external testing and assisting roles. External testing could adopt diagnostic case-control or diagnostic cohort designs. A diagnostic case-control study evaluates the technical validity/accuracy of AI while the latter tests the clinical validity/accuracy of AI in samples representing target patients in real-world clinical scenarios. Ultimate clinical validation of AI requires evaluations of its impact on patient outcomes, referred to as clinical utility, and for which randomized clinical trials are ideal. Device approval of AI is typically granted with proof of technical validity/accuracy and thus does not intend to directly indicate if AI is beneficial for patient care or if it improves patient outcomes. Neither can it categorically address the issue of limited generalizability of AI. After achieving device approval, it is up to medical professionals to determine if the approved AI algorithms are beneficial for real-world patient care. Insurance coverage decisions generally require a demonstration of clinical utility that the use of AI has improved patient outcomes.

An Edge AI Device based Intelligent Transportation System

  • Jeong, Youngwoo;Oh, Hyun Woo;Kim, Soohee;Lee, Seung Eun
    • Journal of information and communication convergence engineering
    • /
    • 제20권3호
    • /
    • pp.166-173
    • /
    • 2022
  • Recently, studies have been conducted on intelligent transportation systems (ITS) that provide safety and convenience to humans. Systems that compose the ITS adopt architectures that applied the cloud computing which consists of a high-performance general-purpose processor or graphics processing unit. However, an architecture that only used the cloud computing requires a high network bandwidth and consumes much power. Therefore, applying edge computing to ITS is essential for solving these problems. In this paper, we propose an edge artificial intelligence (AI) device based ITS. Edge AI which is applicable to various systems in ITS has been applied to license plate recognition. We implemented edge AI on a field-programmable gate array (FPGA). The accuracy of the edge AI for license plate recognition was 0.94. Finally, we synthesized the edge AI logic with Magnachip/Hynix 180nm CMOS technology and the power consumption measured using the Synopsys's design compiler tool was 482.583mW.

연속학습을 활용한 경량 온-디바이스 AI 기반 실시간 기계 결함 진단 시스템 설계 및 구현 (Design and Implementation of a Lightweight On-Device AI-Based Real-time Fault Diagnosis System using Continual Learning)

  • 김영준;김태완;김수현;이성재;김태현
    • 대한임베디드공학회논문지
    • /
    • 제19권3호
    • /
    • pp.151-158
    • /
    • 2024
  • Although on-device artificial intelligence (AI) has gained attention to diagnosing machine faults in real time, most previous studies did not consider the model retraining and redeployment processes that must be performed in real-world industrial environments. Our study addresses this challenge by proposing an on-device AI-based real-time machine fault diagnosis system that utilizes continual learning. Our proposed system includes a lightweight convolutional neural network (CNN) model, a continual learning algorithm, and a real-time monitoring service. First, we developed a lightweight 1D CNN model to reduce the cost of model deployment and enable real-time inference on the target edge device with limited computing resources. We then compared the performance of five continual learning algorithms with three public bearing fault datasets and selected the most effective algorithm for our system. Finally, we implemented a real-time monitoring service using an open-source data visualization framework. In the performance comparison results between continual learning algorithms, we found that the replay-based algorithms outperformed the regularization-based algorithms, and the experience replay (ER) algorithm had the best diagnostic accuracy. We further tuned the number and length of data samples used for a memory buffer of the ER algorithm to maximize its performance. We confirmed that the performance of the ER algorithm becomes higher when a longer data length is used. Consequently, the proposed system showed an accuracy of 98.7%, while only 16.5% of the previous data was stored in memory buffer. Our lightweight CNN model was also able to diagnose a fault type of one data sample within 3.76 ms on the Raspberry Pi 4B device.

Effect of Using Progesterone Releasing Intravaginal Device with Ovsynch Program on Reproduction in Dairy Cattle during Summer Season

  • Alnimer, M.;Lubbadeh, W.
    • Asian-Australasian Journal of Animal Sciences
    • /
    • 제16권9호
    • /
    • pp.1268-1273
    • /
    • 2003
  • Sixty postpartum lactating Friesian cows in 3 treatments at a commercial dairy farm were used to study the effect of using progesterone supplementation with GnRH and PGF2$\alpha$ synchronization with and without timed AI on fertility during summer. Cows in treatment1($Tr_1$) and treatment2 ($Tr_1$) were fitted with progesterone releasing intravaginal device (PRID) device and injected with 10 g GnRH agonist on $51{\pm}3$ d postpartum (pp). Seven days later, PRID was removed and cows received 25 mg PGF2$\alpha$. Two days later, $Tr_1$ cows received another injection of 10 g GnRH and timed AI 16-20 h later. Control cows received only 25 mg PGF2$\alpha$ $58{\pm}3d\;pp$. $Tr_2$ and control cows were AI at detected estrus. Serum progesterone for all cows was determined on days of injection, AI and 21, 23 and 28 d postinsemination. Pregnancy rates from first AI based on serum P4 concentrations on d 21, 23 and 28 postinsemination (50, 40 and 35%) and that based on rectal palpation 40-45 d postinsemination (30, 15 and 15% for $Tr_1$, $Tr_2$ and control cows, respectively) did not differ among the three groups. Whereas, pregnancy rate at 120 d pp for $Tr_1$ (65%) was higher (p<0.05) than that in $Tr_2$ (30%) or control (30%). The overall pregnancy rate was not significantly different (90, 90 and 75% for $Tr_1$, $Tr_2$ and control, respectively). Days open for cows in $Tr_1$ ($100.3{\pm}9$) was less (p<0.03) than that in $Tr_2$ ($130.9{\pm}9$) or control ($135.1{\pm}10$). Results indicate that using PRID device with Ovsynch program had significantly increased pregnancy rate and decreased days open compared to AI at detected estrus after synchronization with GnRH, PRID and PGF2$\alpha$ or synchronization with one injection of PGF2$\alpha$.

SaMD에 대한 휴리스틱 기반 사용적합성 평가 가이드라인 개발 (Development of Guideline for Heuristic Based Usability Evaluation on SaMD)

  • 김종엽;김정현;김재호;정명진
    • 대한의용생체공학회:의공학회지
    • /
    • 제44권6호
    • /
    • pp.428-442
    • /
    • 2023
  • In this study, we have a goal to develop usability evaluation guidelines for heuristic-based artificial intelligence-based Software as a Medical Device (SaMD) in the medical field. We conducted a gap analysis between medical hardware (H/W) and non-medical software (S/W) based on ten heuristic principles. Through severity assessments, we identified 69 evaluation domains and 112 evaluation criteria aligned with the ten heuristic principles. Subsequently, we categorized each evaluation domain into five types, including user safety, data integrity, regulatory compliance, patient therapeutic effectiveness, and user convenience. We proposed usability evaluation guidelines that apply the newly derived heuristic-based Software as a Medical Device (SaMD) evaluation factors to the risk management process. In the discussion, we also have proposed the potential applications of the research findings and directions for future research. We have emphasized the importance of the judicious application of AI technology in the medical field and the evaluation of usability evaluation and offered valuable guidelines for various stakeholders, including medical device manufacturers, healthcare professionals, and regulatory authorities.

A Comparative Study of Methods of Measurement of Peripheral Pulse Waveform

  • Kang, Hee-Jung;Lee, Yong-Heum;Kim, Kyung-Chul;Han, Chang-Ho
    • 대한한의학회지
    • /
    • 제30권3호
    • /
    • pp.98-105
    • /
    • 2009
  • Objective: Increased aortic and carotid arterial augmentation index (AI) is associated with the risk of cardiovascular disease. The most widely used approach for determining central arterial AI is by calculating the aortic pressure waveform from radial arterial waveforms using a transfer function. But how the change of waveform by applied pressure and the pattern of the change rely on subject's characteristics has not been recognized. In this study, we use a new method for measuring radial waveform and observe the change of waveform and the deviation of radial AI in the same position by applied pressure. Method: Forty-six non-patient volunteers (31 men and 15 women, age range 21-58 years) were enrolled for this study. Informed consent in a form approved by the institutional review board was obtained in all subjects. Blood pressure was measured on the left upper arm using an oscillometric method, radial pressure waves were recorded with the use of an improved automated tonometry device. DMP-3000(DAEYOMEDI Co., Ltd. Ansan, Korea) has robotics mechanism to scan and trace automatically. For each subject, we performed the procedure 5 times for each applied pressure level. We could thus obtain 5 different radial pulse waveforms for the same person's same position at different applied pressures. All these processes were repeated twice for test reproducibility. Result: Aortic AI, peripheral AI and radial AI were higher in women than in men (P<0.01), radial AI strongly correlated with aortic AI, and radial AI was consistently approximately 39% higher than aortic AI. Relationship between representative radial AI of DMP-3000 and peripheral AI of SphygmoCor had strongly correlation. And there were three patterns in change of pulse waveform. Conclusion: In this study, it is revealed the new device was sufficient to measure how radial AI and radial waveform from the same person at the same time change under applied pressure and it had inverse-proportion to applied pressure.

  • PDF