• 제목/요약/키워드: Inference Systems

검색결과 988건 처리시간 0.027초

Collaborative Inference for Deep Neural Networks in Edge Environments

  • Meizhao Liu;Yingcheng Gu;Sen Dong;Liu Wei;Kai Liu;Yuting Yan;Yu Song;Huanyu Cheng;Lei Tang;Sheng Zhang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제18권7호
    • /
    • pp.1749-1773
    • /
    • 2024
  • Recent advances in deep neural networks (DNNs) have greatly improved the accuracy and universality of various intelligent applications, at the expense of increasing model size and computational demand. Since the resources of end devices are often too limited to deploy a complete DNN model, offloading DNN inference tasks to cloud servers is a common approach to meet this gap. However, due to the limited bandwidth of WAN and the long distance between end devices and cloud servers, this approach may lead to significant data transmission latency. Therefore, device-edge collaborative inference has emerged as a promising paradigm to accelerate the execution of DNN inference tasks where DNN models are partitioned to be sequentially executed in both end devices and edge servers. Nevertheless, collaborative inference in heterogeneous edge environments with multiple edge servers, end devices and DNN tasks has been overlooked in previous research. To fill this gap, we investigate the optimization problem of collaborative inference in a heterogeneous system and propose a scheme CIS, i.e., collaborative inference scheme, which jointly combines DNN partition, task offloading and scheduling to reduce the average weighted inference latency. CIS decomposes the problem into three parts to achieve the optimal average weighted inference latency. In addition, we build a prototype that implements CIS and conducts extensive experiments to demonstrate the scheme's effectiveness and efficiency. Experiments show that CIS reduces 29% to 71% on the average weighted inference latency compared to the other four existing schemes.

A Multi-Resolution Radial Basis Function Network for Self-Organization, Defuzzification, and Inference in Fuzzy Rule-Based Systems

  • Lee, Suk-Han
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1995년도 추계학술대회 95 KFIS Workshop Realization of Human Friendly System Based on Soft Computiong Techniques
    • /
    • pp.124-140
    • /
    • 1995
  • The merit of fuzzy rule based systems stems from their capability of encoding qualitative knowledge of experts into quantitative rules. Recent advancement in automatic tuning or self-organization of fuzzy rules from experimental data further enhances their power, allowing the integration of the top-down encoding of knowledge with the bottom-up learning of rules. In this paper, methods of self-organizing fuzzy rules and of performing defuzzification and inference is presented based on a multi-resolution radial basis function network. The network learns an arbitrary input-output mapping from sample distribution as the union of hyper-ellipsoidal clusters of various locations, sizes and shapes. The hyper-ellipsoidal clusters, representing fuzzy rules, are self-organized based of global competition in such a way as to ensute uniform mapping errors. The cooperative interpolation among the multiple clusters associated with a mapping allows the network to perform a bidirectional many-to-many mapping, representing a particular from of defuzzification. Finally, an inference engine is constructed for the network to search for an optimal chain of rules or situation transitions under the constraint of transition feasibilities imposed by the learned mapping. Applications of the proposed network to skill acquisition are shown.

  • PDF

Neuro-fuzzy based prediction of the durability of self-consolidating concrete to various sodium sulfate exposure regimes

  • Bassuoni, M.T.;Nehdi, M.L.
    • Computers and Concrete
    • /
    • 제5권6호
    • /
    • pp.573-597
    • /
    • 2008
  • Among artificial intelligence-based computational techniques, adaptive neuro-fuzzy inference systems (ANFIS) are particularly suitable for modelling complex systems with known input-output data sets. Such systems can be efficient in modelling non-linear, complex and ambiguous behaviour of cement-based materials undergoing single, dual or multiple damage factors of different forms (chemical, physical and structural). Due to the well-known complexity of sulfate attack on cement-based materials, the current work investigates the use of ANFIS to model the behaviour of a wide range of self-consolidating concrete (SCC) mixture designs under various high-concentration sodium sulfate exposure regimes including full immersion, wetting-drying, partial immersion, freezing-thawing, and cyclic cold-hot conditions with or without sustained flexural loading. Three ANFIS models have been developed to predict the expansion, reduction in elastic dynamic modulus, and starting time of failure of the tested SCC specimens under the various high-concentration sodium sulfate exposure regimes. A fuzzy inference system was also developed to predict the level of aggression of environmental conditions associated with very severe sodium sulfate attack based on temperature, relative humidity and degree of wetting-drying. The results show that predictions of the ANFIS and fuzzy inference systems were rational and accurate, with errors not exceeding 5%. Sensitivity analyses showed that the trends of results given by the models had good agreement with actual experimental results and with thermal, mineralogical and micro-analytical studies.

동적지식도와 관계형 데이터베이스 기반의 의료영역 지식 개념화 (Dynamic Knowledge Map and RDB-based Knowledge Conceptualization in Medical Arena)

  • Kim, Jin-Sung
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2004년도 춘계학술대회 학술발표 논문집 제14권 제1호
    • /
    • pp.111-114
    • /
    • 2004
  • Management of human knowledge is an interesting concept that has attracted the attention of philosophers for thousands of years. Artificial intelligence and knowledge engineering has provided some degree of rigor to the study of knowledge systems and expert systems(ES) re able to use knowledge to solve the problems and answer questions. Therefore, the process of conceptualization and inference of knowledge are fundamental problem solving activities and hence, are essential activities for solving the problem of software ES construction Especially, the access to relevant, up-to-date and reliable knowledge is very important task in the daily work of physicians and nurses. In this study, we propose the conceptualization and inference mechanism for implicit knowledge management in medical diagnosis area. To this purpose, we combined the dynamic knowledge map(KM) and relational database(RDB) into a dynamic knowledge map(DKM). A graphical user-interface of DKM allows the conceptualization of the implicit knowledge of medical experts. After the conceptualization of implicit knowledge, we developed an RDB-based inference mechanism and prototype software ES to access and retrieve the implicit knowledge stored in RDB. Our proposed system allows the fast comfortable access to relevant knowledge fitting to the demands of the current task.

  • PDF

Automatic Switching of Clustering Methods based on Fuzzy Inference in Bibliographic Big Data Retrieval System

  • Zolkepli, Maslina;Dong, Fangyan;Hirota, Kaoru
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제14권4호
    • /
    • pp.256-267
    • /
    • 2014
  • An automatic switch among ensembles of clustering algorithms is proposed as a part of the bibliographic big data retrieval system by utilizing a fuzzy inference engine as a decision support tool to select the fastest performing clustering algorithm between fuzzy C-means (FCM) clustering, Newman-Girvan clustering, and the combination of both. It aims to realize the best clustering performance with the reduction of computational complexity from O($n^3$) to O(n). The automatic switch is developed by using fuzzy logic controller written in Java and accepts 3 inputs from each clustering result, i.e., number of clusters, number of vertices, and time taken to complete the clustering process. The experimental results on PC (Intel Core i5-3210M at 2.50 GHz) demonstrates that the combination of both clustering algorithms is selected as the best performing algorithm in 20 out of 27 cases with the highest percentage of 83.99%, completed in 161 seconds. The self-adapted FCM is selected as the best performing algorithm in 4 cases and the Newman-Girvan is selected in 3 cases.The automatic switch is to be incorporated into the bibliographic big data retrieval system that focuses on visualization of fuzzy relationship using hybrid approach combining FCM and Newman-Girvan algorithm, and is planning to be released to the public through the Internet.

Application of ANFIS Power Control for Downlink CDMA-Based LMDS Systems

  • Lee, Ze-Shin;Tsay, Mu-King;Liao, Chien-Hsing
    • ETRI Journal
    • /
    • 제31권2호
    • /
    • pp.182-192
    • /
    • 2009
  • Rain attenuation and intercell interference are two crucial factors in the performance of broadband wireless access networks such as local multipoint distribution systems (LMDS) operating at frequencies above 20 GHz. Power control can enhance the performance of downlink CDMA-based LMDS systems by reducing intercell interference under clear sky conditions; however, it may damage system performance under rainy conditions. To ensure robust operation under both clear sky and rainy conditions, we propose a novel power-control scheme which applies an adaptive neuro-fuzzy inference system (ANFIS) for downlink CDMA-based LMDS systems. In the proposed system, the rain rate and the number of users are two inputs of the fuzzy inference system, and output is defined as channel quality, which is applied in the power control scheme to adjust the power control region. Moreover, ITU-R P.530 is employed to estimate the rain attenuation. The influence of the rain rate and the number of users on the distance-based power control (DBPC) scheme is included in the simulation model as the training database. Simulation results indicate that the proposed scheme improves the throughput of the DBPC scheme.

  • PDF

Web Enabled Expert Systems using Hyperlink-based Inference

  • Yong U. Song;Kim, Wooju;June S. Hong
    • 한국지능정보시스템학회:학술대회논문집
    • /
    • 한국지능정보시스템학회 2003년도 춘계학술대회
    • /
    • pp.319-328
    • /
    • 2003
  • With the proliferation of WWW, providing more intelligence to Web sites has become a major concern in e-business industry. In recent days, this trend is more accelerated by prosperity of CRM (Customer Relationship Management) in terms of various aspects such as product recommendation, self after service, etc. To accomplish this goal, many e-companies are eager to embed web enabled rule-based system, that is, expert systems into their Web sites and several well-known commercial tools are already available in the market. Most of those tools are developed based on CGI so far but CGI based systems inherently suffer over-burden problem when there are too many service demands at the same time due to the nature of CGI. To overcome this limitation of the existing CGI based expert systems, we propose a new form of Web-enabled expert system using hyperlink-based inference mechanism. In terms of burden to Web server, our approach is proven to outperform CGI based approach theoretically and also empirically. For practical purpose, our this approach is implemented in a software system, WeBIS and a graphic rule editing methodology, Expert Diagram is incorporated into the system to facilitates rule generation and maintenance. WeBIS is now successfully operated for financial consulting in the web site of a leading financial consulting company in Korea.

  • PDF

Self-Organized Reinforcement Learning Using Fuzzy Inference for Stochastic Gradient Ascent Method

  • K, K.-Wong;Akio, Katuki
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2001년도 ICCAS
    • /
    • pp.96.3-96
    • /
    • 2001
  • In this paper the self-organized and fuzzy inference used stochastic gradient ascent method is proposed. Fuzzy rule and fuzzy set increase as occasion demands autonomously according to the observation information. And two rules(or two fuzzy sets)becoming to be similar each other as progress of learning are unified. This unification causes the reduction of a number of parameters and learning time. Using fuzzy inference and making a rule with an appropriate state division, our proposed method makes it possible to construct a robust reinforcement learning system.

  • PDF

유전 알고리즘에 의한 Hybrid 퍼지 추론기의 구성 (Application of genetic algorithm to hybrid fuzzy inference engine)

  • 박세희;조현찬;이홍기;전홍태
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1992년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 19-21 Oct. 1992
    • /
    • pp.863-868
    • /
    • 1992
  • This paper presents a method on applying Genetic Algorithm(GA), which is a well-known high performance optimizing algorithm, to construct the self-organizing fuzzy logic controller. Fuzzy logic controller considered in this paper utilizes Sugeno's hybrid inference method, which has an advantage of simple defuzzification process in the inference engine. Genetic algorithm is used to find the optimal parameters in the FLC. The proposed approach will be demonstrated using 2 d.o.f robot manipulator to verify its effectiveness.

  • PDF

A hierarchical fuzzy controller using structured Takagi-Sugeno type fuzzy inference engine

  • Moon G. Joo;Lee, Jin S.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1998년도 제13차 학술회의논문집
    • /
    • pp.179-184
    • /
    • 1998
  • In this paper, a new hierarchical fuzzy inference system (HFIS) using structured Takagi-Sugeno type fuzzy inference units(FIUs) is proposed. The proposed HFIS not only solves the rule explosion problem in conventional HFIS, but also overcomes the readability problem caused by the structure where outputs of previous level FIUs are used as input variables directly. Gradient descent algorithm is used for adaptation of fuzzy rules. The ball and beam control is performed in computer simulation to illustrate the performance of the proposed controller.

  • PDF