• Title/Summary/Keyword: mixture-of-experts

Search Result 17, Processing Time 0.021 seconds

Semiparametric mixture of experts with unspecified gate network

  • Jung, Dahai;Seo, Byungtae
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.3
    • /
    • pp.685-695
    • /
    • 2017
  • The traditional mixture of experts (ME) modeled the gate network using a certain parametric function. However, if the assumed parametric function does not properly reflect the true nature, the prediction strength of ME would become weak. For example, the parametric ME often uses logistic or multinomial logistic models for the network model. However, this could be very misleading if the true nature of the data is quite different from those models. Although, in this case, we may develop more flexible parametric models by extending the model at hand, we will never be free from such misspecification problems. In order to alleviate such weakness of the parametric ME, we propose to use the semi-parametric mixture of experts (SME) in which the gate network is estimated in a non-parametrical way. Based on this, we compared the performance of the SME with those of ME and neural networks via several simulation experiments and real data examples.

Cluster-based Linear Projection and %ixture of Experts Model for ATR System (자동 목표물 인식 시스템을 위한 클러스터 기반 투영기법과 혼합 전문가 구조)

  • 신호철;최재철;이진성;조주현;김성대
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.40 no.3
    • /
    • pp.203-216
    • /
    • 2003
  • In this paper a new feature extraction and target classification method is proposed for the recognition part of FLIR(Forwar Looking Infrared)-image-based ATR system. Proposed feature extraction method is "cluster(=set of classes)-based"version of previous fisherfaces method that is known by its robustness to illumination changes in face recognition. Expecially introduced class clustering and cluster-based projection method maximizes the performance of fisherfaces method. Proposed target image classification method is based on the mixture of experts model which consists of RBF-type experts and MLP-type gating networks. Mixture of experts model is well-suited with ATR system because it should recognizee various targets in complexed feature space by variously mixed conditions. In proposed classification method, one expert takes charge of one cluster and the separated structure with experts reduces the complexity of feature space and achieves more accurate local discrimination between classes. Proposed feature extraction and classification method showed distinguished performances in recognition test with customized. FLIR-vehicle-image database. Expecially robustness to pixelwise sensor noise and un-wanted intensity variations was verified by simulation.

The Intelligent Control System for Biped Robot Using Hierarchical Mixture of Experts (계층적 모듈라 신경망을 이용한 이동로봇 지능제어기)

  • Choi Woo-Kyung;Ha Sang-Hyung;Kim Seong-Joo;Kim Yong-Taek;Jeon Hong-Tae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.16 no.4
    • /
    • pp.389-395
    • /
    • 2006
  • This paper proposes the controller for biped robot using intelligent control algorithm. In order to simplify the complexity of biped robot control, manipulator of biped robot is divided into four modules. These modules are controlled by intelligent algorithm with Hierarchical Mixture of Experts(HME) using neural network. Also neural network having direct control method learns the inverse dynamics of biped robot. The HME, which is a network of tree structure, reallocates the input domain for the output by learning pattern of input and output. In this paper, as a result of learning HME repeatedly with EM algorithm, the controller for biped robot operating safety walking is designed by modelling dynamics of biped robot and generating virtual error of HME.

A Study of HME Model in Time-Course Microarray Data

  • Myoung, Sung-Min;Kim, Dong-Geon;Jo, Jin-Nam
    • The Korean Journal of Applied Statistics
    • /
    • v.25 no.3
    • /
    • pp.415-422
    • /
    • 2012
  • For statistical microarray data analysis, clustering analysis is a useful exploratory technique and offers the promise of simultaneously studying the variation of many genes. However, most of the proposed clustering methods are not rigorously solved for a time-course microarray data cluster and for a fitting time covariate; therefore, a statistical method is needed to form a cluster and represent a linear trend of each cluster for each gene. In this research, we developed a modified hierarchical mixture of an experts model to suggest clustering data and characterize each cluster using a linear mixed effect model. The feasibility of the proposed method is illustrated by an application to the human fibroblast data suggested by Iyer et al. (1999).

Gesture Recognition based on Mixture-of-Experts for Wearable User Interface of Immersive Virtual Reality (몰입형 가상현실의 착용식 사용자 인터페이스를 위한 Mixture-of-Experts 기반 제스처 인식)

  • Yoon, Jong-Won;Min, Jun-Ki;Cho, Sung-Bae
    • Journal of the HCI Society of Korea
    • /
    • v.6 no.1
    • /
    • pp.1-8
    • /
    • 2011
  • As virtual realty has become an issue of providing immersive services, in the area of virtual realty, it has been actively investigated to develop user interfaces for immersive interaction. In this paper, we propose a gesture recognition based immersive user interface by using an IR LED embedded helmet and data gloves in order to reflect the user's movements to the virtual reality environments effectively. The system recognizes the user's head movements by using the IR LED embedded helmet and IR signal transmitter, and the hand gestures with the data gathered from data gloves. In case of hand gestures recognition, it is difficult to recognize accurately with the general recognition model because there are various hand gestures since human hands consist of many articulations and users have different hand sizes and hand movements. In this paper, we applied the Mixture-of-Experts based gesture recognition for various hand gestures of multiple users accurately. The movement of the user's head is used to change the perspection in the virtual environment matching to the movement in the real world, and the gesture of the user's hand can be used as inputs in the virtual environment. A head mounted display (HMD) can be used with the proposed system to make the user absorbed in the virtual environment. In order to evaluate the usefulness of the proposed interface, we developed an interface for the virtual orchestra environment. The experiment verified that the user can use the system easily and intuituvely with being entertained.

  • PDF

Classification of the Diagnosis of Diabetes based on Mixture of Expert Model (Mixture of Expert 모형에 기반한 당뇨병 진단 분류)

  • Lee, Hong-Ki;Myoung, Sung-Min
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.11
    • /
    • pp.149-157
    • /
    • 2014
  • Diabetes is a chronic disease that requires continuous medical care and patient-self management education to prevent acute complications and reduce the risk of long-term complications. The worldwide prevalence and incidence of diabetes mellitus are reached epidemic proportions in most populations. Early detection of diabetes could help to prevent its onset by taking appropriate preventive measures and managing lifestyle. The major objective of this research is to develop an automated decision support system for detection of diabetes using mixture of experts model. The performance of the classification algorithms was compared on the Pima Indians diabetes dataset. The result of this study demonstrated that the mixture of expert model achieved diagnostic accuracies were higher than the other automated diagnostic systems.

A Comparison of Deep Neural Network Structures for Learning Various Motions (다양한 동작 학습을 위한 깊은신경망 구조 비교)

  • Park, Soohwan;Lee, Jehee
    • Journal of the Korea Computer Graphics Society
    • /
    • v.27 no.5
    • /
    • pp.73-79
    • /
    • 2021
  • Recently, in the field of computer animation, a method for generating motion using deep learning has been studied away from conventional finite-state machines or graph-based methods. The expressiveness of the network required for learning motions is more influenced by the diversity of motion contained in it than by the simple length of motion to be learned. This study aims to find an efficient network structure when the types of motions to be learned are diverse. In this paper, we train and compare three types of networks: basic fully-connected structure, mixture of experts structure that uses multiple fully-connected layers in parallel, recurrent neural network which is widely used to deal with seq2seq, and transformer structure used for sequence-type data processing in the natural language processing field.

High Performance Concrete Mixture Design using Artificial Neural Networks (신경망을 이용한 고성능 콘크리트의 배합설계)

  • 양승일;윤영수;이승훈;김규동
    • Proceedings of the Korea Concrete Institute Conference
    • /
    • 2002.05a
    • /
    • pp.545-550
    • /
    • 2002
  • Concrete is one of the essential structural materials in the construction. But, concrete consists of many materials and is affected by many factors such as properties of materials, site environmental situations, and skill of constructor. Therefore, concrete mixes depend on experiences of experts. However, it is more and more difficult to determine concrete mixes design by empirical means because more ingredients like mineral and chemical admixtures are included. Artificial Neural Networks(ANN) are a mimic models of human brain to solve a complex nonlinear problem. They are powerful pattern recognizers and classifiers, also their computing abilities have been proven in the fields of prediction, estimation and pattern recognition. Here, among them, the back propagation network and radial basis function network are used. Compositions of high-performance concrete mixes are eight components(water, cement, fine aggregate, coarse aggregate, fly ash, silica fume, superplasticizer and air-entrainer). Compressive strength and slump are measured. The results show that neural networks are proper tools to minimize the uncertainties of the design of concrete mixtures.

  • PDF

The Intelligent Controller for Biped Robot Using Neural Network (이족로봇용 신경망 지능 제어기)

  • 김성주;김용택;고재양;서재용;전홍태
    • Proceedings of the IEEK Conference
    • /
    • 2003.07c
    • /
    • pp.2573-2576
    • /
    • 2003
  • This paper proposes the controller for biped robot using intelligent control algorithm. The main purpose of this paper is to design the robot controller using Hierarchical Mixture of Experts(HME). The neural network direct control method will be applied to the control scheme for the biped robot and neural network will learn the dynamics of biped robot. The teaming scheme using a intelligent controller to biped robot is developed. The teaming scheme uses a HME controller combined with a inverse biped robot model. The controller provides the control signals at each control time instant. Simulation results are reported for a seven-link biped robot.

  • PDF