• 제목/요약/키워드: automatic differentiation

검색결과 50건 처리시간 0.023초

딥러닝 프레임워크의 비교: 티아노, 텐서플로, CNTK를 중심으로 (Comparison of Deep Learning Frameworks: About Theano, Tensorflow, and Cognitive Toolkit)

  • 정여진;안성만;양지헌;이재준
    • 지능정보연구
    • /
    • 제23권2호
    • /
    • pp.1-17
    • /
    • 2017
  • 딥러닝 프레임워크의 대표적인 기능으로는 '자동미분'과 'GPU의 활용' 등을 들 수 있다. 본 논문은 파이썬의 라이브러리 형태로 사용 가능한 프레임워크 중에서 구글의 텐서플로와 마이크로소프트의 CNTK, 그리고 텐서플로의 원조라고 할 수 있는 티아노를 비교하였다. 본문에서는 자동미분의 개념과 GPU의 활용형태를 간단히 설명하고, 그 다음에 logistic regression을 실행하는 예를 통하여 각 프레임워크의 문법을 알아본 뒤에, 마지막으로 대표적인 딥러닝 응용인 CNN의 예제를 실행시켜보고 코딩의 편의성과 실행속도 등을 확인해 보았다. 그 결과, 편의성의 관점에서 보면 티아노가 가장 코딩 하기가 어렵고, CNTK와 텐서플로는 많은 부분이 비슷하게 추상화 되어 있어서 코딩이 비슷하지만 가중치와 편향을 직접 정의하느냐의 여부에서 차이를 보였다. 그리고 각 프레임워크의 실행속도에 대한 평가는 '큰 차이는 없다'는 것이다. 텐서플로는 티아노에 비하여 속도가 느리다는 평가가 있어왔는데, 본 연구의 실험에 의하면, 비록 CNN 모형에 국한되었지만, 텐서플로가 아주 조금이지만 빠른 것으로 나타났다. CNTK의 경우에도, 비록 실험환경이 달랐지만, 실험환경의 차이에 의한 속도의 차이의 편차범위 이내에 있는 것으로 판단이 되었다. 본 연구에서는 세 종류의 딥러닝 프레임워크만을 살펴보았는데, 위키피디아에 따르면 딥러닝 프레임워크의 종류는 12가지가 있으며, 각 프레임워크의 특징을 15가지 속성으로 구분하여 차이를 특정하고 있다. 그 많은 속성 중에서 사용자의 입장에서 볼 때 중요한 속성은 어떤 언어(파이썬, C++, Java, 등)로 사용가능한지, 어떤 딥러닝 모형에 대한 라이브러리가 잘 구현되어 있는지 등일 것이다. 그리고 사용자가 대규모의 딥러닝 모형을 구축한다면, 다중 GPU 혹은 다중 서버를 지원하는지의 여부도 중요할 것이다. 또한 딥러닝 모형을 처음 학습하는 경우에는 사용설명서가 많은지 예제 프로그램이 많은지 여부도 중요한 기준이 될 것이다.

Mineralized Polysaccharide Transplantation Modules Supporting Human MSC Conversion into Osteogenic Cells and Osteoid Tissue in a Non-Union Defect

  • Ge, Qing;Green, David William;Lee, Dong-Joon;Kim, Hyun-Yi;Piao, Zhengguo;Lee, Jong-Min;Jung, Han-Sung
    • Molecules and Cells
    • /
    • 제41권12호
    • /
    • pp.1016-1023
    • /
    • 2018
  • Regenerative orthopedics needs significant devices to transplant human stem cells into damaged tissue and encourage automatic growth into replacements suitable for the human skeleton. Soft biomaterials have similarities in mechanical, structural and architectural properties to natural extracellular matrix (ECM), but often lack essential ECM molecules and signals. Here we engineer mineralized polysaccharide beads to transform MSCs into osteogenic cells and osteoid tissue for transplantation. Bone morphogenic proteins (BMP-2) and indispensable ECM proteins both directed differentiation inside alginate beads. Laminin and collagen IV basement membrane matrix proteins fixed and organized MSCs onto the alginate matrix, and BMP-2 drove differentiation, osteoid tissue self-assembly, and small-scale mineralization. Augmentation of alginate is necessary, and we showed that a few rationally selected small proteins from the basement membrane (BM) compartment of the ECM were sufficient to up-regulate cell expression of Runx-2 and osteocalcin for osteoid formation, resulting in Alizarin red-positive mineral nodules. More significantly, nested BMP-2 and BM beads added to a non-union skull defect, self-generated osteoid expressing osteopontin (OPN) and osteocalcin (OCN) in a chain along the defect, at only four weeks, establishing a framework for complete regeneration expected in 6 and 12 weeks. Alginate beads are beneficial surgical devices for transplanting therapeutic cells in programmed (by the ECM components and alginate-chitosan properties) reaction environments ideal for promoting bone tissue.

지진하중을 받는 강뼈대구조물의 표준단면에 대한 다목적 최적설계 (Multi-Objective Optimization of Steel Frames For Standardized Steel Profiles Under Seismic Loads)

  • 조효남;민대홍;정봉교
    • 한국강구조학회 논문집
    • /
    • 제14권6호
    • /
    • pp.783-791
    • /
    • 2002
  • 본 논문에서는 지진하중을 받는 강뼈대구조물의 표준단면에 대한 다목적 최적설계 정식화 방법을 제안하였다. 다목적 최적화 문제는 강재중량, 변형에너지, 안전성을 목적함수로 구성하였다. 표준단면제원을 이용한 다목적 최적설계 문제를 효율적으로 해결하기 위하여 전역기준법(Global Criterion Method)을 이용하였다. 실제적인 대형구조물의 다목적 최적설계 문제를 효율적으로 해결하기 위해 전체 구조계와 구조 요소계로 나누는 다단계 알고리즘을 적용하였고 자동미분을 이용하여 매개변수에 대한 민감도해석을 이용한 근사재해석 기법을 사용하였다. 또한 전체 구조계와 구조 요소계의 연결을 위해 표준단면을 이용하여 단면 2차 모멘트와 단면적, 단면상수와의 관계를 희귀분석 하였다. 수치해석 결과 안정성을 고려한 강 뼈대 구조물의 최적설계 방법은 기존의 방법보다 합리적인 설계를 유도할 것으로 기대된다.

웹 2.0을 위한 Ajax기반 RSS리더 모듈 개발에 관한 연구 (A Study on the Development of RSS Reader Module Based on Ajax for Web 2.0)

  • 권영제;김차종
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 2007년도 춘계종합학술대회
    • /
    • pp.649-652
    • /
    • 2007
  • 현재 기존의 웹과 차별화를 의미하는 웹 2.0에 대한 관심이 높아져 가고 있다. 기존의 시스템이 클라이언트와 서버 모델에 기반을 둔 정적인 웹이 전형적이었다면, 웹 2.0은 웹이 근본적으로 변화하고 진화한다는 차원의 차세대 웹을 뜻한다. 본 논문에서는 웹 2.0규격하에서 쓰일수 있는 RSS리더에 대한 모듈을 제안한다. 제안된 모듈은 Ajax를 이용하여 개발하였다. 현재 쓰이는 RSS feed가 브라우저에 따라 왜곡될수 있는 부분을 보정하고 한글 및 제 3세계 언어의 인코딩 문제를 해결하였고, Ajax의 유동성 있는 프로그래밍을 통한 DragBox모듈과 RSS Feed의 자동 업데이트 모듈의 설계 및 개발을 통해 웹 2.0 기반상에서의 효과적인 콘텐츠의 활용을 위한 모듈을 개발하였다.

  • PDF

Synthetic Maternal Stress Hormone Can Modulate the Expression of Hox Genes

  • ;;;;김명희
    • 대한의생명과학회지
    • /
    • 제15권3호
    • /
    • pp.249-255
    • /
    • 2009
  • All living things have been developed efficient strategies to cope with external and internal environmental changes via a process termed 'homeostasis'. However, chronic prenatal maternal stress may significantly contributes to pregnancy complications by disturbing hypothalamic-pituitary-adrenal (HPA) axis and the automatic nervous system (ANS), and results in unfavorable development of the fetus. Dysregulation of these two major stress response systems lead to the increased secretion of the glucocorticoids (GCs) which are known to be essential for normal development and the maturation of the central nervous system. As Hox genes are master key regulators of the embryonic morphogenesis and cell differentiation, we aimed to determine the effects of dexamethasone, a potent synthetic glucocorticoid, on gene expression in mesenchymal stem cell C3H10T1/2. Analysis of 39 Hox genes based on reverse transcription PCR (RT-PCR) method revealed that the expression patterns of Hox genes were overall upregulated by long dexametasone treatment. These results indicate that maternal stress may have a deleterious effect on early developing embryo through the stress hormone, glucocorticoid.

  • PDF

개체군 체장자료를 이용한 연령조성 추정 (Inference of Age Compositions in a Sample of Fish from Fish Length Data)

  • 김규한;현상윤;서영일
    • 한국수산과학회지
    • /
    • 제51권1호
    • /
    • pp.79-90
    • /
    • 2018
  • Fish ages are critical information in fish stock assessments because they are required for age-structure models such as virtual population analysis and stochastic catch-at-age models, whose outputs include recruitment strengths, a spawning stock size (abundance or biomass), and the projection of a fish population size in future. However, most countries other than the developed countries have not identified ages of fish caught by fisheries or surveys in a consistent manner for a long time (e.g.,>20 years). Instead, data about fish body sizes (e.g., lengths) have been well available because of ease of measurement. To infer age compositions of fish in a target group using fish length data, we intended to improve the length frequency analysis (LFA), which Schnute and Fournier had introduced in 1980. Our study was different in two ways from the Schnute and Fournier's method. First we calculated not only point estimates of age compositions but also the uncertainty in those estimates. Second, we modified LFA based on the von Bertalanffy growth model (vB-based model) to allow both individual-to-individual and cohort-to-cohort variability in estimates of parameters in the vB-based model. For illustration, we used data about lengths of Korean mackerel Scomber japonicas caught by purse-seine fisheries from 2000-2016.

웹 2.0을 위한 Ajax기반 RSS리더 모듈 개발에 관한 연구 (A Study on the Development of RSS Reader Module Based on Ajax for Web 2.0)

  • 권영제;김차종
    • 한국정보통신학회논문지
    • /
    • 제12권7호
    • /
    • pp.1263-1270
    • /
    • 2008
  • 현재 기존의 웹과 차별화를 의미하는 웹 2.0에 대한 관심이 높아져 가고 있다. 기존의 시스템이 클라이언트와 서버 모델에 기반을 둔 정적인 웹이 전형적이었다면, 웹 2.0은 웹이 근본적으로 변화하고 진화한다는 차원의 차세대 웹을 뜻한다. 본 논문에서는 웹 2.0규격하에서 쓰일 수 있는 RSS리더에 대한 모듈을 제안한다. 제안된 모듈은 Ajax를 이용하여 개발하였다 현재 쓰이는 RSS Feed가 브라우저에 따라 왜곡될 수 있는 부분을 보정하고 한글 및 제 3세계 언어의 인코딩 문제를 해결하였고, Ajax의 유동성 있는 프로그래밍을 통한 DragBox모듈과 RSS Feed의 자동 업데이트 모듈의 설계 및 개발을 통해 웹 2.0 기반상에서의 효과적인 콘텐츠의 활용을 위한 모듈을 개발하였다.

분석적으로 미분 가능한 시스템 동역학을 이용한 온라인 동작 합성 기법 (On-line Motion Synthesis Using Analytically Differentiable System Dynamics)

  • 한다성;노준용;신성용
    • 한국컴퓨터그래픽스학회논문지
    • /
    • 제25권3호
    • /
    • pp.133-142
    • /
    • 2019
  • 물리기반 캐릭터 애니메이션에서 궤적 최적화(trajectory optimization) 기법은 캐릭터 동작에 대한 시스템 동역학 모델(system dynamics model)에 기반하여 가까운 최적의 미래 상태를 예측하여 캐릭터의 동작을 자동적으로 생성하는데 널리 사용되어 왔다. 캐릭터와 환경 간의 접촉 현상을 강체 충돌로 다루는 경우 일반적으로 시스템 동역학 모델은 그 수식이 닫힌 형식(closed form)으로 유도되지 못하고 미분이 불가능하다. 따라서 최근까지 많은 연구자들이 접촉 완화(contact smoothing) 기법을 통해 시스템 동역학의 수치적 미분에 기반한 효율적인 궤적 최적화 기법을 발표해 왔다. 하지만 수치적 미분 정보는 분석적 미분과 달리 부정확하기 때문에 궤적 최적화의 안정성에 영향을 미칠 수 있다. 이 문제를 해결하기 위해 본 논문에서는 접촉 완화 모델에 대한 근사화를 통해 시스템 동역학을 분석적으로 미분하여 닫힌 형식의 도함수를 유도하고, 이를 기반으로 사용자의 온라인 입력에 따라 예제 데이터 없이 이족 캐릭터의 동작을 안정적으로 생성하는 예측 제어 기법(model predictive control (MPC))을 제안한다.

망막반응으로 본 각종파장가시광선조사하에서 발육한 과두(올챙이)의 식물신경계기능변조에 관하여 (Functional Disturbances Through the Retinal Pigment Reaction of the Automatic Nervous System of Tadpoles Developed under Various Visible Rays)

  • 주인호
    • 한국동물학회지
    • /
    • 제1권2호
    • /
    • pp.17-24
    • /
    • 1958
  • Since Kesser first described in 1934 the functional change of the autonomic nervous system caused by certain visible rays many researchers have unanimously approved that animals flashed with a red visible ray develop parasympathicotony while those flashed with a blue visible ray develop sympathicotony. On the other hand through studies made by our colleagues it is now well known that the inner-movement of the retinal pigments of frogs is stimulated in sympathicotony and is in reverse inhibited in parasimpathicotony. It is almost evident that the mechanism by which the inner-movement of the retinal pigments is due to sympathicotony derived from the excessive secretion of adrenalin. In addition , through may recent experiments on the pharmacological action of various medicines on the retinal pigments reaction of tadpoles , ranging from the excessive secretion of adrenalin. In addition , through my recent experiments on the pharmacologtical action of various medicines on the retinal pigments reaction of tadploes, raging from every developmental stage , Ifound that the movement of the retinal pigments by adrenalin is predominant in the earlier developmental stages of taopoles around 11 mm of body length, whereas other medicines fail to give any responce to the retinal pigments in such an earlier stage. When tadpoles grown to body length of 15-16m the retinal pigments move to the complete light position while kept in adrenalin solution. Based on these facts it might be well to consider that if tadpoles were grown under the visible rays for a given period, they might show a functional change of the autonomic nervous system and thereby cause of certain change in the physciological phases of the retinal reaction. Experiments were undertaken to find this matter and also to discover the simultaneous effects of the visible radiations on the developmental process of tadpoles. The results summarized as follows ; 1. The longest wave of visible rav has an effective reaction on the growth of body length of taopoles, while the shortest wave of visible ray causes the same for the metamorphoric differentiation of tadpoles. 2. When keeping two groups of tadpoles the first group of 15 mm body length grown for the period of one week and the latter group of 20 mm body length grown for two weeks under the various visible rays. swimming in adrenalin solution, the inner-movement of the retinal pigment occurs in both groups. The movement of pigments of the first group is accelerated in a sequence of blue ray \ulcorner green ray > brown ray> red ray, and that of the latter group is also accelerated in a sequence of blue ray>green ray > brown ray and red ray. 3. When keeping tow groups of tadpoles, the first group of 20 mm body length grown for the period of two weeks, the latter group of 25 m body length grown for three wheeks, under the various visible rays in sunlight, the inner-movement of the retinal pigments occurs in both groups. The movement of pigments of the first group is accelerated in a sequence of blue ray> green ray>brown ray and red ray, and that of the latter group is also accelerated in a sequence of blue ray > brow ray>red ray. 4. In order words, there facts manifest that tadpoles grown under the various visible rays reveal functional disturbances of the autonomic nervous system, at the time of 15 mm body length by adrenalin solution, which is a unique indicator illustrating the status of sympathicotony, and at the time of 20 mm body length by sunlight. This means that the longest visible ray cause sympathicotony, while the shortest visible ray causes parasympathicotony.

  • PDF

구강 편평세포암종에서 $P16^{ink4}$ 유전자의 Methylation에 대한 연구 (($P16^{ink4}$ Methylation in Squamous Cell Carcinoma of the Oral Cavity.)

  • 강진원;김경욱;류진우;김창진
    • Maxillofacial Plastic and Reconstructive Surgery
    • /
    • 제22권2호
    • /
    • pp.164-173
    • /
    • 2000
  • The p16 protein is a cyclin dependent kinase inhibitor that inhibits cell cycle progression from $G_1$ phase to S phase in cell cycle. Many p16 gene mutations have been noted in many cancer-cell lines and in some primary cancers, and alterations of p16 gene function by DNA methylation have been noticed in various kinds of cancer tissues and cell-lines. There have been a large body of literature has accumulated indicating that abnormal patterns of DNA methylation (both hypomethylation and hypermethylation) occur in a wide variety of human neoplasma and that these aberrations of DNA methylation may play an important epigenetic role in the development and progression of neoplasia. DNA methylation is a part of the inheritable epigenetic system that influences expression or silencing of genes necessary for normal differentiation and proliferation. Gene activity may be silenced by methylation of up steream regulatory regions. Reactivation is associated with demethylation. Although evidence or a high incidence of p16 alterations in a variety of cell lines and primary tumors has been reported, that has been contested by other investigators. The precise mechanisms by which abnormal methylation might contribute to carcinogenesis are still not fully elucidated, but conceivably could involve the modulation of oncogene and other important regulatory gene expression, in addition to creating areas of genetic instability, thus predisposing to mutational events causing neoplasia. There have been many variable results of studies of head and neck squamous cell carcinoma(HNSCC). This investigation was studied on 13 primary HNSCC for p16 gene status by protein expression in immunohistochemistry, and DNA genetic/epigenetic analyzed to determine the incidence, the mechanisms, and the potential biological significance of its Inactivation. As methylation detection method of p16 gene, the methylation specific PCR(MSP) is sensitive and specific for methylation of any block of CpG sites in a CpG islands using bisulfite-modified DNA. The genomic DNA is modified by treatment with sodium bisulfate, which converts all unmethylated cytosines to uracil(thymidine). The primers designed for MSP were chosen for regions containing frequent cytosines (to distinguish unmodified from modified DNA), and CpG pairs near the 5' end of the primers (to provide maximal discrimination in the PCR between methylated and unmethylated DNA). The two strands of DNA are no longer complementary after bisulfite treatment, primers can be designed for either modified strand. In this study, 13 paraffin embedded block tissues were used, so the fragment of DNA to be amplified was intentionally small, to allow the assessment of methylation pattern in a limited region and to facilitate the application of this technique to samlples. In this 13 primary HNSCC tissues, there was no methylation of p16 promoter gene (detected by MSP and automatic sequencing). The p16 protein-specific immunohistochemical staining was performed on 13 paraffin embedded primary HNSCC tissue samples. Twelve cases among the 13 showed altered expression of p16 proteins (negative expression). In this study, The author suggested that low expression of p16 protein may play an important role in human HNSCC, and this study suggested that many kinds of genetic mechanisms including DNA methylation may play the role in carcinogenesis.

  • PDF