• Title/Summary/Keyword: D2GAN

Search Result 53, Processing Time 0.023 seconds

Cycle-Consistent Generative Adversarial Network: Effect on Radiation Dose Reduction and Image Quality Improvement in Ultralow-Dose CT for Evaluation of Pulmonary Tuberculosis

  • Chenggong Yan;Jie Lin;Haixia Li;Jun Xu;Tianjing Zhang;Hao Chen;Henry C. Woodruff;Guangyao Wu;Siqi Zhang;Yikai Xu;Philippe Lambin
    • Korean Journal of Radiology
    • /
    • v.22 no.6
    • /
    • pp.983-993
    • /
    • 2021
  • Objective: To investigate the image quality of ultralow-dose CT (ULDCT) of the chest reconstructed using a cycle-consistent generative adversarial network (CycleGAN)-based deep learning method in the evaluation of pulmonary tuberculosis. Materials and Methods: Between June 2019 and November 2019, 103 patients (mean age, 40.8 ± 13.6 years; 61 men and 42 women) with pulmonary tuberculosis were prospectively enrolled to undergo standard-dose CT (120 kVp with automated exposure control), followed immediately by ULDCT (80 kVp and 10 mAs). The images of the two successive scans were used to train the CycleGAN framework for image-to-image translation. The denoising efficacy of the CycleGAN algorithm was compared with that of hybrid and model-based iterative reconstruction. Repeated-measures analysis of variance and Wilcoxon signed-rank test were performed to compare the objective measurements and the subjective image quality scores, respectively. Results: With the optimized CycleGAN denoising model, using the ULDCT images as input, the peak signal-to-noise ratio and structural similarity index improved by 2.0 dB and 0.21, respectively. The CycleGAN-generated denoised ULDCT images typically provided satisfactory image quality for optimal visibility of anatomic structures and pathological findings, with a lower level of image noise (mean ± standard deviation [SD], 19.5 ± 3.0 Hounsfield unit [HU]) than that of the hybrid (66.3 ± 10.5 HU, p < 0.001) and a similar noise level to model-based iterative reconstruction (19.6 ± 2.6 HU, p > 0.908). The CycleGAN-generated images showed the highest contrast-to-noise ratios for the pulmonary lesions, followed by the model-based and hybrid iterative reconstruction. The mean effective radiation dose of ULDCT was 0.12 mSv with a mean 93.9% reduction compared to standard-dose CT. Conclusion: The optimized CycleGAN technique may allow the synthesis of diagnostically acceptable images from ULDCT of the chest for the evaluation of pulmonary tuberculosis.

A study on artificial intelligence algorithm for imagery through 3D pagoda voxelization (3D 탑 복셀화를 통한 형상화 인공지능 알고리즘에 대한 연구)

  • Beom-Jun kim;Byong-Kwon Lee
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2023.01a
    • /
    • pp.323-324
    • /
    • 2023
  • 본 논문에서는 다양한 복원 인공지능 알고리즘 중 하나인 3차원 복원 기술은 실제로 존재하는 물체의 2차원적인 픽셀을 3차원의 형태로 구현하여 형상화한다. 정확한 3차원 정보 처리가 요구됨에 따라 포인트 클라우드로 표현되는 데이터를 통해 정확한 쿨체의 크기 정보나 좌표 정보를 표시할 수 있다. 데이터의 픽셀을 분석하여 3차원의 형태로 구현할 것을 정의하는 복셀화(Voxelization) 알고리즘 전처리 과정을 통해 3차원 복원 기술 3D-GAN 활용으로 3차원 형태 형상화를 하였다. 본 논문에서는 3차원 복원 알고리즘 통하여 2차원 포인트 클라우드를 분석해 3차원 형태로 복원하는 기술에 대한 설명한다.

  • PDF

A GAN-based face rotation technique using 3D face model for game characters (3D 얼굴 모델 기반의 GAN을 이용한 게임 캐릭터 회전 기법)

  • Kim, Handong;Han, Jongdae;Yang, Heekyung;Min, Kyungha
    • Journal of Korea Game Society
    • /
    • v.21 no.3
    • /
    • pp.13-24
    • /
    • 2021
  • This paper shows the face rotation applicable to game character facial illustration. Existing studies limited data to human face data, required a large amount of data, and the synthesized results were not good. In this paper, the following method was introduced to solve the existing problems of existing studies. First, a 3D model with features of the input image was rotated and then rendered as a 2D image to construct a data set. Second, by designing GAN that can learn features of various poses from the data built through the 3D model, the input image can be synthesized at a desired pose. This paper presents the results of synthesizing the game character face illustration. From the synthesized result, it can be confirmed that the proposed method works well.

A study on evaluation method of NIDS datasets in closed military network (군 폐쇄망 환경에서의 모의 네트워크 데이터 셋 평가 방법 연구)

  • Park, Yong-bin;Shin, Sung-uk;Lee, In-sup
    • Journal of Internet Computing and Services
    • /
    • v.21 no.2
    • /
    • pp.121-130
    • /
    • 2020
  • This paper suggests evaluating the military closed network data as an image which is generated by Generative Adversarial Network (GAN), applying an image evaluation method such as the InceptionV3 model-based Inception Score (IS) and Frechet Inception Distance (FID). We employed the famous image classification models instead of the InceptionV3, added layers to those models, and converted the network data to an image in diverse ways. Experimental results show that the Densenet121 model with one added Dense Layer achieves the best performance in data converted using the arctangent algorithm and 8 * 8 size of the image.

Production of Nitric Oxide in Raw 264.7 Macrophages treated with Ganoderan, the ${\beta}-Glucan$ of Ganoderma lucidum (영지의 균사체성 ${\beta}-glucan$에 의한 Raw 264.7 대식세포의 Nitric Oxide생성)

  • Han, Man-Deuk;Lee, Eun-Sook;Kim, Young-Kweon;Lee, June-Woo;Jeong, Hoon;Yoon, Kyung-Ha
    • The Korean Journal of Mycology
    • /
    • v.26 no.2 s.85
    • /
    • pp.246-255
    • /
    • 1998
  • Ganoderan (GAN), an immunomodulating ${\beta}-glucan$ of G. lucidum, induces potent antitumor immunity in tumor-bearing mice. This study was set up to elucidate the ability of macrophage activation of GANs. GAN-treated Raw 264.7 macrophages showed enhanced production of nitric oxide (NO). The ability of GANs to produce NO was based on differences in chemical composition of GANs obtained from the mycelium on various carbon sources and mycelial fractionation. The highest NO production was observed in CW-AS-WS polysaccharide which was extracted from the mycelial wall. GAN-treated Raw 264.7 cells gave a 2-to 5-fold (24 hr) formation of NO levels compared with those treated with medium only. Partial removal of the protein in the extracellular GAN by TCA treatment did appreciably reduce its capacity to secrete NO. The mixture effect of GAN and LPS increased the nitric oxide secretion from RAW 264.7. The cell proliferation of GAN-treated Raw 264.7 cell tines inhibited as compared with its control. Of the culture supernatant of macrophage activated by GAN, the percentage of cytotoxicity against mouse leukemia L1210 cells was slightly dependent on the amount of NO in the culture supernatants of the activated-macrophages. These results indicate that the ${\beta}-glucan-related$ polysaccharides of the higher fungus activate macrophage and release nitric oxide. It also suggests that murine macrophages possess certain receptors for ${\beta}-anomeric$ glucans and play a critical role of ${\beta}-glucan-related$ tumor killing mechanism.

  • PDF

2차원 영상으로부터 3차원 영상을 모델링하는 기술 동향

  • Jo, Hyeong-Rae;Park, Gu-Man
    • Broadcasting and Media Magazine
    • /
    • v.26 no.4
    • /
    • pp.23-39
    • /
    • 2021
  • 2차원 영상을 3차원 모델 영상으로 변환하는 방식이 다양하게 발전해오고 있다. 딥러닝의 발전 중 특히 GAN의 다양한 연구는 2차원 영상의 생성뿐만 아니라 다양한 3차원 영상의 생성에도 진전을 보였다. 본 고에서는 2차원 영상을 3차원 영상으로 변환하는 연구의 필요성을 바탕으로 관련 연구의 내용과 동향을 분석하였다. 주요 내용으로는 딥러닝 기반의 3차원 객체인식, 2D로부터 3D 변환을 위한 신경망에 대한 연구, 생성적 기법을 적용한 연구, 3D 모델링 도구 등이 포함된다. 관련 연구의 전반적인 흐름을 고려했을 때 향후 3D 모델링의 정교한 표현력 향상, 고속의 고해상도 렌더링, 편리한 온라인 접근성 등을 예상하게 된다. 관련 산업 종사자들에게는 생성시간의 단축을 가져올 수 있고 일반인은 전문적인 3D 기술이 없어도 우수한 3D 모델을 생성하고 활용할 수 있을 것으로 기대한다.

Comparison Analysis of Four Face Swapping Models for Interactive Media Platform COX (인터랙티브 미디어 플랫폼 콕스에 제공될 4가지 얼굴 변형 기술의 비교분석)

  • Jeon, Ho-Beom;Ko, Hyun-kwan;Lee, Seon-Gyeong;Song, Bok-Deuk;Kim, Chae-Kyu;Kwon, Ki-Ryong
    • Journal of Korea Multimedia Society
    • /
    • v.22 no.5
    • /
    • pp.535-546
    • /
    • 2019
  • Recently, there have been a lot of researches on the whole face replacement system, but it is not easy to obtain stable results due to various attitudes, angles and facial diversity. To produce a natural synthesis result when replacing the face shown in the video image, technologies such as face area detection, feature extraction, face alignment, face area segmentation, 3D attitude adjustment and facial transposition should all operate at a precise level. And each technology must be able to be interdependently combined. The results of our analysis show that the difficulty of implementing the technology and contribution to the system in facial replacement technology has increased in facial feature point extraction and facial alignment technology. On the other hand, the difficulty of the facial transposition technique and the three-dimensional posture adjustment technique were low, but showed the need for development. In this paper, we propose four facial replacement models such as 2-D Faceswap, OpenPose, Deekfake, and Cycle GAN, which are suitable for the Cox platform. These models have the following features; i.e. these models include a suitable model for front face pose image conversion, face pose image with active body movement, and face movement with right and left side by 15 degrees, Generative Adversarial Network.

Towards a NFT-based Metaverse Fashion Contents Platform using 3D Conversion (3D 변환을 활용한 NFT 기반 메타버스 패션 컨텐츠 플랫폼)

  • Kim, Min-Ho;Han, Su-Han;Park, Min-Gyu;Jung, Dong-Ju;Lee, Byung-Jeong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.05a
    • /
    • pp.329-332
    • /
    • 2022
  • 본 연구에서는 하나의 2D 이미지를 StyleGAN을 통해 다각도의 이미지를 생성하고, 그것을 다시 Kaolin으로 구현한 역그래픽 렌더러의 입력으로 받아 3D 오브젝트로 변환한다. 또한, 클레이튼 기반의 블록체인을 통해 NFT 기술을 통하여 3D 오브젝트를 NFT로 만들 수 있도록 한다. 최종적으로 2D 이미지를 메타버스에서 활용할 수 있는 3D 패션 아이템으로 변환하고 NFT를 발행하여 거래한다. 본 연구는 개인이 자유롭게 메타버스 콘텐츠를 제공하고 거래하여 메타버스 활성화에 기여할 것으로 기대한다.

Research on Intelligent Anomaly Detection System Based on Real-Time Unstructured Object Recognition Technique (실시간 비정형객체 인식 기법 기반 지능형 이상 탐지 시스템에 관한 연구)

  • Lee, Seok Chang;Kim, Young Hyun;Kang, Soo Kyung;Park, Myung Hye
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.3
    • /
    • pp.546-557
    • /
    • 2022
  • Recently, the demand to interpret image data with artificial intelligence in various fields is rapidly increasing. Object recognition and detection techniques using deep learning are mainly used, and video integration analysis to determine unstructured object recognition is a particularly important problem. In the case of natural disasters or social disasters, there is a limit to the object recognition structure alone because it has an unstructured shape. In this paper, we propose intelligent video integration analysis system that can recognize unstructured objects based on video turning point and object detection. We also introduce a method to apply and evaluate object recognition using virtual augmented images from 2D to 3D through GAN.

Deep Learning Based Digital Staining Method in Fourier Ptychographic Microscopy Image (Fourier Ptychographic Microscopy 영상에서의 딥러닝 기반 디지털 염색 방법 연구)

  • Seok-Min Hwang;Dong-Bum Kim;Yu-Jeong Kim;Yeo-Rin Kim;Jong-Ha Lee
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.23 no.2
    • /
    • pp.97-106
    • /
    • 2022
  • In this study, H&E staining is necessary to distinguish cells. However, dyeing directly requires a lot of money and time. The purpose is to convert the phase image of unstained cells to the amplitude image of stained cells. Image data taken with FPM was created with Phase image and Amplitude image using Matlab's parameters. Through normalization, a visually identifiable image was obtained. Through normalization, a visually distinguishable image was obtained. Using the GAN algorithm, a Fake Amplitude image similar to the Real Amplitude image was created based on the Phase image, and cells were distinguished by objectification using MASK R-CNN with the Fake Amplitude image As a result of the study, D loss max is 3.3e-1, min is 6.8e-2, G loss max is 6.9e-2, min is 2.9e-2, A loss max is 5.8e-1, min is 1.2e-1, Mask R-CNN max is 1.9e0, and min is 3.2e-1.