• Title/Summary/Keyword: Video Enhancement

Search Result 273, Processing Time 0.028 seconds

Enhancement of MSFC-Based Multi-Scale Features Compression Network with Bottom-UP MSFF in VCM (VCM 의 바텀-업 MSFF 를 이용한 MSFC 기반 멀티-스케일 특징 압축 네트워크 개선)

  • Dong-Ha Kim;Gyu-Woong Han;Jun-Seok Cha;Jae-Gon Kim
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2022.11a
    • /
    • pp.116-118
    • /
    • 2022
  • MPEG-VCM(Video Coding for Machine)은 입력된 이미지/비디오의 특징(feature)를 압축하는 Track 1 과 입력 이미지/비디오를 직접 압축하는 Track 2 로 나뉘어 표준화가 진행 중이다. 본 논문은 Track 1 의 비전임무 네트워크로 사용하는 Detectron2 의 FPN(Feature Pyramid Network)에서 추출한 멀티-스케일 특징을 효율적으로 압축하는 MSFC 기반의 압축 모델의 개선 기법을 제시한다. 제안기법은 해상도를 줄여서 단일-스케일 압축맵을 압축하는 기존의 압축 모델에서 저해상도 특징맵을 고해상도 특징맵에 바텀-업(Bottom-Up) 구조로 합성하여 단일-스케일 특징맵을 구성하는 바텀-업 MSFF 를 가지는 압축 모델을 제시한다. 제안방법은 기존의 모델 보다 BPP-mAP 성능에서 1 ~ 2.7%의 개선된 BD-rate 성능을 보이며 VCM 의 이미지 앵커(image anchor) 대비 최대 -85.94%의 BD-rate 성능향상을 보인다.

  • PDF

Delivery of Spatial Partitioning Information for Tile-based Adaptive Bitrate Streaming Using MMT Protocol (MMT 프로토콜을 활용한 타일 기반 적응형 비트율 스트리밍을 위한 영상 분할 정보 전달 기법)

  • An, Eunbin;Kim, Ayoung;Seo, Kwangdeok
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2020.07a
    • /
    • pp.51-54
    • /
    • 2020
  • 본 논문에서는 360 도 VR 영상을 전송하는 기법의 일종인 타일 기반 전송을 MMT(MPEG Media Transport) 프로토콜 기반으로 구현하기 위하여 영상의 공간 분할 정보를 전달하는 방법을 소개한다. 360 도 VR 영상 전송은 대용량 미디어 전송인 동시에 사용자의 움직임에 따라 신속하게 적응적 영상을 전달해야 한다. 타일 기반 전송은 HEVC(High Efficiency Video Coding)의 MCTS(Motion Constrained Tile Sets) 기법을 이용하여 뷰포트에 해당하는 타일들을 고화질로 전달함으로써 이러한 요구사항을 해결한다. 반면, MMT 프로토콜은 초저지연 고화질 영상 전송에 유리한 기술로써 사용자의 시점 변화에 따라 기민하게 영상의 품질을 변환시킬 수 있다. 따라서 HEVC 의 SEI(Supplemental Enhancement Information) 메시지에 포함되는 타일들의 공간 분할 정보를 MMT 프로토콜에 적용하는 방식에 따라 적응적 타일 기반 전송 기법의 효율을 높일 수 있다.

  • PDF

Patients with brain metastases the usefulness of contrast-enhanced FLAIR images after delay (뇌전이 환자의 조영 증강 후 지연 FLAIR 영상의 유용성)

  • Byun, Jae-Hu;Park, Myung-Hwan;Lee, Jin-Wan
    • Korean Journal of Digital Imaging in Medicine
    • /
    • v.16 no.1
    • /
    • pp.13-19
    • /
    • 2014
  • Purpose: FLAIR image is beneficial for the diagnosis of various bran diseases including ischemic CVS, brain tumors and infections. However the border between the legion of brain metastasis and surrounding edema may not be clear. Therefore, this study aims to investigate the practical benefits of delayed imaging by comparing the image from a patient with brain metastasis before a contrast enhancement and the image 10 minutes after a contrast enhancement. Materials and methods: Of the 92 people who underwent MRI brain metastases in suspected patients 13 people in three patients there is no video to target the 37 people confirmed cases, and motion artifacts brain metastases in our hospital June-December 2013, 18 people measurement position except for the three incorrect patient (male: 11 people, female: 7 people, average age: 60 years) in the target, test equipment, 3.0T MR System (ACHIEVA Release, Philips, I was 8ChannelSENSE Head Coil use Best, and the Netherlands). TR 11000 ms, TE 125 ms, TI2800 ms, Slice Thickness 5 mm, gap 5 mm, is a Slice number 21, the parameters of the 3D FFE, T2 FLAIR variable that was used to test, TR 8.1 ms, TE 3.7 ms, Slice number 240 I set to. The experiment was conducted by acquiring the FLAIR prior to contrast enhancement (heretofore referred to as Pre FLAIR), and acquiring the 3D FFE CE five minutes after the contrast enhancement, and recomposing the images in an axial plane of S/T 3mm, G 0mm (heretofore referred to as MPR TRA CE). Using the FLAIR 10 minutes after the contrast enhancement (heretofore referred to as Post FLAIR) and Pi-View, a retrospective study was conducted. Using MRIcro on the image of a patient confirmed for his diagnosis, the images before and after the contrast media, as well as the CNR and SNR of the MPR TRA CE images of the lesion and the site absent of lesion were compared and analyzed using a one-way analysis of variance. Results: CNR for Pre FLAIR and Post FLAIR were 34.35 and 60.13, respectively, with MPR TRA CE at 23.77 showing no significant difference (p<0.050). Post-experiment analysis shows a difference between Pre FLAIR and Post FLAIR in terms of CNR (p<0.050), but no difference in CNR between Post FLAIR and MPR TRA CE (p>0.050), indicating that the contrast media had an effect only on Pre FLAIR and Post FLAIR. The SNR for the normal site Pre FLAIR was 106.43, and for the lesion site 140.79. Post FLAIR for the normal site was 107.79, and for the lesion site 167.91. MPR TRA CE for the normal site was 140.23 and for the lesion site 183.19, showing significant difference (p<0.050), and post-experiment analysis shows that there was a difference in SNR only on the lesion sites for Pre FLAIR and Post FLAIR (p<0.050). There was no difference in SNR between the normal site and lesion site for Post FLAIR and MPR TRA CE, indicating no effect from the contrast media (p>0.050). Conclusions: This experiment shows that Post FLAIR has a higher contrast than Pre FLAIR, and a higher SNR for lesions, It was not not statistically significant and MPR TRA CE but CNR came out high. Inspection of post-contrast which is used in a high magnetic field is frequently used images of 3D T1 but, since the signal of the contrast medium and the blood flow is included, this method can be diagnostic accuracy is reduced, it is believed that when used in combination with Post FLAIR, and that can provide video information added to the diagnosis of brain metastases.

  • PDF

A Performance Comparison of Spatial Scalable Encoders with the Constrained Coding Modes for T-DMB/AT-DMB Services (T-DMB/AT-DMB 서비스를 위한 부호화 모드 제한을 갖는 공간 확장성 부호기의 성능 비교)

  • Kim, Jin-Soo;Park, Jong-Kab;Kim, Kyu-Seok;Choi, Sung-Jin;Seo, Kwang-Deok;Kim, Jae-Gon
    • Journal of Broadcast Engineering
    • /
    • v.13 no.4
    • /
    • pp.501-515
    • /
    • 2008
  • Recently, as users' requests for high quality mobile multimedia services are rapidly increasing and additional bandwidth can be provided by adopting the hierarchical modulation transmission technology, the research on the Advanced Terrestrial DMB (AT-DMB) service using the SVC (Scalable Video Coding) scheme is being actively studied. But, in order to realize a compatible video service and to accelerate the successful standardization and commercialization, it is necessary to simplify the compatible encoder structure. In this parer, we propose a fast mode decision method by constraining the redundant coding modes in the spatial scalable encoder that keeps the current T-DMB video in base layer. The proposed method is based on the statistical characteristics of each coding mode at both base and enhancement layers, inter-layer predictions, which are derived by investigating macroblock-layer coding modes of the spatial scalable encoder's functional structure. Through computer simulations, it is shown that a simplified encoder model that reduces the heavy computational burden can be found, while keeping the objective visual quality very high.

Transform Skip Mode Fast Decision Method for HEVC Encoding (HEVC 부호화를 위한 변환생략 모드 고속 선택 방법)

  • Yang, Seungha;Shim, Hiuk Jae;Lee, Dahee;Jeon, Byeungwoo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.39A no.4
    • /
    • pp.172-179
    • /
    • 2014
  • HEVC (High Efficiency Video Coding) fine-tuned many existing coding tools and adopted also many new coding techniques. As a result, HEVC has accomplished about 2 times of compression efficiency enhancement compared to the existing video coding standard of H.264/AVC. One of the newly adopted tools in HEVC is the transform skip scheme which performs quantization without transform. This technique improves coding efficiency especially with computer-generated images. However, the unavailability of global or local properties of general video signals demands encoder to decide whether performing transform or not for each TU (Transform Unit). The necessity of computing rate-distortion costs for this decision is one reason to increase encoder complexity. In this paper, a fast transform skip mode decision method is proposed, which is based on the fast decision of rate-distortion cost calculation for transform skip mode, by considering frequency characteristics of residual signal. The proposed method can reduce $4{\times}4$ TU encoding time by about 27.1% with only about 0.03% consequential decrement in BDBR.

Fast Mode Decision Algorithm for Scalable Video Coding (SVC) Using Directional Information of Neighboring Layer (스케일러블 비디오 코딩에서 방향성 정보를 이용한 모드 결정 고속화 기법)

  • Jung, Hyun-Ki;Hong, Kwang-Soo;Kim, Byung-Gyu;Kim, Chang-Ki;Yoo, Jeong-Ju
    • Journal of Broadcast Engineering
    • /
    • v.17 no.1
    • /
    • pp.108-121
    • /
    • 2012
  • As Scalable Video Coding (SVC) is a video compression standard extended from H.264/AVC, it is a way to provide scalability in terms of temporal, spatial and quality. Although the compression efficiency of SVC is increased due to the scalability in many aspect, it is essential to reduce the complexity in order to efficiently use because the complexity is relatively increased. To reduce the complexity of SVC in the paper, we propose fast mode decision algorithm to reduce the complexity of encoding process using direction information of B-picture by efficiently performing inter-layer prediction. The proposed algorithm is a fast mode decision algorithm that makes different from detection mode number of forward and backward, bi-direction in the way using best mode of base-layer up-sampled after simply SKIP mode detection using the direction information of best mode of base-layer up-sampled. The experimental results show that the proposed algorithm approach can achieve the maximum computational time saving about 53% with almost no loss of rate distortion (RD) performance in the enhancement layer.

Channel Condition Adaptive Error Concealment using Scalability Coding (채널상태에 적응적인 계층 부호화를 이용한 오류 은닉 방법 연구)

  • Han Seung-Gyun;Park Seung-Ho;Suh Doug-Young
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.1B
    • /
    • pp.8-17
    • /
    • 2004
  • In this paper: we propose the adaptive error concealment technique for scalable video coding over wireless network error prove environment. We prove it is very effective that Error concealment techniques proposed in this paper are applied to scalable video data. In this paper, we propose two methods of error concealment. First one is that the en·or is concealed using the motion vector of base layer and previous VOP data. Second one is that according to existence of motion vector in error position, the error is concealed using the same position data of base layer when the motion vector is existing otherwise using the same position data of previous VOP when the motion vector is 0(zero) adaptively. We show that according to various error pattern caused by condition of wireless network and characteristics of sequence, we refer decoder to base layer data or previous enhancement layer data to effective error concealment. Using scalable coding of MPEG-4 In this paper, this error concealment techniques are available to be used every codec based on DCT.

The depth quality enhancement algorithm for Autostereoscopic 3D Monitor (무안경 3D 모니터를 위한 Depth 화질 향상 Algorithm)

  • Song, Sung-Ho;Lee, Kyoung-Il;Lee, Dong-Ha;Park, Jong-Cheol;Lee, Jea-Jun;Kim, Young-Kil
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2012.05a
    • /
    • pp.133-136
    • /
    • 2012
  • In this paper, we found the many effective ways and apply for improve the 3D quality of Autostereoscopic 3D display products. Autostereoscopic products compared to traditional 3D glasses, the disadvantage is the poor depth of 3D picture quality and it only can see the fixed distance and position. So, for the compensate this disadvantage, we use the Head tracking technology and video placement algorithms and several techniques. In this paper, the will report on how to improve the Parallax Barrier Autostereoscopic 3D quality through the Head tracking of the user identification, video replacement algorithms and crosstalk improving method.

  • PDF

High-performance Mobile Transmission Rate and Physical Layer Linear Error Correction Performance Verification (고성능 모바일의 전송율 향상을 위한 무선 통신 시스템의 물리계층 선형에러 성능 검증)

  • Chung, Myungsug;Lee, Jooyeoun;Jeong, Taikyeong
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.22 no.3
    • /
    • pp.19-26
    • /
    • 2017
  • In this paper, a Linear Error Correction Code, Which is Applicable to Next Generation Wireless Communication System Technology, is Constructed Based on Performance Comparison and Transmission Based on the Premise of High Performance Mobile Rate Enhancement System. This is Because Data Rates are Becoming an Important Issue in Reed-Solomon Codes and Linear Error Code (LDPC) Used in the Physical Layer of Digital Communication and Broadcasting Technologies. Therefore, this paper Simulates the Performance of Reed - Solomon Code and LDPC Applied to Mobile Broadcasting DVB (Digital Video Broadcasting) System and Mobile Broadcasting in Digital Communication and Broadcasting, At this time, Technical Aspects of the Transmission Efficiency and Performance of the LDPC Replacing the Existing Reed-Solomon Code have been Verified from the Viewpoint of Efficiency.

Novel Viterbi Decoding Architecture for DVB-T with Improved Performance in Rayleigh Channels (레일레이 채널에서 성능 향상을 위한 DVB-T용 비터비 디코더의 아키텍쳐)

  • Oh, Jung-Youn;Park, Kyu-Hyun;Lee, Seung-Jun
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.39 no.6
    • /
    • pp.718-726
    • /
    • 2002
  • This paper presents a novel Viterbi decoding architecture for European Digital Video Broadcasting (DVB) receiver. The channel sate information (CSI) of each sub carrier is used to weight the bit-metric of each symbol. The weighted bit-metric is delivered to Viterbi decoder after going through the symbol deinterleaver and bit deinterleaver, such that the CSI can be correctly applied to corresponding bits even after the two interleavings. Simulation shows that the new architecture gives significant performance enhancement of 6~13dB in Rayleigh fading channels depending on the modulation types. This results is also better than previous results by 3.7~10.3dB.