• Title/Summary/Keyword: Inter Prediction

Search Result 307, Processing Time 0.024 seconds

3D-Distortion Based Rate Distortion Optimization for Video-Based Point Cloud Compression

  • Yihao Fu;Liquan Shen;Tianyi Chen
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.2
    • /
    • pp.435-449
    • /
    • 2023
  • The state-of-the-art video-based point cloud compression(V-PCC) has a high efficiency of compressing 3D point cloud by projecting points onto 2D images. These images are then padded and compressed by High-Efficiency Video Coding(HEVC). Pixels in padded 2D images are classified into three groups including origin pixels, padded pixels and unoccupied pixels. Origin pixels are generated from projection of 3D point cloud. Padded pixels and unoccupied pixels are generated by copying values from origin pixels during image padding. For padded pixels, they are reconstructed to 3D space during geometry reconstruction as well as origin pixels. For unoccupied pixels, they are not reconstructed. The rate distortion optimization(RDO) used in HEVC is mainly aimed at keeping the balance between video distortion and video bitrates. However, traditional RDO is unreliable for padded pixels and unoccupied pixels, which leads to significant waste of bits in geometry reconstruction. In this paper, we propose a new RDO scheme which takes 3D-Distortion into account instead of traditional video distortion for padded pixels and unoccupied pixels. Firstly, these pixels are classified based on the occupancy map. Secondly, different strategies are applied to these pixels to calculate their 3D-Distortions. Finally, the obtained 3D-Distortions replace the sum square error(SSE) during the full RDO process in intra prediction and inter prediction. The proposed method is applied to geometry frames. Experimental results show that the proposed algorithm achieves an average of 31.41% and 6.14% bitrate saving for D1 metric in Random Access setting and All Intra setting on geometry videos compared with V-PCC anchor.

Seismic retrofit of steel structures with re-centering friction devices using genetic algorithm and artificial neural network

  • Mohamed Noureldin;Masoum M. Gharagoz;Jinkoo Kim
    • Steel and Composite Structures
    • /
    • v.47 no.2
    • /
    • pp.167-184
    • /
    • 2023
  • In this study, a new recentering friction device (RFD) to retrofit steel moment frame structures is introduced. The device provides both self-centering and energy dissipation capabilities for the retrofitted structure. A hybrid performance-based seismic design procedure considering multiple limit states is proposed for designing the device and the retrofitted structure. The design of the RFD is achieved by modifying the conventional performance-based seismic design (PBSD) procedure using computational intelligence techniques, namely, genetic algorithm (GA) and artificial neural network (ANN). Numerous nonlinear time-history response analyses (NLTHAs) are conducted on multi-degree of freedom (MDOF) and single-degree of freedom (SDOF) systems to train and validate the ANN to achieve high prediction accuracy. The proposed procedure and the new RFD are assessed using 2D and 3D models globally and locally. Globally, the effectiveness of the proposed device is assessed by conducting NLTHAs to check the maximum inter-story drift ratio (MIDR). Seismic fragilities of the retrofitted models are investigated by constructing fragility curves of the models for different limit states. After that, seismic life cycle cost (LCC) is estimated for the models with and without the retrofit. Locally, the stress concentration at the contact point of the RFD and the existing steel frame is checked being within acceptable limits using finite element modeling (FEM). The RFD showed its effectiveness in minimizing MIDR and eliminating residual drift for low to mid-rise steel frames models tested. GA and ANN proved to be crucial integrated parts in the modified PBSD to achieve the required seismic performance at different limit states with reasonable computational cost. ANN showed a very high prediction accuracy for transformation between MDOF and SDOF systems. Also, the proposed retrofit showed its efficiency in enhancing the seismic fragility and reducing the LCC significantly compared to the un-retrofitted models.

Scalable Collaborative Filtering Technique based on Adaptive Clustering (적응형 군집화 기반 확장 용이한 협업 필터링 기법)

  • Lee, O-Joun;Hong, Min-Sung;Lee, Won-Jin;Lee, Jae-Dong
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.2
    • /
    • pp.73-92
    • /
    • 2014
  • An Adaptive Clustering-based Collaborative Filtering Technique was proposed to solve the fundamental problems of collaborative filtering, such as cold-start problems, scalability problems and data sparsity problems. Previous collaborative filtering techniques were carried out according to the recommendations based on the predicted preference of the user to a particular item using a similar item subset and a similar user subset composed based on the preference of users to items. For this reason, if the density of the user preference matrix is low, the reliability of the recommendation system will decrease rapidly. Therefore, the difficulty of creating a similar item subset and similar user subset will be increased. In addition, as the scale of service increases, the time needed to create a similar item subset and similar user subset increases geometrically, and the response time of the recommendation system is then increased. To solve these problems, this paper suggests a collaborative filtering technique that adapts a condition actively to the model and adopts the concepts of a context-based filtering technique. This technique consists of four major methodologies. First, items are made, the users are clustered according their feature vectors, and an inter-cluster preference between each item cluster and user cluster is then assumed. According to this method, the run-time for creating a similar item subset or user subset can be economized, the reliability of a recommendation system can be made higher than that using only the user preference information for creating a similar item subset or similar user subset, and the cold start problem can be partially solved. Second, recommendations are made using the prior composed item and user clusters and inter-cluster preference between each item cluster and user cluster. In this phase, a list of items is made for users by examining the item clusters in the order of the size of the inter-cluster preference of the user cluster, in which the user belongs, and selecting and ranking the items according to the predicted or recorded user preference information. Using this method, the creation of a recommendation model phase bears the highest load of the recommendation system, and it minimizes the load of the recommendation system in run-time. Therefore, the scalability problem and large scale recommendation system can be performed with collaborative filtering, which is highly reliable. Third, the missing user preference information is predicted using the item and user clusters. Using this method, the problem caused by the low density of the user preference matrix can be mitigated. Existing studies on this used an item-based prediction or user-based prediction. In this paper, Hao Ji's idea, which uses both an item-based prediction and user-based prediction, was improved. The reliability of the recommendation service can be improved by combining the predictive values of both techniques by applying the condition of the recommendation model. By predicting the user preference based on the item or user clusters, the time required to predict the user preference can be reduced, and missing user preference in run-time can be predicted. Fourth, the item and user feature vector can be made to learn the following input of the user feedback. This phase applied normalized user feedback to the item and user feature vector. This method can mitigate the problems caused by the use of the concepts of context-based filtering, such as the item and user feature vector based on the user profile and item properties. The problems with using the item and user feature vector are due to the limitation of quantifying the qualitative features of the items and users. Therefore, the elements of the user and item feature vectors are made to match one to one, and if user feedback to a particular item is obtained, it will be applied to the feature vector using the opposite one. Verification of this method was accomplished by comparing the performance with existing hybrid filtering techniques. Two methods were used for verification: MAE(Mean Absolute Error) and response time. Using MAE, this technique was confirmed to improve the reliability of the recommendation system. Using the response time, this technique was found to be suitable for a large scaled recommendation system. This paper suggested an Adaptive Clustering-based Collaborative Filtering Technique with high reliability and low time complexity, but it had some limitations. This technique focused on reducing the time complexity. Hence, an improvement in reliability was not expected. The next topic will be to improve this technique by rule-based filtering.

Effects of Oxidation and Hot Corrosion on the Erosion of Silicon Nitride

  • Kim, Jong Jip
    • Corrosion Science and Technology
    • /
    • v.4 no.4
    • /
    • pp.136-139
    • /
    • 2005
  • The effect of oxidation and hot corrosion on the solid particle erosion was investigated for hot-pressed silicon nitride using as-polished, pre-oxidized and pre-corroded specimens by molten sodium sulfates. Erosion tests were performed at 22, 500 and $900^{\circ}C$ using angular silicon carbide particles of mean diameter $100{\mu}m$. Experimental results show that solid particle erosion rate of silicon nitride increases with increasing temperature for as-polished or pre-oxidized specimens in consistent with the prediction of a theoretical model. Erosion rate of pre-oxidized specimens is lower than that of as-polished specimens at $22^{\circ}C$, but it is higher at $900^{\circ}C$. Lower erosion rate at $22^{\circ}C$ in the pre-oxidized specimens is attributed due to the blunting of surface flaws, and the higher erosion rate at $900^{\circ}C$ is due to brittle lateral cracking. Erosion rate of pre-corroded specimens decreases with increasing temperature. Less erosion at $900^{\circ}C$ than at $22^{\circ}C$ is associated with the liquid corrosion products sealing off pores at $900^{\circ}C$ and the absence of inter-granular crack propagation observed at $22^{\circ}C$.

An Adaptive Motion Vector Resolution Coding Scheme of Inter Prediction Mode in H.264/AVC (H.264/AVC에서 화면간 예측 모드의 적응적 움직임 벡터 해상도 부호화 방법)

  • Lee, Juock;Moon, Joo-Hee
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2010.11a
    • /
    • pp.93-95
    • /
    • 2010
  • 기존의 비디오 부호화 표준에서는 참조영상을 보간하여 해상도를 증가시킨 후, 고정된 움직임 벡터 해상도로 영상 전체를 부호화 한다. 참조 영상의 해상도를 증가시킨 만큼 움직임 보상에 의하여 예측에러가 줄어들지만, 움직임 벡터 해상도가 증가한 만큼 움직임 벡터의 부호화 비트량이 증가한다. 고정된 해상도의 움직임 벡터로 부호화하는 경우, 영상의 지역적인 움직임 특성이 다른 경우 부호화 효율이 떨어질 수 있다. 따라서 본 논문에서는 기존의 비디오 부호화 표준들이 영상의 지역적인 특성을 고려하지 않고 고정된 해상도의 움직임 벡터를 사용하여 부호화하는 문제점을 극복하기 위하여 슬라이스 단위로 1/4 화소 해상도 또는 1/8 화소 해상도 또는 움직임 벡터 단위로 적응적으로 화소 해상도를 결정하는 것 중에서 최적의 슬라이스 움직임 벡터 해상도를 결정하여 부호화하는 방법을 제안한다. 제안한 방법을 사용하여 부호화하면 움직임 벡터의 부호화 비트의 낭비를 막고, 예측 에러도 줄어들어 부호화 효율을 높일 수 있다. 제안하는 방법을 사용하여 부호화 하는 경우 H.264/AVC와 비교하여 평균 1.97%의 BD-RATE을 감소한다.

  • PDF

An Objective No-Reference Perceptual Quality Assessment Metric based on Temporal Complexity and Disparity for Stereoscopic Video

  • Ha, Kwangsung;Bae, Sung-Ho;Kim, Munchurl
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.2 no.5
    • /
    • pp.255-265
    • /
    • 2013
  • 3DTV is expected to be a promising next-generation broadcasting service. On the other hand, the visual discomfort/fatigue problems caused by viewing 3D videos have become an important issue. This paper proposes a perceptual quality assessment metric for a stereoscopic video (SV-PQAM). To model the SV-PQAM, this paper presents the following features: temporal variance, disparity variation in intra-frames, disparity variation in inter-frames and disparity distribution of frame boundary areas, which affect the human perception of depth and visual discomfort for stereoscopic views. The four features were combined into the SV-PQAM, which then becomes a no-reference stereoscopic video quality perception model, as an objective quality assessment metric. The proposed SV-PQAM does not require a depth map but instead uses the disparity information by a simple estimation. The model parameters were estimated based on linear regression from the mean score opinion values obtained from the subjective perception quality assessments. The experimental results showed that the proposed SV-PQAM exhibits high consistency with subjective perception quality assessment results in terms of the Pearson correlation coefficient value of 0.808, and the prediction performance exhibited good consistency with a zero outlier ratio value.

  • PDF

Sea State Hindcast for the Korean Seas With a Spectral Wave Model and Validation with Buoy Observation During January 1997

  • Kumar, B. Prasad;Rao, A.D.;Kim, Tae-Hee;Nam, Jae-Cheol;Hong, Chang-Su;Pang, Ig-Chan
    • Journal of the Korean earth science society
    • /
    • v.24 no.1
    • /
    • pp.7-21
    • /
    • 2003
  • The state-of-art third generation wave prediction model WAM was applied to the Korean seas for a winter monsoon period of January 1997. The wind field used in the present study is the global NSCAT-ERS/NCEP blended winds, which was further interpolated using a bi-cubic spline interpolator to fine grid limited area shallow water regime surrounding the Korean seas. To evaluate and investigate the accuracy of WAM, the hindcasted wave heights are compared with observed data from two shallow water buoys off Chil-Bal and Duk-Juk. A detailed study has been carried with the various meteorological parameters in observed buoy data and its inter-dependency on model computed wave fields was also investigated. The RMS error between the observation and model computed wave heights results to 0.489 for Chil-Bal and 0.417 for Duk-Juk. A similar comparison between the observation and interpolated winds off Duk-Juk show RMS error of 2.28 which suggest a good estimate for wave modelling studies.

Multi-view Rate Control based on HEVC for 3D Video Services

  • Lim, Woong;Lee, Sooyoun
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.8
    • /
    • pp.245-249
    • /
    • 2013
  • In this paper, we propose two rate control algorithms for multi-view extension of HEVC with two rate control algorithms adopted in HEVC and analyze the multi-view rate control performance. The proposed multi-view rate controls are designed on HEVC-based multi-view video coding (MV-HEVC) platform with consideration of high-level syntax, inter-view prediction, etc. not only for the base view but also for the extended views using the rate control algorithms based on URQ (Unified Rate-Quantization) and R-lambda model adopted in HEVC. The proposed multi-view rate controls also contain view-wise target bit allocation for providing the compatibility to the base view. By allocating the target bitrates for each view, the proposed multi-view rate control based on URQ model achieved about 1.83% of average bitrate accuracy and 1.73dB of average PSNR degradation. In addition, about 2.97% of average bitrate accuracy and 0.31dB of average PSNR degradation are achieved with the proposed multi-view rate control based on R-lambda model.

HEVC Encoding Method and Problem Analysis for Independent Tile Decoding (타일의 독립적 복호를 위한 HEVC 부호화 방법 및 문제점 분석)

  • Gwon, Daehyeok;Beak, Aram;Choi, Haechul
    • Journal of Broadcast Engineering
    • /
    • v.22 no.6
    • /
    • pp.765-773
    • /
    • 2017
  • Ultra-high definition videos, panorama contents, and ultra-wide viewing videos have a huge spatial resolution. However, a whole region of images is not always interesting to viewers due to limitations of system resources and display devices. To allow one or more interesting tiles to be decoded freely without decoding other tiles, this paper introduces a tile-based independent coding method. The propose method restraints motion vectors to be within a tile region shifting motion search area and modifying an initial motion vector. Experiments results show that any desired tile is capable to be decoded independently of other tiles.

Inter-Species Validation for Domain Combination Based Protein-Protein Interaction Prediction Method

  • Jang, Woo-Hyuk;Han, Dong-Soo;Kim, Hong-Soog;Lee, Sung-Doke
    • Proceedings of the Korean Society for Bioinformatics Conference
    • /
    • 2005.09a
    • /
    • pp.243-248
    • /
    • 2005
  • 도메인 조합에 기반한 단백질 상호작용 예측 기법은 효모와 같은 특정 종에 대하여 우수한예측 정확도를 보이는 것으로 알려졌으나, 인간과 같은 고등 생명체의 단백질에 대한 상호작용 예측을 수행하기 위하여는 여러종에 대한 기법의 적절성검증과 최적의 학습집단 구성 방안에 대한 연구가 선행되어야 한다. 본 논문에서는, 초파리 단백질을 이용한 예측 정확도 검증으로 도메인 조합 기법의 일반화 가능성을 타진 하고 이종간의 상호작용 예측실험 및 정확도 검증을 통하여 비교적 연구가 덜 되어진 종의 단백질 상호작용 예측을 위한 학습집단 구성 방법에 대하여 기술한다. 초파리 실험에서는 10351개의 상호작용이 있는 단백질 쌍 가운데, 80%와 20%를 각각 학습집단 및 실험집단으로 사용하였으며, 상호작용이 없는단백질 쌍의 학습집단은 1배에서 5배까지 변화시키면서 예측 정확도를 관찰하였다. 이 결과77.58%의 민감도와 92.61%의 특이도를 확인하였다. 이종간의 상호작용 예측 실험은 효모, 초파리, 효모, 초파리에 해당하는 학습집단 각각을 바탕으로 Human, Mouse, E. coli, C. elegans 등의 단백질 상호작용 예측을 수행하였다. 실험 곁과 학습집단의 도메인이 실험집단의 도메인과 많이 겹칠수록 높은 정확도를 보여주었으며, 도메인 집단간의 유사도를 나타내기 위해 고안한 Domain Overlapping Rate(DOR) 는 상호작용 예측 정확도의 중요한 요소임을 찾아내었다.

  • PDF