• Title/Summary/Keyword: Two-Frame

Search Result 2,591, Processing Time 0.035 seconds

Real-time Monocular Camera Pose Estimation using a Particle Filiter Intergrated with UKF (UKF와 연동된 입자필터를 이용한 실시간 단안시 카메라 추적 기법)

  • Seok-Han Lee
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.16 no.5
    • /
    • pp.315-324
    • /
    • 2023
  • In this paper, we propose a real-time pose estimation method for a monocular camera using a particle filter integrated with UKF (unscented Kalman filter). While conventional camera tracking techniques combine camera images with data from additional devices such as gyroscopes and accelerometers, the proposed method aims to use only two-dimensional visual information from the camera without additional sensors. This leads to a significant simplification in the hardware configuration. The proposed approach is based on a particle filter integrated with UKF. The pose of the camera is estimated using UKF, which is defined individually for each particle. Statistics regarding the camera state are derived from all particles of the particle filter, from which the real-time camera pose information is computed. The proposed method demonstrates robust tracking, even in the case of rapid camera shakes and severe scene occlusions. The experiments show that our method remains robust even when most of the feature points in the image are obscured. In addition, we verify that when the number of particles is 35, the processing time per frame is approximately 25ms, which confirms that there are no issues with real-time processing.

A study on end-to-end speaker diarization system using single-label classification (단일 레이블 분류를 이용한 종단 간 화자 분할 시스템 성능 향상에 관한 연구)

  • Jaehee Jung;Wooil Kim
    • The Journal of the Acoustical Society of Korea
    • /
    • v.42 no.6
    • /
    • pp.536-543
    • /
    • 2023
  • Speaker diarization, which labels for "who spoken when?" in speech with multiple speakers, has been studied on a deep neural network-based end-to-end method for labeling on speech overlap and optimization of speaker diarization models. Most deep neural network-based end-to-end speaker diarization systems perform multi-label classification problem that predicts the labels of all speakers spoken in each frame of speech. However, the performance of the multi-label-based model varies greatly depending on what the threshold is set to. In this paper, it is studied a speaker diarization system using single-label classification so that speaker diarization can be performed without thresholds. The proposed model estimate labels from the output of the model by converting speaker labels into a single label. To consider speaker label permutations in the training, the proposed model is used a combination of Permutation Invariant Training (PIT) loss and cross-entropy loss. In addition, how to add the residual connection structures to model is studied for effective learning of speaker diarization models with deep structures. The experiment used the Librispech database to generate and use simulated noise data for two speakers. When compared with the proposed method and baseline model using the Diarization Error Rate (DER) performance the proposed method can be labeling without threshold, and it has improved performance by about 20.7 %.

Difference Factors Analysis of between Quantity Take-off Using BIM Model and Using 2D Drawings in Reinforced Concrete Building Frame (건물 골조수량 산출 시 BIM모델 기반 수량과 2D도면 기반 수량 차이 요인 분석)

  • Kim, Gwang-Hee
    • Journal of the Korea Institute of Building Construction
    • /
    • v.23 no.5
    • /
    • pp.651-662
    • /
    • 2023
  • Recently, research on the use of Building Information Modeling(BIM) for various construction management activities is being actively conducted, and interest in 3D model-based estimation is increasing because it has the advantage of being able to be automatically performed using the attribute information of the 3D model. Therefore, this study aimed that the difference in the quantities is calculated the quantity based on the 2D drawing of a building and is extracted from the 3D model created by the Revit software was compared and tried to find out the cause. The difference in the quantity calculated by the two methods was the largest in the formwork, followed by the smallest in the order of the quantity of rebar and concrete. The reason for this difference is that there is a part where the quantity extraction in the 3D model is not suitable for the quantity calculation standard, and in particular, in the case of formwork, it was difficult to separate only the quantity of the necessary part. In addition, since the quantity of rebar was not separated by member, it was impossible to accurately compare the quantity and identify the cause of the difference. Therefore, it is considered to be the most reasonable to use application software that imports only the numerical information necessary for quantity calculation from the 3D model and applies a separate calculation formula.

Comparative Study on Feature Extraction Schemes for Feature-based Structural Displacement Measurement (특징점 추출 기법에 따른 구조물 동적 변위 측정 성능에 관한 연구)

  • Junho Gong
    • Journal of the Korea institute for structural maintenance and inspection
    • /
    • v.28 no.3
    • /
    • pp.74-82
    • /
    • 2024
  • In this study, feature point detection and displacement measurement performance depending on feature extraction algorithms were compared and analyzed according to environmental changes and target types in the feature point-based displacement measurement algorithm. A three-story frame structure was designed for performance evaluation, and the displacement response of the structure was digitized into FHD (1920×1080) resolution. For performance analysis, the initial measurement distance was set to 10m, and increased up to 40m with an increment of 10m. During the experiments, illuminance was fixed to 450lux or 120lux. The artificial and natural targets mounted on the structure were set as regions of interest and used for feature point detection. Various feature detection algorithms were implemented for performance comparisons. As a result of the feature point detection performance analysis, the Shi-Tomasi corner and KAZE algorithm were found that they were robust to the target type, illuminance change, and increase in measurement distance. The displacement measurement accuracy using those two algorithms was also the highest. However, when using natural targets, the displacement measurement accuracy is lower than that of artificial targets. This indicated the limitation in extracting feature points as the resolution of the natural target decreased as the measurement distance increased.

A Study on Detection of Overloaded Vehicles at Highway Toll Gates Using Detection of Height Changes in Vehicle Cargo Boxes (차량 적재함의 높이 변화 감지를 이용한 고속도로 톨게이트 과적차량 검출에 관한 연구)

  • Gwang Lee;Bong-Keun Kim
    • Journal of Practical Engineering Education
    • /
    • v.16 no.3_spc
    • /
    • pp.391-399
    • /
    • 2024
  • All highway toll gates in Korea use low-speed WIM(Weight-In-Motion) to block overloaded cargo vehicles from entering the main highway, but some cargo vehicle owners are illegally modifying vehicles to operate variable axles and evading crackdowns by manipulating the axles. In previous studies detect all tires of a running vehicle were detected to determine whether there is axle manipulation. However, because the vehicle entry area at the highway toll gate checkpoint is very narrow, there is a problem that it is realistically difficult to film all tires of the entering vehicle in one video frame. In this paper, we proposed a system that can determine whether the axle is being operated through changes in the height of the vehicle's cargo box rather than by detecting tires. To detect changes in the height of a cargo box, we propose a method to extract the representative line of the cargo box using Hough transform and then measure the change in height of the representative line to detect the change in height of the cargo box. In addition, we propose a method to detect changes in the vertical height of a cargo box by accumulating motion vectors of pixels within a certain area of the image using optical flow. And the two methods were compared and their advantages and disadvantages were analyzed and presented.

Excellent Local Tumor Response after Fractionated Stereotactic Radiation Therapy for Locally Recurrent Nasopharynx Cancer (국소 재발 비인강암에 대한 정위적 방사선 분할 치료의 적용)

  • Lim Do Hoon;Chio Dong Rak;Kim Moon Kyung;Kim Dae Yong;Huh Seung Jae;Baek Chung-Hwan;Chu Kwang Chol;Yoon Sung Soo;Park Keunchil;Ahn Yong-Chan
    • Radiation Oncology Journal
    • /
    • v.15 no.1
    • /
    • pp.19-26
    • /
    • 1997
  • Purpose : This study is to report experience with Fractionated Stereotactic Radiation Therapy (FSRT) for locally recurrent nasopharynx cancer after curative conventional radiation therapy. Materials and Methods : Three Patients with locally recurrent and symptomatic nasopharynx cancer were given FSRT as reirradiation method between the Period of September of 1995 and August of 1996 For two Patients, application of FSRT is their third radiation therapy directed to the nasopharynx. Two patients were given low dose chemotherapy as radiation sensitizer concurrently with FSRT Authors used 3-dimensional coordinate system by individually made, relocatable Gill-Thomas-Cosman (GTC) stereotactic frame and multiple non-coplanar arc therapy dose Planning was done using Xknife-3. Total of 45 Gy/18 fractions or 50 Gy/20 fractions were given. Results : Authors observed satisfactory symptomatic improvement and remarkable objective tumor size decrease by follow-up MR images taken 1 month Post-FSRT in ali three patients, while no neurologic side effect attributable to reirradiation was noticed. Two died at 7 and 9 months with loco-regional and distant seeding outside FSRT field, while one patient is living for 4 month. Conclusion Authors experienced satisfactory therapeutic effectiveness and safety of FSRT as reirradiatlon method for locally recurrent nasopharynx cancer Development of more effective systemic chemotherapeutic regimen is desired for distant metastasis

  • PDF

A Study on the Construal Level and Intention of Autonomous Driving Taxi According to Message Framing (해석수준과 메시지 프레이밍에 따른 자율주행택시의 사용의도에 관한 연구)

  • Yoon, Seong Jeong;Kim, Min Yong
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.3
    • /
    • pp.135-155
    • /
    • 2018
  • The purpose of this study is to analyze the difference of interpretation level and intention to use message framing when autonomous vehicle, which is emerging as the product of 4th industrial revolution, is used as taxi, Interpretation level refers to the interpretation of a product or service, assuming that it will happen in the near future or in the distant future. Message framing refers to the formation of positive or negative expressions or messages at the extremes of benefits and losses. In other words, previous studies interpret the value of a product or service differently according to these two concepts. The purpose of this study is to investigate whether there are differences in intention to use when two concepts are applied when an autonomous vehicle is launched as a taxi. The results are summarized as follows: First, the message format explaining the gain and why should be used when using the autonomous taxi in the message framing configuration, and the loss and how when the autonomous taxi is not used. Messages were constructed and compared. The two message framing differed (t = 3.063), and the message type describing the benefits and reasons showed a higher intention to use. In addition, the results according to interpretation level are summarized as follows. There was a difference in intentions to use when assuming that it would occur in the near future and in the near future with respect to the gain and loss, Respectively. In summary, in order to increase the intention of using autonomous taxis, it is concluded that messages should be given to people assuming positive messages (Gain) and what can happen in the distant future. In addition, this study will be able to utilize the research method in studying intention to use new technology. However, this study has the following limitations. First, it assumes message framing and time without user experience of autonomous taxi. This will be different from the actual experience of using an autonomous taxi in the future. Second, self-driving cars should technical progress is continuing, but laws and institutions must be established in order to commercialize it and build the infrastructure to operate the autonomous car. Considering this fact, the results of this study can not reflect a more realistic aspect. However, there is a practical limit to search for users with sufficient experience in new technologies such as autonomous vehicles. In fact, although the autonomous car to take advantage of the public transportation by taxi is now ready for the road infrastructure, and technical and legal public may not be willing to choose to not have enough knowledge to use the Autonomous cab. Therefore, the main purpose of this study is that by assuming that autonomous cars will be commercialized by taxi you can do to take advantage of the autonomous car, it is necessary to frame the message, why can most effectively be used to find how to deliver. In addition, the research methodology should be improved and future research should be done as follows. First, most students responded in this study. It is also true that it is difficult to generalize the hypotheses to be tested in this study. Therefore, in future studies, it would be reasonable to investigate the population of various distribution considering the age, area, occupation, education level, etc. Where autonomous taxi can be used rather than those who can drive. Second, it is desirable to construct various message framing of the questionnaire, but it is necessary to learn various message framing in advance and to prevent errors in response to the next message framing. Therefore, it is desirable to measure the message framing with a certain amount of time when the questionnaire is designed.

Problems of administrative area system in Korea and reforming direction (한국 행정구역체계의 문제점과 개편의 방향)

  • ;Yim, Seok-Hoi
    • Journal of the Korean Geographical Society
    • /
    • v.29 no.1
    • /
    • pp.65-83
    • /
    • 1994
  • Sevaral problems of administrative area sysem in Korea have been brought up for a long time. Because its frame has remained since Chosun and Japanese colonial period in spite of changing local administrative environment in accordance with rapid industrialization and urbanization. Recent reform of city (Shi)- county (Gun) integration is derived from this argument. But problems which permeate deeply overall system cannot be solved by partial reorganization of Shi-Gun. They may be rationalized only through the reform of the whole system. The aims of this study are to analyze problems of administrative area system entirelr and to discuss the direction of its reform from that point of view. Major problems of administrative area system are summed up into the followings. Firstly, it is found that administrative hierarchies are too many levels. Contemporary administrative hierarchical structure is 4 levels: regional autonomous government (Tukpyolshi, Jik'halshi, Do), local autonomous government (Shi, Gun), two leveis of auxiliary administrative area (Up, Myun and Ri). These hierarchies were established in late period of Chosun which transportation was undeveloped and residential activity space was confined. But today developing transportion and expanding sphere of life don't need administrative hierarchical structurl with many levels. Besides developing administrative technology reduces administrative space by degrees. Many levels of contemporary administrative hierarchical structure are main factor of administrative inefficency, discording with settlement system. Second problem is that Tukpyolshi and Jik'halshi - cities under direct control of the central government as metropolitan area - underbounded cities. Underbounded city discomforts residential life and increases external elects of local pulic services. Especially this problem is Seoul, Pusan and Daegu. Third problem is that Do-areas are mostly two larger in integrating into single sphere of life. In fact each of them consistes of two or three sphere of life. Fourth Problem is metropolitan government system that central city is seperated from complementary area, i.e. Do. It brings about weakening the economic force of Do. Fifth problem is that several cities divided single sphere of life. It is main factor of finantial inefficency and facing difficult regional administration. Finally necessity of rural parish (Myun.) is diminished gradually with higher order center oriented activty of rural residents. First of all administrative area system should corresponds with substantial sphere of life in order to solve these problems. Followings are some key directions this study proposes on the reform of administrative area system from that standpoint. 1. Principles of reorgnization -- integration of central dty with complementary area. -- correspondence of administrative hierarchical structure with settlement system. -- correspondence of boundary of administrative area with sphere of life. 2. Reform strategy -- Jik'halshi is integrated with Do and is under the contol of Do. -- Small Seoul shi (city) which have special functions as captal is demarcated in Seoul tukpyolshi and 22 autonomous distrcts of Seoul tukpyolshi is integrated into 3-4 cities. -- Neighboring cities (Shies) in single sphere of life are intrgrated into single city (Shj). -- Myun and Ri are abolished in rural region and new unit of local administrative area on the basis of lowest order sphere of life into which 3-4 Ries are integrated replaces them.

  • PDF

The Changes of Cerebral Metabolic and Hemodynamic Parameters, Brain Histology, and Serum Levels of Neuron-Specific Enolase During Retrograde Cerebral Perfusion Under Pofound Hypothermic total Circulatory Arrest in Pigs (돼지에서 초저체온 순환정지 하의 역행성 뇌관류시 뇌대사, 혈류역학 지표, 뇌조직 소견 및 혈청 내 neuron-specific enolase의 변화)

  • Kim, Kyung-Hwan;Ahn, Hyuk
    • Journal of Chest Surgery
    • /
    • v.33 no.6
    • /
    • pp.445-468
    • /
    • 2000
  • Background: Retrograde cerebral perfusion(RCP) is currently used for brain protection during aorta surgery, however, for the safety of it, various data published so far are insufficient. We performed RCP using pig and investiaged various parameters of cerebral metabolism and brain injury after RCP under deep hypothermia. Material and Method: We used two experimental groups: in group I(7 pigs, 20 kg), we performed RCP for 120 minutes and in group II (5 pigs, 20 kg), we did it for 90 minutes. Nasopharyngeal temperature, jugular venous oxygen saturation, electroencephalogram were continuously monitored, and we checked the parameters of cerebral metabolism, histological changes and serum levels of neuron-specific enolose(NSE) and lactic dehydrogenase(LDH). Central venous pressure during RCP was mainained in the range of 25 to 30 mmHg. Result: Perfusion flow rates(ml/min) during RCP were 130$\pm$57.7(30 minutes), 108.6$\pm$55.2(60 minutes), 107.1$\pm$58.8(90 minutes), 98.6$\pm$58.7(120 minutes) in group I and 72$\pm$11.0(30 minutes), 72$\pm$11.0(60 minutes), 74$\pm$11.4(90 minutes) in group II. The ratios of drain flow to perfusion flow were 0.18(30 minutes), 0.19(60 minutes), 0.17(90 minutes), 0.16(120 minutes) in group I and 0.21, 0.20, 0.17 in group II. Oxygen consumptions(ml/min) during RCP were 1.80$\pm$1.37(30 minutes), 1.72$\pm$1.23(60 minutes), 1.38$\pm$0.82(90 minutes), 1.18$\pm$0.67(120 minutes) in group I and 1.56$\pm$0.28(30 minutes), 1.25$\pm$0.28(60 minutes), 1.13$\pm$0.26(90 minutes). We could observe an decreasing tendency of oxygen consumption after 90 minutes of RCP in group I. Cerebrovascular resistance(dynes.sec.cm-5) during RCP in group I incrased from 71370.9$\pm$369145.5 to 83920.9$\pm$49949.0 after the time frame of 90 minutes(p<0.05). Lactate(mg/min) appeared after 30 minutes of RCP and the levels were 0.15$\pm$0.07(30 minutes), 0.18$\pm$0.10(60 minutes), 0.19$\pm$0.19(90 minutes), 0.18$\pm$0.10(120 minutes) in group I and 0.13$\pm$0.09(30 minutes), 0.19$\pm$0.03(60 minutes), 0.29$\pm$0.11(90 minutes) in group II. Glucose utilization, exudation of carbon dioxide, differences of cerebral tissue acidosis between perfusion blood and drain blood were maintained constantly during RCP. Oxygen saturation levels(%) in drain blood during RCP were 22.9$\pm$4.4(30 minutes), 19.2$\pm$4.5(60 minutes), 17.7$\pm$2.8(90 minutes), 14.9$\pm$2.8(120 minutes) in group I and 21.3$\pm$8.6(30 minutes), 20.8$\pm$17.6(60 minutes), 21.1$\pm$12.1(90 minutes) in group II. There were no significant changes in cerebral metabolic parameters between two groups. Differences in serum levels of NSE and LDH between perfusion blood and drain blood during RCP showed no statistical significance. Serum levels of NSE and LDH after resuming of cardipulmonary bypass decreased to the level before RCP. Brain water contents were 0.73$\pm$0.03 in group I and 0.69$\pm$0.06 in group II and were higher than those of the controls(p<0.05). The light microscopic findings of cerebral neocortex, basal ganglia, hippocampus(CA1 region) and cerebellum showed no evidence of cerebral injury in two groups and there were no different electron microscopy in both groups(neocortex, basal ganglia and hippocampus), but they were thought to be reversible findings. Conclusion: Although we did not proceed this study after survival of pigs, we could perform the RCP successfully for 120 minutes with minimal cerebral metabolism and no evidence of irreversible brain damage. The results of NSE and LDH during and after RCP should be reevaluated with survival data.

  • PDF

Strategy of Multistage Gamma Knife Radiosurgery for Large Lesions (큰 병변에 대한 다단계 감마나이프 방사선수술의 전략)

  • Hur, Beong Ik
    • Journal of the Korean Society of Radiology
    • /
    • v.13 no.5
    • /
    • pp.801-809
    • /
    • 2019
  • Existing Gamma Knife Radiosurgery(GKRS) for large lesions is often conducted in stages with volume or dose partitions. Often in case of volume division the target used to be divided into sub-volumes which are irradiated under the determined prescription dose in multi-sessions separated by a day or two, 3~6 months. For the entire course of treatment, treatment informations of the previous stages needs to be reflected to subsequent sessions on the newly mounted stereotactic frame through coordinate transformation between sessions. However, it is practically difficult to implement the previous dose distributions with existing Gamma Knife system except in the same stereotactic space. The treatment area is expanding because it is possible to perform the multistage treatment using the latest Gamma Knife Platform(GKP). The purpose of this study is to introduce the image-coregistration based on the stereotactic spaces and the strategy of multistage GKRS such as the determination of prescription dose at each stage using new GKP. Usually in image-coregistration either surgically-embedded fiducials or internal anatomical landmarks are used to determine the transformation relationship. Author compared the accuracy of coordinate transformation between multi-sessions using four or six anatomical landmarks as an example using internal anatomical landmarks. Transformation matrix between two stereotactic spaces was determined using PseudoInverse or Singular Value Decomposition to minimize the discrepancy between measured and calculated coordinates. To evaluate the transformation accuracy, the difference between measured and transformed coordinates, i.e., ${\Delta}r$, was calculated using 10 landmarks. Four or six points among 10 landmarks were used to determine the coordinate transformation, and the rest were used to evaluate the approaching method. Each of the values of ${\Delta}r$ in two approaching methods ranged from 0.6 mm to 2.4 mm, from 0.17 mm to 0.57 mm. In addition, a method of determining the prescription dose to give the same effect as the treatment of the total lesion once in case of lesion splitting was suggested. The strategy of multistage treatment in the same stereotactic space is to design the treatment for the whole lesion first, and the whole treatment design shots are divided into shots of each stage treatment to construct shots of each stage and determine the appropriate prescription dose at each stage. In conclusion, author confirmed the accuracy of prescribing dose determination as a multistage treatment strategy and found that using as many internal landmarks as possible than using small landmarks to determine coordinate transformation between multi-sessions yielded better results. In the future, the proposed multistage treatment strategy will be a great contributor to the frameless fractionated treatment of several Gamma Knife Centers.