• Title/Summary/Keyword: software engineering

Search Result 12,329, Processing Time 0.035 seconds

Super High-Resolution Image Style Transfer (초-고해상도 영상 스타일 전이)

  • Kim, Yong-Goo
    • Journal of Broadcast Engineering
    • /
    • v.27 no.1
    • /
    • pp.104-123
    • /
    • 2022
  • Style transfer based on neural network provides very high quality results by reflecting the high level structural characteristics of images, and thereby has recently attracted great attention. This paper deals with the problem of resolution limitation due to GPU memory in performing such neural style transfer. We can expect that the gradient operation for style transfer based on partial image, with the aid of the fixed size of receptive field, can produce the same result as the gradient operation using the entire image. Based on this idea, each component of the style transfer loss function is analyzed in this paper to obtain the necessary conditions for partitioning and padding, and to identify, among the information required for gradient calculation, the one that depends on the entire input. By structuring such information for using it as auxiliary constant input for partition-based gradient calculation, this paper develops a recursive algorithm for super high-resolution image style transfer. Since the proposed method performs style transfer by partitioning input image into the size that a GPU can handle, it can perform style transfer without the limit of the input image resolution accompanied by the GPU memory size. With the aid of such super high-resolution support, the proposed method can provide a unique style characteristics of detailed area which can only be appreciated in super high-resolution style transfer.

3D Architecture Modeling and Quantity Estimation using SketchUp (스케치업을 활용한 3D 건축모델링 및 물량산출)

  • Kim, Min Gyu;Um, Dae Yong
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.7 no.6
    • /
    • pp.701-708
    • /
    • 2017
  • The construction cost is estimated based on the drawings at the design stage and constructor will find efficient construction methods for budgeting and budgeting appropriate to the budget. Accurate quantity estimation and budgeting are critical to determining whether the project is profitable or not. However, since this process is mostly performed depending on manpower or 2D drawings, errors are likely to occur and The BIM(Build Information Modeling) program, which can be automated, is very expensive and difficult to apply in the field. In this study, 3D architectural modeling was performed using SketchUp which is a 3D modeling software and suggest a methodology for Quantity Estimation. As a result, 3D modeling was performed effectively using 2D drawings of buildings. Based on the modeling results, it was possible to calculate the difference of the quantity estimation by 2D drawing and 3D modeling. The research suggests that the 3D modeling using the SketchUp and the calculation of the quantity can prevent the error of the conventional 2D calculation method. If the applicability of the research method is verified through continuous research, it will contribute to increase the efficiency of architectural modeling and quantity Estimation work.

Counting Harmful Aquatic Organisms in Ballast Water through Image Processing (이미지처리를 통한 선박평형수 내 유해수중생물 개체수 측정)

  • Ha, Ji-Hun;Im, Hyo-Hyuk;Kim, Yong-Hyuk
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.6 no.3
    • /
    • pp.383-391
    • /
    • 2016
  • Ballast water provides stability and manoeuvrability to a ship. Foreign harmful aquatic organisms, which were transferred by ballast water, cause disturbing ecosystem. In order to minimize transference of foreign harmful aquatic organisms, IMO(International Maritime Organization) adopted the International Convention for the Control and Management of Ship's Ballast Water and Sediments in 2004. If the convention take effect, a port authority might need to check that ballast water is properly disposed of. In this paper, we propose a method of counting harmful aquatic organisms in ballast water thorough image processing. We extracted three samples from the ballast water that had been collected at Busan port in Korea. Then we made three grey-scale images from each sample as experimental data. We made a comparison between the proposed method and CellProfiler which is a well known cell-counting program based on image processing. Setting of CellProfiler is empirically chosen from the result of cell count by an expert. After finding a proper threshold for each image at which the result is similar to that of CellProfiler, we used the average value as the final threshold. Our experimental results showed that the proposed method is simple but about ten times faster than CellProfiler without loss of the output quality.

Implementation of Plastic Bottle Classification System for Recycling (분리수거를 위한 페트병 분리시스템의 구현)

  • Park, Yongha;Park, Jihoon;Chung, Hoyeong;Lee, Joosang;Lee, Jungyeop
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.365-368
    • /
    • 2021
  • In this study, a plastic bottle recycling bin system that utilizes an infrared sensor was implemented. The proposed system consists of a recognition unit, a control unit, an alarm unit, and a driving unit. The recognition unit detects the plastic bottle, measures the distance between the plastic bottle and the infrared sensor, extracts the value of the bottle, compares the extracted value with a standard range, and then transmits the control value to the control unit if the extracted value of the bottle is outside the standard range. In this case, the result of the presence or absence of a brand label or bottle cap is transmitted to the controller. The control unit opens the entrance of the recycling bin or alerts the alarm unit according to the result value transmitted from the sensor unit. In order to implement the proposed system, the recognition unit was implemented with an infrared sensor, and the control unit was made with an Arduino IDE controller, based on the C programming language. Additionally, the recognition unit and the control unit are able to communicate using analog signals. The proposed system accurately judges the presence or absence of a brand label and bottle cap of plastic bottles according to a predetermined algorithm. It then blocks the entrance of the recycling bin when a brand label or bottle cap is still attached. As the amount of waste discharged per person is relatively high and the majority of such waste is incinerated rather than recycled, the system proposed in this study is expected to increase the recycling rate of plastic bottles.

  • PDF

Context-Dependent Video Data Augmentation for Human Instance Segmentation (인물 개체 분할을 위한 맥락-의존적 비디오 데이터 보강)

  • HyunJin Chun;JongHun Lee;InCheol Kim
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.12 no.5
    • /
    • pp.217-228
    • /
    • 2023
  • Video instance segmentation is an intelligent visual task with high complexity because it not only requires object instance segmentation for each image frame constituting a video, but also requires accurate tracking of instances throughout the frame sequence of the video. In special, human instance segmentation in drama videos has an unique characteristic that requires accurate tracking of several main characters interacting in various places and times. Also, it is also characterized by a kind of the class imbalance problem because there is a significant difference between the frequency of main characters and that of supporting or auxiliary characters in drama videos. In this paper, we introduce a new human instance datatset called MHIS, which is built upon drama videos, Miseang, and then propose a novel video data augmentation method, CDVA, in order to overcome the data imbalance problem between character classes. Different from the previous video data augmentation methods, the proposed CDVA generates more realistic augmented videos by deciding the optimal location within the background clip for a target human instance to be inserted with taking rich spatio-temporal context embedded in videos into account. Therefore, the proposed augmentation method, CDVA, can improve the performance of a deep neural network model for video instance segmentation. Conducting both quantitative and qualitative experiments using the MHIS dataset, we prove the usefulness and effectiveness of the proposed video data augmentation method.

Extending StarGAN-VC to Unseen Speakers Using RawNet3 Speaker Representation (RawNet3 화자 표현을 활용한 임의의 화자 간 음성 변환을 위한 StarGAN의 확장)

  • Bogyung Park;Somin Park;Hyunki Hong
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.12 no.7
    • /
    • pp.303-314
    • /
    • 2023
  • Voice conversion, a technology that allows an individual's speech data to be regenerated with the acoustic properties(tone, cadence, gender) of another, has countless applications in education, communication, and entertainment. This paper proposes an approach based on the StarGAN-VC model that generates realistic-sounding speech without requiring parallel utterances. To overcome the constraints of the existing StarGAN-VC model that utilizes one-hot vectors of original and target speaker information, this paper extracts feature vectors of target speakers using a pre-trained version of Rawnet3. This results in a latent space where voice conversion can be performed without direct speaker-to-speaker mappings, enabling an any-to-any structure. In addition to the loss terms used in the original StarGAN-VC model, Wasserstein distance is used as a loss term to ensure that generated voice segments match the acoustic properties of the target voice. Two Time-Scale Update Rule (TTUR) is also used to facilitate stable training. Experimental results show that the proposed method outperforms previous methods, including the StarGAN-VC network on which it was based.

Heterogeneous Sensor Coordinate System Calibration Technique for AR Whole Body Interaction (AR 전신 상호작용을 위한 이종 센서 간 좌표계 보정 기법)

  • Hangkee Kim;Daehwan Kim;Dongchun Lee;Kisuk Lee;Nakhoon Baek
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.12 no.7
    • /
    • pp.315-324
    • /
    • 2023
  • A simple and accurate whole body rehabilitation interaction technology using immersive digital content is needed for elderly patients with steadily increasing age-related diseases. In this study, we introduce whole-body interaction technology using HoloLens and Kinect for this purpose. To achieve this, we propose three coordinate transformation methods: mesh feature point-based transformation, AR marker-based transformation, and body recognition-based transformation. The mesh feature point-based transformation aligns the coordinate system by designating three feature points on the spatial mesh and using a transform matrix. This method requires manual work and has lower usability, but has relatively high accuracy of 8.5mm. The AR marker-based method uses AR and QR markers recognized by HoloLens and Kinect simultaneously to achieve a compliant accuracy of 11.2mm. The body recognition-based transformation aligns the coordinate system by using the position of the head or HMD recognized by both devices and the position of both hands or controllers. This method has lower accuracy, but does not require additional tools or manual work, making it more user-friendly. Additionally, we reduced the error by more than 10% using RANSAC as a post-processing technique. These three methods can be selectively applied depending on the usability and accuracy required for the content. In this study, we validated this technology by applying it to the "Thunder Punch" and rehabilitation therapy content.

UX Design of Mobile Banking Usage Improvement for Seniors (시니어들을 위한 모바일 뱅킹 이용률 개선을 위한 UX 디자인)

  • Jongbin Lee;Homin Boun
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.12 no.7
    • /
    • pp.325-332
    • /
    • 2023
  • Currently, the world's population has already entered a super-aging era, and the rate is expected to increase rapidly to about 40% by 2050. However, the rapid development of automation technology and the online service sector, the main technologies of the Fourth Industrial Revolution, are still further isolating them in a world where many inconveniences and development technologies are applied. As such, alienation in daily life is widely expanded in various fields, but the financial service sector is one of the must-use areas regardless of age because of its strong nature in the public service sector, and is a very important factor in the period when branches are rapidly decreasing. However, the current utilization rate of mobile banking services is not around 5%, so users over 60 are rarely able to use them. The UX design of the most frequently used remittance service screen in mobile banking services was proposed, and the difficulty of trying to find the preferred bank among 56 or more banks was solved by analyzing the usage rate of each bank and dividing it into three stages by age group from 50 or older. In addition, it was designed to strengthen customized services by showing their recently used banks as the top priority. The design proposed in this study obtained an average of 4.8 points or more out of 5 points as a result of usability satisfaction through interviews with less than 50 senior groups. This study is believed to help each bank upgrade its different mobile banking designs in a unified manner.

Impacts of Nitrate in Base Flow Discharge on Surface Water Quality (질산성 질소 기저유출이 지표수 수질에 미치는 영향)

  • Kim, Geonha;Lee, Hosik
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.29 no.1B
    • /
    • pp.105-109
    • /
    • 2009
  • It is a well known fact that baseflow discharge of rainfall runoff impacts on water quality of surface water significantly. In this paper, impacts of nitrate discharged as base flow on stream water quality were studied by using a software, PULSE from USGS to calculate monthly ground water discharge from hydrograph. We used water quality and flow rate data for Ghapcehon2 site in Daejeon city for year 2005 as well as ground water quality data in the watershed acquired from government agencies. Agricultural and forestry land use are dominant for upstream of Ghapcheon2 in the watershed. Base flow contributes about 85~95% of stream flows during spring and fall while 25~38% of stream flow was induced by base flow during summer and winter. Monthly nitrate loading discharged as base flow for Ghapcheon2 was estimated by using averaged nitrate concentration of groundwater in the watershed. Nitrate loading induced by base flow at Ghapcheon2 was estimated as 5.4 ton of $NO_{3}{^-}-N/km^{2}$, which is about 60% of nitrate loading of surface water, 9.2 ton of $NO_{3}{^-}-N/km^{2}$. Seasonal variation of nitrate concentration of base flow was estimated by dividing monthly nitrate loading by monthly base flow discharge. Nitrate concentration of groundwater was increasing from rainy season. From this study, it can be understood that ground water quality monitoring is important for the proper manage of surface water quality.

Empirical and Numerical Analyses of a Small Planing Ship Resistance using Longitudinal Center of Gravity Variations (경험식과 수치해석을 이용한 종방향 무게중심 변화에 따른 소형선박의 저항성능 변화에 관한 연구)

  • Michael;Jun-Taek Lim;Nam-Kyun Im;Kwang-Cheol Seo
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.29 no.7
    • /
    • pp.971-979
    • /
    • 2023
  • Small ships (<499 GT) constitute 46% of the existing ships, therefore, it can be concluded that they produce relatively high CO2 gas emissions. Operating in optimal trim conditions can reduce the resistance of the ship, which results in fewer greenhouse gases. An affordable way for trim optimization is to adjust the weight distribution to obtain an optimum longitudinal center of gravity (LCG). Therefore, in this study, the effect of LCG changes on the resistance of a small planing ship is studied using empirical and numerical analyses. The Savitsky method employing Maxsurf resistance and the STAR-CCM+ commercial computational fluid dynamics (CFD) software is used for the empirical and numerical analyses, respectively. Finally, the total resistance from the ship design process is compared to obtain the optimum LCG. To summarize, using numerical analysis, optimum LCG is achieved at the 46.2% length overall (LoA) at Froude Number 0.56, and 43.4% LoA at Froude Number 0.63, which provides a significant resistance reduction of 41.12 - 45.16% compared to the reference point at 29.2% LoA.