• Title/Summary/Keyword: Large Scale Data

Search Result 2,773, Processing Time 0.043 seconds

Boosted Regression Method based on Rejection Limits for Large-Scale Data (대량 데이터를 위한 제한거절 기반의 회귀부스팅 기법)

  • Kwon, Hyuk-Ho;Kim, Seung-Wook;Choi, Dong-Hoon;Lee, Kichun
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.42 no.4
    • /
    • pp.263-269
    • /
    • 2016
  • The purpose of this study is to challenge a computational regression-type problem, that is handling large-size data, in which conventional metamodeling techniques often fail in a practical sense. To solve such problems, regression-type boosting, one of ensemble model techniques, together with bootstrapping-based re-sampling is a reasonable choice. This study suggests weight updates by the amount of the residual itself and a new error decision criterion which constructs an ensemble model of models selectively chosen by rejection limits. Through these ideas, we propose AdaBoost.RMU.R as a metamodeling technique suitable for handling large-size data. To assess the performance of the proposed method in comparison to some existing methods, we used 6 mathematical problems. For each problem, we computed the average and the standard deviation of residuals between real response values and predicted response values. Results revealed that the average and the standard deviation of AdaBoost.RMU.R were improved than those of other algorithms.

An Experimental Study on the Furniture Choice and Arrangement Using Scale Down Models according to the Size of Space (축소모형을 이용한 평형별 가구선택과 배치에 대한 실험적 연구)

  • 임소연;안옥희
    • Journal of the Korean housing association
    • /
    • v.6 no.1
    • /
    • pp.39-50
    • /
    • 1995
  • The Plan for effective usage of living room must be suggested because families primarily use living room for public space. And from the viewpoint of function and decoration. the kind of furniture. furniture occupancy quantity. and the arrangement of furniture have much affect on using a dwelling space. So this study will suggest basic data for a good furniture usage through experiment using scale down models. To analyze the data. frequency and percentage were used by running SPSS $PC^+$ program. The major results are as follows. In an experiment using living room and furniture models(Scale 1/20). according to the size of space. TV sizes and furniture occupancy quantity were in proportion to size and space of the living room. Also they chose various types of tea-table and side-tables. In small spaces. subjects chose simple arrangement types (no sofa or I type sofa and cabinet). but in large spaces. they chose \ulcorner type or \ulcorner type sofa and cabinet.

  • PDF

Structure of Particle Clusters Formed in Gas-Solid flows

  • Tanaka, Toshitsugu;Ito, Akihito;Tsuji, Takuya
    • 한국전산유체공학회:학술대회논문집
    • /
    • 2006.10a
    • /
    • pp.26-27
    • /
    • 2006
  • Characteristics of spatial structure of particle clusters are investigated by using the flow field data obtained from three-dimensional numerical simulations. Eulerian/Lagrangian approach with two-way coupling is applied and individual particle-particle collisions are taken into account by using the hard-sphere model. More than 16 million particles are traced in the maximum case. The results show that the cluster is consisted from the multiple-spatial scale components while the low wave-number, hence the large-scale structure, is dominant. Three-dimensional structure reconstructed from the low-pass filtered data enables us to investigate the essential dynamics of particle clusters in detail.

  • PDF

Cosmological Information from the Small-scale Redshift Space Distortions

  • Tonegawa, Motonari;Park, Changbom;Zheng, Yi;Park, Hyunbae;Hong, Sungwook
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.43 no.2
    • /
    • pp.41.3-42
    • /
    • 2018
  • Redshift space distortion (RSD) is known as a powerful cosmological probe. The large-scale RSD has been detected by various redshift surveys and continues to be a major target of ongoing surveys. On the other hand, the small-scale RSD, called finger-of-god (FoG) effect, also has cosmological information, because different cosmological parameters cause different halo mass functions and viriarized velocities. We define the "length" of FoG and examine its dependence on cosmological parameters using the Multiverse simulation. We also use the SDSS DR7 data to see how strong constraints current data sets could provide. It is found that the volume-limited subsample D5, consisting of ~100,000 galaxies at z~0.08, yields $\Delta \Omega_m ~ 0.02$.

  • PDF

Design and Implementation of an Efficient Communication System for Collecting Sensor Data in Large Scale Sensors Networks (대규모 센서 네트워크에서 센서 데이터 수집을 위한 효율적인 통신 시스템 설계 및 구현)

  • Jang, Si-woong;Kim, Ji-Seong
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.1
    • /
    • pp.113-119
    • /
    • 2020
  • Large sensor networks require the collection and analysis of data from a large number of sensors. The number of sensors that can be controlled per micro controller is limited. In this paper, we propose how to aggregate sensor data from a large number of sensors using a large number of microcontrollers and multiple bridge nodes, and design and implement an efficient communication system for sensor data collection. Bridge nodes aggregate data from multiple microcontrollers using SPI communication, and transfer the aggregated data to PC servers using wireless TCP/IP communication. In this paper, the communication system was constructed using the Open H/W Aduo Mini and ESP8266 and performance of the system was analyzed. The performance analysis results showed that more than 30 sensing data can be collected per second from more than 700 sensors.

Characterization of DNJ production for large-scale fermentation of mulberry leaf

  • Kwon, O-Chul;Ju, Wan-Taek;Kim, Hyun-Bok;Sung, Gyoo-Byung;Kim, Yong-Soon
    • International Journal of Industrial Entomology and Biomaterials
    • /
    • v.35 no.2
    • /
    • pp.111-117
    • /
    • 2017
  • Mulberry leaves containing 1-deoxynojirimycin (DNJ) known to be a strong inhibitory effect for ${\alpha}-glucosidase$. Thus, DNJ has been recognized as a potentially important source for prevent or treat hyperglycemia. More effective method for the DNJ high-production is needed because DNJ content of natural mulberry leaf are as low as 0.1%. Many researchers have studied for the DNJ high-production in mulberry leaves such as the harvest season, fermentation using microorganisms, optimal culture conditions, and optimal extraction conditions. In order to provide for useful data that is anticipated at the level of industrial scale, we investigated ${\alpha}-glucosidase$ inhibitory activity, pH value and DNJ content in large-scale based on the optimal culture conditions for mulberry leaf fermentation of small-scale in our previous study. The ${\alpha}-glucosidase$ inhibitory activity, pH value, and DNJ content in this study were measured from the mulberry leaf fermentation broth for 7 days. During mulberry leaf fermentation, the ${\alpha}-glucosidase$ inhibitory activity and DNJ content was increased until 2 to 4 days, but after 4 day was decreased. The pH value showed a decreasing trend up to 2 day, and little changes in 2 to 4 days. However, the pH was started to increase after 4 days.

Optimization for Large-Scale n-ary Family Tree Visualization

  • Kyoungju, Min;Jeongyun, Cho;Manho, Jung;Hyangbae, Lee
    • Journal of information and communication convergence engineering
    • /
    • v.21 no.1
    • /
    • pp.54-61
    • /
    • 2023
  • The family tree is one of the key elements of humanities classics research and is very important for accurately understanding people or families. In this paper, we introduce a method for automatically generating a family tree using information on interpersonal relationships (IIPR) from the Korean Classics Database (KCDB) and visualize interpersonal searches within a family tree using data-driven document JavaScript (d3.js). To date, researchers of humanities classics have wasted considerable time manually drawing family trees to understand people's influence relationships. An automatic family tree builder analyzes a database that visually expresses the desired family tree. Because a family tree contains a large amount of data, we analyze the performance and bottlenecks according to the amount of data for visualization and propose an optimal way to construct a family tree. To this end, we create an n-ary tree with fake data, visualize it, and analyze its performance using simulation results.

MODIS AEROSOL RETRIEVAL IN FINE SPATIAL RESOLUTION FOR LOCAL AND URBAN SCALE AIR QUALITY MONITORING APPLICATIONS

  • Lee, Kwon-Ho;Kim, Young-Joon
    • Proceedings of the KSRS Conference
    • /
    • 2005.10a
    • /
    • pp.378-380
    • /
    • 2005
  • Remote sensing of atmospheric aerosol using MODIS satellite data has been proven to be very useful in global/regional scale aerosol monitoring. Due to their large spatial resolution of $10km^2$ MODIS aerosol optical thickness (AOT) data have limitations for local/urban scale aerosol monitoring applications. Modified Bremen Aerosol Retrieval (BAER) algorithm developed by von Hoyningen-Huene et al. (2003) and Lee et al. (2005) has been applied in this study to retrieve AOT in fe resolutions of $500m^2$ over Korea. Look up tables (LUTs) were constructed from the aerosol properties based on sun-photometer observation and radiation transfer model calculations. It was found that relative error between the satellite products and the ground observations was within about $15\%$. Resulting AOT products were correlated with surface PMIO concentration data. There was good correlation between MODIS AOT and surface PM concentration under certain atmospheric conditions, which supports the feasibility of using the high-resolution MODIS AOT for local and urban scale air quality monitoring

  • PDF

Multiple Source Modeling of Low-Reynolds-Number Dissipation Rate Equation with Aids of DNS Data

  • Park, Young-Don;Shin, Jong-Keun;Chun, Kun-Go
    • Journal of Mechanical Science and Technology
    • /
    • v.15 no.3
    • /
    • pp.392-402
    • /
    • 2001
  • The paper reports a multiple source modeling of low-Reynolds-number dissipation rate equation with aids of DNS data. The key features of the model are to satisfy the wall limiting conditions of the individual source terms in the exact dissipation rate equation using the wall damping functions. The wall damping functions are formulated in term of dimensionless dissipation length scale ι(sup)+(sub)D(≡ι(sub)D($\upsilon$$\xi$)(sup)1/4/$\upsilon$) and the invariants of small and large scale turbulence anisotropy tensors. $\alpha$(sub)ij(=$\mu$(sub)i$\mu$(sub)j/$\kappa$-2$\delta$(sub)ij/3) and e(sub)ij(=$\xi$(sub)ij/$\xi$-2$\delta$(sub)ij/3). The model constants are optimized with aids of DNS data in a plane channel flow. Adopting the dissipation length scale as a parameter of damping function, the applicabilities of $\kappa$-$\xi$ model are extended to the turbulent flow calculation of complex flow passages.

  • PDF

Multiresolution 4- 8 Tile Hierarchy Construction for Realtime Visualization of Planetary Scale Geological Information (행성 규모 지리 정보의 실시간 시각화를 위한 다계층 4-8 타일 구조의 구축)

  • Jin, Jong-Wook;Wohn, Kwang-Yun
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.9 no.4
    • /
    • pp.12-21
    • /
    • 2006
  • Recently, Very large and high resolution geological data from aerial or satellite imagery are available. Many researches and applications require to do realtime visualization of interest geological area or entire planet. Important operation of wide-spreaded terrain realtime visualization technique is the appropriate model resolution selection from pre-processed multi-resolution model hierarchy depend upon participant's view. For embodying such realtime rendering system with large geometric data, Preprocessing multi-resolution hierarchy from large scale geological information of interest area is required. In this research, recent Cubic multiresolution 4-8 tile hierarchy is selected for global planetary applications. Based upon the tile hierarchy, It constructs the selective terminal level tile mesh for original geological information area and starts to sample individual generated tiles for terminal level tiles. It completes the hierarchy by constructing intermediate tiles with low pass filtering in bottom-up direction. This research embodies series of efficient cubic 4-8 tile hierarchy construction mechanism with out-of-core storage. The planetary scale Mars' geographical altitude data and image data were selected for the experiment.

  • PDF