• Title/Summary/Keyword: MA Filtering

Search Result 25, Processing Time 0.022 seconds

Developing a Dynamic Materialized View Index for Efficiently Discovering Usable Views for Progressive Queries

  • Zhu, Chao;Zhu, Qiang;Zuzarte, Calisto;Ma, Wenbin
    • Journal of Information Processing Systems
    • /
    • v.9 no.4
    • /
    • pp.511-537
    • /
    • 2013
  • Numerous data intensive applications demand the efficient processing of a new type of query, which is called a progressive query (PQ). A PQ consists of a set of unpredictable but inter-related step-queries (SQ) that are specified by its user in a sequence of steps. A conventional DBMS was not designed to efficiently process such PQs. In our earlier work, we introduced a materialized view based approach for efficiently processing PQs, where the focus was on selecting promising views for materialization. The problem of how to efficiently find usable views from the materialized set in order to answer the SQs for a PQ remains open. In this paper, we present a new index technique, called the Dynamic Materialized View Index (DMVI), to rapidly discover usable views for answering a given SQ. The structure of the proposed index is a special ordered tree where the SQ domain tables are used as search keys and some bitmaps are kept at the leaf nodes for refined filtering. A two-level priority rule is adopted to order domain tables in the tree, which facilitates the efficient maintenance of the tree by taking into account the dynamic characteristics of various types of materialized views for PQs. The bitmap encoding methods and the strategies/algorithms to construct, search, and maintain the DMVI are suggested. The extensive experimental results demonstrate that our index technique is quite promising in improving the performance of the materialized view based query processing approach for PQs.

Application of 4th Industrial Revolution Technology to Implement Smart-Eco River (스마트 에코 리버 구현을 위한 4차산업혁명 기술의 적용)

  • Kim, Sunghoon;Jang, Suhyung;Lee, Eulrae
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.11-11
    • /
    • 2020
  • 18년 물관리일원화 이후 인프라와 사람 중심으로부터 자연과 인간의 조화를 위한 환경·생태계의 자연성 회복으로의 물관리 패러다임 전환이 빠르게 이루어지고 있으며, 대규모 국책사업이후의 하천 관리에 있어서도 기존의 이수, 치수, 환경이라는 단순한 기능적 구분을 벗어나 보다 근본적이고 장기적인 대국민 서비스로의 전환을 도모하고 있다. 또한, ICBAM 등으로 정의되는 4차산업혁명 기반 기술의 접목이 거의 대부분의 분야에서 이루어지고 있는 것을 실질적으로 체감하는 시기가 도래하였다. 그러나, 하천 및 수자원 관리분야에서의 기술은 근대 엔지니어링의 기초가 되는 수로 건설 등으로부터 시발되어 사실상 가장 앞선 과학적 진보의 토대를 갖추었으나 최근의 기술적 트렌드를 잘 추종하지 못하는 것처럼 비추어 지는 것이 사실이다. 주된 이유로서 기후변화라는 광범위하고 장기적인 입력요소를 가진 하천관리 시스템의 특성상 불확실성의 추정 및 즉각적인 응답이 어려운 부분이 분명히 존재하지만, 실질적으로 여전히 해소되지 않는 부분은 하천의 기초자료 수집에 대한 효율성과 신뢰도가 낮은 것이라고 하겠다. 또한, 유역으로부터 댐-다기능보-하천으로 이어지는 의사결정을 위한 다양한 형태의 자료로부터 적절한 정보를 수집하는 체계(거버넌스의 문제이자 기술적/재정적 한계)가 확립되지 않은 점도 고려해야 할 것이다. 본 연구에서는 인공지능을 활용한 하천의 유량 예측 등을 위해 필요한 수자원 기초데이터의 근원적인 수집 및 관리상의 문제점에 대해서 검토하고자 하였으며, ARIMA, Kalman Filtering, MA 및 복합기법을 통한 자료처리 기법을 적용하여 상황에 맞게 오차 및 불확실성의 저감을 위한 방안을 찾고자 하였다. 또한, 이용자 중심의 하천 관리에 근접한다고 볼 수 있는 스마트워터시티 개념에서의 바람직한 하천관리 기법에 대해서 논의하고, 관련하여 근자에 개발한 하천의 물리적 해석 도구들에 대해서 적용 사례를 검토한다. 마지막으로, 지식기반의 하천관리 의사결정 플랫폼 개발을 위해서 기존의 기계학습을 통한 자동화된 의사결정에 부가하여 전문가와 시스템이 상호작용을 통해서 AI를 학습시켜 결정한 사항을 전문가의 의사결정에 참고하는 MCRDR기법의 적용의 적용 가능성과 도입 방향에 대해서 논의하였다.

  • PDF

Detection of genome-wide structural variations in the Shanghai Holstein cattle population using next-generation sequencing

  • Liu, Dengying;Chen, Zhenliang;Zhang, Zhe;Sun, Hao;Ma, Peipei;Zhu, Kai;Liu, Guanglei;Wang, Qishan;Pan, Yuchun
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.32 no.3
    • /
    • pp.320-333
    • /
    • 2019
  • Objective: The Shanghai Holstein cattle breed is susceptible to severe mastitis and other diseases due to the hot weather and long-term humidity in Shanghai, which is the main distribution centre for providing Holstein semen to various farms throughout China. Our objective was to determine the genetic mechanisms influencing economically important traits, especially diseases that have huge impact on the yield and quality of milk as well as reproduction. Methods: In our study, we detected the structural variations of 1,092 Shanghai Holstein cows by using next-generation sequencing. We used the DELLY software to identify deletions and insertions, cn.MOPS to identify copy-number variants (CNVs). Furthermore, we annotated these structural variations using different bioinformatics tools, such as gene ontology, cattle quantitative trait locus (QTL) database and ingenuity pathway analysis (IPA). Results: The average number of high-quality reads was 3,046,279. After filtering, a total of 16,831 deletions, 12,735 insertions and 490 CNVs were identified. The annotation results showed that these mapped genes were significantly enriched for specific biological functions, such as disease and reproduction. In addition, the enrichment results based on the cattle QTL database showed that the number of variants related to milk and reproduction was higher than the number of variants related to other traits. IPA core analysis found that the structural variations were related to reproduction, lipid metabolism, and inflammation. According to the functional analysis, structural variations were important factors affecting the variation of different traits in Shanghai Holstein cattle. Our results provide meaningful information about structural variations, which may be useful in future assessments of the associations between variations and important phenotypes in Shanghai Holstein cattle. Conclusion: Structural variations identified in this study were extremely different from those of previous studies. Many structural variations were found to be associated with mastitis and reproductive system diseases; these results are in accordance with the characteristics of the environment that Shanghai Holstein cattle experience.

쌍끌이 중층트롤어법의 연구 ( 1 ) - 모형어구의 망구형상에 관하여 - ( A Study on the Pair Midwater Trawling ( 1 ) - Mouth Performance of the Model Net - )

  • 이병기
    • Journal of the Korean Society of Fisheries and Ocean Technology
    • /
    • v.31 no.1
    • /
    • pp.29-44
    • /
    • 1995
  • A model experiment on the pair midwater trawl net applicable to 800 PS class Korean pair bottom trawlers was carried out in the special-prepared experimental thank. the tank was prepared as a reverse trapezoid shape in its vertical section by digging out flat soil. The dimension of the tank showed the 9.6 W$\times$43.0 L(m) of the upper fringe and the 4.8 W$\times$38.0 L(m) of the bottom with 3.0m in depth. The depth of water was maintained 2.7m during experiment. The model net was prepared based on the Tauti's similarity law of fishing gear in 1/30 scale considering the dimension of the experimental tank. Mouth performance of the model net during towing were determined by the photographs taken in front of the net mouth with the combinations of towing velocity, warp length and distance between paired boats. The results obtained can be summarized as follows: 1. Vertical opening of the model nets A and B was varied in the range of 0.18~0.88 m and 0.21~0.78 m (which can be converted into 5.4~26.4m and 6.3~23.4 m in the full-scale net) respectively, and was varied predominantly by towing speed. Vertical opening (H which is appendixed m for the model net. f for the full-scale net. A and B for the types of the model net) can be expressed as the function of towing velocity$V_t$as in the model net $V_t$ : m/ sec)$H_{mA}$=1.67$e^{-1.65V_t}$ $H_{mB}$=1.15$e^{-1.13V_t}$, in the full-scale net ($V_t$ : k't) $H_{fA}$=50.27$e^-0.37V_t$ $H_{fB}$=34.46$e^{-0.26Vt}$. 2. Horizontal opening of the model nets An and b was varied in the range of 1.03~1.54m and 1.04~1.55 m (which can be converted into 30.9~46.2 m and 31.2~46.5m in the full-scale net) respectively, and was varied predominantly by distance between paired boats. Horizontal opening (W, appendixes are as same as the former) an be expressed as the function of distance between paired boats $D_b$as in the model net $W_{mA}$=0.69+0.09$D_b$ $W{mB}$=0.73+0.09$D_b$, in the full-scale net $W_{fA}$=20.81+0.09$D_b$ $W_{fB}$=22.11+0.09$D_b$ 3. Net opening area of the model net A and B was varied in the range of 0.28~1.04 $m^2$ and 0.33~0.94$m^2$(which can be converted into 252~936$m^2$ and 297~846$m^2$ in the full-scale net) respectively, and was varied predominantly by towing velocity. Net opening area ($S$, appendixes are as same as the former) van be expressed as the function of towing velocity$V_t$ as in the model net $v_t$ : m/sec) $S_{Ma}$=2.01$e^{-1.54V_T}$ $S_{mA}$=1.40$e^{-1.65V_t}$, in the full-scale net ($V_t$ : k't) $S_{fA}$=1.807$e^-0.35V_t$ $S_{fA}$=1.265$e^{-0.24V_t}$. 4. Filtering volume of the model nets A and B was varied in the range of 0.32~0.55 $m^3$ and 0.37~0.55$m^3$(which can be converted into 8.640~14.850 $m^3$ and 9.990~14.850$m3$in the full~scale net) respectively, and was predominantly varied by towing speed. filtering volume of the model net-A showed the maximum at the towing speed 0.69 m/sec(3 k't in the full-scale net), compared with that of the model net B showed at 0.92 m/sec(4 k't in the full-scale net).

  • PDF

A Study on Efficiency of Water Purification of Korean Village Bangjuk[dike] as a Means of Ecological Watershed Management (생태적 유역관리 도구로써 마을방죽의 수질정화 효율성 고찰)

  • An, Byung-Chul
    • Journal of the Korean Institute of Traditional Landscape Architecture
    • /
    • v.30 no.2
    • /
    • pp.90-100
    • /
    • 2012
  • This study centering on 10 village - Bangjuks analyzed multifunctionality value of village Bangjuks which have been main water treatment system in Korean traditional villages. On the basis of understanding the structure and character of components such as the well, common spring, village waterway and others which making water-flow and consisting of aquatic system in Korean traditional village Bangjuk, the conclusion as the instrumental device of social and ecological role and ecological watershed management, securing the ecosystem soundness of the damaged or deteriated aquatic ecosystem due to the industrialization and urbanization is as below; 1. The traditional village Bangjuk was environmentally friendly hydraulic system which gathers waterways of village into a point including sewage water, retains and flows out to village through agricultural waterway. Through this Bangjuk, they have managed sewage and rainfall runoff flowed out village efficiently. It is not only a detention system of water but a kind of eco-friendly system that flow out water into the rivers after reusing and filtering it. 2. Around five traditional villages and five villages after modernization, this study classified the types of village Bangjuk as three types considering geographic location, size, etc; marsh type of low swamp, high water -low rice field type of natural flow stucture, low water - high rice field type requiring artificial irrigation facility. All the five traditional villages were turned out to be marsh type of low swamp. Geoji, Sanjeri, Ma-am, Yangchon of the agricultural villages were high water-low rice filed type, and Sangchoenri village was classified low water-high rice field type. 3. This study checked up the function of water purification of village Bangjuk. In Wonteo and Geji villages affected by discharge of village sewer and domestic sewage, the efficiency of ammonia nitrogen($NH_3-N$) and total phosphorus(T-P) was 56~95%, which was high. In Sangcheonri and Sanjeri villages strongly affected by stall and farmland, the efficiency of suspended solids(SS) was 70~85%, and that of total nitrogen(T-N) and total phosphorus(T-P) was 5.3~65%. 4. A water purification system can be found out in the system of village Bangjuk that filter out village sewage and rainfall runoff flowed through the settle and filter of pollution source and denitrification of plants. Through this system of village Bangjuk, it must be used as the basic facilities for the ecological watershed management. The sewage management system of village Bangjuk as a eco-filter must be used and studied as an eco-friendly facility for the ecological watershed management around the subwatershed and catchment.