International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

External vs. Internal: An Essay on Machine Learning Agents for Autonomous Database Management Systems

  • Received : 2023.10.05
  • Published : 2023.10.30
Download PDF
⟨ Previous Next ⟩

Abstract

There are many possible ways to configure database management systems (DBMSs) have challenging to manage and set.The problem increased in large-scale deployments with thousands or millions of individual DBMS that each have their setting requirements. Recent research has explored using machine learning-based (ML) agents to overcome this problem's automated tuning of DBMSs. These agents extract performance metrics and behavioral information from the DBMS and then train models with this data to select tuning actions that they predict will have the most benefit. This paper discusses two engineering approaches for integrating ML agents in a DBMS. The first is to build an external tuning controller that treats the DBMS as a black box. The second is to incorporate the ML agents natively in the DBMS's architecture.

Keywords

References

  1. NoisePage. https://noise.page. 
  2. S. Chaudhuri and V. R. Narasayya. An efficient cost-driven index selection tool for Microsoft SQL Server. In VLDB, pages 146-155, 1997. 
  3. G. C. Durand, M. Pinnecke, R. Piriyev, M. Mohsen, D. Broneske, G. Saake, M. S. Sekeran, F. Rodriguez,and L. Balami. Grid formation: Towards self-driven online data partitioning using reinforcement learning. aiDM'18, pages 1:1-1:7, 2018. 
  4. A. Ganapathi, H. Kuno, U. Dayal, J. L. Wiener, A. Fox, M. Jordan, and D. Patterson. Predicting multiple metrics for queries: Better decisions enabled by machine learning. In International Conference on Data Engineering, pages 592-6017. IEEE, 2009. 
  5. M. Hammer. Self-adaptive automatic database design. In National Computer Conference, AFIPS' 77,pages 123-129, 1977. 
  6. B. Hilprecht, C. Binnig, and U. Rohm. Towards learning a partitioning advisor with deep reinforcement learning. In aiDM@SIGMOD, pages 6:1-6:4, 2019. 
  7. R. Marcus and O. Papaemmanouil. Towards a hands-free query optimizer through deep learning. In CIDR 2019, 9th Biennial Conference on Innovative Data Systems Research, 2019. 
  8. R. Nehme and N. Bruno. Automated partitioning design in parallel database systems. In SIGMOD,SIGMOD, pages 1137-1148, 2011. 
  9. A. Pavlo et al. Make Your Database Dream of Electric Sheep: Engineering for Self-Driving Operation.2019. Under Submission.
  10. A. Sharma, F. M. Schuhknecht, and J. Dittrich. The case for automatic database administration using deep reinforcement learning. CoRR, abs/1801.05643, 2018. 
  11. D. Van Aken, A. Pavlo, G. J. Gordon, and B. Zhang. Automatic database management system tuning through large-scale machine learning. Proceedings of the 2017 ACM International Conference on Management of Data, SIGMOD '17, pages 1009-1024, 2017. 
  12. G. Weikum, C. Hasse, A. Monkeberg, and P. Zabback. The COMFORT automatic tuning project. Information Systems, 19(5):381-432, July 1994.  https://doi.org/10.1016/0306-4379(94)90004-3
  13. B. Xi, Z. Liu, M. Raghavachari, C. H. Xia, and L. Zhang. A smart hill-climbing algorithm for application server configuration. In WWW, pages 287-296, 2004. 
  14. D. C. Zilio, J. Rao, S. Lightstone, G. Lohman, A. Storm, C. Garcia-Arellano, and S. Fadden. DB2 design advisor: integrated automatic physical database design. In VLDB, pages 1087-1097, 2004.