Browse > Article
http://dx.doi.org/10.7582/GGE.2019.22.4.202

Acoustic Full-waveform Inversion using Adam Optimizer  

Kim, Sooyoon (Department of Ocean Energy and Resources Engineering, Korea Maritime and Ocean University)
Chung, Wookeen (Department of Energy and Resources Engineering, Korea Maritime and Ocean University)
Shin, Sungryul (Department of Energy and Resources Engineering, Korea Maritime and Ocean University)
Publication Information
Geophysics and Geophysical Exploration / v.22, no.4, 2019 , pp. 202-209 More about this Journal
Abstract
In this study, an acoustic full-waveform inversion using Adam optimizer was proposed. The steepest descent method, which is commonly used for the optimization of seismic waveform inversion, is fast and easy to apply, but the inverse problem does not converge correctly. Various optimization methods suggested as alternative solutions require large calculation time though they were much more accurate than the steepest descent method. The Adam optimizer is widely used in deep learning for the optimization of learning model. It is considered as one of the most effective optimization method for diverse models. Thus, we proposed seismic full-waveform inversion algorithm using the Adam optimizer for fast and accurate convergence. To prove the performance of the suggested inversion algorithm, we compared the updated P-wave velocity model obtained using the Adam optimizer with the inversion results from the steepest descent method. As a result, we confirmed that the proposed algorithm can provide fast error convergence and precise inversion results.
Keywords
Adam; optimization; steepest descent method; full waveform inversion;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Brossier, R., Operto, S., and Virieux, J., 2009, Seismic imaging of complex onshore structures by 2D elastic frequencydomain full-waveform inversion, Geophysics, 74(6), WCC105.   DOI
2 Dozat, T., 2016, Incorporating Nesterov Momentum into Adam, ICLR 2016 Workshop.
3 Duchi, J., Hazan, E., and Singer, Y., 2011, Adaptive subgradient methods for online learning and stochastic optimization, J. Mach. Learn. Res., 12, 2121-2159.
4 Gauthier, O., Virieux, J., and Tarantola, A., 1986, Twodimensional nonlinear inversion of seismic waveforms: Numerical results, Geophysics, 51, 1387-1403.   DOI
5 Ha, T., Chung, W., and Shin, C., 2009, Waveform inversion using a back-propagation algorithm and a Huber function norm, Geophysics, 74(3), R15-R24.   DOI
6 Ha, J., Shin, S., Shin, C., and Chung, W., 2015, Time domain full waveform inversion of seismic data for the East sea, Korea, using a pseudo-hessian method with source estimation, J. Seism. Explor., 24, 419-437.
7 Mora, P. R., 1987, Nonlinear two-dimensional elastic inversion of multioffset seismic data, Geophysics, 42, 1211-1288.   DOI
8 Hu, W., Abubakar, A., Habashy, T. M., and Liu, J., 2011, Preconditioned non-linear conjugate gradient method for frequency domain full-waveform seismic inversion, Geophys. Prospect., 59(3), 477-491.   DOI
9 Kingma, D., and Ba, J., 2014, Adam: A method for stochastic optimization, arXiv preprint, arXiv:1412.6980.
10 Kolb, P., Collino, F., and Lailly, P., 1986, Pre-stack inversion of a 1-d medium, Proceedings of the IEEE, 74, 498-508.   DOI
11 Nesterov, Y., 1983, A method for unconstrained convex minimization problem with the rate of convergence O (1/$k^2$), Doklady AN USSR, 269, 543-547.
12 Operto, S., Virieux, J., Dessa, J., and Pascal, G., 2006, Crustal seismic imaging from multifold ocean bottom seismometer data by frequency domain full waveform tomography: Application to the eastern Nankai trough, J. Geophys. Res. Solid Earth, 111, B09306.
13 Pratt, R. G., 1990, Inverse theory applied to multi-source crosshole tomography. part 2: elastic wave-equation method, Geophys. Prospect., 38, 311-329.   DOI
14 Ruder, S., 2016, An overview of gradient descent optimization algorithms, arXiv preprint, arXiv:1609.04747.
15 Pratt, R. G., Shin, C., and Hicks, G. J., 1998, Gauss-newton and full Newton methods in frequency-space seismic waveform inversion, Geophys. J. Int., 133, 341-362.   DOI
16 Qian, N., 1999, On the momentum term in gradient descent learning algorithms, Neural networks, 12(1), 145-151.   DOI
17 Roden, J., and Gedney, S., 2000, Convolutional PML (CPML): An efficient FDTD implementation of the C-PML for arbitrary media, Microw. Opt. Techn. Let., 27(5), 334-339.   DOI
18 Shin, C., 1988, Nonlinear elastic wave inversion by blocky parameterization, Ph.D. thesis, University of Tulsa, 30p.
19 Shin, C., Yoon, K., Marfurt, K. J., Park, K., Yang, D., Lim, H. Y., Chung, S., and Shin, S., 2001, Efficient calculation of a partial-derivative wavefield using reciprocity for seismic imaging and inversion, Geophysics, 66, 1856-1863.   DOI
20 Tarantola, A., 1984, Inversion of seismic reflection data in the acoustic approximation, Geophysics, 49, 1259-1266.   DOI
21 Tieleman, T., and Hinton, G., 2012, Lecture 6.5 - RMSProp, COURSERA: Neural Networks for Machine Learning, Technical report.
22 Zeiler, M. D., 2012, Adadelta: an adaptive learning rate method, arXiv preprint, arXiv:1212.5701.
23 Martin, G., Wiley, R., and Marfurt, K, J., 2006, Marmousi2: An elastic upgrade for Marmousi, The Leading Edge, 25(2), 156-166.   DOI