Recently, Prof. LIU Yang at University of Chinese Academy of Sciences (UCAS) published a paper entitled Encoding physics to learn reaction-diffusion process on Nature Machine Intelligence. The journal of Nature Machine Intelligence publishes high-quality original research and reviews in a wide range of topics in machine learning, robotics and AI. The journal also explores and discusses the significant impact of the above academic fields on other scientific disciplines, as well as on many aspects of our society and industry. Prof. LIU is one of the corresponding authors for this paper collaborating with her colleagues from Renmin University of China and Massachusetts Institute of Technology.
The paper proposes a novel network, namely, the physics-encoded recurrent convolutional neural network (PeRCNN), for modelling and discovery of nonlinear spatiotemporal dynamical systems based on sparse and noisy data. The proposed approach can be applied to a variety of problems such as reaction–diffusion processes and other PDE systems, including forward and inverse analysis, data-driven modelling and discovery of PDEs. The prior physics knowledge is forcibly ‘encoded’, which makes the network possess interpretability. In particular, the paper proposes a deep learning framework which forcibly encodes a given physics structure in a recurrent convolutional neural network to facilitate learning of the spatiotemporal dynamics in sparse data regimes. The study finds that such a computational paradigm shows high accuracy, robustness, interpretability and generalizability. In this paper, Prof. LIU and her collaborative research team demonstrated the capabilities of the proposed network architecture by applying it to various tasks in scientific modelling of spatiotemporal dynamics such as reaction–diffusion processes.
Generally speaking, predicting the evolution of complex spatiotemporal dynamical systems is a challenging task for many cases owing to insufficient prior knowledge and a lack of explicit PDE formulation for describing the nonlinear process of the system variables. Common machine learning methods need to rely on a large amount of training data, possessing problems such as poor interpretability, weak generalization, and uncontrollable modelling errors. Thanks to the recent development of data-driven approaches, it is possible to learn spatiotemporal dynamics from measurement data while adding prior physics knowledge. However, existing physics-informed machine learning paradigms impose physical laws or governing equations through soft penalty constraints, and the solution quality largely depends on a trial-and-error proper setting of hyperparameters. Therefore, it is of great necessity to develop new knowledge-embedded learning model to learn the underlying spatiotemporal dynamics from data.
To this end, the paper proposes a novel network, namely, the PeRCNN model. One major advantage of the PeRCNN is that the prior physics knowledge can be encoded into the network, which guarantees that the resulting network strictly obeys given physics (for example, ICs and BCs, general PDE structure, and known terms in PDEs). This brings distinct benefits for improving the convergence and accuracy of the model (see the figure below). By encoding given physical structure into the recurrent convolutional neural network, the performance of modelling spatiotemporal dynamical systems based on sparse and noisy data was improved.
The paper shows with extensive numerical experiments how the proposed approach can be applied to model and discover a variety of reaction–diffusion processes and other PDE systems. By comparing the proposed approach with some existing methods (aka., baseline models), the team found that the approach outperforms (if not performs as good as) the considered baselines consistently under different noise levels and data richness (see the figure below).
In addition, the paper integrates the sparse regression technique with the PeRCNN model for discovering the explicit form of PDEs. The proposed framework for the PDE discovery is presented in the figure below with the example of 2D GS RD equation. The entire procedure consists of three steps, data reconstruction, sparse regression and fine-tuning of coefficients.
Although the paper demonstrates the effectiveness of the PeRCNN on various RD systems, the model is in theory applicable to other types of spatiotemporal PDEs (for example, the 2D Burgers’ equation with the convection term shown in Supplementary Note F.4, and the Kolmogorov turbulent flows at Reynolds number 1,000, discussed in Supplementary Note J).
This research is expected to boost the development of data-driven modelling of complex spatiotemporal dynamical systems, providing scientists and engineers with more powerful tools to understand and predict natural and engineering phenomena. This approach, which combines deep learning and our prior physics knowledge, is expected to be applicable in multiple disciplines and play an important role, including fluid mechanics, biochemistry, environmental science, engineering, materials science, and more. We look forward to seeing the further development and application of this new approach, which may reveal more mysteries about complex spatiotemporal dynamical systems and bring new breakthroughs for future scientific and technological development.
Reference: Chengping Rao, Pu Ren, Qi Wang, Oral Buyukozturk, Hao Sun*, Yang Liu*. Encoding physics to learn reaction-diffusion processes. Nature Machine Intelligence (2023), 5: 765-779. DOI: 10.1038/s42256-023-00685-7
About the corresponding author:
LIU Yang is an Associate Professor in the School of Engineering Science at the University of Chinese Academy of Sciences (UCAS). She received her Ph.D. in Engineering Mechanics from Columbia University in 2015 and did her Postdoc training in the Department of Aeronautics and Astronautics at MIT during 2015-2017. She was a Tenure-Track Assistant Professor in Mechanical Engineering at Northeastern University (2018-2022) before joining UCAS. Her research interests lie in intelligent scientific computing and multiscale computational mechanics. She has published over 30 peer-reviewed articles in top-tiered journals (e.g., Nature Machine Intelligence, Nature Communications, CMAME). Dr. LIU received the Overseas Excellent Young Investigator Award of National Natural Science Foundation of China.
