Deep Learning-Based Forward Modeling and Inversion Techniques for Computational Physics Problems

Deep Learning-Based Forward Modeling and Inversion Techniques for Computational Physics Problems

by Yinpeng Wang, Qiang Ren
Released July 2023
Publisher(s): CRC Press
ISBN: 9781000896671

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This book investigates in detail the emerging deep learning (DL) technique in computational physics, assessing its promising potential to substitute conventional numerical solvers for calculating the fields in real-time. After good training, the proposed architecture can resolve both the forward computing and the inverse retrieve problems.

Table of contents

  1. Cover Page
  2. Half-Title Page
  3. Title Page
  4. Copyright Page
  5. Dedication Page
  6. Contents
  7. Preface
  8. Symbols
  9. 1 Deep Learning Framework and Paradigm in Computational Physics
    1. 1.1 Traditional Numerical Algorithms
      1. 1.1.1 Moment of Method
      2. 1.1.2 Monte Carlo Method
    2. 1.2 Basic Neural Network Structure
      1. 1.2.1 Fully Connected Neural Network
      2. 1.2.2 Convolutional Neural Network
      3. 1.2.3 Recurrent Neural Network
      4. 1.2.4 Generative Adversarial Network
    3. 1.3 Paradigms in Deep Learning
      1. 1.3.1 Data Driven
      2. 1.3.2 Physics Constraint
        1. 1.3.2.1 Fully Connected Based PINN
        2. 1.3.2.2 Convolutional Based PINN
        3. 1.3.2.3 Recurrent Based PINN
        4. 1.3.2.4 Generative Adversarial Based PINN
      3. 1.3.3 Operator Learning
      4. 1.3.4 Deep Learning-Traditional Algorithm Fusion
    4. 1.4 Constitutions of the Book
    5. Bibliography
  10. 2 Application of U-Net in 3D Steady Heat Conduction Solver
    1. 2.1 Traditional Methods
      1. 2.1.1 Analytical Methods
      2. 2.1.2 Numerical Methods
    2. 2.2 Literature Review
    3. 2.3 3D Heat Conduction Solvers via Deep Learning
      1. 2.3.1 Heat Conduction Model
      2. 2.3.2 Data Set
        1. 2.3.2.1 Thermophysical Parameters
        2. 2.3.2.2 Basic Dataset
        3. 2.3.2.3 Open-Source Dataset
        4. 2.3.2.4 Enhanced Dataset
      3. 2.3.3 Architecture of the Network
      4. 2.3.4 Loss Functions
      5. 2.3.5 Pre-Experiments
        1. 2.3.5.1 Activation Function
        2. 2.3.5.2 Learning Rate
        3. 2.3.5.3 Dropout Ratio
        4. 2.3.5.4 Split Ratio
        5. 2.3.5.5 Optimizer
      6. 2.3.6 Results
        1. 2.3.6.1 Passive Cases
        2. 2.3.6.2 Active Cases
        3. 2.3.6.3 Computing Acceleration
    4. 2.4 Conclusion
    5. Bibliography
  11. 3 Inversion of Complex Surface Heat Flux Based on ConvLSTM
    1. 3.1 Introduction
    2. 3.2 Progress in Inversion Research
      1. 3.2.1 Conventional Approach
      2. 3.2.2 Artificial Neural Network
    3. 3.3 Methods
      1. 3.3.1 Physical Model of Heat Conduction
      2. 3.3.2 3D Transient Forward Solver Based on Joint Simulation
      3. 3.3.3 Neural Network Framework Based on ConvLSTM
        1. 3.3.3.1 Fully Connected Network
        2. 3.3.3.2 Recurrent Neural Network
        3. 3.3.3.3 Convolutional LSTM
    4. 3.4 Results and Discussion
      1. 3.4.1 Training of the ConvLSTM
      2. 3.4.2 Inversion of the Regular Plane
      3. 3.4.3 Inversion of the Complex Surface
        1. 3.4.3.1 Thermal Inversion Results of the Fixed Complicated Model
        2. 3.4.3.2 Thermal Inversion Results of the Variable Complicated Model
      4. 3.4.4 Statistical Analysis and Comparison
      5. 3.4.5 Engineering Application
    5. 3.5 Conclusion
    6. Bibliography
  12. 4 Reconstruction of Thermophysical Parameters Based on Deep Learning
    1. 4.1 Introduction
      1. 4.1.1 Physical Foundation
    2. 4.2 Progress in Inversion Research
      1. 4.2.1 Gradient-Based Methods
        1. 4.2.1.1 LM Method
        2. 4.2.1.2 Conjugate Gradient Method
      2. 4.2.2 Global Optimization Algorithm
        1. 4.2.2.1 Genetic Algorithm
        2. 4.2.2.2 Particle Swarm Optimization
      3. 4.2.3 Deep Learning Approach
      4. 4.2.4 Structure of the Chapter
    3. 4.3 Physical Model and Data Generation
      1. 4.3.1 2D Heat Conduction Model
      2. 4.3.2 3D Heat Conduction Model
      3. 4.3.3 Data Generation
        1. 4.3.3.1 The Architecture of the PINN and Its Loss Functions
        2. 4.3.3.2 Comparison with Commercial Software
    4. 4.4 Denoising Process
      1. 4.4.1 Conventional Denoising Approach
      2. 4.4.2 Deep Learning Denoising Framework
      3. 4.4.3 Training and Testing
      4. 4.4.4 Comparisons with Other Approaches
    5. 4.5 Inversion Process
      1. 4.5.1 2D Cases
        1. 4.5.1.1 DL Framework
        2. 4.5.1.2 Training and Testing
      2. 4.5.2 3D Cases
        1. 4.5.2.1 DL Framework
        2. 4.5.2.2 Reconstructing Results
        3. 4.5.2.3 Statistics Analyze
        4. 4.5.2.4 Generalization Ability
        5. 4.5.2.5 Computational Speed
        6. 4.5.2.6 Comparisons with Conventional Network
    6. 4.6 Conclusion
    7. Bibliography
  13. 5 Advanced Deep Learning Techniques in Computational Physics
    1. 5.1 Physics Informed Neural Network
      1. 5.1.1 Fully Connected-Based PINN
        1. 5.1.1.1 Cylindrical Coordinate System
        2. 5.1.1.2 Spherical Coordinate System
        3. 5.1.1.3 Parabolic Coordinate System
      2. 5.1.2 Convolutional-Based PINN
    2. 5.2 Graph Neural Networks
      1. 5.2.1 Architecture of the GNN
      2. 5.2.2 Data Generation and Training
      3. 5.2.3 Results
    3. 5.3 Fourier Neural Networks
      1. 5.3.1 Methods
        1. 5.3.1.1 Framework Architecture
        2. 5.3.1.2 Physics Model
        3. 5.3.1.3 Data Generation
        4. 5.3.1.4 Training
      2. 5.3.2 Results and Discussion
        1. 5.3.2.1 Prediction Accuracy
        2. 5.3.2.2 Statistical Analysis
        3. 5.3.2.3 Comparison
    4. 5.4 Conclusion
    5. Bibliography
  14. Index

Product information

  • Title: Deep Learning-Based Forward Modeling and Inversion Techniques for Computational Physics Problems
  • Author(s): Yinpeng Wang, Qiang Ren
  • Release date: July 2023
  • Publisher(s): CRC Press
  • ISBN: 9781000896671