Peter Norgaard

Peter Norgaard

Peter Norgaard studied Mechanical & Aerospace engineering at the University of Washington and then Princeton University. His undergraduate and graduate research focused on experimental and computational plasma physics, particularly applications to magnetic confinement nuclear fusion. He also studied and worked in the field of numerical methods for ordinary and partial differential equations. At Google, Peter works on the inverse problem of plasma state reconstruction from sparse measurements using Bayesian inference.
Authored Publications
Sort By
  • Title
  • Title, descending
  • Year
  • Year, descending
    Neural general circulation models for weather and climate
    Dmitrii Kochkov
    Janni Yuval
    Jamie Smith
    Griffin Mooers
    Milan Kloewer
    James Lottes
    Peter Dueben
    Samuel Hatfield
    Peter Battaglia
    Alvaro Sanchez
    Matthew Willson
    Nature, 632 (2024), pp. 1060-1066
    Preview abstract General circulation models (GCMs) are the foundation of weather and climate prediction. GCMs are physics-based simulators that combine a numerical solver for large-scale dynamics with tuned representations for small-scale processes such as cloud formation. Recently, machine-learning models trained on reanalysis data have achieved comparable or better skill than GCMs for deterministic weather forecasting. However, these models have not demonstrated improved ensemble forecasts, or shown sufficient stability for long-term weather and climate simulations. Here we present a GCM that combines a differentiable solver for atmospheric dynamics with machine-learning components and show that it can generate forecasts of deterministic weather, ensemble weather and climate on par with the best machine-learning and physics-based methods. NeuralGCM is competitive with machine-learning models for one- to ten-day forecasts, and with the European Centre for Medium-Range Weather Forecasts ensemble prediction for one- to fifteen-day forecasts. With prescribed sea surface temperature, NeuralGCM can accurately track climate metrics for multiple decades, and climate forecasts with 140-kilometre resolution show emergent phenomena such as realistic frequency and trajectories of tropical cyclones. For both weather and climate, our approach offers orders of magnitude computational savings over conventional GCMs, although our model does not extrapolate to substantially different future climates. Our results show that end-to-end deep learning is compatible with tasks performed by conventional GCMs and can enhance the large-scale physical simulations that are essential for understanding and predicting the Earth system. View details
    Preview abstract The Hamiltonian Monte Carlo (HMC) method allows sampling from continuous densities. Favorable scaling with dimension has led to wide adoption of HMC by the statistics community. Modern auto-differentiating software should allow more widespread usage in Bayesian inverse problems. This paper analyzes the two major difficulties encountered using HMC for inverse problems: poor conditioning and multi-modality. Novel results on preconditioning and replica exchange Monte Carlo parameter selection are presented in the context of spectroscopy. Recommendations are analyzed rigorously in the Gaussian case, and shown to generalize in a fusion plasma reconstruction. View details
    Preview abstract We determined the time-dependent geometry including high-frequency oscillations of the plasma density in TAE’s C2W experiment. This was done as a joint Bayesian reconstruction from a 14-chord FIR interferometer in the midplane, 32 Mirnov probes at the periphery, and 8 shine-through detectors at the targets of the neutral beams. For each point in time we recovered, with credibility intervals: the radial density profile of the plasma; bulk plasma displacement; amplitudes, frequencies and phases of the azimuthal modes n=1 to n=4. Also reconstructed were the radial profiles of the deformations associated with each of the azimuthal modes. Bayesian posterior sampling was done via Hamiltonian Monte Carlo with custom preconditioning. This gave us a comprehensive uncertainty quantification of the reconstructed values, including correlations and some understanding of multimodal posteriors. This method was applied to thousands of experimental shots on C-2W, producing a rich data set for analysis of plasma performance. View details
    Preview abstract Hamiltonian Monte Carlo is discussed in the context of a fusion plasma reconstruction. Ill conditioned covariance and multi-modality are discussed in depth. View details
    Preview abstract TAE Technologies, Inc. (TAE) is pursuing an alternative approach to magnetically confined fusion, which relies on field-reversed configuration (FRC) plasmas composed of mostly energetic and well-confined particles by means of a state-of-the-art tunable energy neutral-beam (NB) injector system. TAE’s current experimental device, C-2W (also called “Norman”), is the world’s largest compact-toroid device and has made significant progress in FRC performance, producing record breaking, high temperature (electron temperature, Te >500 eV; total electron and ion temperature, Ttot >3 keV) advanced beam-driven FRC plasmas, dominated by injected fast particles and sustained in steady-state for up to 30 ms, which is limited by NB pulse duration. C-2W produces significantly better FRC performance than the preceding C-2U experiment, in part due to Google’s machine-learning framework for experimental optimization, which has contributed to the discovery of a new operational regime where novel settings for the formation sections yield consistently reproducible, hot, and stable plasmas. Active plasma control system has been developed and utilized in C-2W to produce consistent FRC performance as well as for reliable machine operations using magnets, electrodes, gas injection, and tunable NBs. The active control system has demonstrated a stabilization of FRC axial instability. Overall FRC performance is well correlated with NBs and edge-biasing system, where higher total plasma energy is obtained with increasing both NB injection power and applied-voltage on biasing electrodes. C-2W divertors have demonstrated a good electron heat confinement on open-field-lines using strong magnetic mirror fields as well as expanding the magnetic field in the divertors (expansion ratio >30); the electron energy lost per ion, ~6–8, is achieved, which is close to the ideal theoretical minimum. View details
    Preview abstract Hamiltonian Monte Carlo is a popular sampling technique for smooth target densities. The scale lengths of the target have long been known to influence integration error and sampling efficiency. However, quantitative measures intrinsic to the target have been lacking. In this paper, we restrict attention to the multivariate Gaussian and the leapfrog integrator, and obtain a condition number corresponding to sampling efficiency. This number, based on the spectral and Schatten norms, quantifies the number of leapfrog steps needed to efficiently sample. We demonstrate its utility by using this condition number to analyze HMC preconditioning techniques. We also find the condition number of large inverse Wishart matrices, from which we derive burn-in heuristics. View details
    Preview abstract Fusion Plasma Reconstruction work done at Google in partnership with TAE is presented. View details
    Preview abstract Bayesian methods are used to infer Field Reversed Configuration (FRC) plasma properties for the C-2W machine at TAE Technologies. The approach starts with a statistical distribution of possible plasma states, where physically-motivated constraints are imposed through the Bayesian prior. Possible states are processed by a forward model for the relevant instruments to assess agreement with corresponding measured experimental data. The resulting probability distribution is known as the posterior, from which the most likely plasma state and the corresponding statistical confidence are extracted. Plasma state reconstruction from multi-instrument Bayesian inference are presented in this study, implemented for the upgraded diagnostics that have come online for C-2W. FIR interferometry, Thomson scattering, Bremsstrahlung radiation measurement, and secondary electron emission detection from the neutral beams are used in reconstruction near the FRC midplane. Magnetic probes and imaging from a high-speed camera provide 3D data throughout the main confinement vessel. This study aims to further the understanding of plasma properties and dynamics, such as electron and ion densities, electron temperature, plasma current, and magnetic field topology. View details
    The Plasma Debugger
    Erik Granstedt
    Erik Trask
    Hiroshi Gota
    Jesus Romero
    Matthew Thompson
    Roberto Mendoza
    Tom Madams
    Yair Carmon
    (2018)
    Preview abstract We built a "Plasma Debugger", a tool to reconstruct the state of the FRC plasma in the TAE Technologies' experimental machine C­2W. This generalized Bayesian inference approach combines data from magnetic sensors, fast cameras, FIR interferometer, Thomson Scattering system, Bremsstrahlung measurements and neutral beams shine­-through SEE detectors. It then reconstructs electron density, temperature and bulk plasma currents, with confidence intervals. Computation takes hundreds of CPUs and is performed in the cloud, with results showing up in the plasma machine control room within several minutes of the experiment. The display shows time evolution of the basic plasma properties, giving machine operators additional insight into the plasma behavior. View details