Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learned priors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Secondary Science Teachers’ Implementation of a Curricular Intervention When Teaching With Global Climate Models

In the past decade, emphasis on promoting “climate literacy” in K-16 science classrooms has increased. Teachers play a critical role in cultivating these opportunities, especially in secondary science classrooms. However, most prior climate education research has focused on students and student learning; little is known about how teachers implement climate-focused curricular interventions. Here, we report findings from a concurrent mixed methods, multiple-case study of four secondary science teachers’ implementation of a new, NGSS-aligned, model-centric climate curriculum module grounded in the use of a data-driven, computer-based climate modeling tool—Easy Global Climate Model (EzGCM). We employ multiple data sources, including video-recorded classroom observations, interviews, and instructional artifacts, and both qualitative and quantitative analyses, to investigate how teachers implemented the curriculum. Findings show that, overall, teachers implemented the curriculum in ways that were less model-centric than designed, placing greater emphasis on EzGCM itself rather than using the model to investigate Earth’s changing climate. Additionally, we present detailed single-case studies of each participant teacher that highlight differences in teachers’ implementation of the curriculum module and their reasoning for making observed instructional decisions. This research sheds light on the design of secondary science learning environments by illustrating the varied ways teachers implement a climate-focused curriculum to support students’ developing climate literacy. This has important implications for the design of climate-focused curriculum and supports for teachers.

Secondary science teaching↗
NASA NTRS1994

Learning time series for intelligent monitoring

We address the problem of classifying time series according to their morphological features in the time domain. In a supervised machine-learning framework, we induce a classification procedure from a set of preclassified examples. For each class, we infer a model that captures its morphological features using Bayesian model induction and the minimum message length approach to assign priors. In the performance task, we classify a time series in one of the learned classes when there is enough evidence to support that decision. Time series with sufficiently novel features, belonging to classes not present in the training set, are recognized as such. We report results from experiments in a monitoring domain of interest to NASA.

Manganaris, Stefanos↗
DOE OSTI2021

Statistically-informed deep learning for gravitational wave parameter estimation

We introduce deep learning models to estimate the masses of the binary components of black hole mergers, $(m_1,m_2)$, and three astrophysical properties of the post-merger compact remnant, namely, the final spin, $a_\mathrm f$, and the frequency and damping time of the ringdown oscillations of the fundamental $\ell = m = 2$ bar mode, $(\omega_\mathrm R, \omega_\mathrm I)$. Our neural networks combine a modified WaveNet architecture with contrastive learning and normalizing flow. We validate these models against a Gaussian conjugate prior family whose posterior distribution is described by a closed analytical expression. Upon confirming that our models produce statistically consistent results, we used them to estimate the astrophysical parameters $(m_1,m_2, a_\mathrm f, \omega_\mathrm R, \omega_\mathrm I)$ of five binary black holes: GW150914, GW170104, GW170814, GW190521 and GW190630. We use PyCBC Inference to directly compare traditional Bayesian methodologies for parameter estimation with our deep learning based posterior distributions. Our results show that our neural network models predict posterior distributions that encode physical correlations, and that our data-driven median results and 90% confidence intervals are similar to those produced with gravitational wave Bayesian analyses. This methodology requires a single V100 NVIDIA GPU to produce median values and posterior distributions within two milliseconds for each event. Furthermore, this neural network, and a tutorial for its use, are available at the Data and Learning Hub for Science.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2020

A Reinforcement Learning Framework for Space Missions in Unknown Environments

A land-and-traverse mission to icy worlds such as Europa and Enceladus is challenging due to lack of prior knowledge regarding the terrain conditions. Previous work [1] showed that rovers with high degrees of freedom (DoF) can achieve robust traversal by leveraging redundant modes for mobility to counter terrain uncertainty (e.g. walking, driving, or inch-worming). This paper presents a generic and scalable reinforcement learning scheme for enabling on-board decision making on rovers to automatically switch between modes of traversal based on online performance feedback. The objective is to maximize energy efficiency, minimize operator input and successfully negotiate unstructured terrain conditions without relying on exhaustive prior knowledge. The proposed methodology is well grounded in the literature on reinforcement learning and has been adapted to address conformance to validation and verification requirements and JPL flight operations history of using per-sol prescribed sequences for a space mission.

Tavallali, Peyman↗
NASA NTRSDate not supplied

Preserving and Curating the Moon: Adventures in Lunar Core Processing

The lunar crust is the most easily accessible part of the Moon to both remote sensing and sample analyses and provides an archive of information about planetary formation, crustal evolution, and contains a wealth of information about the origin of the Earth-Moon system [e.g., 1-5]. The Apollo mission returned 382 kg of rocks, soil and core samples. Studies of these lunar samples are crucial for our understanding of the Moon’s formation and geological evolution, and for the past 50 years these returned samples have provided the foundation for lunar science [5]. The returned samples are stored and cared for in the lunar curation facility at NASA’s Johnson Space Center. This facility is comprised of a large suite of clean rooms, sample vaults for pristine and return samples, thin section labs, core and saw rooms, storage and working areas, and ancillary labs all designed to minimize contamination from the environment and other samples. Some of the returned samples were intentionally set aside and left unopened. Recently, the Apollo Next Generation Sample Analysis (ANGSA) initiative was designed to examine these pristine samples so the next generation of lunar scientists can further our insight into the Moon’s history. Here, we present the meticulous process that involves preparing for, and ultimately opening, one of the unopened core samples: Apollo 17 drive tube 73002,0,which was collected on the Moon from a landslide deposit near Lara Crater by astronauts Gene Cernan and Jack Schmitt. In order to open, examine, and curate 73002,0withminimalpotential contamination, great care had to be taken prior to opening its container. Beginning18 months before extrusion of the sample, all core processing equipment was pulled out of storage, identified, sorted, cleaned, and purged with nitrogen gas. However, limited institutional memory has made this step challenging as most of the former core processors from the Apollo area have retired or passed away. Twelvemonths prior to extrusion, table-top rehearsals were initiated to identify equipment and learn how it fits together and operates. Five months before extruding the real core, preparations further evolved to include the extrusion and dissection of a lunar core simulant. In addition, a mock-up glovebox was designed and built to allow for a more realistic practice environment. One month prior to extrusion, the actual core cabinet was prepared for use, which included fitting it with lights, a webcam, and power. The tool and equipment cleaning procedure was also modified to include increased cleanliness and sterility requirements. While still sealed, the core was CT scanned at the University of Texas at Austin to maximize its scientific return. Days before the extrusion, witness plates and foil were deployed inside the core cabinet to monitor potential particle and organic contamination within the cabinet. On Nov. 5th, 2019, core sample 73002,0 was successfully opened and extruded(Fig.1). Dissection of 73002,0 began immediately afterwards and is still under way. Processing this sample will help us prepare for future sampling missions and core extrusions and will enable new scientific discoveries about the Moon.

C H Krysher↗
DOE OSTI2024

A Generation-Storage Coordination Dispatch Strategy for Power System Based on Causal Reinforcement Learning

In the backdrop of global energy transformation, power systems integrating high proportions of renewable energy sources are facing unprecedented challenges in operational stability and dispatch efficiency. To address these challenges, this study introduces a generation-storage coordination real-time dispatch strategy based on Causal Power System Dynamic Reinforcement Learning (CPSDRL). Diverging from traditional reinforcement learning approaches, CPSDRL innovatively incorporates causal inference within the state prediction model - the crux of model-based reinforcement learning - thereby establishing the Power Causal Dynamic Model (PCDM). Assisted by the prior knowledge of power systems, the model significantly enhances prediction accuracy and reliability through a two-stage training process. Utilizing PCDM, this study further applies a direct policy search algorithm to optimize the real-time dispatch strategy. Experimental results indicate that the proposed method improves the stability of generation-storage coordination real-time dispatch and exhibits competitive advantages in sample efficiency and computational speed, compared to traditional model-based and model-free reinforcement learning algorithms. This method is expected to enhance the practicality and adaptability of causal reinforcement learning techniques in power system scheduling and control.

causal reinforcement learning↗
DOE OSTI2021

Bayesian sparse learning with preconditioned stochastic gradient MCMC and its applications

Deep neural networks have been successfully employed in an extensive variety of research areas, including solving partial differential equations. Despite its significant success, there are some challenges in effectively training DNN, such as avoiding overfitting in over-parameterized DNNs and accelerating the optimization in DNNs with pathological curvature. Here, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an adaptive empirical method. That is, one will alternatively sample from the posterior using preconditioned stochastic gradient Langevin Dynamics (PSGLD), and optimize the latent variables via stochastic approximation. The sparsity of the network is achieved while optimizing the hyperparameters with adaptive searching and penalizing. A popular SG-MCMC approach is Stochastic gradient Langevin dynamics (SGLD). However, considering the complex geometry in the model parameter space in nonconvex learning, updating parameters using a universal step size in each component as in SGLD may cause slow mixing. To address this issue, we apply a computationally manageable preconditioner in the updating rule, which provides a step-size parameter to adapt to local geometric properties. Moreover, by smoothly optimizing the hyperparameter in the preconditioning matrix, our proposed algorithm ensures a decreasing bias, which is introduced by ignoring the correction term in the preconditioned SGLD. According to the existing theoretical framework, we show that the proposed algorithm can asymptotically converge to the correct distribution with a controllable bias under mild conditions. Numerical tests are performed on both synthetic regression problems and learning solutions of elliptic PDE, which demonstrate the accuracy and efficiency of the present work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Differentiable modelling to unify machine learning and physical models for geosciences

Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. Here, in this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs.

58 GEOSCIENCES↗
DOE OSTI2024

Practical Hamiltonian learning with unitary dynamics and Gibbs states

We study the problem of learning the parameters for the Hamiltonian of a quantum many-body system, given limited access to the system. In this work, we build upon recent approaches to Hamiltonian learning via derivative estimation. We propose a protocol that improves the scaling dependence of prior works, particularly with respect to parameters relating to the structure of the Hamiltonian (e.g., its locality k). Furthermore, by deriving exact bounds on the performance of our protocol, we are able to provide a precise numerical prescription for theoretically optimal settings of hyperparameters in our learning protocol, such as the maximum evolution time (when learning with unitary dynamics) or minimum temperature (when learning with Gibbs states). Thanks to these improvements, our protocol has practical scaling for large problems: we demonstrate this with a numerical simulation of our protocol on an 80-qubit system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Learning energy-based representations of quantum many-body states

Efficient representation of quantum many-body states on classical computers is a problem of practical importance. An ideal representation of a quantum state combines a succinct characterization informed by the structure and symmetries of the system along with the ability to predict the physical observables of interest. Several machine-learning approaches have been recently used to construct such classical representations, which enable predictions of observables and account for physical symmetries. However, the structure of a quantum state typically gets lost unless a specialized is employed based on prior knowledge of the system. Moreover, most such approaches give no information about what states are easier to learn in comparison with others. Here, we propose a generative energy-based representation of quantum many-body states derived from Gibbs distributions used for modeling the thermal states of classical spin systems. Based on the prior information on a family of quantum states, the energy function can be specified by a small number of parameters using an explicit low-degree polynomial or a generic parametric family such as neural nets and can naturally include the known symmetries of the system. Our results show that such a representation can be efficiently learned from data using exact algorithms in a form that enables the prediction of expectation values of physical observables. Importantly, the structure of the learned energy function provides a natural explanation for the difficulty of learning an energy-based representation of a given class of quantum states when measured in a certain basis. Published by the American Physical Society 2024

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2005

Real-Time Principal-Component Analysis

A recently written computer program implements dominant-element-based gradient descent and dynamic initial learning rate (DOGEDYN), which was described in Method of Real-Time Principal-Component Analysis (NPO-40034) NASA Tech Briefs, Vol. 29, No. 1 (January 2005), page 59. To recapitulate: DOGEDYN is a method of sequential principal-component analysis (PCA) suitable for such applications as data compression and extraction of features from sets of data. In DOGEDYN, input data are represented as a sequence of vectors acquired at sampling times. The learning algorithm in DOGEDYN involves sequential extraction of principal vectors by means of a gradient descent in which only the dominant element is used at each iteration. Each iteration includes updating of elements of a weight matrix by amounts proportional to a dynamic initial learning rate chosen to increase the rate of convergence by compensating for the energy lost through the previous extraction of principal components. In comparison with a prior method of gradient-descent-based sequential PCA, DOGEDYN involves less computation and offers a greater rate of learning convergence. The sequential DOGEDYN computations require less memory than would parallel computations for the same purpose. The DOGEDYN software can be executed on a personal computer.

Duong, Vu↗
DOE OSTI2026

Comparing Synoptic Pattern Evolution for Flash‐Flood‐Producing and Non‐Flash‐Flood‐Producing Mesoscale Convective Systems in the United States

Understanding how the short-term evolution of synoptic weather patterns influence Mesoscale Convective Systems (MCSs) is essential, as these systems are responsible for over half of central U.S. flash floods, leading to substantial socioeconomic and water resource management impacts. This study analyzes long-term MCS data, flash flood reports, and atmospheric reanalyses from 2007 to 2017 using a machine learning clustering algorithm to examine how the synoptic weather patterns evolve prior to MCS initiation. While the clusters reflect seasonal and regional differences in MCS occurrence, they do not consistently distinguish between MCSs that do and do not produce flash floods. Systems in the southern Great Plains are more flood-prone when a synoptic-scale forcing, located near the system, drives strong water vapor transport from the nearby moisture source. More generally under different synoptic weather patterns, a broader precipitating area is the most dominant factor governing MCS flash flood potential.

atmospheric dynamics↗
DOE OSTI2025

Detectable ship tracks account for just 5% of aerosol indirect forcing from ship emissions

Ship emissions are a major source of aerosols over oceans, affecting both air quality and energy balance of the climate. However, estimates of their climate forcing diverge between studies relying on visible ship-tracks and those based on models. Here we show that forcing due to visible ship-tracks accounts for just 5% of the total forcing over the southeast Atlantic shipping-lane. Most forcing from ship emissions comes from aerosols that do not form detectable ship-tracks. They are only tips of the iceberg. We make three forcing calculations, one bottom-up based on visible ship-tracks, one top-down based on spatial relationships, and a hybrid approach that combines top-down or model estimated cloud droplet number concentration changes and cloud adjustments. Although the forcing based on machine learning detected ship tracks is an order of magnitude greater than prior results using manually detected ship-tracks, it remains only 5% of that inferred by top-down or cloud adjustment based methods for pre-2020 shipping. The top-down and the combined cloud adjustments methods show similar forcing for the post-2020 reduction in ships’ sulfur emission, although the methods have important regional differences in cloud adjustments that need further investigation. Our results reconcile a long-standing discrepancy in the literature and have important implications for aerosol indirect forcing and marine cloud brightening.

Yuan, Tianle [NASA Goddard Space Flight Center (GS↗
DOE OSTI2025

Preparation and Qualification of Preproduction SSR2 Jacketed Cavities for PIP-II

The qualification of 325 MHz Single Spoke Resonators type 2 (SSR2) jacketed cavities to meet technical requirements represents a significant milestone in the development of the SSR2 cryomodules for the PIP-II Project at Fermilab. This poster reports the procedures and lessons learned in processing and preparing these cavities for horizontal cold testing prior to integration into a cavity string assembly, with a focus on addressing the field emission issues observed during the cold testing. A comprehensive root cause analysis identified critical fabrication, processing, and handling factors impacting field emission onset. New techniques were successfully developed and implemented to achieve field emission-free SSR2 cavities, and efforts were made to correlate radiation levels measured at the test stand with expected levels in the LINAC tunnel. Additionally, the evolution of field emission through assembly steps was thoroughly investigated, leading to a reassessment of design choices and enhancing our understanding of their effects on cavity performance.

Grassellino, L. [Fermilab]↗
NASA NTRS2003

Residual Gas Effects on Detached Solidification in Microgravity

Many microgravity directional solidification experiments yielded ingots with portions that grew without contacting the ampoule wall, leading to greatly improved crystallographic perfection. Our long-term goal is to make such detached solidification reproducible, which requires a full understanding of the mechanisms underlying it. Our Moving Meniscus Model of steady-state detachment predicts that it depends strongly on the surface tension of the melt and the advancing contact angle with the ampoule wall. Detached solidification is more likely when the contact angle for the melt on the ampoule wall is high, i.e. non-wetting. It has been claimed that impurities increase the contact angle. The objective of the current project is to determine the influence of residual gases on the surface tension and contact angle of molten semiconductors on typical ampoule materials. We are focusing on determining the influence of oxygen on the contact angle of molten InSb on clean silica ('quartz'), including the advancing and retreating contact angles in addition to the usual equilibrium contact angle. We have created a gas flow system that allows us to control the oxygen partial pressure over a sessile drop of InSb on a horizontal quartz surface. The cell is slowly tilted while videotaping to reveal the contact angles on the two sides of the drop just prior to it rolling down the surface. Thus far, we have learned the following: (1) Molten InSb readily forms an oxide layer in the presence of the trace amounts of oxygen found in high purity argon; (2) This oxide contains a substantial amount of Ga, which presumably is a trace contaminant that is not detectable in the starting material; (3) The addition of 10% hydrogen to the argon gas is sufficient to reduce the oxide and produce a clean drop; (4) An infrared filter must precede the video camera in order to produce a sharp image of the drop for later image analysis; (5) Tilting the surface on which the drop rests causes the two sides of the drop to display different contact angles, reflecting contact line sticking; (6) Vibration strongly accelerates the approach of the drop to its final shape on a horizontal surface by helping to overcome sticking of the contact line; (7) Oscillation of the drop surface due to vibration appears to increase as the surface is inclined from horizontal. Presumably, the angle at which the drop rolls down the surface is also reduced by vibration. This observation is particularly significant, as the meniscus must move along the ampoule wall during detached solidification.

Regel, Liya L.↗
NASA NTRS2013

Development of the ISS NORS

This paper will discuss the design and development of the Nitrogen Oxygen Recharge System (NORS) for the International Space Station (ISS). The emphasis of the paper is the collaborative effort between The Boeing Company and Cobham in the crafting of the architecture of the system to meet NASA's requirements. Specific examples to be discussed include the inclusion of the pneumatic isolation valve for compliance with safety requirement, the inclusion of a single stage regulator with flow limiter versus a two-stage regulator, and the use of integrated assemblies as opposed to separate valves/regulators. The paper will also discuss NORS experience with integrated assemblies (common body) verses prior ISS hardware and Cobham trade study efforts, to include lessons learned and potential applications to future programs.

Brandon, Richard↗
NASA NTRS2012

MAVEN Relay Operations Concept

The Mars Atmosphere and Volatile EvolutioN (MAVEN) mission will launch in late 2013 and following a 10 month cruise to Mars, will study the upper atmosphere of the planet. In addition to the science instruments, the MAVEN spacecraft is equipped with an Electra UHF transceiver to support relay communication with landed assets. This paper describes how UHF relay service is provisioned by MAVEN. The discussion includes a description of the Electra payload, the process by which relay activities are coordinated and accounted for, the process of a typical relay session, including uplink and downlink, as well as special commands to calibrate and verify relay performance. The operational processes for providing these services are inherited largely from prior Mars missions and take advantage of existing infrastructure and lessons learned from those missions. Preliminary data volume return capabilities using adaptive data rates and low-density parity check channel coding are presented.

Electra↗
DOE OSTI2021

Automating Discovery of Physics-Informed Neural State Space Models via Learning and Evolution

Recent works exploring deep learning application to dynamical systems modeling have demonstrated that embedding physical priors into neural networks can yield more effective, physically-realistic, and data-efficient models. However, in the absence of complete prior knowledge of a dynamical system's physical characteristics, determining the optimal structure and optimization strategy for these models can be difficult. In this work, we explore methods for discovering neural state space dynamics models for system identification. Starting with a design space of block-oriented state space models and structured linear maps with strong physical priors, we encode these components into a model genome alongside network structure, penalty constraints, and optimization hyperparameters. Demonstrating the overall utility of the design space, we employ an asynchronous genetic search algorithm that alternates between model selection and optimization and obtains accurate physically consistent models of three physical systems: an aerodynamics body, a continuous stirred tank reactor, and a two tank interacting system.

genetic algorithms, neural architecture search, ne↗