Epistemic Uncertainty-Aware Barlow Twins Reduced Order Modeling for Nonlinear Contact Problems
Not Available
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
Not Available
Not Available
This article delineates the training activities carried out under the auspices of the U.S. Department of Energy’s (DOE) Exascale Computing Project (ECP). While some of these activities are specific to members of ECP, others can be beneficial to the community at large. Additionally, we report on training opportunities and resources that the broad Computer Science and Engineering (CS&E) community can tap into; we seek to increase awareness about these resources, which we expect to go beyond ECP’s scope and life cycle.
Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. Department of Energy’s Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities—building an advanced software ecosystem that supports next-generation applications and addresses disruptive changes in computer architectures. However, concerns are growing about the productivity of the developers of scientific software. Members of the Interoperable Design of Extreme-scale Application Software project serve as catalysts to address these challenges through fostering software communities, incubating and curating methodologies and resources, and disseminating knowledge to advance developer productivity and software sustainability. This article discusses how these synergistic activities are advancing scientific discovery—mitigating technical risks by building a firmer foundation for reproducible, sustainable science at all scales of computing, from laptops to clusters to exascale and beyond.
Not Available
Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and often nondifferentiable parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of combinatorial libraries, processing spaces, and molecular embedding spaces. Often these systems are expensive or time consuming to evaluate a single instance, and hence classical approaches based on exhaustive grid or random search are too data intensive. This resulted in strong interest toward active learning methods such as Bayesian optimization (BO) where the adaptive exploration occurs based on human learning (discovery) objective. However, classical BO is based on a predefined optimization target, and policies balancing exploration and exploitation are purely data driven. In practical settings, the domain expert can pose prior knowledge of the system in the form of partially known physics laws and exploration policies often vary during the experiment. Here, we propose an interactive workflow building on multifidelity BO (MFBO), starting with classical (data-driven) MFBO, then expand to a proposed structured (physics-driven) structured MFBO (sMFBO), and finally extend it to allow human-in-the-loop interactive interactive MFBO (iMFBO) workflows for adaptive and domain expert aligned exploration. These approaches are demonstrated over highly nonsmooth multifidelity simulation data generated from an Ising model, considering spin–spin interaction as parameter space, lattice sizes as fidelity spaces, and the objective as maximizing heat capacity. Detailed analysis and comparison show the impact of physics knowledge injection and real-time human decisions for improved exploration with increased alignment to ground truth. Here, the associated notebooks allow to reproduce the reported analyses and apply them to other systems.
We introduce a novel digital twin (DT) framework for the predictive maintenance of long-term physical systems. Using monitoring tire health as an application, we show how the DT framework can be used to enhance automotive safety and efficiency, and how the technical challenges can be overcome using a three-step approach. First, to manage the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on these data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as remaining casing potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainties, providing reliable confidence intervals around predicted RCP. Second, to incorporate real-time data, we update the predictive model in the DT framework, ensuring its accuracy throughout its lifespan with the aid of hybrid modeling and the use of the discrepancy function. Third, to assist decision-making in predictive maintenance, we implement a tire state decision algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This approach ensures that our DT accurately predicts system health, continually refines its digital representation, and supports predictive maintenance decisions. Furthermore, our framework effectively embodies a physical system, leveraging big data and machine learning (ML) for predictive maintenance, model updates, and decision-making.
This presentation provides a brief snapshot of the InterPACK paper InterPACK2023-113781. The paper explores copper inverse opal (CIO) surface reliability in pool boiling experiments in water and a new, low-global-warming-potential (GWP = 1) hydrofluoroolefin (HFO) refrigerant R-1233zd. The CIO-based structure is intended to develop enhanced two-phase heat transfer surfaces for extreme-heat-flux (approximately 1 kW/cm2) micro-coolers. In this study, a limited number of pool boiling experiments were performed using water and HFO-1233zd fluid, and the reliability of the CIO-based surfaces was evaluated. Critical heat flux (CHF) values in HFO-1233zd at 40 Degrees Celsius to 45 Degrees Celsius saturation temperatures and the corresponding saturation pressures were also measured. The CHF values with the refrigerant are significantly lower compared to those with water, but the refrigerant allows for a wider usable temperature range in the end application of the micro-coolers and is not limited to data centers with controlled ambient conditions. Reliability experiments with CIO surface samples - involving pool boiling with water on the CIO surfaces for approximately 48 hours and with HFO-1233zd for 144 hours - showed no structural degradation of the enhanced surface or any significant performance drop in heat transfer coefficients. The CIO surface samples in water were oxidized, most likely due to the presence of air in water and in the experimental vessel.
The Resolve instrument aboard the X-ray Imaging and Spectroscopy Mission (XRISM) is a 36-pixel microcalorimeter spectrometer that provides nondispersive spectroscopy with ∼ 5 eV spectral resolution in the soft X-ray waveband. Resolve has a requirement to provide an absolute energy-scale calibration of ± 2 eV from 0.3 to 12 keV. We describe our ground calibration strategy and results of a subset of the ground calibration campaigns, including a discussion of improvements in the energy scale ground calibration compared with Hitomi’s. These improvements include calibration of the low-energy band below 4 keV with the instrument in the flight dewar and the dewar aperture door open, which was not performed for Hitomi, and thorough measurements over an extended high-energy waveband to 22 keV. We also developed an improved technique for gain calibration of “mid-res” secondary events, which have suppressed gain due to proximity to a preceding X-ray event (18 to 70 ms) on the same pixel. We provide a discussion of the on-orbit energy scale monitoring campaigns and an assessment of the Resolve energy scale uncertainties, a key parameter for astrophysics analysis. Energy-scale calibration approaches for future space-based instruments, including the X-ray Integral Field Unit on Athena and microcalorimeter spectrometers proposed or under discussion for future X-ray observatory concepts, have heritage in the calibration of XRISM. We briefly comment on lessons learned from Resolve calibration that are relevant for these future instruments.
The software-tutorial was developed within the 2024 Remote Sensing and Fluxes Upscaling for Real-world Impact workshop as part of the hands-on session. The workshop was supported by AmeriFlux, National Ecological Observatory Network (NEON) and CarbonDew. The software provides basic tools to perform the following tasks: - gather remote sensing images using Google Earth Engine API; - gather flux data; - perform basic functions, such as plotting time-series, perform QA of the data, compute vegetation indices; - perform correlation analysis between flux data and remote sensing data; - perform flux predictions based on remote sensing data integrated in different modalities.
L-malic acid is widely used in the food, chemical, and pharmaceutical industries. Here, we report on production of malic acid from xylose, the second most abundant sugar in lignocellulosic hydrolysates, by engineered Saccharomyces cerevisiae . To enable malic acid production in a xylose-assimilating S. cerevisiae , we overexpressed PYC1 and PYC2, coding for pyruvate carboxylases, a truncated MDH3 coding for malate dehydrogenase, and SpMAE1, coding for a Schizosaccharomyces pombe malate transporter. Additionally, both the ethanol- and glycerol-producing pathways were blocked to enhance malic acid production. The resulting strain produced malic acid from both glucose and xylose, but it produced much higher titers of malic acid from xylose than glucose. Interestingly, the engineered strain had higher malic acid yield from lower concentrations (10 g L‒1) of xylose, with no ethanol production, than from higher xylose concentrations (20 and 40 g L‒1). As such, a fed-batch culture maintaining xylose concentrations at low levels was conducted and 61.2 g L‒1 of malic acid was produced, with a productivity of 0.32 g L‒1 h. These results represent successful engineering of S. cerevisiae for the production of malic acid from xylose, confirming that that xylose offers the efficient production of various biofuels and chemicals by engineered S. cerevisiae .
Wastewater heat recovery is currently an underutilized technology that could be part of solving the climate crisis. A large portion of the heat that leaves a building in the form of wastewater is potentially recoverable for pre-heating domestic hot water or other service water systems. While there are several different approaches to wastewater heat recovery, this project focused on creating detailed, integrated building models for wastewater heat recovery heat pump systems. EnergyPlus models were developed featuring inputs and assumptions corresponding to manufacturers’ specifications, performance lab test data and feedback from engineering consultants. EnergyPlus’s supervisory control Energy Management System objects were heavily relied upon to overcome modelling challenges. The developed EnergyPlus model was integrated into U.S. Department of Energy New Construction Reference Building models for various climate zones and building types to assess potential energy use, energy cost and greenhouse gas emission reductions.
This work advances laser absorption spectroscopy with measurements of aluminum monoxide (AlO) temperature and column density in extreme pressure ( P > 60 bar) and temperature ( T > 4000 K) environments. Measurements of the AlO A 2 Π i – X 2 Σ + transition are made using a microelectromechanical system, tunable vertical cavity surface emitting laser (MEMS-VCSEL). Simultaneous emission measurements of the AlO B 2 Σ + – X 2 Σ + transition are made along a line of sight that is coaxial with the laser absorption. Absorption temperature fits agree with emission spectra for a T = 3200 K, P = 9 bar case. In cases with T > 4000 K, P > 60 bar, absorption fits match the ambient temperature while emission fits over-estimate it, owing to high optical depths. These data juxtapose passive and active spectroscopic methods and demonstrate the versatility of AlO laser absorption in high-pressure and high-temperature environments where experimental data remain scarce, and engineering models will benefit from refined measurements.
In modern Machine Learning, model training is an iterative, experimental process that can consume enormous computation resources and developer time. To aid in that process, experienced model developers log and visualize program variables during training runs. Exhaustive logging of all variables is infeasible, so developers are left to choose between slowing down training via extensive conservative logging, or letting training run fast via minimalist optimistic logging that may omit key information. As a compromise, optimistic logging can be accompanied by program checkpoints; this allows developers to add log statements post-hoc, and "replay" desired log statements from checkpoint---a process we refer to as hindsight logging. Unfortunately, hindsight logging raises tricky problems in data management and software engineering. Done poorly, hindsight logging can waste resources and generate technical debt embodied in multiple variants of training code. In this paper, we present methodologies for efficient and effective logging practices for model training, with a focus on techniques for hindsight logging. Our goal is for experienced model developers to learn and adopt these practices. To make this easier, we provide an open-source suite of tools for Fast Low-Overhead Recovery (flor) that embodies our design across three tasks: (i) efficient background logging in Python, (ii) adaptive periodic checkpointing, and (iii) an instrumentation library that codifies hindsight logging for efficient and automatic record-replay of model-training. Model developers can use each flor tool separately as they see fit, or they can use flor in hands-free mode, entrusting it to instrument their code end-to-end for efficient record-replay. Our solutions leverage techniques from physiological transaction logs and recovery in database systems. Evaluations on modern ML benchmarks demonstrate that flor can produce fast checkpointing with small user-specifiable overheads (e.g. 7%), and still provide hindsight log replay times orders of magnitude faster than restarting training from scratch.
Final project briefing from PingThings for FOA 1861
A major objective of the project was to train and evaluate the effectiveness of multiple event and anomaly detection, identification and classification deep temporal learning models for processing of real-time phasor measurement unit (PMU) data streams. A vast dataset, consisting of two years of phasor measurements from all three U.S. Interconnections, was curated and released by the Department of Energy (DOE) through Pacific Northwest National Laboratory (PNNL). The dataset also included an event log that provided event times and types (e.g. generator trips, line trips, planned service events, transformer operations, etc.). Our analysis of this dataset addressed six (6) of the eleven (11) research priorities identified in Funding Opportunity Announcement (FOA) DE-FOA-0001861 “Big Data Analysis of Synchrophasor Data” (FOA 1861). Rather than being limited to pre-determined specific algorithms, this project relied on the uniquely structured, highly performant underlying time series database capabilities of the PredictiveGrid platform to assess the vast dataset utilizing a wide variety of algorithms.
VERAView has been developed as an interactive graphical interface for the visualization and engineering analyses of output data from VERA. The Python-based software is easy to install, intuitive to use, and provides instantaneous 2D and 3D images, 1D plots, and alpha-numeric data from VERA multi-physics simulations. This document provides a brief overview of the software and some description of the major features of the application, including examples of each of the encapsulated “widgets” that have been implemented thus far. VERAView is still under major development and large changes in the software and this document are still anticipated.