SEARCH · Engineering Papers

Results for “Common data models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Evaluation of the Self Retrieval Augmented Generation Technique on Common Security Advisory Framework Data

This small experimental report evaluates a variation of Retrieval Augmented Generation (RAG), called Self-RAG. This method uses a generative language model that incorporates retrieved facts into its generation and is explicitly trained to be able to determine whether retrieved information is enough to answer the input query, with a user-defined threshold for confidence. We performed an experiment using data from the publicly available CISA Common Security Advisory Framework (CSAF) repository (https://github.com/cisagov/CSAF) as the database of facts to be used in retrieval. Qualitative results from the experiment demonstrate that the Self-RAG method has some ability to provide reasonable answers to queries that are in the dataset and will often ignore irrelevant information when asked outside of domain questions (e.g., general facts). In settings with deliberately confusing questions (the question is within domain, but asks about a fabricated advisory), it was able to refuse 40% of the time without further adjustments to the original framework. While this performance is not sufficient for current practical use, further improvements to data formatting, disambiguating results, and leveraging threshold values could improve performance significantly. However, evaluating this will require more extensive evaluations on larger datasets and potentially better models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

A semblance measure for model comparison

Algorithmic and computational advances have made it possible that geophysical survey and earth model design can be aided by many systematic trial inverse-modelling runs with synthetic data. Such may, for example, come up in machine-learning approaches. Automated image appraisal pertaining to such applications will involve common statistical tests for goodness-of-data fit as a primary evaluation method. However, solution non-uniqueness may render multiple images equivalent in terms of their data fit, requiring secondary categorizers. A logical choice for classifying synthetic-imaging results quantifies the goodness of model fit where a known reference model replaces the observational input. The task of model intercomparison in terms of measuring the resemblance to the reference model poses challenges to common distance-based metrics like root mean square error and mean absolute error. First, distance-based metrics can introduce spurious contributions when smooth models with fuzzy target contours are to be compared against a sharp reference. Second, large differences due to parameter-estimation overshoots can dominate distance metrics. Here, we propose a remedy that is referred to as semblance and is based on the idea of logistic functions, where a binary-dependent variable adds non-zero or zero accumulation terms for the, respectively, passing or failing of preset target thresholds. This classifying approach is amenable to an objective where model feature recognition is primary. Numerical comparisons to distance-based metrics provide evidence for the advantages of the semblance in view of this objective. Geophysical imaging in conjunction with machine-learning is seen as a benefitting upcoming application area.

58 GEOSCIENCES↗

DOE OSTI2021

Statistical Uncertainty in Paleoclimate Proxy Reconstructions

A quantitative analysis of any environment older than the instrumental record relies on proxies. Uncertainties associated with proxy reconstructions are often underestimated, which can lead to artificial conflict between different proxies, and between data and models. In this paper, using ordinary least squares linear regression as a common example, we describe a simple, robust and generalizable method for quantifying uncertainty in proxy reconstructions. We highlight the primary controls on the magnitude of uncertainty, and compare this simple estimate to equivalent estimates from Bayesian, nonparametric and fiducial statistical frameworks. We discuss when it may be possible to reduce uncertainties, and conclude that the unexplained variance in the calibration must always feature in the uncertainty in the reconstruction. This directs future research toward explaining as much of the variance in the calibration data as possible. We also advocate for a “data-forward” approach, that clearly decouples the presentation of proxy data from plausible environmental inferences.

58 GEOSCIENCES↗

DOE OSTI2025

Data-driven model validation for neutrino-nucleus cross section measurements

Neutrino-nucleus cross section measurements are needed to improve interaction modeling to meet the precision needs of neutrino experiments in efforts to measure oscillation parameters and search for physics beyond the Standard Model. We review the difficulties associated with modeling neutrino-nucleus interactions that lead to a dependence on event generators in oscillation analyses and cross section measurements alike. We then describe data-driven model validation techniques intended to address this model dependence. The method relies on utilizing various goodness-of-fit tests and the correlations between different observables and channels to probe the model for defects in the phase space relevant for the desired analysis. These techniques shed light on relevant mismodeling, allowing it to be detected before it begins to bias the cross section results. We compare more commonly used model validation methods which directly validate the model against alternative ones to these data-driven techniques and show their efficacy with fake data studies. These studies demonstrate that employing data-driven model validation in cross section measurements represents a reliable strategy to produce robust results that will stimulate the desired improvements to interaction modeling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Data-driven model validation for neutrino-nucleus cross section measurements

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

SSAPy - Space Situational Awareness for Python

SSAPy is a fast and flexible orbit modeling and analysis tool for orbits spanning from low-Earth into the cislunar regime. Orbits can be flexibly specified from common input formats such as Keplerian elements or two-line element (TLE) data files. SSAPy allows users to model satellites and specify parameters such as satellite area, mass, and drag coefficients. SSAPy includes a customizable force-propagation with a range of Earth, Lunar, radiation, atmospheric, and maneuvering models. SSAPy makes use of various community integration methods and can calculate time-evolved orbital quantities, including satellite magnitudes and state vectors. Users can specify various space- and ground-based observation models with support for multiple coordinate and reference frames. SSAPy also supports orbit analysis and propagation methods such as multiple hypothesis tracking and has built-in uncertainty quantification. The majority of SSAPy’s methods are vectorized and parallelizable, allowing for effective use of high-performance computer (HPC) systems. Finally, SSAPy has plotting functionality, allowing users to visualize orbits and trajectories. Examples are shown in Figure 1 and Figure 2.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Quantifying the Known Unknown: Including Marine Sources of Greenhouse Gases in Climate Modeling

Researchers have recently estimated that Arctic submarine permafrost currently traps 60 billion tons of methane and contains 560 billion tons of organic carbon in seafloor sediments and soil, a giant pool of carbon with potentially large feedbacks on the climate system. Unlike terrestrial permafrost, the submarine permafrost system has remained a “known unknown” because of the difficulty in acquiring samples and measurements. Consequently, this potentially large carbon stock never yet considered in global climate models or policy discussions, represents a real wildcard in our understanding of Earth’s climate. This report summarizes our group’s effort at developing a numerical modeling framework designed to produce a first-of-its-kind estimate of Arctic methane gas releases from the marine sediments to the water column, and potentially to the atmosphere, where positive climate feedback may occur. Newly developed modeling capability supported by the Laboratory Directed Research and Development (LDRD) program at Sandia National Laboratories now gives us the ability to probabilistically map gas distribution and quantity in the seabed by using a hybrid approach of geospatial machine learning, and predictive numerical thermodynamic ensemble modeling. The novelty in this approach is its ability to produce maps of useful data in regions that are only sparsely sampled, a common challenge in the Arctic, and a major obstacle to progress in the past. By applying this model to the circum-Arctic continental shelves and integrating the flux of free gas from in situ methanogenesis and dissociating gas hydrates from the sediment column under climate forcing, we can provide the most reliable estimate of a spatially and temporally varying source term for greenhouse gas flux that can be used by global oceanographic circulation and Earth system models (such as DOE’s E3SM). The result will allow us to finally tackle the wildcard of the submarine permafrost carbon system, and better inform us about the severity of future national security threats that sustained climate change poses.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

CrossLink: Geometry API [Slides]

The mesh generation process is very challenging and time consuming when working with complex CAD models. The process of creating and sorting geometric entities into groups appropriate for meshing is labor intensive and prone to error. In addition, the common data exchange formats such as STEP and IGES do not propagate information such as entity names that may be defined in the original model. Finally, entity counts change frequently with parameter variation as a result of tolerance-based geometry operations. Thus, sorting by index does not provide a robust and repeatable means for grouping. xGeom is a geometry library that enables the creation of NURBS curves and surfaces via a python scripting interface. xGeom is ideal for studying relatively simple models and is fully integrated with CrossLink’s mesh generation capabilities. For more complex models, xCAD is a python-based Creo Parametric CAD model driver that enables the model to be generated, queried, parametrically modified, regenerated, and exported without data loss and in a fully repeatable manner.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Deep Learning Reconstruction of Daily Soil CO 2 Efflux Reveals Biogeochemical Insights and Reduces Annual Estimate Uncertainty Despite Limited Daily Predictability

Soil CO 2 efflux is commonly measured monthly or seasonally, leaving daily dynamics poorly resolved and contributing to global estimation uncertainty. We trained a single Long Short-Term Memory (LSTM) model to predict daily soil CO 2 efflux across 82 globally distributed sites in COSORE, with 0.2%–46.9% daily data coverage from 2003 to 2020. Despite using far fewer sites than are typically used to train a single deep learning model, with observations biased toward temperate mesic sites, the LSTM model performed well at approximately one-third of sites, reconstructed nearly 2 decades of daily efflux, and outperformed commonly used approaches for estimating daily efflux when applied to the same data set. Performance was weakest at pronounced peaks and troughs and at non-temperate sites with <1.5 years of observations and irregular data patterns. Nevertheless, annual efflux from reconstructed daily data had <40% error even at underperforming sites, substantially improving estimates derived from monthly and seasonal sampling (maximum errors of 95% and 136%, respectively). Temperature sensitivity (Q 10 ) estimated from reconstructed daily predictions closely matched estimates from daily observations, whereas Q 10 values derived from monthly or seasonal observations deviated substantially, suggesting that coarse temporal sampling may contribute to uncertainty in reported Q 10 values. Consistent daily reconstructions further enabled trend analyses for well-performing, predominantly temperate sites and showed increasing soil CO 2 efflux at most sites from 2003 to 2020, with more variable summer trends. Despite limitations, these results demonstrate the potential of LSTM models to reconstruct daily soil CO 2 efflux and reduce estimation uncertainties from sparse observations.

Smykalov, Valerie [Pennsylvania State University, ↗

DOE OSTI2024

High-Resolution Frequency-Domain Spectroscopic and Modeling Studies of Photosystem I (PSI), PSI Mutants and PSI Supercomplexes

Photosystem I (PSI) is one of the two main pigment–protein complexes where the primary steps of oxygenic photosynthesis take place. This review describes low-temperature frequency-domain experiments (absorption, emission, circular dichroism, resonant and non-resonant hole-burned spectra) and modeling efforts reported for PSI in recent years. In particular, we focus on the spectral hole-burning studies, which are not as common in photosynthesis research as the time-domain spectroscopies. Experimental and modeling data obtained for trimeric cyanobacterial Photosystem I (PSI 3 ), PSI 3 mutants, and PSI 3 –IsiA 18 supercomplexes are analyzed to provide a more comprehensive understanding of their excitonic structure and excitation energy transfer (EET) processes. Detailed information on the excitonic structure of photosynthetic complexes is essential to determine the structure–function relationship. We will focus on the so-called “red antenna states” of cyanobacterial PSI, as these states play an important role in photochemical processes and EET pathways. The high-resolution data and modeling studies presented here provide additional information on the energetics of the lowest energy states and their chlorophyll (Chl) compositions, as well as the EET pathways and how they are altered by mutations. We present evidence that the low-energy traps observed in PSI are excitonically coupled states with significant charge-transfer (CT) character. The analysis presented for various optical spectra of PSI 3 and PSI 3 -IsiA 18 supercomplexes allowed us to make inferences about EET from the IsiA 18 ring to the PSI 3 core and demonstrate that the number of entry points varies between sample preparations studied by different groups. In our most recent samples, there most likely are three entry points for EET from the IsiA 18 ring per the PSI core monomer, with two of these entry points likely being located next to each other. Therefore, there are nine entry points from the IsiA 18 ring to the PSI 3 trimer. We anticipate that the data discussed below will stimulate further research in this area, providing even more insight into the structure-based models of these important cyanobacterial photosystems.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Implementation of a self-consistent slab model of bilayer structure in the SasView suite

Slab models are simple and useful structural descriptions which have long been used to describe lyotropic lamellar phases, such as lipid bilayers. Typically, slab models assume a midline symmetry and break a bilayer structure into three pieces, a central solvent-free core and two symmetric outer layers composed of the soluble portion of the amphiphile and associated solvent. This breakdown matches reasonably well to the distribution of neutron scattering length density and therefore is a convenient and common approach for the treatment of small-angle scattering data. Here, an implementation of this model within the SasView software suite is reported. The implementation is intended to provide physical consistency through the area per amphiphile molecule and number of solvent molecules included within the solvent-exposed outer layer. The proper use of this model requires knowledge of (or good estimates for) the amphiphile and solvent molecule volume and atomic composition, ultimately providing a self-consistent data treatment with only two free parameters: the lateral area per amphiphile molecule and the number of solvent molecules included in the outer region per amphiphile molecule. Here, the use of this code is demonstrated in the fitting of standard lipid bilayer data sets, obtaining structural parameters consistent with prior literature and illustrating the typical and ideal cases of fitting for neutron scattering data obtained using single or multiple contrast conditions. While demonstrated here for lipid bilayers, this model is intended for general application to block copolymers, surfactants, and other lyotropic lamellar phase structures for which a slab model is able to reasonably estimate the neutron scattering length density/electron-density profile of inner and outer layers of the lamellae.

36 MATERIALS SCIENCE↗

DOE OSTI2022

A Framework for Neural Network Inference on FPGA-Centric SmartNICs

FPGA-based SmartNICs offer great potential to significantly improve the performance of high-performance computing and warehouse data processing by tightly coupling support for reconfigurable data-intensive computation with cross-node communication, thereby mitigating the von Neumann bottleneck. Existing work, however, has been generally been limited in that it assumes an accelerator model where kernels are offloaded to SmartNICs, but most control tasks are left to the CPUs. This leads to frequent waiting, inferior performance, and scaling challenges. In this work, we propose a new distributive data-centric computing framework, named FCsN, for reconfigurable SmartNIC-based systems. Through a lightweight task circulation execution model and its implementation architecture, FCsN allows the complete detaching of kernel execution, control logic, system scheduling, and network communication to the SmarNICs. This boosts performance by: (i) avoiding the control dependency with CPUs and (ii) supporting streaming kernel execution and network communication at line rate and in a very fine-grained manner. We demonstrate the efficiency and flexibility of FCsN using various types of neural network applications including graph neural networks; as these last are both irregular and data intensive they offer an especially robust demonstration. Evaluations using commonly-used neural network models and graph datasets show that a system with the support of FCsN can achieve, on average, 144 speedups over the MPI-based standard CPU baselines.

Guo, Anqi↗

DOE OSTI2023

Modeling of the cold electron plasma density for radiation belt physics

This review focusses strictly on existing plasma density models, including ionospheric source models, empirical density models, physics-based and machine-learning density models. This review is framed in the context of radiation belt physics and space weather codes. The review is limited to the most commonly used models or to models recently developed and promising. A great variety of conditions is considered such as the magnetic local time variation, geomagnetic conditions, ionospheric source regions, radial and latitudinal dependence, and collisional vs. collisionless conditions. These models can serve to complement satellite observations of the electron plasma density when data are lacking, are for most of them commonly used in radiation belt physics simulations and can improve our understanding of the plasmasphere dynamics.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

The kinematic properties of Milky Way stellar halo populations

ABSTRACT In the Gaia era, stellar kinematics are extensively used to study Galactic halo stellar populations, to search for halo structures, and to characterize the interface between the halo and hot disc populations. We use distribution function-based models of modern data sets with 6D phase space data to qualitatively describe a variety of kinematic spaces commonly used in the study of the Galactic halo. Furthermore, we quantitatively assess how well each kinematic space can separate radially anisotropic from isotropic halo populations. We find that scaled action space (the ‘action diamond’) is superior to other commonly used kinematic spaces at this task. We present a new, easy to implement selection criterion for members of the radially anisotropic Gaia–Enceladus merger remnant. Assuming a 1:1 ratio of Gaia–Enceladus stars to more isotropic halo, we find our selection achieves a sample purity of 86 per cent in our models with respect to contamination from the more isotropic halo. We compare this criterion to literature criteria, finding that it produces the highest purity in the resulting samples, at the expense of a modest reduction in completeness. We also show that selection biases that underlie nearly all contemporary spectroscopic data sets can noticeably impact the E−Lz distribution of samples in a manner that may be confused for real substructure. We conclude by providing recommendations for how authors should use stellar kinematics in the future to study the Galactic stellar halo.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Report for Task 10: Controllability and Observability Analysis (Deliverable D7))

It is common to have less than full observability for distribution systems, as the number of available measurements are not sufficient. Considering increasing penetration of distributed energy resources (DERs), it is imperative to understand and control distribution systems better. Developed for the transmission system, the original numerical observability analysis methods were based on the canonical DC Power Flow (DC-PF) model. However, the DC-PF model is ill-suited for the distribution system in which line resistance to reactance (R/X) ratios can be near unity. In this report, we apply the non-iterative Observability Test (OT) and Observable Island Identification Procedure (OIIP) in to the gain matrix from the distribution system state estimator. Because sensors are few in distribution systems, pseudo-measurements based on historical load profiles and zero-injection virtual measurements are often employed to ensure observability. However, both the observability and the accuracy of the state estimates are uncertain when historical data is limited/unavailable.

42 ENGINEERING↗

DOE OSTI2022

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Unified Memory: GPGPU-Sim/UVM Smart Integration

CPU/GPU heterogeneous compute platforms are an ubiquitous element in computing and a programming model specified for this heterogeneous computing model is important for both performance and programmability. A programming model that exposes the shared, unified, address space between the heterogeneous units is a necessary step in this direction as it removes the burden of explicit data movement from the programmer while maintaining performance. GPU vendors, such as AMD and NVIDIA, have released software-managed runtimes that can provide programmers the illusion of unified CPU and GPU memory by automatically migrating data in and out of the GPU memory. However, this runtime support is not included in GPGPU-Sim, a commonly used framework that models the features of a modern graphics processor that are relevant to non-graphics applications. UVM Smart was developed, which extended GPGPU-Sim 3.x to in- corporate the modeling of on-demand pageing and data migration through the runtime. This report discusses the integration of UVM Smart and GPGPU-Sim 4.0 and the modifications to improve simulation performance and accuracy.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

System Modeling Frameworks for Wind Turbines and Plants: Review and Requirements Specifications

System modeling frameworks for wind turbines and plants are used by research groups and industry to design wind energy systems that take into account key trade-offs across performance, cost, and reliability at both the turbine and plant level. The frameworks are exercised using a variety of multi-disciplinary design, analysis and optimization (MDAO) methods. To improve inter-operability and foster collaboration, this report proposes a classification system for the frameworks along dimensions of model fidelity and scope. The classification system is first motivated with reviews the state-of-the-art in the development of software frameworks for integrated wind turbine and plant simulation. Within each major wind turbine and power plant subsystem, a matrix is developed for the disciplines used and the fidelity levels with which each discipline can be modeled. The existing frameworks are then classified according to the matrix. Next, an ontology is proposed that will allow for standardizing how data is transferred between the most common discipline-fidelity combinations used in the frameworks. A common representation of data creates the ability to 1) share system descriptions and analysis results, supporting more transparent benchmarks and comparison, and 2) integrate models together into workflows within and across organizations for improving the efficiency and performance of wind turbine and power plant design processes. Ultimately, this integration leads to better overall wind energy system designs with high performance and low costs.

17 WIND ENERGY↗