Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data- limited”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Artificial Intelligence Techniques in Smart Grid: A Survey

The smart grid is enabling the collection of massive amounts of high-dimensional and multi-type data about the electric power grid operations, by integrating advanced metering infrastructure, control technologies, and communication technologies. However, the traditional modeling, optimization, and control technologies have many limitations in processing the data; thus, the applications of artificial intelligence (AI) techniques in the smart grid are becoming more apparent. This survey presents a structured review of the existing research into some common AI techniques applied to load forecasting, power grid stability assessment, faults detection, and security problems in the smart grid and power systems. It also provides further research challenges for applying AI technologies to realize truly smart grid systems. Finally, this survey presents opportunities of applying AI to smart grid problems. The paper concludes that the applications of AI techniques can enhance and improve the reliability and resilience of smart grid systems.

energy systems↗
DOE OSTI2022

Resolving temperature limitation on spring productivity in an evergreen conifer forest using a model–data fusion framework

Abstract. The flow of carbon through terrestrial ecosystems and the response to climate are critical but highly uncertain processes in the global carbon cycle. However, with a rapidly expanding array of in situ and satellite data, there is an opportunity to improve our mechanistic understanding of the carbon (C) cycle's response to land use and climate change. Uncertainty in temperature limitation on productivity poses a significant challenge to predicting the response of ecosystem carbon fluxes to a changing climate. Here we diagnose and quantitatively resolve environmental limitations on the growing-season onset of gross primary production (GPP) using nearly 2 decades of meteorological and C flux data (2000–2018) at a subalpine evergreen forest in Colorado, USA. We implement the CARbon DAta-MOdel fraMework (CARDAMOM) model–data fusion network to resolve the temperature sensitivity of spring GPP. To capture a GPP temperature limitation – a critical component of the integrated sensitivity of GPP to temperature – we introduced a cold-temperature scaling function in CARDAMOM to regulate photosynthetic productivity. We found that GPP was gradually inhibited at temperatures below 6.0 ∘C (±2.6 ∘C) and completely inhibited below −7.1 ∘C (±1.1 ∘C). The addition of this scaling factor improved the model's ability to replicate spring GPP at interannual and decadal timescales (r=0.88), relative to the nominal CARDAMOM configuration (r=0.47), and improved spring GPP model predictability outside of the data assimilation training period (r=0.88). While cold-temperature limitation has an important influence on spring GPP, it does not have a significant impact on integrated growing-season GPP, revealing that other environmental controls, such as precipitation, play a more important role in annual productivity. This study highlights growing-season onset temperature as a key limiting factor for spring growth in winter-dormant evergreen forests, which is critical in understanding future responses to climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Search for boosted low-mass resonances decaying into hadrons produced in association with a photon in pp collisions at $ \sqrt{s}$ = 13 TeV with the ATLAS detector

Many extensions of the Standard Model, including those with dark matter particles, propose new mediator particles that decay into hadrons. This paper presents a search for such low mass narrow resonances decaying into hadrons using 140 fb −1 of proton-proton collision data recorded with the ATLAS detector at a centre-of-mass energy of 13 TeV. The resonances are searched for in the invariant mass spectrum of large-radius jets with two-pronged substructure that are recoiling against an energetic photon from initial state radiation, which is used as a trigger to circumvent limitations on the maximum data recording rate. This technique enables the search for boosted hadronically decaying resonances in the mass range 20–100 GeV hitherto unprobed by the ATLAS Collaboration. The observed data are found to agree with Standard Model predictions and 95% confidence level upper limits are set on the coupling of a hypothetical new spin-1 Z′ resonance with Standard Model quarks as a function of the assumed Z′-boson mass in the range between 20 and 200 GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Operando real-space imaging of a structural phase transformation in the high-voltage electrode LixNi0.5Mn1.5O4

Abstract Discontinuous solid-solid phase transformations play a pivotal role in determining the properties of rechargeable battery electrodes. By leveraging operando Bragg Coherent Diffractive Imaging (BCDI), we investigate the discontinuous phase transformation in Li x Ni 0.5 Mn 1.5 O 4 within an operational Li metal coin cell. Throughout Li-intercalation, we directly observe the nucleation and growth of the Li-rich phase within the initially charged Li-poor phase in a 500 nm particle. Supported by the microelasticity model, the operando imaging unveils an evolution from a curved coherent to a planar semi-coherent interface driven by dislocation dynamics. Our data indicates negligible kinetic limitations from interface propagation impacting the transformation kinetics, even at a discharge rate of C/2 (80 mA/g). This study highlights BCDI’s capability to decode complex operando diffraction data, offering exciting opportunities to study nanoscale phase transformations with various stimuli.

Sun, Yifei (ORCID:0000000295625120)↗
DOE OSTI2021

Evaluation of Data Catalog Software for Hanford Site Environmental Datasets

Environmental information and data underpin achievement of the U.S. Department of Energy (DOE) Office of Environmental Management (EM) mission at the Hanford Site. The Hanford Environmental Data Management (HEDM) Program is the DOE Richland Operations Office (RL) approach to develop and implement a formal program for managing environmental data and the associated records, materials, and systems at the Hanford Site. The current project, contract, organization, and contractor-specific efforts at managing environmental data sets are insufficient to provide orderly, long-term, site-wide access. A vital element to be created within the HEDM program plan is a catalog of data sources, called the Hanford Environmental Information and Data Index (HEIDI), that will enable long-term access and retrievability for the multiple independent sources of data that might otherwise be difficult to discover. This report compares leading open source and commercial data catalog platforms using criteria to assess the functionality needed to develop the HEIDI catalog of Hanford data sources that connects and exchanges data with established Hanford Local Area Network (HLAN) enterprise information technology systems. Proprietary platforms evaluated included ArcGIS Enterprise Sites, Junar, OpenDataSoft, and Socrata, and non-proprietary platforms included Energy Data eXchange (EDX), Comprehensive Knowledge Archive Network (CKAN), and DKAN (a Drupal-based open data portal based on CKAN). Capabilities supporting data discoverability, retrieval, and archival, as well as metadata standard requirements and integration into the HLAN were rated as either failing to meet requirements (F), meeting requirements (M), or exceeding requirements by delivering additional desired features (E). The lowest rating for any capability area was assigned as the overall rating for the platform. These findings enable DOE-RL and the contractors implementing the HEDM plan to focus on candidate tools likely to meet the requirements for implementing HEIDI. All of the platforms receiving an overall rating of ‘F’ were unable to be deployed on Hanford infrastructure or within dedicated cloud resources. A propriety software-as-a-service (SaaS) model of delivering a data catalog (e.g., found in software such as Junar and OpenDataSoft) favors consistency across customers at the expense of customization and configurable roles that are needed for Hanford work. Hosting data on a shared commercial platform places limits on dataset size (maximum of 240 Mb for OpenDataSoft), a significant limitation for HEIDI implementation. EDX, a government data catalog based on CKAN, received the ‘F’ rating due to an inability to incorporate authentication from HLAN into the system. Among platforms rated ‘M’ or ‘E’, only the Socrata platform had a SaaS delivery model. In contrast to other SaaS platforms, Socrata provided custom roles and gateways that allow local datasets to be incorporated into an online catalog. Socrata also complies with the Federal Risk and Authorization Management Program, a significant benefit for cloud-based management of Hanford data. The other platforms rated ‘M’ or ‘E’, ArcGIS Enterprise Sites, CKAN, and DKAN, provide fully self-hosted options, allowing for greater control and flexibility with the HEIDI catalog. These widely used tools have supportive communities of practice, extensive customization options, and demonstrated deployments that provide evidence that they can meet requirements, often deliver additional desired features, and work well with federal government systems. Completely customized alternatives built on a collection of applications were not evaluated because achieving similar performance to CKAN or DKAN requires substantial resources, especially in the absence of the active communities that have grown to support these tools. ArcGIS Enterprise Sites, Socrata, CKAN, and DKAN were evaluated as strong candidates for successful implementation with HEIDI.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Accurate and Rapid Forecasts for Geologic Carbon Storage via Learning-Based Inversion-Free Prediction

Carbon capture and storage (CCS) is one approach being studied by the U.S. Department of Energy to help mitigate global warming. The process involves capturing CO 2 emissions from industrial sources and permanently storing them in deep geologic formations (storage reservoirs). However, CCS projects generally target “green field sites,” where there is often little characterization data and therefore large uncertainty about the petrophysical properties and other geologic attributes of the storage reservoir. Consequently, ensemble-based approaches are often used to forecast multiple realizations prior to CO 2 injection to visualize a range of potential outcomes. In addition, monitoring data during injection operations are used to update the pre-injection forecasts and thereby improve agreement between forecasted and observed behavior. Thus, a system for generating accurate, timely forecasts of pressure buildup and CO 2 movement and distribution within the storage reservoir and for updating those forecasts via monitoring measurements becomes crucial. This study proposes a learning-based prediction method that can accurately and rapidly forecast spatial distribution of CO 2 concentration and pressure with uncertainty quantification without relying on traditional inverse modeling. The machine learning techniques include dimension reduction, multivariate data analysis, and Bayesian learning. The outcome is expected to provide CO 2 storage site operators with an effective tool for timely and informative decision making based on limited simulation and monitoring data.

58 GEOSCIENCES↗
DOE OSTI2020

Evaluation of Alignment: Precision, Recall, Weighting and Limitations

In the real world, data does not come neatly packaged. Instead, it typically comes as small updates from many sources with different conventions. Building a single, cohesive knowledge-base to work from requires merging small updates from many different sources. This paper outlines methods we have investigated for scoring merging routines. Given a challenge problem consisting of a large knowledge-base and a set of smaller documents, algorithms are asked to identify alignment points between the smaller document and the knowledge base. This paper surveys options for evaluating such algorithms, providing notes on strengths, weaknesses and considerations for interpretation.

Cottam, Joseph A.↗
DOE OSTI2026

Calibration of urban building energy model using smart meter data for district peak load prediction

Urban building energy modeling (UBEM) is a powerful approach to assessing baseline building energy performance and retrofits with new technologies across building stocks in cities. However, the accuracy of UBEM is often constrained by the limited availability of reliable data about building characteristics and operations, such as envelope efficiency levels, HVAC system performance, and end-use load patterns. Existing research has performed UBEM calibration using annual or monthly energy consumption data, which falls short when higher-resolution time series applications are needed, such as peak load prediction for utility operation planning. This study presents a new framework for calibrating building energy models at urban scale using smart meter data, targeting the accurate prediction of summer peak electricity loads to support robust grid planning. The framework first integrates various data sources to enhance baseline input assumptions for building models, and then calibrates the baseline models through a pattern-matching approach. A case study using CityBES and two years of AMI data from over 9000 residential customers in Portland, Oregon, demonstrated the workflow and its effectiveness. The calibrated models achieved a daily peak load mean absolute percentage error of 2.6 % during the heatwave in the calibration year, and 2.0 % in the validation year using another year of AMI data. Using the calibrated models, we analyzed the demand flexibility potential of the district building stock as an application of UBEM calibration. The findings affirm the appropriate use of UBEM for peak electric load forecasting and demand side management at the utility distribution system level.

AMI data↗
DOE OSTI2024

Mathematical methods for optimal polynomial recovery of high-dimensional systems from noisy data

The goal of our Early Career Research Project (ECRP) is to establish a modern mathematical foundation that will enable next-generation computational methods for polynomial approximation of high-dimensional systems, having a certain set of constraints, from a limited amount of noisy data. Such a foundation is critical to realizing the future potential of the DOE user facilities, and will ultimately empower scientists to address a fundamental question, namely, “how many realizations of a nonlinear manifold are required to recover the entire high-dimensional solution map, with optimal approximation guarantees and minimal computational cost?” The central theme of this effort aims to conquer this challenge by pioneering the development of extraordinarily innovative theoretical analysis and transformational non-intrusive computational methodologies. Such approaches will enable the reconstruction of the entire high-dimensional solution map, with accuracy comparable to the best approximation, while utilizing an optimal number of samples. During this reporting period we have made significant progress on four thrusts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Forty years of durability assessment of nuclear waste glass by standard methods

Abstract Standard methods to assess the durability of vitrified radioactive waste were first developed in the 1980’s and, over the last 40 years, have evolved to yield a range of responses depending on experimental conditions and glass composition. Mechanistic understanding of glass dissolution has progressed in parallel, enhancing our interpretation of the data acquired. With the implementation of subsurface disposal for vitrified radioactive waste drawing closer, it is timely to review the available standard methodologies and reflect upon their relative advantages, limitations, and how the data obtained can be interpreted to support the post-closure safety case for radioactive waste disposal.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Physics informed neural network can retrieve rate and state friction parameters from acoustic monitoring of laboratory stick-slip experiments

Various machine learning (ML) and deep learning (DL) techniques have been recently applied to the forecasting of laboratory earthquakes from friction experiments. The magnitude and timing of shear failures in stick-slip cycles are predicted using features extracted from the recorded ultrasonic or acoustic emission (AE) signals. In addition, the Rate and State Friction (RSF) constitutive laws are extensively used to model the frictional behavior of faults. In this work, we use data from shear experiments coupled with passive acoustic (variance, kurtosis, and AE rate) interleaved with active source ultrasonic monitoring (transmitted wave amplitude) to develop physics-informed neural network (PINN) models incorporating the RSF law and AE rate generation equation with wave amplitude serving as a proxy for friction state variable. This PINN framework allows learning RSF parameters from stick-slip experiments rather than measuring them through a series of velocity step experiments. We observe that when the stick-slip cycles are irregular, the PINN models outperform the data-driven DL models. Transfer learning (TL) PINN models are also developed by pre-training on data collected at one normal stress level followed by forecasting shear failures and retrieving RSF parameters at other stress levels (i.e., with different recurrence intervals) after retraining on a limited amount of new data. Our findings suggest that TL models perform better compared to standalone models. Both standalone and TL PINN-estimated RSF parameters and their ground truth values show excellent agreements thus demonstrating that RSF parameters can be retrieved from laboratory stick-slip experiments using the corresponding acoustic data and that the transmitted wave amplitude provides a good representation of the evolving frictional state during stick-slips.

58 GEOSCIENCES↗
DOE OSTI2025

DESIVAST: Catalogs of Low-redshift Voids Using Data from the DESI Data Release 1 Bright Galaxy Survey

We present three separate void catalogs created using a volume-limited sample of the DESI Data Release 1 Bright Galaxy Survey. We use the algorithms VoidFinder and V 2 to construct void catalogs out to a redshift of z = 0.24. Excluding voids affected by the boundaries of the survey, we obtain 1489 voids with VoidFinder, 389 with V 2 using REVOLVER pruning, and 297 with V 2 using VIDE pruning. Comparing our catalogs with overlapping Sloan Digital Sky Survey void catalogs, we find generally consistent void properties but significant differences in the void volume overlap, which we attribute to differences in the galaxy selection and survey masks. These catalogs are suitable for studying the variation in galaxy properties with cosmic environment and for cosmological studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Optimizers for stabilizing likelihood-free inference

A growing number of applications in particle physics and beyond use neural networks as unbinned likelihood ratio estimators applied to real or simulated data. Precision requirements on the inference tasks demand a high-level of stability from these networks, which are affected by the stochastic nature of training. We show how physics concepts can be used to stabilize network training through a physics-inspired optimizer. In particular, the energy conserving descent (ECD) optimization framework uses classical Hamiltonian dynamics on the space of network parameters to reduce the dependence on the initial conditions while also stabilizing the result near the minimum of the loss function. We develop a version of this optimizer known as , which has few free hyperparameters with limited ranges guided by physical reasoning. We apply to representative likelihood-ratio estimation tasks in particle physics and find on average that it out-performs the widely used Adam optimizer. We expect that ECD will be a useful tool for wide array of data-limited problems, where it is computationally expensive to exhaustively optimize hyperparameters and mitigate fluctuations with ensembling.

Monte Carlo methods↗
DOE OSTI2024

Extreme sparsification of physics-augmented neural networks for interpretable model discovery in mechanics

Data-driven constitutive modeling with neural networks has received increased interest in recent years due to its ability to easily incorporate physical and mechanistic constraints and to overcome the challenging and time-consuming task of formulating phenomenological constitutive laws that can accurately capture the observed material response. However, even though neural network-based constitutive laws have been shown to generalize proficiently, the generated representations are not easily interpretable due to their high number of trainable parameters. Sparse regression approaches exist that allow for obtaining interpretable expressions, but the user is tasked with creating a library of model forms which by construction limits their expressiveness to the functional forms provided in the libraries. Here, in this work, we propose to train regularized physics-augmented neural network-based constitutive models utilizing a smoothed version of $L^0$-regularization. This aims to maintain the trustworthiness inherited by the physical constraints, but also enables interpretability which has not been possible thus far on any type of machine learning-based constitutive model where model forms were not assumed a priori but were actually discovered. During the training process, the network simultaneously fits the training data and penalizes the number of active parameters, while also ensuring constitutive constraints such as thermodynamic consistency. We show that the method can reliably obtain interpretable and trustworthy constitutive models for compressible and incompressible hyperelasticity, yield functions, and hardening models for elastoplasticity, using synthetic and experimental data. This work aims to set a new paradigm for interpretable machine learning models in the broad area of solid mechanics where low and limited data is available along with prior knowledge of physical constraints that the learned maps need to obey. This paradigm can potentially be extended to a broader spectrum of scientific exploration.

Data-driven constitutive models↗
DOE OSTI2020

Distributed Solar 2020 Data Update [Slides]

Berkeley Lab’s Tracking the Sun report summarizes installed prices and other trends among grid-connected, distributed solar photovoltaic (PV) systems in the United States. This report is now being published on a biannual cycle. In 2020, Berkeley Lab has released a more limited Distributed Solar 2020 Data Update, which consists of the same data otherwise published in Tracking the Sun report. The update includes data on more than 1.9 million systems installed through 2019, covering 82% of all distributed PV systems installed nationally through that timeframe.As in prior years, the data update focuses to a large degree on installed prices reported for distributed PV projects, describing both historical trends and variability in pricing across projects.With respect to the historical price trajectory, national median installed prices fell, from 2018 to 2019, by roughly 1% for residential systems, remained essentially flat for small non-residential systems, and fell by 4% for large non-residential systems. Across all three customer segments, these are the slowest annual percentage declines since 2006-2008.Pricing continues to vary widely across individual projects, reflecting, among other things, differences in system sizing and design, installer-level pricing strategies, and local market conditions. For example, among residential systems installed in 2019, the lowest 20% were priced below $3.1/W, while the highest 20% were above $4.5/W. The distributions for non-residential systems exhibit similarly wide spreads.In addition to data on installed prices, the data update also covers a broad range of trends related to distributed PV system design, including: system sizing, module efficiency, module-level power electronics, inverter-loading ratios, solar+storage installations, mounting configuration, panel orientation, third-party ownership, and customer segmentation.

14 SOLAR ENERGY↗
DOE OSTI2023

Identification of novel organic polar materials: A machine learning study with importance sampling

Recent advances in the synthesis of polar molecular materials have produced practical alternatives to ferroelectric ceramics, opening up exciting new avenues for their incorporation into modern electronic devices. However, in order to realize the full potential of polar polymer and molecular crystals for modern technological applications, it is paramount to assemble and evaluate all the available data for such compounds, identifying descriptors that could be associated with an emergence of ferroelectricity. In this paper, we utilized data-driven approaches to judiciously shortlist candidate materials from a wide chemical space that could possess ferroelectric functionalities. A machine learning study with importance sampling was employed to address the challenge of having a limited amount of available data on already-known organic ferroelectrics. Sets of molecular- and crystal-level descriptors were combined with a Random Forest Regression algorithm in order to predict the spontaneous polarization of the shortlisted compounds. First-principles simulations were performed to further validate the predictions obtained from the machine learning model.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Journey to Time-Variable Moment Tensors through Inversion of Acoustic and Seismoacoustic Data

We explore the capability of acoustic and seismoacoustic datasets to directly resolve a complex, time-variable source consisting of a buried mechanism, represented as a moment tensor, and a spall mechanism, represented as a vertical force at the surface. Traditionally, each component of a resolved moment tensor assumes one underlying source time function, which likely fails to capture the full evolution of a dynamic source, such as an explosion followed by slip on near-source joints or development of spallation. Specifically, we expand previous work to resolve a time-variable moment tensor using single-modality and joint-modality inversion frameworks through analysis of infrasound and seismoacoustic data recorded as part of the Source Physics Experiment Phase II: Dry Alluvium Geology (DAG). We investigate the impact of including signals from seismic-to-air coupling that are local to each infrasound sensor in comparison to mainly atmosphere-propagating acoustic signals, which occur from coupling of the wavefield from the subsurface to the atmosphere directly above the source. Additionally, we assess the ability of our inversion algorithm to fit observed infrasound data using a variety of time-variable source mechanisms. First, we consider the buried moment tensor source alone, which assumes that the determined Green’s functions incorporate effects from spallation or that the impact from spallation is minimal. Second, we examine the estimated buried moment tensor and vertical surface spallation as terms that must both be resolved in the inversion. Third, we assess the ability for an estimated vertical surface spallation source to fit the acoustic data on its own. Finally, we compare results from the joint inversion of both seismic geophone and infrasound acoustic data for the buried-only source compared to buried and spallation sources. Our results are a preliminary investigation into the applications of the inversion technique to recorded datasets and show the technique has limited capabilities using acoustic data alone. Instead, this method shows promise for seismic and seismoacoustic datasets to resolve the time-variable mechanisms of a buried source.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Measuring impacts of California agri-environmental programs using field-scale satellite data

In the past decade, California has invested over $\$$200 million in direct grants to growers to support the adoption of agricultural practices that save water and/or improve soil health while also reducing greenhouse gas emissions. Ex-post evaluation of agri-environmental outcomes of these grant programs, however, is limited. We use satellite data to monitor changes in field-level consumptive water use and greenness (i.e. normalized difference vegetation index), a proxy for agricultural productivity, for the most frequently funded crop-types (almonds, grapes, and walnuts) in two California Department of Food and Agriculture programs. Nearly 600 fields receiving funding during the 2014–2022 period were analyzed using two causal inference methods. Fields that received grants to both upgrade irrigation systems and install irrigation water management sensors showed reduced consumptive water use and greenness by an average of 3.5% and 4.2%, respectively (significant at the 10% level). In contrast, we find that the adoption of only irrigation water management sensors, which are designed to inform irrigation scheduling and management, resulted in an average increase of 4.1% and 4.8% in consumptive water use and greenness respectively (significant at the 5% level). We find negligible effects for either consumptive water use or greenness when both pump efficiency upgrades and sensors were implemented. We further find that grants for compost addition and cover cropping led to small greenness increases of 1.7% and 2.8% respectively (significant at the 10% level) and had insignificant effects on consumptive water use. Our analysis of five agri-environmental program interventions reveals that several practice outcomes may be at odds with stated program goals of reducing water use while maintaining or improving agricultural productivity.

agriculture↗