SEARCH · Engineering Papers

Results for “data driven optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

All sources NASA NTRS DOE OSTI

DOE OSTI2025

A physics-constrained neural ordinary differential equations approach for robust learning of stiff chemical kinetics

The high computational cost associated with solving for detailed chemistry poses a significant challenge for predictive computational fluid dynamics (CFD) simulations of turbulent reacting flows. While deep learning techniques have been explored to develop faster surrogate models, they often fail to integrate reliably with CFD solvers. This instability arises because traditional deep learning approaches optimize for training error without ensuring compatibility with ordinary differential equation (ODE) solvers, resulting in accumulation of errors over time. Recently, neuralODE (NODE) based approaches have been shown to be a promising technique to emulate and accelerate detailed chemistry computations. Here, in the present work, we extend this NODE framework for stiff chemical kinetics by incorporating mass conservation constraints directly into the loss function during training. This ensures that the total mass as well as the individual elemental species masses are conserved in an a-posteriori manner. Proof-of-concept studies are performed with the novel physics-constrained NODE (PC-NODE) approach for homogeneous autoignition of hydrogen-air mixture over a range of composition and thermodynamic conditions. It is demonstrated that the PC-NODE framework not only improves the physical consistency of the resulting data-driven model with respect to mass conservation criteria, but also improves training efficiency. PC-NODE is shown to achieve 2–100× speedup relative to the hydrogen-air detailed chemical mechanism depending on the type of the ODE solver (implicit or explicit) used during autoregressive inference tests. Lastly, a-posteriori studies are performed wherein the trained PC-NODE model is coupled with a CFD solver. It is shown that higher accuracy is achieved with PC-NODE relative to the purely data-driven NODE approach. Moreover, PC-NODE also exhibits robustness and generalizability to unseen initial conditions from within (interpolative capability) as well as outside (extrapolative capability) the training regime.

computational combustion↗

DOE OSTI2024

Datasets for Widespread Residential Space Heating Electrification in Texas

In this experiment, we explore long term patterns in electricity demand driven by the dual effects of full electrification of space heating in Texas (by adoption of electric heat pumps), and climate change. We use a predictive model of electricity demand, climate projections, and an open source nodal power system (DC Optimal Power Flow) model of the Electric Reliability Council of Texas (ERCOT) system. Heat pumps are a more energy efficient way of providing space heating and cooling in homes. We attempt to exhaustively investigate the impacts of full residential space heating electrification by adoption of heat pumps for the segment of Texas households that currently rely on fossil fuels (about 40%), while simultaneously incorporating climate change meteorological variables. We explore a range of scenarios of heat pump efficiency and climate uncertainty over a long period of future years (2020-2099). In total, the simulation experiment generates 1,280 simulation years of hourly data. We report and analyze results in form of impacts on residential load, total load, peak load, seasonality of peaking, and reliability measured by occurrence and frequency of loss of load events. While the experiment is for ERCOT, the insights and approach can be applied to other regions. The results from the analysis can inform system planners on a range of potential capacity requirements/ reliability implications and/or risks of full space heating electrification via the adoption of electric heat pumps, given the uncertainty in the scenarios/ climate futures. The dataset includes model output for residential, non residential and total load, and the results from the GO ERCOT model runs for 4 RCP Scenarios (RCP 4.5 Cooler, RCP 4.5 Hotter, RCP 8.5 Cooler, RCP 8.5 Hotter), 4 Heating electrification Scenarios (Base , Standard Efficiency HP, High Efficiency HP, Ultra-High Efficiency HP) over 80 years (2020-2099). The metrological variables at BA scale were weighted weighted using population projections consistent with the SSP3 scenario.

Climate Change↗

NASA NTRS2019

Prediction of Pushback Times and Ramp Taxi Times for Departures at Charlotte Airport

When optimizing the takeoff sequence and schedule for departures at busy airports, it is important to accurately predict the taxi times from gate to runway because those are used to calculate the earliest possible takeoff times. Several airports like Charlotte Douglas International Airport show relatively long taxi times inside the ramp area with large variations, with respect to the travel times in the airport movement area. Also, the pushback process times have not been accurately modeled so far mainly due to the lack of accurate data. The recent deployment of the integrated arrival, departure, and surface traffic management system at Charlotte airport by NASA enables more accurate flight data in the airport surface operations to be obtained. Taking advantage of this system, actual pushback times and ramp taxi times from historical flight data at this airport are analyzed. Based on the analysis, a simple, data-driven prediction model is introduced for estimating pushback times and ramp transit times of individual departure flights. To evaluate the performance of this prediction model, several machine learning techniques are also applied to the same dataset. The prediction results show that the data-driven prediction model is as good as the machine learning algorithms when comparing various prediction performance metrics.

Lee, Hanbong↗

NASA NTRS2019

Prediction of Pushback Times and Ramp Taxi Times for Departures at Charlotte Airport

airport surface operations↗

DOE OSTI2024

Machine Learning-Enabled Image Classification for Automated Electron Microscopy

Abstract Traditionally, materials discovery has been driven more by evidence and intuition than by systematic design. However, the advent of “big data” and an exponential increase in computational power have reshaped the landscape. Today, we use simulations, artificial intelligence (AI), and machine learning (ML) to predict materials characteristics, which dramatically accelerates the discovery of novel materials. For instance, combinatorial megalibraries, where millions of distinct nanoparticles are created on a single chip, have spurred the need for automated characterization tools. This paper presents an ML model specifically developed to perform real-time binary classification of grayscale high-angle annular dark-field images of nanoparticles sourced from these megalibraries. Given the high costs associated with downstream processing errors, a primary requirement for our model was to minimize false positives while maintaining efficacy on unseen images. We elaborate on the computational challenges and our solutions, including managing memory constraints, optimizing training time, and utilizing Neural Architecture Search tools. The final model outperformed our expectations, achieving over 95% precision and a weighted F-score of more than 90% on our test data set. This paper discusses the development, challenges, and successful outcomes of this significant advancement in the application of AI and ML to materials discovery.

Materials Science↗

DOE OSTI2026

Predicting initial trans-membrane pressure across cycles in the ultrafiltration process using random forest

With growing freshwater scarcity, direct potable reuse (DPR) systems that reclaim wastewater for drinking are becoming increasingly important for sustainable water supply. Reliable operation requires minimizing downtime in ultrafiltration (UF) units, where membrane fouling leads to elevated trans-membrane pressure (TMP). This study develops data-driven regression models based on random forest (RF) and autoregressive (AR) approaches to forecast the initial TMP at the start of each UF filtration cycle in a pilot-scale DPR system. The RF model consistently outperforms baseline methods, including historical mean, last observation carried forward, and AR models, across multiple forecast horizons, achieving the lowest root mean square error. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent input variables across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is assessed for both direct and recursive RF modelling approaches. The proposed RF framework establishes a robust foundation for predictive monitoring and real-time optimization of UF operations, supporting sustainable and reliable water reuse.

direct potable reuse↗

DOE OSTI2023

Inferring Type II-P Supernova Progenitor Masses from Plateau Luminosities

Abstract Connecting observations of core-collapse supernova explosions to the properties of their massive star progenitors is a long-sought, and challenging, goal of supernova science. Recently, Barker et al. presented bolometric light curves for a landscape of progenitors from spherically symmetric neutrino-driven core-collapse supernova (CCSN) simulations using an effective model. They find a tight relationship between the plateau luminosity of the Type II-P CCSN light curve and the terminal iron-core mass of the progenitor. Remarkably, this allows us to constrain progenitor properties with photometry alone. We analyze a large observational sample of Type II-P CCSN light curves and estimate a distribution of iron-core masses using the relationship of Barker et al. The inferred distribution matches extremely well with the distribution of iron-core masses from stellar evolutionary models and namely, contains high-mass iron cores that suggest contributions from very massive progenitors in the observational data. We use this distribution of iron-core masses to infer minimum and maximum masses of progenitors in the observational data. Using Bayesian inference methods to locate optimal initial mass function parameters, we find M min = 9.8 − 0.27 + 0.37 and M max = 24.0 − 1.9 + 3.9 solar masses for the observational data.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Toward autonomous design and synthesis of novel inorganic materials

Autonomous experimentation driven by artificial intelligence (AI) provides an exciting opportunity to revolutionize inorganic materials discovery and development. Herein, we review recent progress in the design of self-driving laboratories, including robotics to automate materials synthesis and characterization, in conjunction with AI to interpret experimental outcomes and propose new experimental procedures. We focus on efforts to automate inorganic synthesis through solution-based routes, solid-state reactions, and thin film deposition. In each case, connections are made to relevant work in organic chemistry, where automation is more common. Characterization techniques are primarily discussed in the context of phase identification, as this task is critical to understand what products have formed during synthesis. The application of deep learning to analyze multivariate characterization data and perform phase identification is examined. To achieve “closed-loop” materials synthesis and design, we further provide a detailed overview of optimization algorithms that use active learning to rationally guide experimental iterations. Lastly, we highlight several key opportunities and challenges for the future development of self-driving inorganic materials synthesis platforms.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Leveraging BERT and Network-Based Attention Analysis for Identifying Treatment Milestones in EHRs

This study introduces a sophisticated data-driven framework for analyzing Electronic Health Records (EHRs) using transformer-based models to identify and disentangle overlapping treatment contexts. The framework leverages a preprocessing pipeline that transforms structured procedural codes into semantically enriched descriptive text, enabling the use of attention mechanisms to cluster medical events into treatment milestones—cohesive and distinct components of care processes. The methodology is rigorously validated using synthetic datasets derived from the MIMIC-III database, designed to simulate the heterogeneity and overlapping procedural contexts characteristic of real-world EHR scenarios. Quantitative evaluation highlights the framework’s robustness in disentangling concurrent care pathways, with attention metrics and unsupervised clustering approaches demonstrating the ability to preserve intra-context relationships while distinguishing inter-context dependencies. By addressing challenges inherent in data heterogeneity, this approach provides a foundation for uncovering complex treatment patterns, advancing clinical decision-making, and optimizing resource allocation in diverse healthcare environments.

Kim, Minsu [ORNL] (ORCID:0000000224185535)↗

DOE OSTI2022

Investigation of Timing Properties for an Event Driven with Access and Reset Decoder Readout Architecture for a Pixel Array

The large number of data generating sources (data channels) on a single chip requires appropriate techniques to manage a readout from these channels. One of the main methods is sharing a medium of transmission, which requires arbitration to avoid collisions or deadlocks. Existing solutions face several problems such as a dead time, unintended prioritization or metastability. That is why we decided to create a new readout architecture named EDWARD i.e., Event Driven with Access and Reset Decoder. The EDWARD architecture gets rid of the earlier mentioned problems and mitigates the other ones. However, due to the use of logic circuits outside a standard cell library, which are hard to characterize, we were challenged to perform an additional transient analysis to validate the architecture. Here we show a methodology and the results of the simulations. Based on the results obtained we can confirm the functional correctness of the system and plan the optimization of operating conditions in order to achieve better performance. Our goal is to use the EDWARD architecture in the future radiation detectors to be built at Brookhaven National Laboratory.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Hybridizing Machine Learning and Physically-based Earth System Models to Improve Prediction of Multivariate Extreme Events (AI Exploration of Wildland Fire Prediction)

Focal Areas: This project responds to two focal areas identified in the DOE Call for AI4ESP White Papers: 1) Predictive modeling through the use of artificial intelligence (AI) techniques, and 2) insights gleaned from complex data using explainable AI and big data analytics. Science Challenge: Large wildland fires (hereafter wildfires) appearing as high-impact compound climate extreme events are closely related to hydroclimate and water cycle extremes that modulate surface fuel supply and combustibility. These compound events have multivariate climatic features (e.g., temperature, precipitation, relative humidity, wind, lightning) and societal drivers (e.g., forest management, land use change, human caused ignitions). Meanwhile, they induce strong feedbacks to the coupled atmosphere, biosphere, and hydrosphere by perturbing regional and global radiation budget as well as ecological, biogeochemical, and water cycles across multiple spatiotemporal scales. The nonlinear interactions between these natural and anthropogenic components of the Earth system are too complex to be completely and adequately represented in today’s Earth system models (ESMs). The inherent stochastic nature of fire activity at all scales further increases the difficulty of its prediction using ESMs that are usually developed from deterministic equations and parameterizations. Besides, concurrence of long-term (decadal to interdecadal) global climate change and fire regime shifts overlapping with short-term (intraseasonal to interannual) variations of regional fire weather and burning activity confound predictability of these compound extreme events. We propose to address the above scientific challenges by using machine learning (ML)-based data-driven modeling techniques to integrate observations and physically-based ESMs’ simulations in a computationally efficient hybrid prediction system. This prediction system is supposed to characterize the wildfire’s sensitivity to climate and exogenous drivers at high resolution (~ 0.25°) on subseasonal to seasonal (S2S) timescales providing improved predictability and explainability. We will use the system to help identify: (1) What are the computational elements of a hybrid system needed to predict compound climate extreme events such as global wildfires? (2) What are the key drivers (either natural or anthropogenic) that modulate short-term variations of multivariate fire weather and burning activity over different regions? How can one take advantage of those driver-response relationships to improve the predictability of large wildfires on S2S time scales? (3) What are the underlying physical mechanisms and sources of improved predictability? Which ML techniques are optimal in revealing and adapting these mechanisms?

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2004

Putting Priors in Mixture Density Mercer Kernels

This paper presents a new methodology for automatic knowledge driven data mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. We describe a new method called Mixture Density Mercer Kernels to learn kernel function directly from data, rather than using predefined kernels. These data adaptive kernels can en- code prior knowledge in the kernel using a Bayesian formulation, thus allowing for physical information to be encoded in the model. We compare the results with existing algorithms on data from the Sloan Digital Sky Survey (SDSS). The code for these experiments has been generated with the AUTOBAYES tool, which automatically generates efficient and documented C/C++ code from abstract statistical model specifications. The core of the system is a schema library which contains template for learning and knowledge discovery algorithms like different versions of EM, or numeric optimization methods like conjugate gradient methods. The template instantiation is supported by symbolic- algebraic computations, which allows AUTOBAYES to find closed-form solutions and, where possible, to integrate them into the code. The results show that the Mixture Density Mercer-Kernel described here outperforms tree-based classification in distinguishing high-redshift galaxies from low- redshift galaxies by approximately 16% on test data, bagged trees by approximately 7%, and bagged trees built on a much larger sample of data by approximately 2%.

Srivastava, Ashok N.↗

NASA NTRS2012

Estimation and Bias Correction of Aerosol Abundance using Data-driven Machine Learning and Remote Sensing

Air quality information is increasingly becoming a public health concern, since some of the aerosol particles pose harmful effects to peoples health. One widely available metric of aerosol abundance is the aerosol optical depth (AOD). The AOD is the integrated light extinction coefficient over a vertical atmospheric column of unit cross section, which represents the extent to which the aerosols in that vertical profile prevent the transmission of light by absorption or scattering. The comparison between the AOD measured from the ground-based Aerosol Robotic Network (AERONET) system and the satellite MODIS instruments at 550 nm shows that there is a bias between the two data products. We performed a comprehensive analysis exploring possible factors which may be contributing to the inter-instrumental bias between MODIS and AERONET. The analysis used several measured variables, including the MODIS AOD, as input in order to train a neural network in regression mode to predict the AERONET AOD values. This not only allowed us to obtain an estimate, but also allowed us to infer the optimal sets of variables that played an important role in the prediction. In addition, we applied machine learning to infer the global abundance of ground level PM2.5 from the AOD data and other ancillary satellite and meteorology products. This research is part of our goal to provide air quality information, which can also be useful for global epidemiology studies.

Malakar, Nabin K.↗

DOE OSTI2025

Systematic feature design for cycle life prediction of lithium-ion batteries during formation

Optimization of the formation step in lithium-ion battery manufacturing is challenging due to limited physical understanding of solid-electrolyte interphase formation and the long testing time (∼100 days) for cells to reach the end of life. We propose a systematic feature-design framework that requires minimal domain knowledge for accurate cycle life prediction during formation. By only using two simple Q (V) features designed from our framework, extracted from formation data without any additional diagnostic cycles, we achieved an average of 9.87% error for cycle life prediction. Here, the physics-based investigation guided by the two designed features shows that the voltage ranges identified by our framework capture the effects of formation temperature and microscopic-particle resistance heterogeneity. By designing highly predictive, robust, and interpretable features, our approach can accelerate industrial battery formation research, leveraging the interplay between data-driven feature design and mechanistic understanding.

25 ENERGY STORAGE↗

DOE OSTI2024

Optimal spectral resolution for solids and liquids using FT and other infrared spectrometers: How much resolution do you really need?

In this study we investigate the possibility of using spectral resolutions for infrared measurements of solids and liquids that are not powers of two, e.g. are not at 1, 2, 4, 8, or 16 cm-1 resolution. In almost all reported literature of the last fifty years the resolution used to record for a Fourier transform infrared spectrum has been a power of two. This stems from the fact that 1) the Cooley-Tukey algorithm used to compute such a transform was constructed to use only powers of two and was also driven by 2) the fact that the computing horsepower required to compute the Fourier transform increases as N?log?_2 (N), where N is the number of points in the interferogram (spectrum). For typical spectra, however, the CPU time is no longer a consideration. Our study is based on both liquid and solid spectra, all of which were recorded at 2 cm-1 resolution. There were at total of 70 solids spectra representing 2,472 spectral peaks and 61 liquids spectra (1,765 spectral peaks), each peak being inspected for being singlet / multiplet in nature. Of the 1,765 liquid bands examined, only 27 had widths less than 5 cm-1. Of the 2,472 solid bands examined, only 39 peaks have widths less than 5 cm-1. For liquids, the mean peak width is 24.7 cm-1 but the median peak width is 13.7 cm-1, and, similarly, for solids, the mean peak width is 22.2 cm-1 but the median peak width is 11.2 cm-1. In both cases, solids and liquids, a skewed peak widths distribution was observed, the peak of the distribution representing narrower bands in the 7 to 9 cm-1 FWHM range but displaying a long tail to the very broad bands, with some displaying spectral widths of 100 cm-1 or more. Because one of the most important criteria for successful instrumental design in IR spectroscopy is the spectral resolution, the data were further analyzed showing that a value to resolve 95% of all bands is 5.7 cm-1 for liquids and 5.3 cm-1 for solids; such a resolution would capture the native linewidth (no instrumental broadening) of 95% of all the solids and liquid bands, respectively. Based on the present results we suggest that, when accounting only for intrinsic linewidths an optimized resolution of 6.0 cm-1 will capture 91% of all condensed-phase bands for IR detection of chemical, mineral, and biological materials.

Forland, Brenda M.↗

NASA NTRS2017

3D Material Response Analysis of PICA Pyrolysis Experiments

The PICA decomposition experiments of Bessire and Minton are investigated using 3D material response analysis. The steady thermoelectric equations have been added to the CHAR code to enable analysis of the Joule-heated experiments and the DAKOTA optimization code is used to define the voltage boundary condition that yields the experimentally observed temperature response. This analysis has identified a potential spatial non-uniformity in the PICA sample temperature driven by the cooled copper electrodes and thermal radiation from the surface of the test article (Figure 1). The non-uniformity leads to a variable heating rate throughout the sample volume that has an effect on the quantitative results of the experiment. Averaging the results of integrating a kinetic reaction mechanism with the heating rates seen across the sample volume yield a shift of peak species production to lower temperatures that is more significant for higher heating rates (Figure 2) when compared to integrating the same mechanism at the reported heating rate. The analysis supporting these conclusions will be presented along with a proposed analysis procedure that permits quantitative use of the existing data. Time permitting, a status on the in-development kinetic decomposition mechanism based on this data will be presented as well.

Oliver, A. Brandon↗

NASA NTRS2021

Recent Advancements in Modeling and Simulation of Entry Systems at NASA

This paper describes recent development of modeling and simulation technologies for entry systems in support of NASA’s exploration missions. Mission-tailored research and development in modeling of entry systems occurs across the Agency (e.g., within the Orion and Mars 2020 Programs), however the aim of this paper is to discuss the broad, cross-mission research conducted by NASA’s Entry Systems Modeling (ESM) Project, which serves as the Agency’s only concerted effort toward advancing entry systems across a range of technical disciplines. Technology development in ESM is organized and prioritized from a system-level perspective, resulting in four broad technical areas of investment: (1) Predictive material modeling, (2) Shock layer kinetics and radiation, (3) Computational and experimental aerosciences, and (4) Guidance, navigation, and control. Investments in thermal protection material modeling are geared toward high-fidelity, predictive models capable of handling complex structures, with an eye toward optimizing design performance and quantifying thermal protection system reliability. New computational tools have been developed to characterize material properties and behavior at the microstructural level, and experimental techniques (molecular beam scattering, micro-computed tomography, among others) have been developed to measure material kinetics, morphology, and other parameters needed to inform and validate detailed simulations. Advancements have also been made in macrostructural simulation capability to enable 3-D system-scale calculations of material response with complex topological features, including differential recession of tile gaps. Research and development in the area of shock layer kinetics has focused on air and CO2-based atmospheres. Capacity and capability of the NASA Ames Electric Arc Shock Tube (EAST) have been expanded in recent years and analysis of resulting data has led to several improvements in kinetic models, while simultaneously reducing uncertainties associated with radiative heat transfer predictions. First-principles calculations of fundamental kinetic, thermodynamic, and transport data, along with state-specificmodels for non-equilibrium flow regimes, have also yielded new insights and have the potential to vastly improve model fidelity. Aerosciences is a very broad area of interest in entry systems, yet a number of important challenges are being addressed: Coupled fluid-structure simulations of parachute inflation and dynamics; Experimental and computational studies of vehicle dynamics; Multi-phase flow with dust particles to simulate entry environments at Mars during dust storms; Studies of roughness-induced heating augmentation relevant to tiled and woven thermal protection systems; and Advanced numerical methods to optimize computational analyses for desired accuracy versus cost. Guidance and control in the context of entry systems has focused on development of methods for multi-axis control (i.e. pitch and yaw, rather than bank angle alone) of spacecraft during entry and descent. With precision landing requirements driven by Mars human exploration goals, recent efforts have yielded 6-DOF models of multi-axis control with propulsive descent of both inflatable and rigid ellipsled-like architectures. Results for both configurations have demonstrated the ability to land within the 50-meter precision requirement demanded by Mars human exploration missions, while also reducing propellant requirements by enabling more efficient control through entry and descent. Ongoing research in GN&C is developing mechanical specifications for the systems and establishing engineering feasibility.

aerothermodynamics↗

DOE OSTI2026

Responsible Adoption of Artificial Intelligence (AI) in Electric Grid Operations

The future of the grid will be powered by AI—or undermined by it. Artificial intelligence is rapidly reshaping grid operations, improving fault detection, forecasting accuracy, and real-time optimization. As AI systems move closer to operational decision loops, however, they introduce new consequence pathways: expanded attack surfaces, model integrity risks, regulatory exposure, and human-automation challenges. This talk presents a consequence-driven framework for deploying AI responsibly in the electric grid. Attendees will gain practical strategies to strengthen resilience, boost reliability, and deploy AI securely — ensuring the grid of the future is not only smarter but safer.

25 - ENERGY STORAGE↗