Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

Improving the prediction of daily reservoir releases over the CONUS using conditioned LSTM

Reservoirs play a vital role in regulating streamflow timing and variability for hydroelectricity, flood control, water supply, irrigation, and recreation. Despite their importance, many reservoirs lack comprehensive operational guidelines, making their management complex due to conflicting operational objectives. Hence traditional policy-based reservoir models often fail to capture real-world conditions accurately and they depend on perfect streamflow predictions, which are not always available. In contrast, data-driven models like Long Short-Term Memory (LSTM) networks offer a robust alternative. This study introduces an approach that integrates reservoir characteristics—such as main use, climate, and maximum capacity—into the LSTM model to enhance reservoir release predictions. Using data from nearly 200 reservoirs in the contiguous United States (CONUS), our conditioned LSTM model (LSTM_cond) was compared with both the vanila LSTM and a traditional policy-based approach. Furthermore, our results show that while both LSTM_cond and LSTM perfoms better than the policy-based approach, LSTM_cond consistently outperforms LSTM for hydroelectric, water supply, irrigation, and recreation reservoirs. The KGE median values for LSTM_cond for out-sample reservoirs are 0.764, 0.565, 0.821, and 0.779, respectively, for the aforementioned reservoir types, which are consistently higher that the corresponding KGE values of 0.737, 0.413, 0.775, and 0.713 of LSTM, demonstrating its advantages in improving generalizability.

CONUS↗

Local Atomic Structure in Photo-isomerized Ruthenium Sulfur Dioxide Complexes Revealed by Pair Distribution Function Analysis

SO 2 linkage photoisomerization in crystalline ruthenium-based complexes has demonstrated nanophotonic phenomena such as optical switching and nano-optomechanical transduction. Molecular insights into these materials have been explored largely via the characterization of their photoinduced crystal structures via in situ single-crystal X-ray diffraction, known as photocrystallography. Photoinduced molecular disorder is present, which photocrystallography can model to the extent that it is confined within the periodic boundary of a unit cell. However, non-periodic molecular disorder is suspected to exist as well. In situ total scattering experiments were therefore carried out on finely powdered crystals of four ruthenium-sulfur dioxide complexes. Data were modeled using light-minus-dark' difference pair distribution function analysis, which afforded photoinduced structural changes exclusively. This revealed structural features that were first compared against models of photoinduced crystal structures known a priori from photocrystallography. Furthermore, statistical inference was then employed, which evidenced generally good agreement between the total scattering data and the photocrystallographic models, while revealing real differences that are indicative of a structure with only a short-range order. Overall, our findings demonstrate that in situ light-induced total scattering experiments on finely powdered crystals are able to reveal the photoinduced structure. Overall, the evidence suggests that such structure could include a short-range order as well as photocrystallographic content. Our demonstration experiment offers a pathway to develop studies that capture the short-range order in linkage photoisomers, while we have outlined the procedure for testing the validity of associated structural models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Knock Mitigation Effectiveness of EGR across the Pressure-Temperature Domain

Exhaust gas recirculation (EGR) has been shown to enable efficiency improvements in SI engines through multiple different mechanisms, including decreasing the knock propensity at high load, which allows higher compression ratio. While many of the benefits of EGR are applicable to both low and high power density engines, including reductions in pumping work and improved specific heat ratio, the knock benefits and corresponding compression ratio increases have been limited to low power density naturally aspirated engines primarily intended for hybrid vehicle architectures. An earlier study [1] indicated that there may be a kinetic limitation for the ability of EGR to mitigate knock under these conditions, but that study only considered a small number of conditions. In this investigation, we expand on that study while also providing data for model validation for the new light-duty combustion consortium from the U.S. Department of Energy: Partnership for Advancing Combustion Engines (PACE). In this investigation, the effectiveness of EGR to mitigate knock is studied with regards to the effect of engine speed (1,500 and 3,000 rpm), changing trajectory in the pressure-temperature domain by varying the intake manifold temperature (35, 60, and 90 deg C), and by considering the effect of minor species by studying the effect of untreated EGR vs. EGR that has been treated by an automotive three-way catalyst. Additionally, to increase the relevance of these data for future modeling studies, the performance of the full boiling range gasoline was compared relative to a surrogate formulation. The study found that the fuel surrogate performs well, confirmed the kinetic limitations of EGR to mitigate knock under boost, and showed improvements in EGR performance with catalyzed EGR.

42 ENGINEERING↗

Experimental determinations of carbon and hydrogen isotope fractionations and methane clumped isotope compositions associated with ethane pyrolysis from 550 to 600°C

Methane clumped isotope compositions signify the relative natural abundances of rare, doubly substituted isotopic species of methane ( 13 CH 3 D and 12 CH 2 D 2 ) and have emerged as a new isotopic tool to trace the sources, sinks, and lifecycles of methane in the environment. Such measurements can identify equilibration (or reequilibration) temperatures if found to be in isotopic equilibrium or non-equilibrium processes (e.g., kinetically controlled reactions or mixing) if not in isotopic equilibrium. Naturally occurring thermogenic methane—formed by the thermally activated breakdown of larger organic molecules—has been found to have clumped isotope compositions consistent with equilibrium at reasonable gas formation temperatures in some settings and non-equilibrium processes occurring during either formation, migration, storage, or extraction in others. To explore the potential controls on the isotopic composition of thermogenic methane, we conducted isothermal time-series ethane pyrolysis experiments at 550 and 600 °C to measure methane and ethane 13 C/ 12 C and D/H fractionations and methane clumped isotope compositions (resolved 13 CH 3 D and 12 CH 2 D 2 ). We explore the effects of modifying the initial clumped isotope composition of ethane and the addition of water vapor to pyrolysis experiments. We observe that ethane and methane 13 C/ 12 C are controlled by kinetic isotope effects and Rayleigh distillation processes. In contrast, ethane and methane D/H and methane clumped isotope compositions appear to be controlled by a combination of these processes and hydrogen isotope exchange. The hydrogen isotope exchange processes lead to isotopic equilibrium as reaction completion is approached for both D/H (ethane/methane) and methane clumped isotope compositions. Here, we develop a chemical model based on a mass balance approach that accounts for inheritance vs. hydrogen-abstraction formation pathways for singly and doubly substituted isotopologues of ethane and methane that is compared to the experimental data. The model allows the determination of carbon and hydrogen kinetic isotope effects associated with ethane cracking and hydrogen abstraction reactions that, where applicable, we compare to prior theoretical constraints. From the comparison of the model to the experimental data, we infer that the kinetically controlled ethane and methane bulk isotope compositions and methane clumped isotope compositions are controlled by kinetic isotope effects (both primary and secondary) associated with both C–C bond and C–H bond cleavage reactions. Specifically, the methane clumped isotope compositions likely result from a combination of clumped isotope effects associated with ethane breakdown and/or assembly of methane isotopologues (expressed in terms of γ-factor parameters ≠ 1) and combinatorial effects that arise probabilistically. We discuss our experimental results in the context of recent pyrolysis experiments and observations of naturally occurring thermogenic methane. We consider a proposal consistent with observations from nature that the hydrogen isotope exchange reactions that promote equilibration of methane isotopic molecules at or near formation temperature may be facilitated by free radicals generated by pyrolysis reactions. In this framework, isotope exchange effectively ceases when pyrolysis effectively ceases locking in compositions that can be consistent with peak formation temperatures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Developing Synthetic Distribution Models Using Open-Source Data Sets

The deployment of distributed generation resources at scale with the distribution side of the power system network over the last two decades has spurred a lot of research interest in distribution networks. Given, the sensitive nature of power system data sets, utilities are still reluctant to open-source distribution networks. Although some open-source data sets are available, they may not cover the region of interest. In this paper, we introduce the Synthetic dIstribution Network Generator (SING), new software that allows users to develop synthetic distribution models, using open-source data sets, in any region of interest within the continental US.

data set↗

Accomplishments and Year-End Performance Report; Wind Energy Program: Fiscal Year 2021

The National Wind Technology Center (NWTC), located at the U.S. Department of Energy's (DOE's) National Renewable Energy Laboratory (NREL) Flatirons Campus, has been a driving force in advancing wind energy technology research worldwide since its designation as a DOE national research center in 1992. Enabled by the Flatirons Campus's world-class facilities, scientists, engineers, analysts, and researchers are pushing the frontiers of science to pursue wind energy innovation. In Fiscal Year (FY) 2021, NREL continued to provide the technical expertise, research capabilities, and industry understanding to support DOE's ambitious climate action and research goals by advancing technology, addressing market and deployment barriers, and driving down costs with more efficient, reliable, and predictable wind energy systems. One of several highlights, NREL received an R&D 100 Special Recognition Award for its Thermoplastic Resin System for Wind Turbine Blades. This breakthrough in the wind turbine manufacturing process will enable the production of recyclable blades that are stronger, longer, and less expensive, while increasing energy capture, decreasing energy and transportation costs, and increasing blade reliability. In a year when the entire U.S. economy struggled to address workforce gaps, an NREL study compared wind industry needs, training programs, and hiring practices with perspectives from students and recent college graduates. Researchers hope that, by pinpointing areas of disconnect, the expectations of employers who have difficulty filling entry-level jobs can better align with the preparation of the potential applicants who find it hard to break into the field. The lab also made numerous new data and modeling resources available in FY 2021. Recent NREL releases include a modeling tool for predicting the power performance and structural loads of wind turbines within a wind farm (FAST.Farm), a computational framework for modeling golden eagle behavior near wind farms, and 20 years of offshore wind data. Updates were also made to the widely used Wind Plant Integrated Systems Design and Engineering Model (WISDEM), which couples engineering and cost models to examine system-level trade-offs. Now, bolstered by a renewed national commitment to tackle climate change and revitalize the U.S. economy through increased investment in clean energy - particularly in offshore wind energy - NREL stands poised to lead the way to a sustainable future that powers the United States with significant levels of reliable, low-cost, accessible wind energy. This report provides an overview of the achievements NREL made on behalf of DOE's Wind Energy Technologies Office (WETO) and other partners during FY 2021 (between Oct. 1, 2020, and Sept. 30, 2021).

Flatirons Campus↗

Assessment of WRF (v 4.2.1) dynamically downscaled precipitation on subdaily and daily timescales over CONUS

Abstract. This study analyzes the quality of simulated historical precipitation across the contiguous United States (CONUS) in a 12 km Weather Research and Forecasting model version 4.2.1 (WRF v 4.2.1)-based dynamical downscaling of the fifth-generation ECMWF atmospheric reanalysis (ERA5). This work addresses the following questions. First, how well are the 3 and 24 h precipitation characteristics (diurnal and annual cycles, precipitation frequency, annual and seasonal mean and maximum precipitation, and distribution of seasonal maximum precipitation) represented in the downscaled simulation, compared to ERA5? And second, how does the performance of the simulated WRF precipitation vary across seasons, regions, and timescales? Performance is measured against the National Centers for Environmental Prediction/Environmental Modeling Center (NCEP/EMC) 4 km Stage IV and Oregon State University Parameter-Elevation Regressions on Independent Slopes Model (PRISM) data on 3 and 24 h timescales, respectively. Our analysis suggests that the 12 km WRF exhibits biases typically found in other WRF simulations, including those at convection-permitting scales. In particular, WRF simulates both the timing and magnitude of the summer diurnal precipitation peak as well as ERA5 over most of the CONUS, except for a delayed diurnal peak over the Great Plains. As compared to ERA5, both the month and the magnitude of the precipitation peak annual cycle are remarkably improved in the downscaled WRF simulation. WRF slightly overestimates 3 and 24 h precipitation maximum over the CONUS, in contrast to ERA5, which generally underestimates these quantities mainly over the eastern half of the CONUS. Notably, WRF better captures the probability density distribution (PDF) of 3 and 24 h annual and seasonal maximum precipitation. WRF exhibits seasonally dependent precipitation biases across the CONUS, while ERA5's biases are relatively consistent year round over most of the CONUS. These results suggest that dynamical downscaling to a higher resolution improves upon some precipitation metrics but is susceptible to common regional climate model biases. Consequently, if used as input data for domain-specific models, we suggest moderate bias correction be applied to the dynamically downscaled product.

54 ENVIRONMENTAL SCIENCES↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

The AEOLUS Center is dedicated to developing a unified optimization-under-uncertainty framework for (1) learning predictive models from data and (2) optimizing experiments, processes, and designs governed by these models, all driven by complex, uncertain energy systems. AEOLUS addressed the critical need for principled, rigorous, scalable, and structure-exploiting capabilities for exploring parameter and decision spaces of complex forward simulation models---the so-called outer loop. This report summarizes the work done under DE-SC0021077 on (1) nonlocal models for solidification problems, (2) a multifidelity method for a nonlocal diffusion model, and (3) multifidelity Monte Carlo methods.

97 MATHEMATICS AND COMPUTING↗

Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems (Final Report for AEOLUS)

The AEOLUS Center is dedicated to developing a unified optimization-under-uncertainty framework for: (1) learning predictive models from data; and (2) optimizing experiments, processes, and designs governed by these models, all driven by complex, uncertain energy systems. AEOLUS addresses the critical need for principled, rigorous, scalable, and structure-exploiting capabilities for exploring parameter and decision spaces of complex forward simulation models. This report summarizes the key highlights of our research during the period of performance.

97 MATHEMATICS AND COMPUTING↗

Enhanced HLW glass property-composition models - phase 3

During the present phase (Phase 3) of work to enhance and expand the HLW glass property-composition models, test data for 137 glasses were collected and incorporated into the combined WTP/ORP database. The new data include those collected on glasses from two statistically designed matrices to augment the moderate alumina region (the HLW16-MA matrix covering the region of 9 wt% < Al2O3 < 12 wt% with 16 glasses) and the ultra-high alumina region (the HLW16-UHA matrix covering the region of 26 wt% < Al2O3 < 29 wt% with 29 glasses). The addition of ORP glasses over the different phases of testing has significantly expanded the combined WTP/ORP database. The compiled data include glass compositions, PCT (B, Li and Na) releases, spinel T1%, electrical conductivity, viscosity, TCLP-Cd releases, and nepheline formation upon CCC. With the exception of the CCC spinel formation data – the CCC data will be used to support the further development of nepheline models for Hanford HLW glasses.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

Learning from learning machines: improving the predictive power of energy-water-land nexus models with insights from complex measured and simulated data

Focal Area(s): Insights gleaned from complex data (observed and simulated) using AI; Predictive modeling through the use of AI techniques and AI-derived model components, including physics- and knowledge-informed models; Energy-water-land nexus and integrated energy systems – models of MultiSector dynamics. Science Challenge: Scientific communities are in need of tools for the computational integration of physics-based models, experimental data, and empirical/observational studies across a broad range of temporal and spatial scales to explore and meet EESSD grand challenges. We require AI algorithms for the discovery of process-drivers in the Earth-energy-human system and to link them with complex measured and simulated data. We aim to understand the energy-water-land nexus, particularly under extreme forcing scenarios and rare events, leveraging scale-aware AI process models, including probabilistic uncertainties, and benefiting from the emerging 5G-enabled landscape-scale sensing and edge computing capabilities. These models are needed to identify instabilities and tipping points that manifest extreme system behaviors with consequences for integrated energy systems and the environment. This work requires fundamental advances in uncertainty quantification, in particular, to identify and model unlikely but catastrophic outliers. Specifically, we need models that are interpretable to domain scientists and, essentially, explainable to public and private stake holders.

54 ENVIRONMENTAL SCIENCES↗

Automatic Digitization and Orientation of Scanned Mesh Data for Floor Plan and 3D Model Generation

This paper describes a novel approach for generating accurate floor plans and 3D models of building interiors using scanned mesh data. Unlike previous methods, which begin with a high resolution point cloud from a laser range-finder, our approach begins with triangle mesh data, as from a Microsoft HoloLens. It generates two types of floor plans, a “pen-and-ink” style that preserves details and a drafting-style that reduces clutter. It processes the 3D model for use in applications by aligning it with coordinate axes, annotating important objects, dividing it into stories, and removing the ceiling. Its performance is evaluated on commercial and residential buildings, with experiments to assess quality and dimensional accuracy. Our approach demonstrates promising potential for automatic digitization and orientation of scanned mesh data, enabling floor plan and 3D model generation in various applications such as navigation, interior design, furniture placement, facilities management, building construction, and HVAC design.

Sharma, Ritesh↗

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗

Online evolutionary neural architecture search for multivariate non-stationary time series forecasting

Time series forecasting (TSF) is one of the most important tasks in data science. TSF models are usually pre-trained with historical data and then applied on future unseen datapoints. However, real-world time series data is usually non-stationary and models trained offline usually face problems from data drift. Models trained and designed in an offline fashion can not quickly adapt to changes quickly or be deployed in real-time. To address these issues, this work presents the Online NeuroEvolution-based Neural Architecture Search (ONE-NAS) algorithm, which is a novel neural architecture search method capable of automatically designing and dynamically training recurrent neural networks (RNNs) for online forecasting tasks. Without any pre-training, ONE-NAS utilizes populations of RNNs that are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world, large-scale multivariate wind turbine data as well as the univariate Dow Jones Industrial Average (DJIA) dataset. These results demonstrate that ONE-NAS outperforms traditional statistical time series forecasting methods, including online linear regression, fixed long short-term memory (LSTM) and gated recurrent unit (GRU) models trained online, as well as state-of-the-art, online ARIMA strategies. Additionally, results show that utilizing multiple populations of RNNs which are periodically repopulated provide significant performance improvements, allowing this online neural network architecture design and training to be successful.

97 MATHEMATICS AND COMPUTING↗

Privacy-preserving federated learning: Application to behind-the-meter solar photovoltaic generation forecasting

Here, the growing usage of decentralized renewable energy sources has made accurate estimation of their aggregated generation crucial for maintaining grid flexibility and reliability. However, the majority of distributed photovoltaic (PV) systems are behind-the-meter (BTM) and invisible to utilities, leading to three challenges in obtaining an accurate forecast of their aggregated output. Firstly, traditional centralized prediction algorithms used in previous studies may not be appropriate due to privacy concerns. There is therefore a need for decentralized forecasting methods, such as federated learning (FL), to protect privacy. Secondly, there has been no comparison between localized, centralized, and decentralized forecasting methods for BTM PV production, and the trade-off between prediction accuracy and privacy has not been explored. Lastly, the computational time of data-driven prediction algorithms has not been examined. This article presents a FL power forecasting method for PVs, which uses federated learning as a decentralized collaborative modeling approach to train a single model on data from multiple BTM sites. The machine learning network used to design this FL-based BTM PV forecasting model is a multi-layered perceptron, which ensures privacy and security of the data. Comparing the suggested FL forecasting model to non-private centralized and entirely private localized models revealed that it has a high level of accuracy, with an RMSE that is 18.17% lower than localized models and 9.9% higher than centralized models.

14 SOLAR ENERGY↗

Correction for Neutral Pressure-Driven Signal in Radiated Power Measurements on Proto-MPEX

A pinhole camera using four-channel resistive bolometers was designed and implemented on the Prototype Material Plasma Exposure eXperiment (Proto-MPEX) to measure the plasma radiated power. Quantification of the radiated power is required for comprehensive power balance assessments but faces unique challenges on linear plasma devices due to weak absolute signal, compared to typical use in toroidal fusion plasmas, and high neutral pressure changes. Around 1 mTorr, the pressure-driven signal contribution was shown to overwhelm the radiated power signal in Proto-MPEX, found to be ~3 μW . Since the pressure-driven signals could not be predicted from first principle arguments, the signals were corrected using empirical models that take two experimental pressure measurements and the raw bolometer signal to reveal the radiated power signals. Four “gas-only” Proto-MPEX shots were taken, without the radio frequency (rf) plasma discharge, to train, optimize, and validate empirical models. The data included two pressure measurements at different locations along with the bolometer signal. Multiple models were tested; partial least-squares regression with a cross correlation method to account for the time offset in the pressure measurements provided the best combination of accuracy and stability. The model was validated to have a modeling error of 0.0036 V, which was lower than 10% of the expected radiated power signal. The model was tested on a different “gas-only” shot with a complete time-series data. For plasma operation shots, the corrected bolometer measurements were compared with an absolute extreme ultraviolet photodiode measurement and similarities and differences are discussed.

Lee, Seungsup↗