Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

GODEEEP-hydro: Historical and projected power system ready hydropower data for the United States

Hydropower is a critical electricity resource in the United States which, in addition to low-cost electricity generation, provides valuable ancillary grid services, and supports the integration of nondispatchable weather-dependent resources (e.g., wind and solar). Despite its value to the grid, there are very few comprehensive datasets available from which to study both historical and future impacts of climate, weather driven energy droughts, and integration of other weather driven generation. In this paper, we present a hydropower generation dataset covering 1,452 hydroelectric plants in the contiguous U.S. The dataset contains monthly and weekly hydropower generation estimates for both historical (1982–2019) and future (2020–2099) periods which includes 4 future climate scenarios. In addition, this dataset provides weekly and monthly constraints such as minimum and maximum power which are particularly useful in power system models which are used to study grid reliability, transmission planning and capacity expansion.

13 HYDRO ENERGY↗
DOE OSTI2025

Forty-year hydropower generation reanalysis for Conterminous United States

First published in 2022, the RectifHyd dataset provides hydrologically consistent estimates of monthly net generation for approximately 1,500 hydropower plants in the United States, addressing a gap in industrial surveys that have collected monthly generation data from only ~10% of plants post-2003. Here we present RectifHydPlus—an extended and enhanced dataset that improves on both the proxy information and temporal downscaling methodology adopted in RectifHyd. In addition to providing updated estimates of historical monthly generation for 590 plants with >10 MW nameplate capacity from 1980 through 2019, RectifHydPlus adds a hydrological control dataset that isolates the influence of historical water availability on generation. The new hydrological control dataset is suited to applications seeking to represent the capabilities of the contemporary fleet subject to historical interannual variability in climate. RectifHydPlus also includes a forty-year, daily-resolution, spill-adjusted water release time series for each dam, allowing users to aggregate generation estimates to the desired temporal resolution.

Hydroelectricity↗
DOE OSTI2025

Unified 0.25-degree gridded infrastructure-critical extreme weather for the United States from 1979 to 2100

Extreme weather events can severely disrupt critical infrastructure, triggering cascading effects on power, transportation, and essential services. However, standard weather and climate datasets often lack specialized variables necessary for hazard assessments. We present a unified dataset of infrastructure-critical weather and climate variables across the United States at 0.25° resolution, covering daily or sub-daily intervals from 1979 to 2100. The dataset includes temperature, dew point, wind gusts, precipitation partitioned by rain, snow, and freezing rain or ice pellets, lightning, and wildfire metrics. Historical conditions (1979-2023) are synthesized from observations and reanalysis products, while future projections are derived from 14 CMIP6 global climate models (historical, SSP245, and SSP585 experiments). Physically based and data-driven methods are used to estimate variables not directly provided by existing models. By integrating these variables into a single unified dataset, we enable consistent, high-resolution assessments of weather-related infrastructure risks across past and future periods, supporting wide-ranging applications in energy, transportation, water resources, emergency management, and beyond.

Climate and Earth system modelling↗
DOE OSTI2022

Development and validation of a mathematical model of heart rate response to fluid perturbation

Physiological closed-loop controlled (PCLC) medical devices monitor and automatically adjust the patient’s condition by using physiological variables as feedback, ideally with minimal human intervention to achieve the target levels set by a clinician. PCLC devices present a challenge when it comes to evaluating their performance, where conducting large clinical trials can be expensive. Virtual physiological patients simulated by validated mathematical models can be utilized to obtain preclinical evidence of safety and assess the performance of the PCLC medical device during normal and worst-case conditions that are unlikely to happen in a limited clinical trial. A physiological variable that plays a major role during fluid resuscitation is heart rate (HR). For in silico assessment of PCLC medical devices regarding fluid perturbation, there is currently no mathematical model of HR validated in terms of its predictive capability performance. This paper develops and validates a mathematical model of HR response using data collected from sheep subjects undergoing hemorrhage and fluid infusion. The model proved to be accurate in estimating the HR response to fluid perturbation, where averaged between 21 calibration datasets, the fitting performance showed a normalized root mean square error (NRMSE) of 7.41 ± 2.8%. The model was also evaluated in terms of model predictive capability performance via a leave-one-out procedure (21 subjects) and an independent validation dataset (6 subjects). Two different virtual cohort generation tools were used in each validation analysis. The generated envelope of virtual subjects robustly met the defined acceptance criteria, in which 95% of the testing datasets presented simulated HR patterns that were within a deviation of 50% from the observed data. In addition, out of 16000 and 18522 simulated subjects for the leave one-out and independent datasets, the model was able to generate at least one virtual subject that was close to the real subject within an error margin of 9.56 ± 3.15% and 11.1 ± 1.22% NRMSE, respectively. In conclusion, the model can generate valid virtual HR physiological responses to fluid perturbation and be incorporated into future non-clinical simulated testing setups for assessing PCLC devices intended for fluid resuscitation.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Structural differences between human and mouse neurons and their implementation in generative AIs

Mouse and human brains have different functions that depend on their neuronal networks. We analyzed nanometer-scale three-dimensional structures of brain tissues of the mouse medial prefrontal cortex and compared them with structures of the human anterior cingulate cortex. The obtained results indicated that mouse neuronal somata are smaller and neurites are thinner than those of human neurons. We implemented these characteristics of mouse neurons in convolutional layers of a generative adversarial network (GAN) and a denoising diffusion implicit model (DDIM), which were then subjected to image generation tasks using photo datasets of cat faces, cheese, human faces, birds, and automobiles. The mouse-mimetic GAN outperformed a standard GAN in the image generation task using the cat faces and cheese photo datasets, but underperformed for human faces and birds. The mouse-mimetic DDIM gave similar results, suggesting that the nature of the datasets affected the results. Analyses of the five datasets indicated differences in their image entropy, which should influence the number of parameters required for image generation. The preferences of the mouse-mimetic AIs coincided with the impressions commonly associated with mice. The relationship between the neuronal network and brain function should be investigated by implementing other biological findings in artificial neural networks.

generative AI↗
DOE OSTI2022

Autonomous design of new chemical reactions using a variational autoencoder

Artificial intelligence based chemistry models are a promising method of exploring chemical reaction design spaces. However, training datasets based on experimental synthesis are typically reported only for the optimal synthesis reactions. This leads to an inherited bias in the model predictions. Therefore, robust datasets that span the entirety of the solution space are necessary to remove inherited bias and permit complete training of the space. In this study, an artificial intelligence model based on a Variational AutoEncoder (VAE) has been developed and investigated to synthetically generate continuous datasets. The approach involves sampling the latent space to generate new chemical reactions. This developed technique is demonstrated by generating over 7,000,000 new reactions from a training dataset containing only 7,000 reactions. The generated reactions include molecular species that are larger and more diverse than the training set.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Scientific machine learning benchmarks

Deep learning has transformed the use of machine learning technologies for the analysis of large experimental datasets. In science, such datasets are typically generated by large-scale experimental facilities, and machine learning focuses on the identification of patterns, trends and anomalies to extract meaningful scientific insights from the data. In upcoming experimental facilities, such as the Extreme Photonics Application Centre (EPAC) in the UK or the international Square Kilometre Array (SKA), the rate of data generation and the scale of data volumes will increasingly require the use of more automated data analysis. Furthermore, at present, identifying the most appropriate machine learning algorithm for the analysis of any given scientific dataset is a challenge due to the potential applicability of many different machine learning frameworks, computer architectures and machine learning models. Historically, for modelling and simulation on high-performance computing systems, these issues have been addressed through benchmarking computer applications, algorithms and architectures. Extending such a benchmarking approach and identifying metrics for the application of machine learning methods to open, curated scientific datasets is a new challenge for both scientists and computer scientists. Here, we introduce the concept of machine learning benchmarks for science and review existing approaches. As an example, we describe the SciMLBench suite of scientific machine learning benchmarks.

42 ENGINEERING↗
DOE OSTI2022

DMC-ICE13 : Ambient and high pressure polymorphs of ice from diffusion Monte Carlo and density functional theory

Ice is one of the most important and interesting molecular crystals, exhibiting a rich and evolving phase diagram. Recent discoveries mean that there are now 20 distinct polymorphs; a structural diversity that arises from a delicate interplay of hydrogen bonding and van der Waals dispersion forces. This wealth of structures provides a stern test of electronic structure theories, with Density Functional Theory (DFT) often not able to accurately characterize the relative energies of the various ice polymorphs. Thanks to recent advances that enable the accurate and efficient treatment of molecular crystals with Diffusion Monte Carlo (DMC), we present here the DMC-ICE13 dataset; a dataset of lattice energies of 13 ice polymorphs. This dataset encompasses the full structural complexity found in the ambient and high-pressure molecular ice polymorphs, and when experimental reference energies are available, our DMC results deliver sub-chemical accuracy. Using this dataset, we then perform an extensive benchmark of a broad range of DFT functionals. Of the functionals considered, revPBE-D3 and RSCAN reproduce reference absolute lattice energies with the smallest error, while optB86b-vdW and SCAN+rVV10 have the best performance on the relative lattice energies. Our results suggest that a single functional achieving reliable performance for all phases is still missing, and that care is needed in the selection of the most appropriate functional for the desired application. The insights obtained here may also be relevant to liquid water and other hydrogen-bonded and dispersion-bonded molecular crystals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Machine learning predictions of high-Curie-temperature materials

Technologies that function at room temperature often require magnets with a high Curie temperature, $T$ C , and can be improved with better materials. Discovering magnetic materials with a substantial $T$ C is challenging because of the large number of candidates and the cost of fabricating and testing them. Using the two largest known datasets of experimental Curie temperatures, we develop machine-learning models to make rapid $T$ C predictions solely based on the chemical composition of a material. We train a random-forest model and a k -NN one and predict on an initial dataset of over 2500 materials and then validate the model on a new dataset containing over 3000 entries. The accuracy is compared for multiple compounds' representations (“descriptors”) and regression approaches. A random-forest model provides the most accurate predictions and is not improved by dimensionality reduction or by using more complex descriptors based on atomic properties. Further, a random-forest model trained on a combination of both datasets shows that cobalt-rich and iron-rich materials have the highest Curie temperatures for all binary and ternary compounds. An analysis of the model reveals systematic error that causes the model to over-predict low-$T$ C materials and under-predict high-$T$ C materials. For exhaustive searches to find new high-$T$ C materials, analysis of the learning rate suggests either that much more data is needed or that more efficient descriptors are necessary.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Comparison of multifidelity machine learning models for potential energy surfaces

Multifidelity modeling is a technique for fusing the information from two or more datasets into one model. It is particularly advantageous when one dataset contains few accurate results and the other contains many less accurate results. Within the context of modeling potential energy surfaces, the low-fidelity dataset can be made up of a large number of inexpensive energy computations that provide adequate coverage of the N-dimensional space spanned by the molecular internal coordinates. The high-fidelity dataset can provide fewer but more accurate electronic energies for the molecule in question. Here, we compare the performance of several neural network-based approaches to multifidelity modeling. We show that the four methods (dual, Δ-learning, weight transfer, and Meng–Karniadakis neural networks) outperform a traditional implementation of a neural network, given the same amount of training data. We also show that the Δ-learning approach is the most practical and tends to provide the most accurate model.

Chemistry↗
DOE OSTI2024

Review and meta-analysis of electron temperatures from high-intensity laser–solid interactions

The accelerated electron spectrum from high-intensity laser–solid interaction is often conveniently described using a Boltzmann distribution, whose temperature is known within the field as the hot-electron temperature. The importance of the electron temperature is highlighted by the sheer number of experimental and simulation studies on the subject over the past three decades. Recently, multi-kJ, multi-ps pulses have yielded electron spectra with temperatures far beyond the expected ponderomotive result. Expressions that predict the electron temperature considering laser parameters beyond intensity and wavelength have been developed, albeit using small datasets. In this review, we present what is, to the best of our knowledge, the largest dataset of electron temperatures gathered from experimental measurements and particle-in-cell simulations. This dataset allows us to compare existing analytical and empirical hot-electron temperature scaling models over a wide parameter range. We also develop new scaling models that incorporate the laser pulse duration of the laser and the plasma scale length. Three models that include pulse-duration and scale length dependence are especially successful at predicting both simulated and experimental data. The dataset will soon be made publicly available to encourage further investigation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Algorithm to extract direction in 2D discrete distributions and a continuous Frobenius norm

In this study, we present a novel algorithm for determining directionality in 2D distributions of discrete data. We compare a reference dataset with a known direction to a measured dataset with an unknown direction by the Frobenius norm of the difference (FND) to find the unknown direction. To generalize this concept, we develop a continuous Frobenius norm of the difference (CFND) as a continuous analog of the FND and derive its analytical expression. By relating fitted and normalized 2D Gaussian distributions, we show that the CFND approximates the FND, and we validate this relationship with computer simulations. We find that a first-order approximation of the CFND between two similar Gaussian distributions takes the form of an absolute sine function, offering a simple analytical form with potential applications in specialized areas such as segmented inverse beta decay neutrino detectors, astronomy, machine learning, and more. Our methodology consists of modeling a 2D Gaussian distribution, binning the data into a histogram, and encoding it as a square matrix. Rotating this matrix around its geometric center and comparing it to a measured dataset using the FND gives us rotational data that we fit with an absolute sine function. The location of the minimum of this fit is the angle closest to the true angle of the direction in the measured dataset. We present the derivation and discuss initial applications of the CFND in our novel algorithm, demonstrating its success in approximating directionality in 2D distributions.

Physics↗
DOE OSTI2024

Organ-delimited gene regulatory networks provide high accuracy in candidate transcription factor selection across diverse processes

Organ-specific gene expression datasets that include hundreds to thousands of experiments allow the reconstruction of organ-level gene regulatory networks (GRNs). However, creating such datasets is greatly hampered by the requirements of extensive and tedious manual curation. Here, we trained a supervised classification model that can accurately classify the organ-of-origin for a plant transcriptome. This K-Nearest Neighbor-based multiclass classifier was used to create organ-specific gene expression datasets for the leaf, root, shoot, flower, and seed in Arabidopsis thaliana . A GRN inference approach was used to determine the: i. influential transcription factors (TFs) in each organ and, ii. most influential TFs for specific biological processes in that organ. These genome-wide, organ-delimited GRNs (OD-GRNs), recalled many known regulators of organ development and processes operating in those organs. Importantly, many previously unknown TF regulators were uncovered as potential regulators of these processes. As a proof-of-concept, we focused on experimentally validating the predicted TF regulators of lipid biosynthesis in seeds, an important food and biofuel trait. Of the top 20 predicted TFs, eight are known regulators of seed oil content, e.g., WRI1, LEC1, FUS3. Importantly, we validated our prediction of MybS2, TGA4, SPL12, AGL18, and DiV2 as regulators of seed lipid biosynthesis. We elucidated the molecular mechanism of MybS2 and show that it induces purple acid phosphatase family genes and lipid synthesis genes to enhance seed lipid content. This general approach has the potential to be extended to any species with sufficiently large gene expression datasets to find unique regulators of any trait-of-interest.

09 BIOMASS FUELS↗
DOE OSTI2021

The LHC Olympics 2020 a community challenge for anomaly detection in high energy physics

A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. In order to develop and benchmark new anomaly detection methods within this framework, it is essential to have standard datasets. To this end, we have created the LHC Olympics 2020, a community challenge accompanied by a set of simulated collider events. Participants in these Olympics have developed their methods using an R&D dataset and then tested them on black boxes: datasets with an unknown anomaly (or not). Furthermore, methods made use of modern machine learning tools and were based on unsupervised learning (autoencoders, generative adversarial networks, normalizing flows), weakly supervised learning, and semi-supervised learning. This paper will review the LHC Olympics 2020 challenge, including an overview of the competition, a description of methods deployed in the competition, lessons learned from the experience, and implications for data analyses with future datasets as well as future colliders.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

The anomaly of the CMB power with the latest Planck data

Abstract The lack of power anomaly is an unexpected feature observed at large angular scales in the maps of Cosmic Microwave Background (CMB) produced by the COBE, WMAP andPlancksatellites. This signature, which consists in a missing of power with respect to that predicted by the ΛCDM model, might hint at a new cosmological phase before the standard inflationary era.The main point of this paper is taking into account the latestPlanckpolarisation data to investigate how the CMB polarisation improves the understanding of this feature. With this aim, we apply to the latestPlanckdata, both PR3 (2018) and PR4 (2020) releases, a new class of estimators capable of evaluating this anomaly by considering temperature and polarisation data both separately and in a jointly way. This is the first time that the PR4 dataset has been used to study this anomaly. To critically evaluate this feature, taking into account the residuals of known systematic effects present in thePlanckdatasets, we analyse the cleaned CMB maps using different combinations of sky masks, harmonic range and binning on the CMB multipoles.Our analysis shows that the estimator based only on temperature data confirms the presence of a lack of power with a lower-tail-probability (LTP), depending on the component separation method, ≤ 0.33% and ≤ 1.76% for PR3 and PR4, respectively. To our knowledge, the LTP≤ 0.33% for the PR3 dataset is the lowest one present in the literature obtained fromPlanck2018 data, considering thePlanckconfidence mask. We find significant differences between these two datasets when polarisation is taken into account most likely due to a different level of systematics. Especially, the analysis with PR3 data, unlike that with PR4, seems to point towards a lack of power at large scales also for polarisation.Moreover, we also show that for the PR3 dataset the inclusion of the subdominant polarisation information provides estimates that are less likely accepted in a ΛCDM cosmological model than the only-temperature analysis over the entire harmonic-range considered. In particular, at ℓ max = 26, we found that no simulation has a value as low as the data for all the pipelines.

Astronomy & Astrophysics↗
DOE OSTI2020

A semi-supervised machine learning detector for physics events in tokamak discharges

Databases of physics events have been used in various fusion research applications, including the development of scaling laws and disruption avoidance algorithms, yet they can be time-consuming and tedious to construct. This paper presents a novel application of the label spreading semi-supervised learning algorithm to accelerate this process by detecting distinct events in a large dataset of discharges, given few manually labeled examples. A high detection accuracy (> 85%) for H-L back transitions and initially rotating locked modes is demonstrated on a dataset of hundreds of discharges from DIII-D with manually identified events for which only 3 discharges are initially labeled by the user. Lower yet reasonable performance (~75%) is also demonstrated for the core radiative collapse, an event with a much lower prevalence in the dataset. Additionally, analysis of the performance sensitivity indicates that the same set of algorithmic parameters is optimal for each event. Furthermore, this suggests that the method can be applied to detect a variety of other events not included in this paper, given that the event is well described by a set of 0D signals robustly available on many discharges. Procedures for analysis of new events are demonstrated, showing automatic event detection with increasing fidelity as the user strategically adds manually labeled examples. Detections on Alcator C-Mod and EAST are also shown, demonstrating the potential for this to be used on a multi-tokamak dataset.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Validation of edge turbulence codes against the TCV-X21 diverted L-mode reference case

Self-consistent full-size turbulent-transport simulations of the divertor and scrape-off-layer (SOL) of existing tokamaks have recently become feasible. This enables the direct comparison of turbulence simulations against experimental measurements. In this work, we perform a series of diverted ohmic L-mode discharges on the tokamak à configuration variable (TCV) tokamak, building a first-of-a-kind dataset for the validation of edge turbulence models. This dataset, referred to as TCV-X21, contains measurements from five diagnostic systems from the outboard midplane (OMP) to the divertor targets—giving a total of 45 one- and two-dimensional comparison observables in two toroidal magnetic field directions. The experimental dataset is used to validate three flux-driven 3D fluid-turbulence models—GBS, GRILLIX and TOKAM3X. With each model, we perform simulations of the TCV-X21 scenario, individually tuning the particle and power source rates to achieve a reasonable match of the upstream separatrix value of density and electron temperature. We find that the simulations match the experimental profiles for most observables at the OMP—both in terms of profile shape and absolute magnitude—while a comparatively poorer agreement is found towards the divertor targets. The match between simulation and experiment is seen to be sensitive to the value of the resistivity, the heat conductivities, the power injection rate and the choice of sheath boundary conditions. Additionally, despite targeting a sheath-limited regime, the discrepancy between simulations and experiment also suggests that the neutral dynamics should be included. The results of this validation show that turbulence models are able to perform simulations of existing devices and achieve reasonable agreement with experimental measurements. Where disagreement is found, the validation helps to identify how the models can be improved. By publicly releasing the experimental dataset and validation analysis, this work should help to guide and accelerate the development of predictive turbulence simulations of the edge and SOL.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Active causal learning for decoding chemical complexities with targeted interventions

Abstract Predicting and enhancing inherent properties based on molecular structures is paramount to design tasks in medicine, materials science, and environmental management. Most of the current machine learning and deep learning approaches have become standard for predictions, but they face challenges when applied across different datasets due to reliance on correlations between molecular representation and target properties. These approaches typically depend on large datasets to capture the diversity within the chemical space, facilitating a more accurate approximation, interpolation, or extrapolation of the chemical behavior of molecules. In our research, we introduce an active learning approach that discerns underlying cause-effect relationships through strategic sampling with the use of a graph loss function. This method identifies the smallest subset of the dataset capable of encoding the most information representative of a much larger chemical space. The identified causal relations are then leveraged to conduct systematic interventions, optimizing the design task within a chemical space that the models have not encountered previously. While our implementation focused on the QM9 quantum-chemical dataset for a specific design task—finding molecules with a large dipole moment—our active causal learning approach, driven by intelligent sampling and interventions, holds potential for broader applications in molecular, materials design and discovery.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗