Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Air compressor load forecasting using artificial neural network

Air compressor systems are responsible for approximately 10% of the electricity consumed in United States and European Union industry. As many researches have proven the effectiveness of using Artificial Neural Network inair compressor performance prediction, there is still a need to forecast the air compressor electrical load profile. The objective of this study is to predict compressed air systems’ electrical load profile, which is valuable to industry practitioners as well as software providers in developing better practice and tools for load managementand look-ahead scheduling programs. Two artificial neural networks, Two-Layer Feed-Forward Neural Networkand Long Short-Term Memory were used to predict an air compressors electrical load. Compressors with three different control mechanisms are evaluated with a total number of 11,874 observations. Here, the forecasts were validated using out-of-sample datasets with 5-fold cross-validation. Models produced average coefficient ofdetermination values from 0.24 to 0.94, average root-mean-square errors from 0.05 kW - 5.83 kW, and meanabsolute scaled errors from 0.20 to 1.33. The results indicate that both artificial neural networks yield goodresults for compressors using variable speed drive (average R 2 = 0.8 and no naïve forecasting), only the longshort-term memory model gives acceptable results for compressors using on/off control (average R 2 = 0.82 and no naïve forecasting), and no satisfactory results are obtained for load/unload type air compressors (models constituting active forecasting).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Machine learning prediction on the fractional free volume of polymer membranes

Fractional free volume (FFV) characterizes the microstructural level features of polymers and affects their properties including thermal, mechanical, and separation performance. Experimental measurements and theoretical analyses have been used to quantify the FFV of polymers, but challenges remain because of their limitations. Experimental measurements are laborious and based on semi empirical equations, while Bondi’s group contribution theory involves ambiguities like the determination of van der Waals volume and the choice of factor values in the theoretical equation. To efficiently evaluate the FFV of polymers, this study utilizes high-throughput molecular dynamics (MD) simulations to build a large dataset regarding polymer’s FFV. Based on this large dataset, we further build machine learning (ML) models to establish the composition-structure relation. Inspired by group contribution theory which correlates polymer’s functional groups to FFV, our ML models correlate polymer’s substructures or physico-chemical indexes to FFV. Here, our study first benchmarks the MD simulation protocol to obtain reliable FFV of polymers and then carries out high-throughput MD simulations for more than 6,500 homopolymers and 1,400 polyamides. Such a large and diverse dataset makes the well-trained ML models more generalizable, compared with the group contribution theory. The efficiency of a feed forward neural network model is further demonstrated by applying it to a hypothetical polyimide dataset of more than 8 million chemical structures. The predicted FFVs of hypothetical polyimides are further validated by MD simulations. The obtained FFVs of the 8 million polymers, plus their previously reported gas separation performances, demonstrate the promising capability of ML virtual screening for the discovery of polymer membranes with exceptional permeability/selectivity.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗
DOE OSTI2024

Machine Learning-Based Identification of the Interface Regions for Coupling Local and Nonlocal Models

Local-nonlocal coupling approaches provide a means to combine the computational efficiency of local models and the accuracy of nonlocal models. However, the coupling process can be challenging, requiring expertise to identify the interface between local and nonlocal regions. Here, this study introduces a machine learning-based approach to automatically detect the regions in which the local and nonlocal models should be used. The method uses loading functions evaluated at grid points to decide the model selection at those points. Training of the networks is based on datasets provided by classes of loading functions for which reference coupling configurations are computed using accurate coupled solutions, where accuracy is measured in terms of the relative error between the solution to the coupling approach and the solution to the nonlocal model. We study two approaches that vary in data structure. The first, the full-domain input data approach, uses the entire load vector and outputs a complete label vector, performing a global classification. The second, a window-based approach, processes loads into windows and addresses the problem as a node-wise classification where each window's central point is classified individually. The classification problems are solved via deep learning algorithms based on convolutional neural networks. The performance of these approaches is studied on one-dimensional numerical examples using F1-scores and accuracy metrics. Notably, the windowing approach achieves an accuracy of 0.96 and an F1-score of 0.97, highlighting its potential to automate coupling processes effectively and enhance computational efficiency in material science applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Models and Processes to Extract Drug-like Molecules From Natural Language Text

Researchers worldwide are seeking to repurpose existing drugs or discover new drugs to counter the disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). A promising source of candidates for such studies is molecules that have been reported in the scientific literature to be drug-like in the context of viral research. However, this literature is too large for human review and features unusual vocabularies for which existing named entity recognition (NER) models are ineffective. We report here on a project that leverages both human and artificial intelligence to detect references to such molecules in free text. We present 1) a iterative model-in-the-loop method that makes judicious use of scarce human expertise in generating training data for a NER model, and 2) the application and evaluation of this method to the problem of identifying drug-like molecules in the COVID-19 Open Research Dataset Challenge (CORD-19) corpus of 198,875 papers. We show that by repeatedly presenting human labelers only with samples for which an evolving NER model is uncertain, our human-machine hybrid pipeline requires only modest amounts of non-expert human labeling time (tens of hours to label 1778 samples) to generate an NER model with an F-1 score of 80.5%—on par with that of non-expert humans—and when applied to CORD’19, identifies 10,912 putative drug-like molecules. This enriched the computational screening team’s targets by 3,591 molecules, of which 18 ranked in the top 0.1% of all 6.6 million molecules screened for docking against the 3CLPro protein.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physics

Large language models have revolutionized artificial intelligence by enabling large, generalizable models trained through self-supervision. This paradigm has inspired the development of scientific foundation models (FMs). However, applying this capability to experimental particle physics is challenging due to the sparse, spatially distributed nature of detector data, which differs dramatically from natural language. This work addresses if an FM for particle physics can scale and generalize across diverse tasks. We introduce a new dataset with more than 11 million particle collision events and a suite of downstream tasks and labeled data for evaluation. We propose a novel self-supervised training method for detector data and demonstrate its neural scalability with models that feature up to 188 million parameters. With frozen weights and task-specific adapters, this FM consistently outperforms baseline models across all downstream tasks. The performance also exhibits robust data-efficient adaptation. Further analysis reveals that the representations extracted by the FM are task-agnostic but can be specialized via a single linear mapping for different downstream tasks.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2005

Extracting Quantitative Data from Lunar Soil Spectra

Using the modified Gaussian model (MGM) developed by Sunshine et al. [1] we compared the spectral properties of the Lunar Soil Characterization Consortium (LSCC) suite of lunar soils [2,3] with their petrologic and chemical compositions to obtain quantitative data. Our initial work on Apollo 17 soils [4] suggested that useful compositional data could be elicited from high quality soil spectra. We are now able to expand upon those results with the full suite of LSCC soils that allows us to explore a much wider range of compositions and maturity states. The model is shown to be sensitive to pyroxene abundance and can evaluate the relative portion of high-Ca and low-Ca pyroxenes in the soils. In addition, the dataset has provided unexpected insights into the nature and causes of absorption bands in lunar soils. For example, it was found that two distinct absorption bands are required in the 1.2 m region of the spectrum. Neither of these bands can be attributed to plagioclase or agglutinates, but both appear to be largely due to pyroxene.

Noble, S. K.↗
NASA NTRS2012

Volatile Siderophile Elements in Shergottites: Constraints on Core Formation and Magmatic Degassing

Volatile siderophile elements (e.g., As, Sb, Ge, Ga, In, Bi, Zn, Cd, Sn, Cu, Pb) can place constraints both on early differentiation as well as the origin of volatiles. This large group of elements has been used to constrain Earth accretion [1,2], and Earth-Moon geochemistry [3]. Application to Earth has been fostered by new experimental studies of these elements such as Ge, In, and Ga [4,5,6]. Application to Mars has been limited by the lack of data for many of these elements on martian meteorites. Many volatile elements are considered in the pioneering work by [7] but for only the small number of martian samples then available. We have made new measurements on a variety of martian meteorites in order to obtain more substantial datasets for these elements using the analytical approach of [8]. We use the new dataset, together with published data from the literature, to define martian mantle abundances of volatile siderophile elements. Then, we evaluate the possibility that these abundances could have been set by mid-mantle (14 GPa, 2100 C) metal-silicate equilibrium, as suggested by the moderately and slightly siderophile elements [9]. Finally, we examine the possibility that some elements were affected by volatility and magmatic degassing.

Righter, Kevin↗
NASA NTRS2011

GLM Proxy Data Generation: Methods for Stroke/Pulse Level Inter-Comparison of Ground-Based Lightning Reference Networks

In order to produce useful proxy data for the GOES-R Geostationary Lightning Mapper (GLM) in regions not covered by VLF lightning mapping systems, we intend to employ data produced by ground-based (regional or global) VLF/LF lightning detection networks. Before using these data in GLM Risk Reduction tasks, it is necessary to have a quantitative understanding of the performance of these networks, in terms of CG flash/stroke DE, cloud flash/pulse DE, location accuracy, and CLD/CG classification error. This information is being obtained through inter-comparison with LMAs and well-quantified VLF/LF lightning networks. One of our approaches is to compare "bulk" counting statistics on the spatial scale of convective cells, in order to both quantify relative performance and observe variations in cell-based temporal trends provided by each network. In addition, we are using microsecond-level stroke/pulse time correlation to facilitate detailed inter-comparisons at a more-fundamental level. The current development status of our ground-based inter-comparison and evaluation tools will be presented, and performance metrics will be discussed through a comparison of Vaisala s Global Lightning Dataset (GLD360) with the NLDN at locations within and outside the U.S.

Cummins, Kenneth L.↗
NASA NTRS2012

Characterizing the Vertical Profile of Aerosol Particle Extinction and Linear Depolarization over Southeast Asia and the Maritime Continent: The 2007-2009 View from CALIOP

Vertical profiles of 0.532 μm aerosol particle extinction coefficient and linear volume depolarization ratio are described for Southeast Asia and the Maritime Continent. Quality-screened and cloud-cleared Version 3.01 Level 2 NASA Cloud Aerosol Lidar with Orthogonal Polarization (CALIOP) 5-km Aerosol Profile datasets are analyzed from 2007 to 2009. Numerical simulations from the U.S. Naval Aerosol Analysis and Predictive System (NAAPS), featuring two-dimensional variational assimilation of NASA Moderate Resolution Imaging Spectroradiometer and Multi-angle Imaging Spectro- Radiometer quality-assured datasets, combined with regional ground-based lidar measurements, are considered for assessing CALIOP retrieval performance, identifying bias, and evaluating regional representativeness. CALIOP retrievals of aerosol particle extinction coefficient and aerosol optical depth (AOD) are high over land and low over open waters relative to NAAPS (0.412/0.312 over land for all data points inclusive, 0.310/0.235 when the per bin average is used and each is treated as single data points; 0.102/0.151 and 0.086/0.124, respectively, over ocean). Regional means, however, are very similar (0.180/0.193 for all data points and 0.155/0.159 when averaged per normalized bin), as the two factors offset one another. The land/ocean offset is investigated, and discrepancies attributed to interpretation of particle composition and a-priori assignment of the extinction-to-backscatter ratio ("lidar ratio") necessary for retrieving the extinction coefficient from CALIOP signals. Over land, NAAPS indicates more dust present than CALIOP algorithms are identifying, indicating a likely assignment of a higher lidar ratio representative of more absorptive particles. NAAPS resolvesmore smoke overwater than identified with CALIOP, indicating likely usage of a lidar ratio characteristic of less absorptive particles to be applied that biases low AOD there. Over open waters except within the Bay of Bengal, aerosol particle scattering is largely capped below 1.5 km MSL, though ground-based lidar measurements at Singapore differ slightly from this finding. Significant aerosol particle presence over land is similarly capped near 3.0 km MSL over most regions. Particle presence at low levels regionally, except over India, is dominated by relatively non-depolarizing particles. Industrial haze, sea salt droplets and fresh smoke are thus most likely present.

linear volume depolarization ratio↗
NASA NTRS2017

Meteorite Dust and Health - A Novel Approach for Determining Bulk Compositions for Toxicological Assessments of Precious Materials

With the resurgence of human curiosity to explore planetary bodies beyond our own, comes the possibility of health risks associated with the materials covering the surface of these planetary bodies. In order to mitigate these health risks and prepare ourselves for the eventuality of sending humans to other planetary bodies, toxicological evaluations of extraterrestrial materials is imperative (Harrington et al. 2017). Given our close proximity, as well as our increased datasets from various missions (e.g., Apollo, Mars Exploration Rovers, Dawn, etc…), the three most likely candidates for initial human surface exploration are the Moon, Mars, and asteroid 4Vesta. Seven samples, including lunar mare basalt NWA 4734, lunar regolith breccia NWA 7611, martian basalt Tissint, martian regolith breccia NWA 7034, a vestian basalt Berthoud, a vestian regolith breccia NWA 2060, and a terrestrial mid-ocean ridge basalt, were examined for bulk chemistry, mineralogy, geochemical reactivity, and inflammatory potential. In this study, we have taken alliquots from these samples, both the fresh samples and those that underwent iron leaching (Tissint, NWA 7034, NWA 4734, MORB), and performed low pressure, high temperature melting experiments to determine the bulk composition of the materials that were previously examined.

Vander Kaaden, K. E.↗
NASA NTRS2017

An Evaluation of Teleconnections Over the United States in an Ensemble of AMIP Simulations with the MERRA-2 Configuration of the GEOS Atmospheric Model

The atmospheric general circulation model that is used in NASA's Modern Era Retrospective Analysis for Research and Applications Version 2 (MERRA-2) is evaluated with respect to the relationship between large-scale teleconnection patterns and daily temperature and precipitation over the United States (US) using a ten-member ensemble of simulations, referred to as M2AMIP. A focus is placed on four teleconnection patterns that are known to influence weather and climate in the US: El Nino Southern Oscillation, the Pacific Decadal Oscillation, the North Atlantic Oscillation, and the Pacific-North American Pattern. The monthly and seasonal indices associated with the patterns are correlated with daily temperature and precipitation statistics including: (i) monthly mean 2 m temperature and precipitation, (ii) the frequency of extreme temperature events at the 90th, 95th, and 99th percentiles, and (iii) the frequency and intensity of extreme precipitation events classified at the 90th, 95th, and 99th percentiles.Correlations obtained with M2AMIP data and thus the strength of teleconnections in the free-running model are evaluated through comparison against corresponding correlations computed from observations and from MERRA-2. Overall, the strongest teleconnections in all datasets occur during the winter and coincide with the largest agreement between the observations, MERRA-2, and M2AMIP. When M2AMIP does capture the correlation seen in observations, there is a tendency for the spatial extent to be exaggerated. The weakest agreement between the data sources, for all teleconnection patterns, is in the correlation with extreme precipitation; however there are discrepancies between the datasets in the number of days with at least 1 mm of precipitation: M2AMIP has too few days with precipitation in the Northwest and the Northern Great Plains and too many days in the Northeast. In JJA, M2AMIP has too few days with precipitation in the western two-thirds of the country and too many days with precipitation along the east coast.

JJA↗
NASA NTRSDate not supplied

Analyzing Natural Language Context in Human-Machine Teaming using Supervised Machine Learning

Building a foundation for trustworthiness and trust verification in multi-asset teaming is the research challenge of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR). The Design Reference Mission (DRM) for ATTRACTOR is a search and rescue mission objective governed by a multi-member team consisting of human and machine operators. A crucial component to the effort is the communication between humans and autonomous agents throughout both planning and execution stages of the mission. Intuitive communication methods and modalities are posited as critical enablers for certifying trust and trustworthiness. This paper reports on the data collection and analysis conducted in support of the Human Informed Natural-language GANs Evaluation (HINGE)project to attain explainable and trusted communication between human-machine assets. Two identically curated image description datasets were acquired for HINGE, both consisting of two unique input modalities (typed vs. verbal) and retrieved in two distinct contexts (general vs. specific). The gathered datasets were assessed and compared using Parts-of-Speech (POS)features, sentence similarity metrics, and linguistic analysis. Then, the datasets were modeled and tested separately and in combination with one another using machine learning algorithms. The comparison and testing results reveal a superior dataset, by which a preferred context and input is understood, for generating image representations of missing persons using a Generative Adversarial Network (GAN).

Bryan A Barrows↗
NASA NTRSDate not supplied

TPSAS-NF1676L-23246-DND

The Arctic Radiation-IceBridge Sea and Ice Experiment (ARISE) was conducted from Fairbanks, Alaska during the September transition in the Beaufort-Chukchi Seas. Fifteen missions were flown with a NASA C-130 to characterize clouds, sea-ice, and associated radiative properties over a wide range of conditions. The advanced instrumentation payload included broadband and spectral radiometers, in-situ cloud probes, a laser altimeter and digital camera system. The flight profiles were tightly coordinated with multiple intersecting satellite overpasses allowing for a thorough evaluation of the Clouds and the Earth's Radiant Energy System (CERES) satellite climate data products. Thus, a rich dataset was acquired to help better understand cloud radiative effects as sea-ice conditions are changing due to arctic warming. The mission also acquired measurements to supplement the ongoing Operation Icebridge campaign. An overview of the mission operations, preliminary results, and a description of the datasets now available to the scientific community, will be presented.

William L Smith, Jr↗
NASA NTRSDate not supplied

Linear Mixed-Effects Models for Human-in-the-Loop Tracking Experiment Data

Linear mixed-effects models provide several benefits over more traditional statistical inference tests that are particularly useful for most human-in-the-loop tracking experiment data. However, surprisingly, mixed models are virtually not used for the analysis of tracking experiment data. This paper uses of linear mixed-effects models to analyze combined tracking data from two previous human-in-the-loop roll tracking experiments that compared control behavior metrics collected in both a research aircraft and a motion-base simulator. In the experiments, pilots' behavior under 10 different motion configurations with varying motion filter gains and break frequencies was evaluated and compared to that in the real aircraft. The linear mixed-effects model analysis on the combined dataset confirmed the main statistical outcomes of the individual experiments. The main benefits of mixed models for this type of data were demonstrated by successfully combining data from two experiments that used different experimental conditions and of which one had an additional apparatus and the other a missing participant. Finally, the mixed-model analysis was able to explicitly test for scientifically relevant statistical differences in the dependent measures between the aircraft and simulator, as well as both experiments.

manual control↗
NASA NTRS2021

Passive Microwave Brightness Temperature Assimilation to Improve Snow Mass Estimation across Complex Terrain in Pakistan, Afghanistan, and Tajikistan

An ensemble Kalman filter is used to assimilate Advanced Microwave Scanning Radiometer-2 (AMSR2) observations of passive microwave (PMW) brightness temperatures (spectral differences, ΔT b ) into land surface model estimates of snow mass over northwestern high mountain Asia (HMA). Trained support vector machines serve as the observation operator and map the geophysical modeled variables into ΔT b space within the assimilation framework. Evaluation of the assimilation routine is carried out through comparison of assimilated snow mass estimates with an in situ dataset. The assimilation framework helps improve the land surface model estimates through PMW ΔT b assimilation, particularly in terms of decreasing the domain-wide bias. The assimilation framework proved more effective during the (dry) snow accumulation season and decreased the bias and root-mean-square error (RMSE) in snow mass estimates at 76% and 58% of the comparative pixels, respectively. During the snow ablation season, the PMW brightness temperature signal contained less information related to snow mass due to the presence of other concurrent geophysical features that effectively serve as noise during the snow mass update. The utilization of PMW ΔT b for accurate snow mass estimation in complex terrain such as HMA is dependent on a multitude of factors for optimal results; however, it does add utility to the land surface model if the relevant pitfalls are taken into consideration prior to the state variable update.

Jawairia Ahmad↗
NASA NTRS2023

The Coupling Between Tropical Meteorology, Aerosol Lifecycle, Convection, and Radiation, During the Clouds, Aerosol and Monsoon Processes Philippines Experiment (CAMP2Ex)

The NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP2Ex) employed the NASA P-3, Stratton Park Engineering Company (SPEC) Learjet 35, and a host of satellites and surface sensors to characterize the coupling of aerosol processes, cloud physics, and atmospheric radiation within the Maritime Continent’s complex southwest monsoonal environment. Conducted in the late summer of 2019 from Luzon Philippines in conjunction with the Office of Naval Research Propagation of Intraseasonal Tropical OscillatioNs (PISTON) experiment with its R/VSally Ride stationed in the North Western Tropical Pacific, CAMP2Ex documented diverse biomass burning, industrial and natural aerosol populations and their interactions with small to congestus convection. The 2019 season exhibited El Nino and associated drought, high biomass burning emissions, and an early monsoon transition allowing for observation of pristine to massively polluted environments as they advected through intricate diurnal mesoscale and radiative environments into the monsoonal trough. CAMP2Ex’s preliminary results indicate 1) increasing aerosol loadings tend to invigorate congestus convection in height and increase liquid water paths; 2) lidar, polarimetry, and geostationary Advanced Himawari Imager remote sensing sensors have skill in quantifying diverse aerosol and cloud properties and their interaction; and 3) high resolution remote sensing technologies are able to greatly improve our ability to evaluate the radiation budget in complex cloud systems. Through the development of innovative informatics technologies, CAMP2Ex provides a benchmark dataset of an environment of extremes for the study of aerosol, cloud and radiation processes as well as a crucible for the design of future observing systems.

CAMP2Ex↗
DOE OSTI2020

Ambient Synchrophasor Measurement Based System Inertia Estimation

This paper develops an algorithm to estimate the system inertia value based on ambient synchrophasor measurement. Informative features are extracted from ambient synchrophasor measurements for machine-learning-based inertia estimation. Besides ambient synchrophasor measurements of FNET/GridEye, other available data relevant to inertia (such as weather and system load data) are also used to improve the inertia estimation accuracy. Then a machine learning algorithm to estimate system inertia is developed. A test dataset including ambient synchrophasor data from FNET/GridEye measurements and the WECC system inertia data from NERC is used to evaluate the performance of the developed inertia estimation method. The average and maximum estimation errors of the developed inertia estimation method is lower than 5% and 10%, respectively. This accuracy is higher than reported accuracy values in existing literature.

CUI, YI↗