Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Emerging Flexible Designs for Geospatial Multimodal Foundation Models

Foundation models are rapidly transforming Earth observation by enabling scalable pretraining across diverse unlabeled geospatial modalities. However, their architectural diversity—ranging from encoder-only to encoder-decoder and masked autoencoding paradigms—makes it challenging to assess performance trade-offs in a consistent manner. In this work, we present an apples-to-apples comparison of leading FM architectures designed for geospatial multimodal reasoning, with a particular focus on flexibility across varied spectral band configurations. We standardize pretraining using identical self-supervised learning objectives and training datasets, and evaluate all models under consistent parameterization on the GEOBench benchmark across classification and segmentation tasks. Our results offer new insights into the design trade-offs between model flexibility, modality alignment, and downstream task performance. By highlighting architectural strengths and limitations under controlled conditions, this study provides practical guidance for building next-generation geospatial foundation models capable of robust multimodal reasoning.

Ambrozio Dias, Philipe [ORNL] (ORCID:0000000194277↗

Grid Optimization (GO) Competition Platform

A software for a multi-challenge power-flow grid optimization competition was developed. The platform brings together high performance computing clusters, webservers, databases, competition datasets, schedulers, evaluation codes, and a multitude of language compilers and optimization solvers to host the competition. The original video announcing the competition, from former Secretary Perry, at: https://www.youtube.com/watch?v=hZwX3P9vS8M

Veeramany, Arun↗

FATHOMS-RAG

Dataset and Evaluation code for the FATHOMS-RAG paper

Hildebrand, Samuel [Louisiana State Univ., Baton R↗

HITMAN

HITMAN (Hermite Interpolation of Trajectories and Measurement Synthesis for Analysis of Navigators) interpolates—or estimates the unknown values between known values—flight trajectories and generates synthetic inertial measurement unit (IMU) data using Hermite splines. This Python library provides modeling and simulation capabilities to synthesize inertial measurements from discrete trajectory points, enabling researchers to create exemplar datasets for evaluating navigation algorithms in various applications, including consumer devices like smartphones and vehicles. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Walker II, Michael [Sandia National Lab. (SNL-CA),↗

TULIP: An RNA-seq-based Primary Tumor Type Prediction Tool Using Convolutional Neural Networks

Background: With cancer as one of the leading causes of death worldwide, accurate primary tumor type prediction is critical in identifying genetic factors that can inhibit or slow tumor progression. There have been efforts to categorize primary tumor types with gene expression data using machine learning, and more recently with deep learning, in the last several years. Methods In this paper, we developed four 1-dimensional (1D) Convolutional Neural Network (CNN) models to classify RNA-seq count data as one of 17 highly represented primary tumor types or 32 primary tumor types regardless of imbalanced representation. Additionally, we adapted the models to take as input either all Ensembl genes (60,483) or protein coding genes only (19,758). Unlike previous work, we avoided selection bias by not filtering genes based on expression values. RNA-seq count data expressed as FPKM-UQ of 9,025 and 10,940 samples from The Cancer Genome Atlas (TCGA) were downloaded from the Genomic Data Commons (GDC) corresponding to 17 and 32 primary tumor types respectively for training and validating the models. Results: All 4 1D-CNN models had an overall accuracy of 94.7% to 97.6% on the test dataset. Further evaluation indicates that the models with protein coding genes only as features performed with better accuracy compared to the models with all Ensembl genes for both 17 and 32 primary tumor types. For all models, the accuracy by primary tumor type was above 80% for most primary tumor types. Conclusions: We packaged all 4 models as a Python-based deep learning classification tool called TULIP (TUmor CLassIfication Predictor) for performing quality control on primary tumor samples and characterizing cancer samples of unknown tumor type. Further optimization of the models is needed to improve the accuracy of certain primary tumor types.

Jones, Sara↗

Data-Driven Energy Resilience Assessment and Enhancement in Urban Communities: A Case Study in Detroit

This paper presents a data-driven framework for assessing and enhancing energy resilience in urban communities. The resilience assessment is based on two datasets: 1) annual aggregated power outage data and 2) 15-minute interval outage data. High-impact, low-probability (HILP) events are identified within these datasets to evaluate community resilience under extreme conditions. To enhance resilience, an optimization framework utilizing mixed integer linear programming is developed to determine the optimal sizing and placement of solar photovoltaic (PV) systems and battery energy storage systems (BESS). This method offers a cost-effective and practical solution for improving energy resilience in vulnerable communities. Furthermore, a case study of the City of Detroit in Michigan demonstrates the effectiveness of the framework through simulation and validation.

Energy resilience assessment↗

Dispersion Validation for Flow Involving a Large Structure Revisited: 45 Degree Rotation

The atmospheric dispersion of contaminants in the wake of a large urban structure is a challenging fluid mechanics problem of interest to the scientific and engineering communities. Magnetic Resonance Velocimetry (MRV) and Magnetic Resonance Concentration (MRC) are relatively new techniques that leverage diagnostic equipment used primarily by the medical field to make 3D engineering measurements of flow and contaminant dispersal. SIERRA/Fuego, a computational fluid dynamics (CFD) code at Sandia National Labs is employed to make detailed comparisons to the dataset to evaluate the quantitative and qualitative accuracy of the model. This work is the second in a series of scenarios. In the prior work, a single large building in an array of similar buildings was considered with the wind perpendicular to a building face. In this work, the geometry is rotated by 45 degrees and improved studies are performed for simulation credibility. The comparison exercise shows conditionally good comparisons between the model and experiment. Model uncertainties are assessed through parametric variations. Various methods of quantifying the accuracy between experiments and data are examined Three-dimensional analysis of accuracy is performed. The effort helped identify deficiencies in the techniques used to make these comparisons, and further methods development therefore becomes one of the main recommendations for follow-on work.

42 ENGINEERING↗

Fuel-Cladding Eutectic Study of Legacy Fast Flux Test Facility (FFTF) MFF HT9/U-10Zr Metallic Fuel

This report presents the first systematic investigation of fuel-cladding eutectic interaction (FCEI) in irradiated HT9/U-10Zr metallic fuel from the Fast Flux Test Facility (FFTF) Materials Fuels Form (MFF) program, using differential scanning calorimetry (DSC) coupled with scanning electron microscopy (SEM) and energy dispersive X-ray spectroscopy (EDS). Two irradiated fuel cross-sections, MNT07H (9.5 at% burnup, x/L = 0.78) and MNT08H (7.0 at% burnup, x/L = 0.93), were subjected to three successive isothermal annealing rounds (R1–R3) at 820°C for 20 minutes each, yielding a cumulative transient duration of one hour. This study directly addresses a recognized gap in the existing FCEI database, which previously lacked irradiated HT9/U-10Zr data at burnup levels above 8 at%. Two principal findings emerge from the study. First, for both samples, FCEI remained spatially confined within the pre-existing fuel-cladding chemical interaction (FCCI) zone boundaries after R3, with no measurable eutectic penetration into unaffected cladding beyond the original FCCI layer. This self-limiting behavior is consistent with historical Fuel Behavior Test Apparatus (FBTA) results and is attributed to the near-eutectic phase composition of the FCCI zone, which rapidly absorb the available eutectic-forming constituents and then stall penetration once the FCCI zone is consumed. A comparison with unirradiated surrogate data further supports this mechanism: whereas a U–34 at.% Fe sample would be expected to show ~176 µm of iron penetration under comparable conditions, the irradiated samples exhibited only ~20 µm, a discrepancy attributed to irradiation-induced interfacial porosity and pre-existing FCCI composition gradients. Second, for MNT08H, FCEI was observed exclusively on the half of the cladding circumference where pre-existing steady-state FCCI was present, with no detectable FCEI on the opposite half. Three hypotheses are proposed to explain this asymmetry: the inhibiting role of a zirconium-rich rind at the fuel-cladding interface; the chemical sequestration of iron by redistributed zirconium within the fuel matrix; and the persistence of fuel-cladding gaps on the FCEI-free half that preclude direct contact. All three hypotheses require further experimental investigation. The results extend the empirical FCEI database into higher-burnup territory and demonstrate the viability of DSC-based testing as a substitute for the no-longer-available FBTA apparatus. Future work will include additional cross-section testing, compilation of the full FCEI dataset, model evaluation, and DSC testing of ternary fuel compositions to broaden the experimental basis for safety assessment of sodium-cooled fast reactor systems.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Real-Time Anomaly Detection for Beyond Standard Model Searches in ProtoDUNE Horizontal Drift

This paper summarizes work conducted throughout a SULI internship at Fermi National Accelerator Laboratory focused on building an unsupervised machine learning model for real-time anomaly detection in ProtoDUNE Horizontal Drift. Using simulated data, we trained an autoencoder model on a pure cosmic dataset, and evaluated it on both cosmic and neutrino events---making the model an anomaly detector. The goal was to make a model which matches or exceeds the current ADC Simple Window trigger algorithm so that our model can perform at the same rate but provide sensitivity to potential beyond-the-Standard-Model (BSM) signatures. In the end, we were able to construct a model which slightly exceeds the capabilities of the ADC Simple Window while remaining completely unsupervised, achieving $31.9 \pm 0.2$\% ($26.6 \pm 0.2$\%) $\nu$ efficiency at 5 Hz (2 Hz), a 3.6 (3.2) percentage point increase. Additionally, $17.5 \pm 0.3$\% ($18.3 \pm 0.3$\%) of the events that passed the autoencoder at 5 Hz (2 Hz) were missed by the current trigger algorithm. Future work will investigate alternative normalization methods, including quantile transformation, and evaluate the model on ProtoDUNE-HD detector-glitch data if that data becomes available.

Wilson, Cameron C. [Cincinnati U., RWC]↗

Real-Time Anomaly Detection for Beyond Standard Model Searches in ProtoDUNE Horizontal Drift

This paper summarizes work conducted throughout a SULI internship at Fermi National Accelerator Laboratory focused on building an unsupervised machine learning model for real-time anomaly detection in ProtoDUNE Horizontal Drift. Using simulated data, we trained an autoencoder model on a pure cosmic dataset, and evaluated it on both cosmic and neutrino events---making the model an anomaly detector. The goal was to make a model which matches or exceeds the current ADC Simple Window trigger algorithm so that our model can perform at the same rate but provide sensitivity to potential beyond-the-Standard-Model (BSM) signatures. In the end, we were able to construct a model which slightly exceeds the capabilities of the ADC Simple Window while remaining completely unsupervised, achieving $31.9 \pm 0.2$\% ($26.6 \pm 0.2$\%) $\nu$ efficiency at 5 Hz (2 Hz), a 3.6 (3.2) percentage point increase. Additionally, $17.5 \pm 0.3$\% ($18.3 \pm 0.3$\%) of the events that passed the autoencoder at 5 Hz (2 Hz) were missed by the current trigger algorithm. Future work will investigate alternative normalization methods, including quantile transformation, and evaluate the model on ProtoDUNE-HD detector-glitch data if that data becomes available.

Wilson, Cameron C. [Cincinnati U., RWC]↗

Fire and Drought Affect Multiple Aspects of Diversity in a Migratory Bird Stopover Community

Drought and high-severity, stand-replacing wildfires can have substantial impacts on the composition of avian communities, including stop-over communities during migration. An inextricable link exists between drought and wildfire, each operating and impacting across different timescales. Many studies have found nonlinear avian abundance trends in breeding community time series data that include pre- and post-fire observations, describing an initial decrease in abundance followed by rapid increases that can attenuate over time. Here, we use a fall bird-banding dataset to evaluate shifts in a drought-impacted avian community following wildfire from taxonomic, functional, and phylogenetic perspectives. We looked at the community as a whole and also categorized birds as residents, migrants, and breeders to assess potential varying responses at the study site. We observed post-fire shifts in functional and phylogenetic diversity that corresponded to changes in vegetation. An influx of migratory insectivores post-fire drove much of the variation between pre- and post-fire avian communities and toward a more related, less phylogenetically dispersed community. A concurrent monsoon season drought was also associated with functional and phylogenetic diversity, highlighting the intertwined pulse press effects on avian communities. Overall, our results suggest that, although bird communities are immediately impacted by fire-driven resource changes, they can rebound over time, it is unclear how long-term drought may continue to shape the composition of these avian communities.

59 BASIC BIOLOGICAL SCIENCES↗

Assessment of Climate Change Impacts on Renewable Energy Resources in Western North America

We examine a 25 km resolution climate model dataset to evaluate how regional climate change impacts solar and wind energy under a high-emission scenario. Our study considers the Western Electricity Coordinating Council (WECC) region, which covers the western United States and southwestern Canada, focusing specifically on locations with existing solar and wind infrastructure. First, we conduct a historical model comparison of solar and wind energy capacity factors to highlight model uncertainties across the study area. Using future climate projections, we then assess the seasonal patterns of solar and wind capacity factors for three timeframes: historical, mid-century, and end of century. Additionally, we estimate the frequency of solar and wind resource droughts during these periods for the entire WECC and its five operational subregions, finding that certain subregions are more susceptible to energy droughts due to limited renewable resources. Finally, we present day-ahead capacity factor forecasts to support energy storage planning and provide estimates of offshore wind energy capacity within the WECC. Our results indicate that offshore wind capacity factors are nearly twice as high as onshore values, with less seasonal variation, which suggests that offshore wind could offer a more consistent renewable energy supply in the future.

climate change↗

Atmospheric Radiation Measurement (ARM) airborne field campaign data products between 2013 and 2018

Airborne measurements are pivotal for providing detailed, spatiotemporally resolved information about atmospheric parameters and aerosol and cloud properties, thereby enhancing our understanding of dynamic atmospheric processes. For 30 years, the US Department of Energy (DOE) Office of Science supported an instrumented Gulfstream 1 (G-1) aircraft for atmospheric field campaigns. Data from the final decade of G-1 operations were archived by the Atmospheric Radiation Measurement (ARM) Data Center and made publicly available at no cost to all registered users. To ensure a consistent data format and to improve the accessibility of the ARM airborne data, an integrated dataset was recently developed covering the final 6 years of G-1 operations (2013 to 2018, https://doi.org/10.5439/1999133; Mei and Gaustad, 2024). The integrated dataset includes data collected from 236 flights (766.4 h), which covered the Arctic, the US Southern Great Plains (SGP), the US West Coast, the eastern North Atlantic (ENA), the Amazon Basin in Brazil, and the Sierras de Córdoba range in Argentina. These comprehensive data streams provide much-needed insight into spatiotemporal variability in the thermodynamic quantities and aerosol and cloud properties for addressing essential science questions in Earth system process studies. This paper describes the DOE ARM merged G-1 datasets, including information on the acquisition, data collection challenges and future potentials, and quality control processes. It further illustrates the usage of this merged dataset to evaluate the Energy Exascale Earth System Model (E3SM) with the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package.

54 ENVIRONMENTAL SCIENCES↗

ECMWF and SSM/I global surface wind speeds

Monthly mean 2.5 deg x 2.5 deg resolution 10-m height wind speeds from the Special Sensor Microwave/Imager (SSM/I) instrument and the European Centre for Medium-Range Weather Forecasts (ECMWF) forecast-analysis system are compared between 60 deg S and 60 deg N during 1988-91. The SSM/I data were uniformly processed while numerous changes were made to the ECMWF forecast-analysis system. The SSM/I measurements, which were compared with moored-buoy wind observations, were used as a reference dataset to evaluate the influence of the changes made to the ECMWF system upon the ECMWF surface wind speed over the ocean. A demonstrable yearly decrease of the difference between SSM/I and ECMWF wind speeds occurred in the 10 deg S-10 deg N region, including the 5 deg S-5 deg N zone of the Pacific Ocean, where nearly all of the variations occurred in the 160 deg E-160 deg W region. The apparent improvement of the ECMWF wind speed occurred at the same time as the yearly decrease of the equatorial Pacific SSM/I wind speed, which was associated with the natural transition from La Nina to El Nino conditions. In the 10 deg S-10 deg N tropical Atlantic, the ECMWF wind speed had a 4-yr trend, which was not expected nor was it duplicated with the SSM/I data. No yearly trend was found in the difference between SSM/I and ECMWF surface wind speeds in middle latitudes of the Northern and Southern Hemispheres. The magnitude of the differences between SSM/I and ECMWF was 0.4 m/s or 100% larger in the Northern than in the Southern Hemisphere extratropics. In two areas (Arabian Sea and North Atlantic Ocean) where ECMWF and SSM/I wind speeds were compared to ship measurements, the ship data had much better agreement with the ECMWF analyses compared to SSM/I data. In the 10 deg S-10 deg N area the difference between monthly standard deviations of the daily wind speeds dropped significantly from 1988 to 1989 but remained constant at about 30% for the remaining years.

Halpern, David↗

SPARCLE: Validation of Observing System Simulations (SPace Readiness Coherent Lidar Experiment)

NASA recently approved a mission to fly a Doppler Wind Lidar (DWL) on a U.S. Space Shuttle. SPARCLE, managed by Marshall Space Flight Center in Huntsville, AL, is targeted for launch in March 2001. This mission is viewed as a necessary demonstration of a solid state (2 micron) lidar using coherent detection before committing resources to a 3-5 year research or operational mission. While, to many, this shuttle mission is seen as the first step in a series leading to a fully operational wind observing system, to others, it is a chance to validate predictions of performance based upon theoretical models, analyses of airborne and ground-based data, and sophisticated observing system simulation experiments. This paper will be presented in two parts: first a brief overview of the SPARCLE mission and second, a summary of current performance predictions and key contributions from ground- based and airborne DWL research. The SPARCLE instrument is a 100 mJ, 6 Hz, diode-pumped 2-micron laser with a .25 m telescope using heterodyne mixing in a fiber and an InGaAs detector. A 25 cm silicon wedge scanner will be used in step-stare modes with dwells ranging from 60 seconds to .5 seconds. Pointing knowledge is achieved with a dedicated GPS/INS mounted close to the lidar. NASA's Hitchhiker program is providing the instrument enclosures (2 cans) and mission logistics support. An on-board data system is sized to record 150 Gbytes of raw signal from a two 400 MHZ A/D converters. On-board signal processing will be used to control the frequency of the Local Oscillator. SPARCLE is predicted to have a single shot backscatter sensitivity near 1x10(exp -6) m-1 sr-1, To achieve higher sensitivity, shot accumulation will be employed. Ground-based, 2 micron DWLs have been used to assess the benefits of shot accumulation (approximately SQRT for SNR). Airborne programs like MACAWS have provided good datasets for evaluating various sampling strategies and signal processing algorithms. Using these real data to calibrate our simulation models, we can describe when and how well SPARCLE is expected to preform. Outputs from these performance models will be presented.

Emmitt, G. D.↗

A Global Climatology of Tropospheric and Stratospheric Ozone Derived from Aura OMI and MLS Measurements

A global climatology of tropospheric and stratospheric column ozone is derived by combining six years of Aura Ozone Monitoring Instrument (OMI) and Microwave Limb Sounder (MLS) ozone measurements for the period October 2004 through December 2010. The OMI/MLS tropospheric ozone climatology exhibits large temporal and spatial variability which includes ozone accumulation zones in the tropical south Atlantic year-round and in the subtropical Mediterranean! Asia region in summer months. High levels of tropospheric ozone in the northern hemisphere also persist in mid-latitudes over the eastern North American and Asian continents extending eastward over the Pacific Ocean. For stratospheric ozone climatology from MLS, largest ozone abundance lies in the northern hemisphere in the latitude range 70degN-80degN in February-April and in the southern hemisphere around 40degS-50degS during months August-October. The largest stratospheric ozone abundances in the northern hemisphere lie over North America and eastern Asia extending eastward across the Pacific Ocean and in the southern hemisphere south of Australia extending eastward across the dateline. With the advent of many newly developing 3D chemistry and transport models it is advantageous to have such a dataset for evaluating the performance of the models in relation to dynamical and photochemical processes controlling the ozone distributions in the troposphere and stratosphere.

Ziemke, J.R.↗

Analysis of One-Way Laser Ranging Data to LRO, Time Transfer and Clock Characterization

We processed and analyzed one-way laser ranging data from International Laser Ranging Service ground stations to NASA's Lunar Reconnaissance Orbiter (LRO), obtained from June 13, 2009 until September 30, 2014. We pair and analyze the one-way range observables from station laser fire and spacecraft laser arrival times by using nominal LRO orbit models based on the GRAIL gravity field. We apply corrections for instrument range walk, as well as for atmospheric and relativistic effects. In total we derived a tracking data volume of approximately 3000 hours featuring 64 million Full Rate and 1.5 million Normal Point observations. From a statistical analysis of the dataset we evaluate the experiment and the ground station performance. We observe a laser ranging measurement precision of 12.3 centimeters in case of the Full Rate data which surpasses the LOLA (Lunar Orbiting Laser Altimeter) timestamp precision of 15 centimeters. The averaging to Normal Point data further reduces the measurement precision to 5.6 centimeters. We characterized the LRO clock with fits throughout the mission time and estimated the rate to 6.9 times10 (sup -8), the aging to 1.6 times 10 (sup -12) per day and the change of aging to 2.3 times 10 (sup -14) per day squared over all mission phases. The fits also provide referencing of onboard time to the TDB (Barycentric Dynamical Time) time scale at a precision of 166 nanoseconds over two and 256 nanoseconds over all mission phases, representing ground to space time transfer. Furthermore we measure ground station clock differences from the fits as well as from simultaneous passes which we use for ground to ground time transfer from common view observations. We observed relative offsets ranging from 33 to 560 nanoseconds and relative rates ranging from 2 times 10 (sup -13) to 6 times 10 (sup -12) between the ground station clocks during selected mission phases. We study the results from the different methods and discuss their applicability for time transfer.

Bauer, S.↗

From CMS to the U.S. Greenhouse Gas Center – Improved Tracking of Recent Changes in Co 2 and Ch 4 From NASA’s Quasi-Operational Modeling Systems

Reliable, low latency delivery of high quality global flux and concentration information is a growing but still unmet need to advance expanding measurement, monitoring, reporting, and verification efforts that underpin federal climate mitigation strategies. Here we present on progress toward developing space-based greenhouse gas (GHG) monitoring systems that can provide comprehensive information trailing real time by a matter of weeks to a few months. Through support from its Carbon Monitoring System (CMS) program, NASA has developed the capability to assimilate XCO 2 retrievals from the Orbiting Carbon Observatory, 2 (OCO 2 ) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO 2 mixing ratio. When observations are unavailable, concentration fields are further informed by observationally-informed bottom-up flux packages that incorporate remotely sensed fire, nighttime lights, and vegetation observations combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of these datasets supports evaluation with independent aircraft data to improve confidence in satellite data, development of new regional modeling approaches, and quantification of the climate impacts of GHGs. The system has recently been expanded to assimilate XCH 4 from ESA’s TROPOspheric Monitoring Instrument (TROPOMI) instrument and is supported by companion efforts to improve delivery of estimates of bottom-up land and ocean fluxes. The quasi-operational GEOS-GHG system is contributing to the recently announced U.S. Greenhouse Gas Center (GHG Center) by delivering information on recent changes in CO 2 and CH 4 emissions and concentrations to support stakeholder and research communities. In this presentation, we provide an overview of the current system configured to support the GHG Center. We highlight examples of how this data contributes to broader NASA initiatives including the Earth Information Center, an innovative virtual and physical exhibit designed to show how NASA data helps the nation combat climate change. We conclude by discussing how innovations in CMS research can address remaining data gaps and modeling challenges to advance operational GHG monitoring in the future.

Lesley Ott↗