Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Part-scale microstructure prediction for laser powder bed fusion Ti-6Al-4V using a hybrid mechanistic and machine learning model

Laser powder bed fusion (LPBF) Ti-6Al-4V is widely studied for use in structural applications in aerospace and medical industries, but mechanical anisotropy and microstructural inhomogeneity prohibits its wider adoption. Although successful microstructure prediction models have been developed, a remaining challenge is their limited integration across length/time scales and validation by experimental studies. Here, this work proposes a physics-augmented machine learning surrogate model to unite predictions of LPBF temperature, β phase morphology and texture, and α/α’ formation into a single framework that is calibrated and validated with experiments. First, a phase field (PF) model of the martensitic β→α’ transformation is developed and calibrated using data from in-situ synchrotron cyclic heating/cooling studies quantifying the variation of α phase fraction with time. In parallel, an established finite difference-Monte Carlo (FDMC) model predicts the part-scale temperature profile and β grain formation during solidification. A dataset is developed using LPBF cyclic temperature descriptors from the FDMC model as inputs and corresponding α/α’ phase fraction and width from the PF model as outputs. Five machine learning (ML) regression models are tested and optimized, having mean absolute error in testing ≤ 4 %, and the k-nearest neighbors (KNN) model is selected as the best performing. The KNN model is called at the nodal level during post-processing of the FDMC model to replace and downscale the response of the PF model. The combined agility and accuracy of the hybrid FDMC-ML model enables part-scale microstructure predictions that can be further used for property predictions to accelerate AM process optimization.

36 MATERIALS SCIENCE↗

Airborne imaging spectroscopy surveys of Arctic and boreal Alaska and northwestern Canada 2017–2023

Since 2015, NASA’s Arctic Boreal Vulnerability Experiment (ABoVE) has investigated how climate change impacts the vulnerability and/or resilience of the permafrost-affected ecosystems of Alaska and northwestern Canada. ABoVE conducted extensive surveys with the Next Generation Airborne Visible/Infrared Imaging Spectrometer (AVIRIS-NG) during 2017, 2018, 2019, and 2022 and with AVIRIS-3 in 2023 to characterize tundra, taiga, peatlands, and wetlands in unprecedented detail. The ABoVE AVIRIS dataset comprises ~1700 individual flight lines covering ~120,000 km 2 with nominal 5 m × 5 m spatial resolution. Data include individual transects to capture important gradients like the tundra-taiga ecotone and maps of up to 10,000 km 2 for key study areas like the Mackenzie Delta. The ABoVE AVIRIS surveys enable diverse ecosystem science, provide crucial benchmark data for validating retrievals from the PACE, PRISMA, and EnMAP satellite sensors and help prepare for the SBG and CHIME missions. This paper guides interested researchers to fully explore the ABoVE AVIRIS spectral imagery and complements our guide to the ABoVE airborne synthetic aperture radar surveys.

Miller, Charles E. [California Institute of Techno↗

Evaluation of the response to electrons and pions in the scintillating fiber and lead calorimeter for the future electron-ion collider

The performance of the Baby Barrel Electromagnetic Calorimeter (Baby BCAL) — a small-scale lead-scintillating-fiber (Pb/ScFi) prototype of the GlueX Barrel Electromagnetic Calorimeter (BCAL) — was tested in a dedicated beam campaign at the Fermilab Test Beam Facility (FTBF). This study provides a benchmark for the Pb/ScFi component of the future Barrel Imaging Calorimeter (BIC) in the ePIC detector at the Electron-Ion Collider (EIC). The detector response to electrons and pions was studied at beam energies between 4 and 10 GeV, extending previous GlueX tests to a higher energy regime. The calibrated detector exhibits good linearity within uncertainties, and its electron energy resolution meets EIC requirements. The data further constrain the constant term in the energy resolution to below 1.9%, improving upon previous constraints at lower energies. Simulations reproduce key features of the electron and pion data within the limitations of the collected dataset and the FTBF test environment. Electron-pion separation in the test beam setup was analyzed using multiple methods, incorporating varying degrees of beam-related effects. The inclusion of longitudinal shower profile information enhanced the separation performance, underscoring its relevance for the full-scale BIC in ePIC. These results provide essential benchmarks for the Pb/ScFi section of the future BIC, validating detector simulations and guiding optimization strategies for electron-pion discrimination.

47 OTHER INSTRUMENTATION↗

Dispersion Validation for Flow Involving a Large Structure Revisited: 45 Degree Rotation

The atmospheric dispersion of contaminants in the wake of a large urban structure is a challenging fluid mechanics problem of interest to the scientific and engineering communities. Magnetic Resonance Velocimetry (MRV) and Magnetic Resonance Concentration (MRC) are relatively new techniques that leverage diagnostic equipment used primarily by the medical field to make 3D engineering measurements of flow and contaminant dispersal. SIERRA/Fuego, a computational fluid dynamics (CFD) code at Sandia National Labs is employed to make detailed comparisons to the dataset to evaluate the quantitative and qualitative accuracy of the model. This work is the second in a series of scenarios. In the prior work, a single large building in an array of similar buildings was considered with the wind perpendicular to a building face. In this work, the geometry is rotated by 45 degrees and improved studies are performed for simulation credibility. The comparison exercise shows conditionally good comparisons between the model and experiment. Model uncertainties are assessed through parametric variations. Various methods of quantifying the accuracy between experiments and data are examined Three-dimensional analysis of accuracy is performed. The effort helped identify deficiencies in the techniques used to make these comparisons, and further methods development therefore becomes one of the main recommendations for follow-on work.

42 ENGINEERING↗

Transient Deformation in Additively Manufactured 316L Stainless Steel Lattices Characterized with in-situ X-ray Phase Contrast Imaging: The Complete Dataset for Three Geometrical Lattices

Metallic lattice structures are being considered for shock mitigation applications due to their superior mechanical properties, energy absorption capability and lightweight characteristics inherent of the additive manufacturing process. In this study, shock compression experiments coupled to x-ray phase contrast imaging (PCI) were conducted on 316L stainless steel lattices. Meso-scale simulations incorporating the as-built lattice structure characterized by computed tomography were used to simulate PCI radiographs in CTH for direct comparison to experimental data. The methodology presented here offers robust validation for constitutive properties to further our understanding of lattice compaction at application-relevant strain rates.

36 MATERIALS SCIENCE↗

PV inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 20 kW off-the-shelf grid following PV inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Due to the limitations of the DC supply used, inverter is tested under 75%, 50%, 25% load conditions (This dataset does not contain 100% load condition). In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.88 to 1.09 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59.4 Hz to 60.45 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Validating deep learning inference during chest X-ray classification for COVID-19 screening

Abstract The new coronavirus unleashed a worldwide pandemic in early 2020, and a fatality rate several times that of the flu. As the number of infections soared, and capabilities for testing lagged behind, chest X-ray (CXR) imaging became more relevant in the early diagnosis and treatment planning for patients with suspected or confirmed COVID-19 infection. In a few weeks, proposed new methods for lung screening using deep learning rapidly appeared, while quality assurance discussions lagged behind. This paper proposes a set of protocols to validate deep learning algorithms, including our ROI Hide-and-Seek protocol, which emphasizes or hides key regions of interest from CXR data. Our protocol allows assessing the classification performance for anomaly detection and its correlation to radiological signatures, an important issue overlooked in several deep learning approaches proposed so far. By running a set of systematic tests over CXR representations using public image datasets, we demonstrate the weaknesses of current techniques and offer perspectives on the advantages and limitations of automated radiography analysis when using heterogeneous data sources.

59 BASIC BIOLOGICAL SCIENCES↗

Phylometagenomics of cycad coralloid roots reveals shared symbiotic signals

Cycads are known to host symbiotic cyanobacteria, includingNostocalesspecies, as well as other sympatric bacterial taxa within their specialized coralloid roots. Yet, it is unknown if these bacteria share a phylogenetic origin and/or common genomic functions that allow them to engage in facultative symbiosis with cycad roots. To address this, we obtained metagenomic sequences from 39 coralloid roots sampled from diverse cycad species and origins in Australia and Mexico. Culture-independent shotgun metagenomic sequencing was used to validate sub-community co-cultures as an efficient approach for functional and taxonomic analysis. Our metanalysis shows a host-independent microbiome core consisting of seven bacterial orders with high species diversity within the identified taxa. Moreover, we recovered 43 cyanobacterial metagenome-assembled genomes, and in addition toNostocspp., symbiotic cyanobacteria of the genusAulosirawere identified for the first time. Using this robust dataset, we used phylometagenomic analysis to reveal three monophyletic cyanobiont clades, two host-generalist and one cycad-specific that includesAulosiraspp. Although the symbiotic clades have independently arisen, they are enriched in certain functional genes, such as those related to secondary metabolism. Furthermore, the taxonomic composition of associated sympatric bacterial taxa remained constant. Our research quadruples the number of cycad cyanobiont genomes and provides a robust framework to decipher cyanobacterial symbioses, with the potential of improving our understanding of symbiotic communities. This study lays a solid foundation to harness cyanobionts for agriculture and bioprospection, and assist in conservation of critically endangered cycads.

Genetics & Heredity↗

5-minute Wind Power Data based on WFIP2 WRF Simulation

The second Wind Forecast Improvement Project (WFIP2) was a public-private partnership funded by the U.S. Department of Energy and NOAA, aimed at enhancing the forecast skill of numerical weather prediction models for turbine-height winds in regions with complex terrain. An 18-month Weather Research and Forecasting (WRF) model simulation was conducted over the Pacific Northwest, with model outputs validated against observational data collected during WFIP2. Simulated wind speeds were used to estimate wind power generation using reV (the Renewable Energy Potential Model developed by NREL) at ten wind project sites. Two sets of results were produced: one using wind speeds extracted from the model grid cell at the project centroid, and another using wind speeds from the actual turbine locations. For each dataset, power output was calculated using both actual turbine-specific power curves and nine generic power curves to convert wind speed into power.

17 WIND ENERGY↗

A Predictive Approach to Eliminating Errors in Software Code

NASA s Metrics Data Program Data Repository is a database that stores problem, product, and metrics data. The primary goal of this data repository is to provide project data to the software community. In doing so, the Metrics Data Program collects artifacts from a large NASA dataset, generates metrics on the artifacts, and then generates reports that are made available to the public at no cost. The data that are made available to general users have been sanitized and authorized for publication through the Metrics Data Program Web site by officials representing the projects from which the data originated. The data repository is operated by NASA s Independent Verification and Validation (IV&V) Facility, which is located in Fairmont, West Virginia, a high-tech hub for emerging innovation in the Mountain State. The IV&V Facility was founded in 1993, under the NASA Office of Safety and Mission Assurance, as a direct result of recommendations made by the National Research Council and the Report of the Presidential Commission on the Space Shuttle Challenger Accident. Today, under the direction of Goddard Space Flight Center, the IV&V Facility continues its mission to provide the highest achievable levels of safety and cost-effectiveness for mission-critical software. By extending its data to public users, the facility has helped improve the safety, reliability, and quality of complex software systems throughout private industry and other government agencies. Integrated Software Metrics, Inc., is one of the organizations that has benefited from studying the metrics data. As a result, the company has evolved into a leading developer of innovative software-error prediction tools that help organizations deliver better software, on time and on budget.

Source record↗

Lake Anna Water Resources: Using NASA Earth Observations to Identify Algal Event Risk Factors in Lake Anna and Help Inform Future Management Practices

Lake Anna is a man-made reservoir and popular recreation destination that spans over 13,000 acres-9,600 public and 3,400 private-in the Piedmont region of Virginia. The Lake has recently seen a rise in documented harmful algal blooms (HABs), which pose a variety of community and ecological concerns and are often exacerbated by anthropogenic factors, such as excess nutrient loads from agricultural runoff. NASA DEVELOP has partnered with the Virginia Department of Environmental Quality (DEQ) to help monitor cyanobacteria and nutrient pollution indicators across Lake Anna. The team utilized Earth observations (EO) and in situ ancillary data to identify and monitor algal bloom trends. The team used Landsat 8 Operational Land Imager (OLI), Landsat 9 OLI-2, Sentinel-2 Multispectral Instrument (MSI), and Sentinel-3 Ocean and Land Color Instrument (OLCI) to analyze water quality variables such as chlorophyll-a, turbidity, surface temperature, and cyanobacteria. Due to the lack of comprehensive in situ data and historic HAB event records, our ability to compare and validate EOs was limited. Additionally, deficient spatial resolutions, along with a geographically complicated shoreline, accentuated the spatial constraints we faced in our analysis. After examining EOs, our results indicated conditions conducive to the formation of HABs within the upper reaches of Lake Anna. Yet, spatially dependent limiting factors may have also influenced where these phenomena developed. When used in concert with existing in situ datasets, NASA EOs provide relevant stakeholders with more comprehensive analyses with which to engage in enhanced monitoring and watershed management.

cyanobacteria↗

Coupled Air Quality and Boundary-Layer Meteorology in Western U.S. Basins during Winter: Design and Rationale for a Comprehensive Study

The wintertime episodes of high aerosol concentrations occur frequently in urban and agricultural basins and valleys worldwide. These episodes often arise following development of persistent cold-air pools (PCAPs) that limit mixing and modify chemistry. While field campaigns targeting either basin meteorology or wintertime pollution chemistry have been conducted, coupling between interconnected chemical and meteorological processes remains an insufficiently studied research area. Gaps in understanding the coupled chemical–meteorological interactions that drive high-pollution events make identification of the most effective air-basin specific emission control strategies challenging. To address this, a September 2019 workshop occurred with the goal of planning a future research campaign to investigate air quality in western U.S. basins. Approximately 120 people participated, representing 50 institutions and five countries. Workshop participants outlined the rationale and design for a comprehensive wintertime study that would couple atmospheric chemistry and boundary layer and complex-terrain meteorology within western U.S. basins. Participants concluded the study should focus on two regions with contrasting aerosol chemistry: three populated valleys within Utah (Salt Lake, Utah, and Cache Valleys) and the San Joaquin Valley in California. This paper describes the scientific rationale for a campaign that will acquire chemical and meteorological datasets using airborne platforms with extensive range, coupled to surface-based measurements focusing on sampling within the near-surface boundary layer, and transport and mixing processes within this layer, with high vertical resolution at a number of representative sites. No prior wintertime basin-focused campaign has provided the breadth of observations necessary to characterize the meteorological–chemical linkages outlined here, nor to validate complex processes within coupled atmosphere–chemistry models.

54 ENVIRONMENTAL SCIENCES↗

High-Temperature Gas-Cooled Reactor Research Survey and Overview: Preliminary Data Platform Construction for the Nuclear Energy University Program

Since the U.S. Department of Energy Office of Nuclear Energy initiated the Nuclear Energy University Program (NEUP) in 2009, there are 29 NEUP projects focusing on high-temperature gas-cooled reactor (HTGR) research up to July 2022. The resultant research product, either experimental or computational, were published as final NEUP reports, journal articles and conference proceedings. However, these federally funded products have been scattered and sometimes cannot be easily accessed. To improve access to this valuable HTGR validation data and optimize the return on the significant investment made by the Department of Energy, the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program started a survey of completed and ongoing HTGR NEUP projects to develop a public-access database specific for HTGRs applications that can be used to retrieve computational fluid dynamics and system code validation data. This effort will help guide future NEUP-funded research, define new state of the ART Phenomena Identification and Ranking Table (PIRT), and promote the usage of this data in the codes validation matrices. This report provides an overview of the NEUP-funded HTGR-related research projects from Fiscal Year (FY) 2009–2021 and identifies validation knowledge gaps still existing in HTGR thermal-fluid research. A preliminary data platform has been developed for the 29 NEUP projects investigating HTGR thermal hydraulics, including their final reports as well as the available scientific publications. As an ultimate goal for this work, the ART-GCR program will create a central database at Idaho National Laboratory to identify, organize, and store these datasets generated by experimental investigations or computational models, experimental facility descriptions, and publicly-available academic products from the HTGR-related NEUP projects and provide future guidance for the storage and transmission of important project documentations for later NEUP projects as well.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The development of rainfall retrievals from radar at Darwin

Abstract. The U.S. Department of Energy Atmospheric Radiation Measurement program Tropical Western Pacific site hosted a C-band polarization (CPOL) radar in Darwin, Australia. It provides 2 decades of tropical rainfall characteristics useful for validating global circulation models. Rainfall retrievals from radar assume characteristics about the droplet size distribution (DSD) that vary significantly. To minimize the uncertainty associated with DSD variability, new radar rainfall techniques use dual polarization and specific attenuation estimates. This study challenges the applicability of several specific attenuation and dual-polarization-based rainfall estimators in tropical settings using a 4-year archive of Darwin disdrometer datasets in conjunction with CPOL observations. This assessment is based on three metrics: statistical uncertainty estimates, principal component analysis (PCA), and comparisons of various retrievals from CPOL data. The PCA shows that the variability in R can be consistently attributed to reflectivity, but dependence on dual-polarization quantities was wavelength dependent for 1 10mmh-1. Rainfall estimates during these conditions primarily originate from deep convective clouds with median drop diameters greater than 1.5 mm. An uncertainty analysis and intercomparison with CPOL show that a Colorado State University blended technique for tropical oceans, with modified estimators developed from video disdrometer observations, is most appropriate for use in all cases, such as when 1 10mmh-1 (deeper convective rain).

54 ENVIRONMENTAL SCIENCES↗

Doppler spectra from ARM Doppler Lidar during ARMing the Edge

There is a need for long-term observations of cloud and precipitation fall speeds in validating and improving rainfall forecasts from climate models. To this end, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility Southern Great Plains (SGP) site at Lamont, Oklahoma, hosts five ARM Doppler lidars that can measure cloud and aerosol properties. In particular, the ARM Doppler lidars record Doppler spectra that contain information about the fall speeds of cloud and precipitation particles. In this dataset, we provide the Doppler spectra from the ARM Doppler lidar at C1 recorded in April 2022 during ARMing the Edge.

54 ENVIRONMENTAL SCIENCES↗

Statistical Evaluation of Combined Daily Gauge Observations and Rainfall Satellite Estimations over Continental South America

This paper describes a comprehensive assessment of a new high-resolution, high-quality gauge-satellite based analysis of daily precipitation over continental South America during 2004. This methodology is based on a combination of additive and multiplicative bias correction schemes in order to get the lowest bias when compared with the observed values. Inter-comparisons and cross-validations tests have been carried out for the control algorithm (TMPA real-time algorithm) and different merging schemes: additive bias correction (ADD), ratio bias correction (RAT) and TMPA research version, for different months belonging to different seasons and for different network densities. All compared merging schemes produce better results than the control algorithm, but when finer temporal (daily) and spatial scale (regional networks) gauge datasets is included in the analysis, the improvement is remarkable. The Combined Scheme (CoSch) presents consistently the best performance among the five techniques. This is also true when a degraded daily gauge network is used instead of full dataset. This technique appears a suitable tool to produce real-time, high-resolution, high-quality gauge-satellite based analyses of daily precipitation over land in regional domains.

Vila, Daniel↗

Use of ILTV Control Laws for LaNCETS Flight Research

A report discusses the Lift and Nozzle Change Effects on Tail Shock (LaNCETS) test to investigate the effects of lift distribution and nozzle-area ratio changes on tail shock strength of an F-15 aircraft. Specific research objectives are to obtain inflight shock strength for multiple combinations of nozzle-area ratio and lift distribution; compare results with preflight prediction tools; and update predictive tools with flight results. The objectives from a stability and control perspective are to ensure adequate aircraft stability for the changes in lift distribution and plume shape, and ensure manageable transient from engaging and disengaging the ILTV research control laws. In order to change the lift distribution and plume shape of the F-15 aircraft, a decade-old Inner Loop Thrust Vectoring (ILTV) research control law was used. Flight envelope expansion was performed for the test configuration and flight conditions prior to the probing test points. The approach for achieving the research objectives was to utilize the unique capabilities of NASA's NF-15B-837 aircraft to allow the adjustment of the nozzle-area ratio and/or canard positions by engaging the ILTV research control laws. The ILTV control laws provide the ability to add trim command biases to canard positions, nozzle area ratios, and thrust vectoring through the use of datasets. Datasets consist of programmed test inputs (PTIs) that define trims to change the nozzle-area ratio and/or canard positions. The trims are applied as increments to the normally commanded positions. A LaNCETS non-linear, six-degrees-of-freedom simulation capable of realtime pilot-in-the-loop, hardware-in-the-loop, and non-real-time batch support was developed and validated. Prior to first flight, extensive simulation analyses were performed to show adequate stability margins with the changes in lift distribution and plume shape. Additionally, engagement/disengagement transient analysis was also performed to show manageable transients.

Moua, Cheng↗

Global Validation of Columnar Water Vapor Derived from EOS MODIS-MAIAC Algorithm Against the Ground-Based AERONET Observations

The water vapor is a relevant greenhouse gas in the Earth's climate system, and satellite products become one of the most effective way to characterize and monitor the columnar water vapor (CWV) content at global scale. Recently, a new product (MCD19) was released as part of MODIS (Moderate Resolution Imaging Spectroradiometer) Collection 6 (C6). This operational product from the Multi-Angle Implementation for Atmospheric Correction (MAIAC) algorithm includes a high 1-kilometer resolution CWV retrievals. This study presents the first global validation of MAIAC C6 CWV obtained from MODIS MCD19A2 product. This evaluation was performed using Aerosol Robotic Network (AERONET) observations at 265 sites (2000-2017). Overall, the results show a good agreement between MAIAC/AERONET CWV retrievals, with correlation coefficient higher than 0.95 and RMS (Root Mean Square) error lower than 0.250 centimeters. The binned error analysis revealed an underestimation (approximately 10 percent) of Aqua CWV retrievals with negative bias for CWV higher than 3.0 centimeters. In contrast, Terra CWV retrievals show a slope of regression close to unity and a low mean bias of 0.075 centimeters. While the accuracy is relatively similar between 1.0 and 5.0 centimeters for both sensor products, Terra dataset is more reliable for applications in humid tropical areas (less than 5.0 centimeters). The expected error was defined as plus or minus 15 percent, with less than 68 percent of retrievals falling within this envelope. However, the accuracy is regionally dependent, and lower error should be expected in some regions, such as South America and Oceania. Since MODIS instruments have exceeded their design lifetime, time series analysis was also presented for both sensor products. The temporal analysis revealed a systematic offset of global average between Terra and Aqua CWV records. We also found an upward trend (approximately 0.2 centimeters per decade) in Terra CWV retrievals, while Aqua CWV retrievals remain stable over time. The sensor degradation influences the ability to detect climate signals, and this study indicates the need for revisiting calibration of the MODIS bands 17-19, mainly for Terra instrument, to assure the quality of the MODIS water vapor product. Finally, this study presents a comprehensive validation analysis of MAIAC CWV over land, raising the understanding of its overall quality.

MAIAC↗