Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data normalization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Measuring impacts of California agri-environmental programs using field-scale satellite data

In the past decade, California has invested over $\$$200 million in direct grants to growers to support the adoption of agricultural practices that save water and/or improve soil health while also reducing greenhouse gas emissions. Ex-post evaluation of agri-environmental outcomes of these grant programs, however, is limited. We use satellite data to monitor changes in field-level consumptive water use and greenness (i.e. normalized difference vegetation index), a proxy for agricultural productivity, for the most frequently funded crop-types (almonds, grapes, and walnuts) in two California Department of Food and Agriculture programs. Nearly 600 fields receiving funding during the 2014–2022 period were analyzed using two causal inference methods. Fields that received grants to both upgrade irrigation systems and install irrigation water management sensors showed reduced consumptive water use and greenness by an average of 3.5% and 4.2%, respectively (significant at the 10% level). In contrast, we find that the adoption of only irrigation water management sensors, which are designed to inform irrigation scheduling and management, resulted in an average increase of 4.1% and 4.8% in consumptive water use and greenness respectively (significant at the 5% level). We find negligible effects for either consumptive water use or greenness when both pump efficiency upgrades and sensors were implemented. We further find that grants for compost addition and cover cropping led to small greenness increases of 1.7% and 2.8% respectively (significant at the 10% level) and had insignificant effects on consumptive water use. Our analysis of five agri-environmental program interventions reveals that several practice outcomes may be at odds with stated program goals of reducing water use while maintaining or improving agricultural productivity.

agriculture↗
DOE OSTI2025

Data from a throughfall exclusion experiment: Fine root dynamics, morphology, chemistry, and AMF colonization across four lowland Panamanian forests

Fine roots regulate forest nutrient, carbon, and water cycling, yet their variation within and among tropical forests remains under-characterized. We quantified root productivity, disappearance, and stocks to 1 m using minirhizotron imaging, and we measured morphology, elemental composition [root carbon (C), root nitrogen (N), root phosphorus (P)], and arbuscular mycorrhizal fungi (AMF) colonization to 20 cm using ingrowth cores and sequential coring. Sampling took place in four distinct lowland Panamanian forests (32 plots; 8 per forest) from 2018 through 2022 under control and throughfall-exclusion (drought) treatments in the Panama Rainforest Changes with Experimental Drying (PARCHED) experiment.The dataset is presented as an Excel workbook with six tabs. The first tab is the data dictionary. Tab S1 contains ingrowth-core production and mortality, morphology and soil moisture. Tab S2 contains sequential-coring standing stocks with associated morphology and soil moisture. Tab S3 contains minirhizotron row data records to 1 m depth, including per-frame root length and diameter, normalized length metrics, and session timing. Tab S4 contains AMF colonization. Tab S5 contains fine-root chemistry at 0–10 cm, reporting %P, %C, %N, and C:N for samples collected via ingrowth cores and sequential-coring standing stocks. CSV mirrors for each tab are provided, and a KML file supplies coordinates for all 32 plots.Key variables span live and dead fine-root biomass (and coarse fractions where applicable), specific root length (SRL) and area (SRA), diameter, root tissue density (RTD), soil moisture, AMF colonization, root %N, %C, %P, and C:N, along with minirhizotron root length and diameter. Depth, season, treatment, and plot/site identifiers are included to support cross-tab integration and analysis from 0–100 cm (minirhizotron) and 0–20 cm (cores).Units are reported in-column and missing values are coded as NA. No special software is required to open or use the files (Excel, CSV, and KML compatible).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

SPRUCE Whole Ecosystem Warming (WEW) Environmental Data and Water Table Summaries, Marcell Experimental Forest, Minnesota, 2015-2024

This data set contains observations of photosynthetically active radiation (PAR), precipitation, soil temperature, soil volumetric water content, air temperature, relative humidity, and normalized water table depth that are summarized on a daily, weekly, monthly, and annual basis for each of the SPRUCE plots. Observations span 2015-2024. This dataset draws on several datasets (Hanson et al. 2016; Hanson et al. 2020; and Warren, unpublished data) and compiles these environmental observations into useful formats for data analysis. These environmental metrics can be used to understand the environmental conditions inside SPRUCE environmental chambers throughout the durations of the experiment and can be paired with other data for modeling and analysis. R code used to generate these files is provided as part of the data package. This dataset contains four data files in comma separate (.csv) format and a compressed folder (*.zip) containing three R (*.r) scripts. Additional metadata are provided: one data dictionary and a file-level metadata file in comma separate (.csv) format and a user guide in PDF (*.pdf) format. User note: Users must cite the original dataset/s along with this dataset when publishing any analyses using this dataset. Details on the dataset used to compile each variable are available in the header row of the files and in the user guide.

air temperature↗
DOE OSTI2024

ML-based calibration and control of the GlueX Central Drift Chamber

The GlueX Central Drift Chamber (CDC) in Hall D at Jefferson Lab, used for detecting and tracking charged particles, is calibrated and controlled during data taking using a Gaussian process. The system dynamically adjusts the high voltage applied to the anode wires inside the chamber in response to changing environmental and experimental conditions such that the gain is stabilized. Control policies have been established to manage the CDC's behavior. These policies are activated when the model's uncertainty exceeds a configurable threshold or during human-initiated tests during normal production running. Finally, we demonstrate the system reduces the time detector experts dedicate to calibration of the data offline, leading to a marked decrease in computing resource usage without compromising detector performance.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

The 3D Lyman- α forest power spectrum from eBOSS DR16

We measure the three-dimensional power spectrum (P3D) of the transmitted flux in the Lyman-α (Ly α) forest using the complete extended Baryon Oscillation Spectroscopic Survey data release 16 (eBOSS DR16). This sample consists of ~205 000 quasar spectra in the redshift range 2 ≤ z ≤ 4 at an effective redshift z = 2.334. We propose a pair-count spectral estimator in configuration space, weighting each pair by exp( i k ∙ r), for wave vector k and pixel pair separation r, effectively measuring the anisotropic power spectrum without the need for fast Fourier transforms. This accounts for the window matrix in a tractable way, avoiding artefacts found in Fourier-transform based power spectrum estimators due to the sparse sampling transverse to the line of sight of Ly α skewers. We extensively test our pipeline on two sets of mocks: (i) idealized Gaussian random fields with a sparse sampling of Ly α skewers, and (ii) log-normal LyaCoLoRe mocks including realistic noise levels, the eBOSS survey geometry and contaminants. On eBOSS DR16 data, the Kaiser formula with a non-linear correction term obtained from hydrodynamic simulations yields a good fit to the power spectrum data in the range $(0.02 ≤ k ≤ 0.35)$ h Mpc -1 at the 1–2σ level with a covariance matrix derived from LyaCoLoRe mocks. We demonstrate a promising new approach for full-shape cosmological analyses of Ly α forest data from cosmological surveys such as eBOSS, the currently observing Dark Energy Spectroscopic Instrument and future surveys such as the Prime Focus Spectrograph, WEAVE-QSO, and 4MOST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Real-Time Anomaly Detection for Searches Beyond the Standard Model in the ProtoDUNE Horizontal Drift Detector

This paper summarizes work conducted throughout a SULI internship at Fermi National Accelerator Laboratory focused on building an unsupervised machine learning model for real-time anomaly detection in ProtoDUNE Horizontal Drift. Using simulated data, we trained an autoencoder model on a pure cosmic dataset, and evaluated it on both cosmic and neutrino events—making the model an anomaly detector. The goal was to make a model which matches or exceeds the current ADC Simple Window trigger algorithm so that our model can perform at the same rate but provide sensitivity to potential beyond-the-Standard-Model (BSM) signatures. In the end, we were able to construct a model which slightly exceeds the capabilities of the ADC Simple Window while remaining completely unsupervised, achieving 31.9 ± 0.2% (26.6 ± 0.2%) ν efficiency at 5 Hz (2 Hz), a 3.6 (3.2) percentage point increase. Additionally, 17.5 ± 0.3% (18.3 ± 0.3%) of the events that passed the autoencoder at 5 Hz (2 Hz) were missed by the current trigger algorithm. Future work will investigate alternative normalization methods, including quantile transformation, and evaluate the model on ProtoDUNE-HD detector-glitch data if that data becomes available.

Wilson, C. [Cincinnati U., RWC]↗
DOE OSTI2026

Real-Time Anomaly Detection for Beyond Standard Model Searches in ProtoDUNE Horizontal Drift

This paper summarizes work conducted throughout a SULI internship at Fermi National Accelerator Laboratory focused on building an unsupervised machine learning model for real-time anomaly detection in ProtoDUNE Horizontal Drift. Using simulated data, we trained an autoencoder model on a pure cosmic dataset, and evaluated it on both cosmic and neutrino events---making the model an anomaly detector. The goal was to make a model which matches or exceeds the current ADC Simple Window trigger algorithm so that our model can perform at the same rate but provide sensitivity to potential beyond-the-Standard-Model (BSM) signatures. In the end, we were able to construct a model which slightly exceeds the capabilities of the ADC Simple Window while remaining completely unsupervised, achieving $31.9 \pm 0.2$\% ($26.6 \pm 0.2$\%) $\nu$ efficiency at 5 Hz (2 Hz), a 3.6 (3.2) percentage point increase. Additionally, $17.5 \pm 0.3$\% ($18.3 \pm 0.3$\%) of the events that passed the autoencoder at 5 Hz (2 Hz) were missed by the current trigger algorithm. Future work will investigate alternative normalization methods, including quantile transformation, and evaluate the model on ProtoDUNE-HD detector-glitch data if that data becomes available.

Wilson, Cameron C. [Cincinnati U., RWC]↗
DOE OSTI2026

Real-Time Anomaly Detection for Beyond Standard Model Searches in ProtoDUNE Horizontal Drift

This paper summarizes work conducted throughout a SULI internship at Fermi National Accelerator Laboratory focused on building an unsupervised machine learning model for real-time anomaly detection in ProtoDUNE Horizontal Drift. Using simulated data, we trained an autoencoder model on a pure cosmic dataset, and evaluated it on both cosmic and neutrino events---making the model an anomaly detector. The goal was to make a model which matches or exceeds the current ADC Simple Window trigger algorithm so that our model can perform at the same rate but provide sensitivity to potential beyond-the-Standard-Model (BSM) signatures. In the end, we were able to construct a model which slightly exceeds the capabilities of the ADC Simple Window while remaining completely unsupervised, achieving $31.9 \pm 0.2$\% ($26.6 \pm 0.2$\%) $\nu$ efficiency at 5 Hz (2 Hz), a 3.6 (3.2) percentage point increase. Additionally, $17.5 \pm 0.3$\% ($18.3 \pm 0.3$\%) of the events that passed the autoencoder at 5 Hz (2 Hz) were missed by the current trigger algorithm. Future work will investigate alternative normalization methods, including quantile transformation, and evaluate the model on ProtoDUNE-HD detector-glitch data if that data becomes available.

Wilson, Cameron C. [Cincinnati U., RWC]↗
DOE OSTI2024

Human limits in machine learning: prediction of potato yield and disease using soil microbiome data

Abstract Background The preservation of soil health is a critical challenge in the 21st century due to its significant impact on agriculture, human health, and biodiversity. We provide one of the first comprehensive investigations into the predictive potential of machine learning models for understanding the connections between soil and biological phenotypes. We investigate an integrative framework performing accurate machine learning-based prediction of plant performance from biological, chemical, and physical properties of the soil via two models: random forest and Bayesian neural network. Results Prediction improves when we add environmental features, such as soil properties and microbial density, along with microbiome data. Different preprocessing strategies show that human decisions significantly impact predictive performance. We show that the naive total sum scaling normalization that is commonly used in microbiome research is one of the optimal strategies to maximize predictive power. Also, we find that accurately defined labels are more important than normalization, taxonomic level, or model characteristics. ML performance is limited when humans can’t classify samples accurately. Lastly, we provide domain scientists via a full model selection decision tree to identify the human choices that optimize model prediction power. Conclusions Our study highlights the importance of incorporating diverse environmental features and careful data preprocessing in enhancing the predictive power of machine learning models for soil and biological phenotype connections. This approach can significantly contribute to advancing agricultural practices and soil health management.

Aghdam, Rosa↗
DOE OSTI2024

Mapping domain structures near a grain boundary in a lead zirconate titanate ferroelectric film using X-ray nanodiffraction

The effect of an electric field on local domain structure near a 24° tilt grain boundary in a 200 nm-thick Pb(Zr 0.2 Ti 0.8 )O 3 bi-crystal ferroelectric film was probed using synchrotron nanodiffraction. The bi-crystal film was grown epitaxially on SrRuO 3 -coated (001) SrTiO 3 24° tilt bi-crystal substrates. From the nanodiffraction data, real-space maps of the ferroelectric domain structure around the grain boundary prior to and during application of a 200 kV cm −1 electric field were reconstructed. In the vicinity of the tilt grain boundary, the distributions of densities of c -type tetragonal domains with the c axis aligned with the film normal were calculated on the basis of diffracted intensity ratios of c - and a -type domains and reference powder diffraction data. Diffracted intensity was averaged along the grain boundary, and it was shown that the density of c -type tetragonal domains dropped to ∼50% of that of the bulk of the film over a range ±150 nm from the grain boundary. This work complements previous results acquired by band excitation piezoresponse force microscopy, suggesting that reduced nonlinear piezoelectric response around grain boundaries may be related to the change in domain structure, as well as to the possibility of increased pinning of domain wall motion. The implications of the results and analysis in terms of understanding the role of grain boundaries in affecting the nonlinear piezoelectric and dielectric responses of ferroelectric materials are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Integration of GOES Data for Solar Resource Assessment of the Contiguous United States

The National Solar Radiation Database (NSRDB), produced by the National Laboratory of the Rockies (NLR), provides high-resolution solar resource data for the contiguous United States (CONUS) using Geostationary Operational Environmental Satellite (GOES) East and West observations. This study evaluates the integration of multi-satellite data within the GOES-East/West overlap regions, where conventional longitude-based selection methods often produce an artificial boundary seam. Our results demonstrate that an advanced blending algorithm, which incorporates sun-satellite scattering angles and satellite viewing zenith angles, improves NSRDB accuracy and creates a spatially continuous dataset. Validation against ground-based irradiance measurements reveals reductions in both percentage error (PE) and normalized Root Mean Square Error (nRMSE), particularly in the central United States. The dynamical integration of multi-satellite data provides a robust foundation for more precise modeling of solar resource and improved spatiotemporal analysis of solar ramp across the CONUS.

14 SOLAR ENERGY↗
DOE OSTI2025

Spin-phonon coupling in AFM transition-metal mono-oxide

Time-of-flight INS measurements were performed on single crystal NiO with the Wide Angular Range Chopper Spectrometer (ARCS) at the Spallation Neutron Source. Experiments were performed on NiO single crystal mounted in an aluminum can and cooled using a closed-cycle helium refrigerator. Measurements were conducted at T = 100 K and 650 K, with the [HHL] scattering plane aligned horizontally. A Fermi chopper with slit spacing of 1.52mm, spinning at 300 Hz, was used to select an incident neutron energy of 100 meV. All datasets were normalized to a vanadium standard to correct for detector efficiency and solid angle coverage. The data sets include the .nxs files, the generated .hdf5 files (for use with Phonon Explorer), and Python scripts used to create them.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Microseismicity Modulation Due To Changes in Geothermal Production at San Emidio, Nevada, USA

Brief cessations of geothermal production can induce seismicity, a phenomenon that has drawn increasing attention in recent years. Such observations are rare, and the underlying mechanism requires careful analysis. In April 2022, a dense seismic and hydrologic monitoring system was deployed at the San Emidio geothermal field, Nevada, to accompany a planned power plant shutdown. Using the dense seismic array data, we detected and located ∼1,800 microseismic events (MSEs) and developed a high-resolution tomographic P-wave velocity model. We observed substantially increased microseismicity during shutdown. Most MSEs occurred on pre-existing normal faults, which are contained within extremely low-velocity zones that are likely damaged, fluid-filled, and hydraulically connected to nearby production wells. Hydrologic data show rapid fluid pressure increases of <60 kPa following the shutdown. We suggest that the cessation of production rapidly increased fluid pressures along pre-existing fault zones, activating critically stressed fault patches and fractures and producing microseismicity.

Guo, Hao [University of Wisconsin-Madison, WI (Uni↗
DOE OSTI2025

DESI 2024 II: sample definitions, characteristics, and two-point clustering statistics

We present the samples of galaxies and quasars used for DESI 2024 cosmological analyses, drawn from the DESI Data Release 1 (DR1). We describe the construction of largescale structure (LSS) catalogs from these samples, which include matched sets of synthetic reference ‘randoms’ and weights that account for variations in the observed density of the samples due to experimental design and varying instrument performance. We detail how we correct for variations in observational completeness, the input ‘target’ densities due to imaging systematics, and the ability to confidently measure redshifts from DESI spectra. We then summarize how remaining uncertainties in the corrections can be translated to systematic uncertainties for particular analyses. We describe the weights added to maximize the signalto-noise of DESI DR1 2-point clustering measurements. We detail measurement pipelines applied to the LSS catalogs that obtain 2-point clustering measurements in configuration and Fourier space. The resulting 2-point measurements depend on window functions and normalization constraints particular to each sample, and we present the corrections required to match models to the data. We compare the configuration- and Fourier-space 2-point clustering of the data samples to that recovered from simulations of DESI DR1 and find they are, generally, in statistical agreement to within 2% in the inferred real-space over-density field. The LSS catalogs, 2-point measurements, and their covariance matrices will be released publicly with DESI DR1.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

High-Temperature Neutron Diffraction Study of Vanadium and Vanadium–Niobium Null-Matrix Alloy for Spectrum Normalization

This study systematically evaluates a vanadium–niobium (V 94.1 Nb 5.9 ) null-matrix alloy as a reference material for neutron spectrum normalization and compares its performance with that of pure vanadium under identical experimental conditions. Neutron diffraction experiments are conducted on the VULCAN Engineering Materials Diffractometer at the Spallation Neutron Source, Oak Ridge National Laboratory, over a temperature range from room temperature to 1200 °C under vacuum. Pure vanadium exhibited distinct Bragg peaks across all temperatures, with its diffraction behavior influenced by both sample orientation and temperature. As the temperature increased, the diffraction peaks shifted to larger d-spacings and decreased in intensity, while spectral deviation near d ≈ 2.8 Å exceeded 10% at 1200 °C. In contrast, the V–Nb alloy produced a nearly featureless spectrum over the full d-spacing range, confirming near-complete cancellation of coherent scattering over the wide temperature range. Its spectra were insensitive to sample orientation, temperature, and microstructural evolution, with spectral deviation around d ≈ 2.8 Å exceeded 5% at 1200 °C. In conclusion, these results demonstrate that the V–Nb null-matrix alloy provides a thermally stable, efficient, and reliable normalization standard for time-of-flight diffractometers or other instrument where it is needed, enabling reduced data acquisition time and improved data quality in high-temperature neutron diffraction experiments.

Alloys↗
DOE OSTI2024

Invertible Temper Modeling using Normalizing Flows and the Effects of Structure Preserving Loss

Advanced manufacturing research and development is typically small-scale, owing to costly experiments associated with these novel processes. Deep learning techniques could help accelerate this development cycle but frequently struggle in small-data regimes like the advanced manufacturing space. While prior work has applied deep learning to modeling visually plausible advanced manufacturing microstructures, little work has been done on data-driven modeling of how microstructures are affected by heat treatment, or assessing the degree to which synthetic microstructures are able to support existing workflows. We propose to address this gap by using invertible neural networks (normalizing flows) to model the effects of heat treatment, e.g., tempering. The model is developed using scanning electron microscope imagery from samples produced using shear-assisted processing and extrusion (ShAPE) manufacturing. This approach not only produces visually and topologically plausible samples, but also captures information related to a sample’s material properties or experimental process parameters. We also demonstrate that topological data analysis, used in prior work to characterize microstructures, can also be used to stabilize model training, preserve structure, and improve downstream results. We assess directions for future work and identify our approach as an important step towards end-to-end deep learning system for accelerating advanced manufacturing research and development.

Howland, Sylvia↗
DOE OSTI2025

Acceptance dependence of factorial cumulants, long-range correlations, and the antiproton puzzle

We analyze joint factorial cumulants of protons and antiprotons in relativistic heavy-ion collisions and point out that they obey the scaling Ĉnmp,p¯∝〈Np〉n〈Np¯〉m as a function of acceptance when only long-range correlations are present in the system, such as global baryon conservation and volume fluctuations. This hypothesis can be directly tested experimentally without the need for corrections for volume fluctuations. We show that if correlations among protons and antiprotons are driven by global baryon conservation and volume fluctuations only, the equality Ĉ2p/〈Np〉2=Ĉ2p¯/〈Np¯〉2 holds for large systems created in central collisions. We point out that the experimental data of the STAR Collaboration from phase I of the Relativistic Heavy Ion Collider (RHIC) beam energy scan (BES) are approximately consistent with the scaling Ĉnmp,p¯∝〈Np〉n〈Np¯〉m, but the normalized antiproton correlations are stronger than those of protons, −Ĉ2p¯/〈Np¯〉2>−Ĉ2p/〈Np〉2. Existing theoretical baselines, based on global baryon conservation and volume fluctuations, cannot explain the data, which we refer to as the antiproton puzzle. We also discuss high-order factorial cumulants which can be measured with sufficient precision within phase II of RHIC-BES.

Bzdak, Adam↗
DOE OSTI2024

Utah FORGE: Fluid Injection Induced Shearing Experiments on Fractured Granitoid at Elevated Temperatures

This repository contains experimental data from a series of fluid injection-induced shearing tests conducted on Utah FORGE granitoid. The experiments were performed using an aluminum triaxial pressure vessel (TEMCO) apparatus at Pennsylvania State University. The primary aim was to investigate the impact of temperature on fault seismicity and to explore how different pre-stress ratios influence shearing behavior. The data includes results from experiments conducted under varying conditions of temperature, pre-stress ratios, and pore pressure increments. The rock samples used in these experiments were 60-grit granitoid with a single inclined fracture oriented at 60 degrees with respect to the horizontal cross-section. The dataset also includes measurements of normal stiffness at different temperatures and images of the experimental apparatus. The included README file details each experiential setup and outlines which data files represent which experimental conditions.

15 GEOTHERMAL ENERGY↗