Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data harmonization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Harmonizing solar induced fluorescence across spatial scales, instruments, and extraction methods using proximal and airborne remote sensing: A multi-scale study in a soybean field

Solar-induced chlorophyll fluorescence (SIF) has been widely used to track vegetation photosynthesis at different scales ranging from in-situ measurements to satellite products. Airborne platforms sample SIF data at a spatial scale intermediate between in-situ and satellite, matching that of ground measurement (e.g. flux tower footprints and other field sampling), enabling us to explore causes of SIF variation and validate satellite-based SIF products. However, harmonizing SIF across sensors and platforms (correcting for systematic errors to yield a consistent, comparable SIF product) is challenging because SIF can be retrieved in different absorption windows, with different instruments and methods complicating the comparison between different observational levels (i.e., ground, airborne, satellites) and between sites equipped with different instruments with varying optical properties (spectral resolution and sampling intervals, spatial resolution). Additionally, the spatial and temporal variability of atmospheric properties can influence the retrieval of the weak SIF signal. Because of these complications, direct comparisons of airborne and ground SIF across scales are rarely attempted. Here, in this study, we combined airborne SIF data with simultaneous ‘ground truth’ data collected by stationary and mobile platforms in a soybean field in Nebraska, USA. In this effort, we tested several SIF extraction methods, including Fraunhofer Line Discrimination (FLD), improved Fraunhofer Line Discrimination (iFLD), Spectral Fitting Method (SFM), SpecFit, and a Singular Vector Decomposition (SVD) method. The SpecFit method was sensitive to the 715–740 nm water bands and removing the water bands in the fitting process yielded better agreement between the airborne and ground SIF spectra. Accurate estimation of the ground level downwelling irradiance obtained by ground measurements over a calibration target improved agreement between airborne and ground SIF retrievals at the O 2 A band, and allowed us to derive a SIF dataset with improved agreement across platforms and sampling scales. This experimental approach provided a method for generating comparable SIF signals across instruments, methods and platforms, which is critical to understanding the SIF-GPP relationship at different scales and to cross-validate the diversity of platforms used for satellite products calibration and validation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Azimuthal Correlations within Exclusive Dijets with Large Momentum Transfer in Photon-Lead Collisions

The structure of nucleons is multidimensional and depends on the transverse momenta, spatial geometry, and polarization of the constituent partons. Such a structure can be studied using high-energy photons produced in ultraperipheral heavy-ion collisions. The first measurement of the azimuthal angular correlations of exclusively produced events with two jets in photon-lead interactions at large momentum transfer is presented, a process that is considered to be sensitive to the underlying nuclear gluon polarization. This study uses a data sample of ultraperipheral lead-lead collisions at s NN = 5.02 TeV , corresponding to an integrated luminosity of 0.38 nb - 1 , collected with the CMS experiment at the LHC. The measured second harmonic of the correlation between the sum and difference of the two jet transverse momentum vectors is found to be positive, and rising, as the dijet transverse momentum increases. A well-tuned model that has been successful at describing a wide range of proton scattering data from the HERA experiments fails to describe the observed correlations, suggesting the presence of gluon polarization effects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Impacts of swinging door lossy compression of synchrophasor data

As the number of operational Phasor Measurement Units (PMUs) is increasing, compression is becoming crucial for efficiently transferring and storing enormous amount of synchrophasor data continuously measured from a power system. Some utilities in the U.S. have already adopted a nonlinear compression technique, called Swinging Door Algorithm (SDA), assuming compressed data meets technical and regulatory requirements without resulting in any degradation of the measurements. This paper studies impacts of this compression algorithm on field measured and simulated PMU data, and presents results from spectral analyses of raw and decompressed measurements. The results show blind application of the SDA compression alters frequency content in the measurements and introduces false harmonics and aliasing. These can lead to false conclusions being drawn from the measurements about the power system condition.

42 ENGINEERING↗
DOE OSTI2026

OC6 Phase III: Validation of Wind Turbine Aerodynamic Loading During Surge/Pitch Motion

The objective of Phase III of the Offshore Code Comparison Collaboration, Continued, with Correlation and unCertainty (OC6) project was to validate the accuracy of aerodynamic load predictions by offshore wind modeling tools for a floating offshore wind turbine as it experiences large surge-translational and pitch-rotational motion, as would occur during normal operation. The test data considered were generated at Politecnico di Milano – a wind tunnel with a robotic excitation system to emulate wave loading on the wind turbine. Testing was performed using a scaled version of the DTU 10-MW reference model, and motion was prescribed as harmonic oscillations in the surge and pitch directions, independently. A variety of models were examined in the project, performing a three-way validation between engineering-level tools, higher-fidelity tools, and measurement data from two wind tunnel experimental campaigns. The Load Cases (LC) considered in this testing are as follows: LC 1.X - Steady Wind LC 2.X - Unsteady Wind - Surge Motion LC 3.X - Unsteady Wind - Pitch Motion Details on the results of the OC6 Phase III campaign can be found in the following reference: Bergua R., et al. OC6 project Phase III: validation of the aerodynamic loading on a wind turbine rotor undergoing large motion caused by a floating support structure, Wind Energ. Sci., 8, 465–485, https://doi.org/10.5194/wes-8-465-2023, 2023.

17 WIND ENERGY↗
DOE OSTI2023

A Multi-Harmonic System Identification Method for Internal Circuit Element Monitoring

Many critical infrastructures depend on the reliability of electronic circuits, whose health depends on the values of internal circuit elements that degrade over time. It is therefore important to estimate the values of internal circuit elements from external measurements and monitor them for changes. The challenge to doing so is that, typically, the internal voltages and currents are not accessible for measurement. Prior work on internal circuit element monitoring uses data obtained from sensors placed inside the circuit or requires additional circuitry to be added to the given system, both of which are undesirable. We propose a new multi-harmonic frequency-domain based system identification method that is non-intrusive. It exploits the latent non-idealities already present in the system, specifically harmonics in the measured input and output signals. We show how sensitivity analysis can be used to both assess the accuracy of the method as well as to optimize the choice of harmonics to use. We use as a motivation and illustrative example the problem of determining the equivalent series resistance and capacitance in a class of dc-link capacitance circuits in Adjustable Speed Drives. We assess the performance of this method using simulations, and establish its validity by experimental results.

Deshpande, Ankit Vivek↗
DOE OSTI2020

Recent Development of Frequency Estimation Methods for Future Smart Grid

The frequency estimated by the Phasor Measurement Unit (PMU) is a critical index of power system status and supports many smart grid applications. The future smart grid features high penetration of renewables and more fast-moving power electronics inverters but raises challenges to the reliable frequency estimation. This article presents three methods to address these challenges. First, an enhanced zero-crossing algorithm was developed to track the fast-changing frequency in system dynamics. Second, we propose a technology that can tolerate the system transient and suppress the outliers. Third, an algorithm was developed to export high time-resolution frequency estimations with minimum computational effort. All of the proposed methods are realized in hardware and compared with classical frequency estimation methods. The testing results indicate that the proposed methods have excellent performance. They can be used in future PMUs and provide reliable and high time resolution data for smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Constraining low redshift [C II ] emission by cross-correlating FIRAS and BOSS data

ABSTRACT We perform a tomographic cross-correlation analysis of archival FIRAS data and the BOSS galaxy redshift survey to constrain the amplitude of [C II] 2P3/2 → 2P1/2 fine structure emission. Our analysis employs spherical harmonic tomography (SHT), which is based on the angular cross-power spectrum between FIRAS maps and BOSS galaxy over-densities at each pair of redshift bins, over a redshift range of 0.24 < z < 0.69. We develop the SHT approach for intensity mapping, where it has several advantages over existing power spectral estimators. Our analysis constrains the product of the [C II] bias and [C II] specific intensity, $b_{\rm [C \small{\rm II}]}I_{\rm [C \small{\rm II}]}$, to be <0.31 MJy/sr at z ≈ 0.35 and <0.28 MJy/sr at z ≈ 0.57 at $95{{\ \rm per\ cent}}$ confidence. These limits are consistent with most current models of the [C II] signal, as well as with higher-redshift [C II] cross-power spectrum measurements from the Planck satellite and BOSS quasars. We also show that our analysis, if applied to data from a more sensitive instrument such as the proposed PIXIE satellite, can detect pessimistic [C II] models at high significance.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Plastic additives in the ocean: Use of a comprehensive dataset for meta-analysis and method development

In excess of 13,000 chemicals are added to plastics (‘additives’) to improve performance, durability, and production of plastic products. They are categorized into numerous chemical classes including flame retardants, light stabilizers, antioxidants, and plasticizers. While research on plastic additives in the marine environment has increased over the past decade, there is a lack of methodological standardization. To direct future measurement of plastic additives, we compiled a first-of-its-kind dataset of literature assessing plastic additives in marine environments, delineated by sample type (plastic debris, seawater, sediment, biota). Using this dataset, we performed a meta-analysis to summarize the state of the science. Currently, our dataset includes 217 publications published between 1978 and May 2023. The majority of publications analyzed plastic additives in biota collected from Europe and Asia. Analyses concentrated on plasticizers, brominated flame retardants, and bisphenols. Common sample preparation techniques included Solvent - Agitation extraction for plastic, sediment, and biota samples, and Solid Phase Extraction for seawater samples with dichloromethane and solvent mixtures including dichloromethane as the organic extraction solvent. Finally, most analyses were performed utilizing gas chromatography/mass spectrometry. There are a variety of data gaps illuminated by this meta-analysis, most notably the small number of compounds that have been targeted for detection compared to the large number of additives used in plastic production. The provided dataset facilitates future investigation of trends in plastic additive concentration data in the marine environment (allowing for comparison to toxicity thresholds) and acts as a starting point for optimizing and harmonizing plastic additive analytical methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

On learning what to learn: Heterogeneous observations of dynamics and establishing possibly causal relations among them

Abstract Before we attempt to (approximately) learn a function between two sets of observables of a physical process, we must first decide what the inputs and outputs of the desired function are going to be. Here we demonstrate two distinct, data-driven ways of first deciding “the right quantities” to relate through such a function, and then proceeding to learn it. This is accomplished by first processing simultaneous heterogeneous data streams (ensembles of time series) from observations of a physical system: records of multiple observation processes of the system. We determine (i) what subsets of observables are common between the observation processes (and therefore observable from each other, relatable through a function); and (ii) what information is unrelated to these common observables, therefore particular to each observation process, and not contributing to the desired function. Any data-driven technique can subsequently be used to learn the input–output relation—from k-nearest neighbors and Geometric Harmonics to Gaussian Processes and Neural Networks. Two particular “twists” of the approach are discussed. The first has to do with the identifiability of particular quantities of interest from the measurements. We now construct mappings from a single set of observations from one process to entire level sets of measurements of the second process, consistent with this single set. The second attempts to relate our framework to a form of causality: if one of the observation processes measures “now,” while the second observation process measures “in the future,” the function to be learned among what is common across observation processes constitutes a dynamical model for the system evolution.

Sroczynski, David W.↗
DOE OSTI2025

EVs@Scale Next-Gen Profiles - Fleet Utilization 2024

As part of the U.S. Department of Energy’s EVs@Scale initiative, the Next-Gen Profiles (NGP) project provides a comprehensive, data-driven analysis of electric vehicle (EV) and electric vehicle supply equipment (EVSE) operations across real-world fleet deployments. This paper presents findings from the NGP’s Fleet Utilization study, which investigates operational behavior and asset usage across seventeen EV fleets and two EVSE fleets, encompassing a wide range of vehicle types and use cases. Data collected from diverse sources—varying in format and temporal resolution—are first reformatted into a unified structure. From this harmonized dataset, a suite of rigorously defined performance metrics is calculated at an hourly cadence, enabling consistent cross-comparison of charging, routing, and other key operational behaviors. Amid rapidly increasing EV adoption and growing demands for energy-efficient fleet operations, the analysis reveals clear utilization trends—including diurnal and weekly activity cycles, differences in short versus long charging session dependencies, and route-specific energy usage patterns. These findings highlight the need for tailored infrastructure strategies and the deployment of advanced energy management systems, such as Distributed Energy Resource Management Systems (DERMS) and Site Energy Management Systems (SEMS), which can optimize charging schedules and mitigate peak loads. By leveraging anonymized, harmonized datasets and standardized metrics, this study offers critical insights into fleet behavior and performance, providing a foundation to improve operational efficiency, reduce costs, and enable the scalable deployment of electrified transportation.

Wells, Landon↗
DOE OSTI2024

Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. Validation on simulations

Beyond-two-point statistics contain additional information on cosmological as well as astrophysical and observational (systematics) parameters. In this methodology paper we provide an end-to-end simulationbased analysis of a set of Gaussian and non-Gaussian weak lensing statistics using detailed mock catalogs of the Dark Energy Survey (DES). Here, we implement: 1) second and third moments; 2) wavelet phase harmonics (WPH); 3) the scattering transform (ST). Our analysis is fully based on simulations, it spans a space of seven $νw$CDM cosmological parameters, and it forward models the most relevant sources of systematics of the data (masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration). We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a likelihood-free-inference approach. We validate the pipeline extensively, and we find that WPH exhibits the strongest performance when combined with second moments, followed by ST, and then by third moments. The combination of all the different statistics further enhances constraints with respect to second moments, up to 25 percent, 15 percent, and 90 percent for S 8 , Ω m , and the figure-of-merit FoM S8;Ωm , respectively. We further find that non-Gaussian statistics improve constraints on w and on the amplitude of intrinsic alignment with respect to second moments constraints. The methodological advances presented here are suitable for application to Stage IV surveys from Euclid, Rubin-LSST, and Roman with additional validation on mock catalogs for each survey. In a companion paper we present an application to DES Year 3 data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.

Vidyaratne, Lasitha S.↗
DOE OSTI2024

Efficient prediction of attosecond two-colour pulses from an X-ray free-electron laser with machine learning

Abstract X-ray free-electron lasers are sources of coherent, high-intensity X-rays with numerous applications in ultra-fast measurements and dynamic structural imaging. Due to the stochastic nature of the self-amplified spontaneous emission process and the difficulty in controlling injection of electrons, output pulses exhibit significant noise and limited temporal coherence. Standard measurement techniques used for characterizing two-coloured X-ray pulses are challenging, as they are either invasive or diagnostically expensive. In this work, we employ machine learning methods such as neural networks and decision trees to predict the central photon energies of pairs of attosecond fundamental and second harmonic pulses using parameters that are easily recorded at the high-repetition rate of a single shot. Using real experimental data, we apply a detailed feature analysis on the input parameters while optimizing the training time of the machine learning methods. Our predictive models are able to make predictions of central photon energy for one of the pulses without measuring the other pulse, thereby leveraging the use of the spectrometer without having to extend its detection window. We anticipate applications in X-ray spectroscopy using XFELs, such as in time-resolved X-ray absorption and photoemission spectroscopy, where improved measurement of input spectra will lead to better experimental outcomes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Machine-learning Kohn–Sham potential from dynamics in time-dependent Kohn–Sham systems

Abstract The construction of a better exchange-correlation potential in time-dependent density functional theory (TDDFT) can improve the accuracy of TDDFT calculations and provide more accurate predictions of the properties of many-electron systems. Here, we propose a machine learning method to develop the energy functional and the Kohn–Sham potential of a time-dependent Kohn–Sham (TDKS) system is proposed. The method is based on the dynamics of the Kohn–Sham system and does not require any data on the exact Kohn–Sham potential for training the model. We demonstrate the results of our method with a 1D harmonic oscillator example and a 1D two-electron example. We show that the machine-learned Kohn–Sham potential matches the exact Kohn–Sham potential in the absence of memory effect. Our method can still capture the dynamics of the Kohn–Sham system in the presence of memory effects. The machine learning method developed in this article provides insight into making better approximations of the energy functional and the Kohn–Sham potential in the TDKS system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

GCAM Regional Tuning: A framework to tune GCAM parameters

GCAM assumptions typically generate scenarios that are designed to be internally consistent and globally coherent. The gcamdata tool which facilitates the compilation of data sets and user assumptions is not well suited to tailoring to specific country or regional realities, sponsor requirements, or perform harmonization for model intercomparison needs. As described in this report, the GCAM Regional Tuning project develops a computational framework that enables users to adjust GCAM parameters, so model outputs match targeted outcomes at user-defined spatial, temporal, and sectoral resolutions. The framework integrates GCAM, gcamdata, and gcamwrapper with a set of flexible “tuning directives” and an iterative numerical solver. Users can define targets (e.g., technology shares in power generation, BEV uptake, sectoral service demands), select tuners that manipulate relevant GCAM parameters (e.g., share weights, cost adders, elasticities), and export tuned parameters as reusable GCAM XML inputs for future runs. We demonstrate the approach and document usage, diagnostics, and known limitations, and we outline potential future directions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

SULI Intern Final Report: Computationally Investigating Hydrogen Thermo-Diffusion in Yttrium Hydride Using Multiscale Methods

The renaissance of nuclear energy has arrived, heralding an age of abundant inexpensive clean energy, and renewed space exploration. In nuclear-powered spacecraft and microreactors, safety and size are of utmost importance. Yttrium Hydride (YHx) is being researched for its utility as a neutron moderator in nuclear reactors; the hydrogen in YHx slows down neutrons, enabling a continuous nuclear reaction in the reactor. This has the benefit of allowing reactors to be more safe, compact, and efficient. The goal of this effort is to computationally predict the coefficient of temperature-dependent hydrogen diffusion within YHx, the Soret coefficient. This parameter is essential for determining the safe operating modes of YHx moderators. Zirconium Hydride (ZrHx) is used in the Training, Research, Isotopes, General Atomics (TRIGA) reactor, is the reference material for these calculations. In this work, nanoscale atomic modeling in the Vienna Ab initio Simulation Package (VASP) is combined with the mesoscale finite element phase-field module in the Multiphysics Object-Oriented Simulation Environment (MOOSE); this culminates in a new multiscale computational method to simulate Soret diffusion of hydrogen in YHx. This data is useful for predicting experimental outcomes. This workflow involves convergence testing followed by static, Nudged Elastic Band (NEB), Quasi-Harmonic Approximation (QHA), and Molecular Dynamics (MD) calculations - linked with phase field simulation. NEB simulates hydrogen migration, while QHA and MD predict temperature-dependent properties. The static calculations align with literature, and preliminary NEB and QHA calculations yield accurate results. Once the atomic calculations are complete, we will incorporate Electron Backscatter Diffraction (EBSD) images and VASP-generated parameters into the phase field module to simulate intra- and intergranular transport of hydrogen in ZrHx and YHx. Future research will extend our approach to fuel-moderator materials systems such as Uranium-Yttrium Hydride (U-YHx). This work contributes to the development of advanced nuclear energy solutions for space travel.

36 - MATERIALS SCIENCE↗
DOE OSTI2022

Augmented Gaussian random field: Theory and computation

We propose the novel augmented Gaussian random field (AGRF), which is a universal framework incorporating the data of observable and derivatives of any order. Rigorous theory is established. We prove that under certain conditions, the observable and its derivatives of any order are governed by a single Gaussian random field, which is the aforementioned AGRF. As a corollary, the statement "the derivative of a Gaussian process remains a Gaussian process" is validated, since the derivative is represented by a part of the AGRF. Moreover, a computational method corresponding to the universal AGRF framework is constructed. Both noiseless and noisy scenarios are considered. Formulas of the posterior distributions are deduced in a nice closed form. A significant advantage of our computational method is that the universal AGRF framework provides a natural way to incorporate arbitrary order derivatives and deal with missing data. We use four numerical examples to demonstrate the effectiveness of the computational method. The numerical examples are composite function, damped harmonic oscillator, Korteweg-De Vries equation, and Burgers' equation.

Mathematics↗
DOE OSTI2020

Correlations between azimuthal anisotropy Fourier harmonics in PbPb collisions at sNN =2.76 TeV in the HYDJET++ model and in the multiphase transport model

Correlations between azimuthal anisotropy Fourier harmonics vn (n=2,3,4) are studied using the events from PbPb collisions at sNN=2.76 TeV generated by the HYDJET++ and multiphase transport (AMPT) models, and compared to the corresponding experimental results obtained by the ATLAS Collaboration. The Fourier harmonics vn are measured over a wide centrality range using the two-particle azimuthal correlation method. The slopes of the v2-v3 correlation from both models are in a good agreement with the ATLAS data. The HYDJET++ model predicts a stronger slope for the v2-v4 and v3-v4 correlations than the ones experimentally measured, while the results from the AMPT model are in a rather good agreement with the experimental results. In contrast to the HYDJET++ predictions, the AMPT model predicts a boomeranglike shape in the structure of the correlations as found in the experimental data. © 2020 American Physical Society.

60 APPLIED LIFE SCIENCES↗