Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data harmonization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Bridging the Last Mile with Open-Source Advancements: Empowering Communities through Fusion of Aerosol Optical Depth (AOD) Products from Multi-Satellite Sensors

Aerosol Optical Depth (AOD) is a crucial parameter for understanding atmospheric aerosol distribution and their impact on climate and air quality. With the growing number of Earth observation satellites, there is an abundance of AOD products derived from various sensors onboard both geostationary and low-orbit satellites. The availability of multiple datasets provides an opportunity to harness the strengths of each sensor and create comprehensive and accurate AOD datasets for climate and air quality studies at different temporal and spatial scales. Our NASA aerosol MEaSURES project has made significant strides in recent years by undertaking the ambitious task of developing an open-source package tailored for fusing AOD products from different sources. The package is based on OOP (Object-Oriented Programming) design and is implemented in Python modules. Generic interfaces enable easy inclusion of large and heterogeneous data. The package may be utilized to produce harmonized AOD datasets with enhanced spatial and temporal coverage. The latest version of the package is able to process and integrate the dark-target AOD data from six different sensors: AHI Himawari-8, ABI GOES-West, ABI GOES-East, MODIS AQUA, MODIS TERRA, and VIIRS SNPP. Rigorous validation and intercomparison studies have been performed to assess the accuracy and reliability of the fused AOD product against ground-based measurements and reference datasets. The open-source nature of the developed package ensures transparency, reproducibility, and community engagement. The research community and stakeholders can access, contribute to, and further improve the fusion methodology, making it adaptable to other studies, or expanding it to include new satellite data as they become available. In this poster presentation, we will introduce the accomplishments and challenges faced during the development of the open-source package for AOD data fusion, and demonstrate the advantages of combining AOD products from the six aforementioned satellite sensors. The presentation aims to foster discussions, collaborations, and future directions in integrating Earth observation and remote sensing data, which may contribute to a better understanding of atmospheric aerosols and their impacts on our environment.

Zhaohui Zhang↗
DOE OSTI2024

Harmonized Database of Western U.S. Water Rights (HarDWR) v.1

Abstract In the arid and semi-arid Western U.S., access to water is regulated through a legal system of water rights. Individuals, companies, organizations, municipalities, and tribal entities have documents that declare their water rights. State water regulatory agencies collate and maintain these records, which can be used in legal disputes over access to water. While these records are publicly available data in all Western U.S. states, the data have not yet been readily available in digital form from all states. Furthermore, there are many differences in data format, terminology, and definitions between state water regulatory agencies. Here, we have collected water rights data from 11 Western U.S. state agencies, harmonized terminology and use definitions, formatted them for consistency, and tied them to a Western U.S.-wide shapefile of water administrative boundaries.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Reviews and syntheses: The promise of big diverse soil data, moving current practices towards future potential

Abstract. In the age of big data, soil data are more available and richer than ever, but – outside of a few large soil survey resources – they remain largely unusable for informing soil management and understanding Earth system processes beyond the original study. Data science has promised a fully reusable research pipeline where data from past studies are used to contextualize new findings and reanalyzed for new insight. Yet synthesis projects encounter challenges at all steps of the data reuse pipeline, including unavailable data, labor-intensive transcription of datasets, incomplete metadata, and a lack of communication between collaborators. Here, using insights from a diversity of soil, data, and climate scientists, we summarize current practices in soil data synthesis across all stages of database creation: availability, input, harmonization, curation, and publication. We then suggest new soil-focused semantic tools to improve existing data pipelines, such as ontologies, vocabulary lists, and community practices. Our goal is to provide the soil data community with an overview of current practices in soil data and where we need to go to fully leverage big data to solve soil problems in the next century.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1975

Relativity mission with two counter-orbiting polar satellites

In 1918, J. Lense and H. Thirring calculated that a moon in orbit around a massive rotating planet would experience a nodal dragging effect due to general relativity. We describe an experiment to measure this effect with two counter-orbiting drag-free satellites in polar earth orbit. For a 2 1/2 year experiment, the measurement accuracy should approach 1%. In addition to precision tracking data from existing ground stations, satellite-to-satellite Doppler ranging data are taken at points of passing near the poles. New geophysical information on both earth harmonics and tidal effects is inherent in the polar ranging data.

Van Patten, R. A.↗
NASA NTRS1980

Equivalent source modeling of the main field using MAGSAT data

The software was considerably enhanced to accommodate a more comprehensive examination of data available for field modeling using the equivalent sources method by (1) implementing a dynamic core allocation capability into the software system for the automatic dimensioning of the normal matrix; (2) implementing a time dependent model for the dipoles; (3) incorporating the capability to input specialized data formats in a fashion similar to models in spherical harmonics; and (4) implementing the optional ability to simultaneously estimate observatory anomaly biases where annual means data is utilized. The time dependence capability was demonstrated by estimating a component model of 21 deg resolution using the 14 day MAGSAT data set of Goddard's MGST (12/80). The equivalent source model reproduced both the constant and the secular variation found in MGST (12/80).

Source record↗
DOE OSTI2026

Enabling probabilistic learning on manifolds through double diffusion maps

Here, we present a generative learning framework for probabilistic sampling that extends Probabilistic Learning on Manifolds (PLoM), which is designed to generate statistically consistent realizations of a random vector in a finite-dimensional Euclidean space, informed by a (representative) set of observations. In its original form, PLoM constructs a reduced-order probabilistic model by combining three main components: (a) kernel density estimation to approximate the underlying probability measure, (b) Diffusion Maps to characterize the manifold of the data, and (c) a reduced-order Itô Stochastic Differential Equation (ISDE) to sample from the learned distribution. However, its sampling dynamics are posed in the ambient space and the retained number of reduced coordinates is chosen by projection-reconstruction error. In practice, this often (i) requires more coordinates than the data’s intrinsic dimension to achieve stable sampling and (ii) lacks a smooth, basis-independent lifting back to the data domain; moreover, standard Diffusion Maps emphasize harmonic eigenfunctions and can miss non-harmonic latent structure. We address these limitations by decoupling geometry learning from sampling: a first Diffusion Maps pass identifies non-harmonic coordinates on which we formulate a full-order ISDE directly in the latent space, while Double Diffusion Maps captures multiscale geometric features and Geometric Harmonics (GH) learns a smooth lifting map to the ambient variables that is independent of the particular diffusion basis. This hybrid design preserves the system’s dynamical richness with a compact geometric representation and enables principled out-of-sample inference. The effectiveness and robustness of the proposed method are illustrated through two numerical studies: one based on data generated from two-dimensional Hermite polynomial functions and another based on high-fidelity simulations of a detonation wave in a reactive flow.

Double diffusion maps↗
NASA NTRS1981

Preliminary models of the core field

Using the CHROFIN tapes containing MAGSAT data for the month of December, two spherical harmonic models were prepared. One of these models was specially designed to study the Bangui anomaly region. For this region an attempt was made to downward continue the data and to compare it with the existing ground level map.

Lemouel, J. L.↗
NASA NTRS1987

Atlas of wide-field-of-view outgoing longwave radiation derived from Nimbus 7 Earth radiation budget data set - November 1978 to October 1985

An atlas of monthly mean outgoing longwave radiation global contour maps and associated spherical harmonic coefficients is presented. The atlas contains 84 months of continuous data from November 1978 to October 1985. The data were derived from the second Earth radiation budget experiment, which was flown on the Nimbus 7 Sun-synchronous satellite in 1978. This data set is a companion set and extension to a similar report of the Nimbus 6 satellite. Together these two reports give a data set covering a 10 year time period and will be very valuable in studying different aspects of our changing climate over monthly, annual, and interannual scales in the time domain and over regional, zonal, and global scales in the spatial domain.

Bess, T. Dale↗
NASA NTRS1973

Electrostatic velocity-space instabilities stimulated near the harmonics of the electron cyclotron frequency in the ionosphere

Data are presented on observations made in the ionospheric plasma that provide evidence for the stimulation of Harris type instabilities at nf sub H in a single electron transition. An illustration is also given of the change in shape of the dispersion curve for a given nf sub H as the upper hybrid frequency crosses the nf sub H value. It was concluded that the instability can exist near nf sub H only when the hybrid frequency nf sub H.

Benson, R. F.↗
NASA NTRS1999

A Critical Examination of Wind-Wave Spectral Functional Form

Traditionally, data from random ocean waves are presented in spectral functions. The spectra are the result of Fourier analysis. Fourier spectral analysis has dominated data analysis for, at least, the last hundred years. It has been the standard method for is examining the global amplitude-frequency distributions. Although Fourier transform valid under extremely general conditions, there are some crucial restrictions for the Fourier spectral analysis. The system must be linear, and the data must be stationary- otherwise, the resulting spectrum will make little physical sense. The stationarity requirement is also a common required criterion for most of other available data analysis methods. Nevertheless, few, if any, natural phenomena are linear and stationary. To compound these complications is the imperfection of our probes or numerical schemes the interactions of the imperfect probes even with a perfect linear system can make the final data nonlinear. Furthermore, all the available data are usually of finite duration. Under these conditions, Fourier analysis is of limited use, For lack of alternatives, however, Fourier analysis is still used to process such data. The loose application of Fourier analysis and the insouciant adoption of the stationary and linear assumptions may lead to misleading conclusions. Ocean waves are know to be nonlinear, and the wind system generating the wave field are seldom stationary- As a result, the traditional examination of the spectral form hardly made physical sense. A new method for analyzing nonlinear and nonstationary data has been developed. The key part is the Empirical Mode Decomposition (EMD) method with which any complicated data set can be decomposed into a finite and often small number of Intrinsic Mode Functions (IMF) that serve as the basis of the representation of the data, This decomposition method is adaptive, and, therefore, highly efficient. The IMFs admit well-behaved Hilbert transforms, and yield instantaneous energy and frequency as functions of time that give sharp identifications of imbedded structures. The final presentation of the results is an energy-frequency-time distribution, designated as the Hilbert Spectrum. Among the main conceptual innovations is the introduction of the instantaneous frequencies for complicated data sets, which eliminate the need of spurious harmonics to represent nonlinear and nonstationary signals. The spectral forms of the ocean waves are very different. This new method offers the first physical meaningful view of the wave spectrum. Data from laboratory and field will be presented to illustrate the differences.

Huang, Norden E.↗
DOE OSTI2025

Assessing methods in fusion and fitting for time series construction in remote sensing-based earth observations

This study evaluates the comparative performance of spatiotemporal fusion and time-series fitting methods for constructing high-spatiotemporal-resolution remote sensing time-series data. Due to in-class similarity of fusion methods and fitting methods, we employ the Fit-FC (Fitting, spatial Filtering, and residual Compensation) model as a representative fusion method and the linear harmonic fitting model as a representative fitting method. Both Fit-FC and the linear harmonic fitting are widely used for high-spatiotemporal-resolution time-series data construction, and we modify the original Fit-FC model to enable automatic time-series fusion. To ensure data representativeness, we use 3 years (2019–2021) of Harmonized Landsat and Sentinel-2 surface reflectance datasets and Terra MCD43A4 products. Eight experimental regions are selected worldwide to guarantee generalization of the comparative performance between fusion and fitting methods, covering diverse land-use types (cropland, developed land, forest, and grassland) and varying climatological conditions. Time-series of NDVI and surface reflectance are analyzed under both actual observations and simulated data-missing scenarios. The constructed time-series data reveals that (1) the modified Fit-FC and linear harmonic fitting model achieve excellent performance in constructing high-resolution time-series images; (2) the fusion method outperforms the fitting method in constructing time-series of NDVI and surface reflectance images in cropland-, forest-, and grassland-dominated regions; (3) both methods achieve comparable performance in developed-dominated regions; (4) the fusion method is more robust to missing data, and better captures abrupt phenological transitions under conditions of continuous missing data; (5) the fitting method is computationally more efficient, making it suitable for large-scale time-series image reconstruction. This study provides valuable insights for selecting optimal strategies to generate high-resolution time-series images across diverse application scenarios and lays a foundation for extensions to other vegetation indices or land surface variables.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1979

M2 ocean tide parameters and the deceleration of the moon's mean longitude from satellite orbit data

An estimation is made of the principal long-period spherical harmonic parameters in the representation of the M2 ocean tide from the orbital histories of the three satellites 1967-92A, Starlette, and GEOS 3. The data used are primarily the evolution of the orbital inclinations of the satellites in conjunction with the longitude of the ascending node from GEOS 3. Analysis procedure and analytic formulation, as well as ocean tidal parameter estimation and deceleration of the lunar mean longitude are outlined. The credibility of the M2 ocean tide solution is further enhanced by the close accord between the computed value for the deceleration of the lunar mean longitude and other recently reported estimates. It is evident from the results presented that studies of close earth satellite orbits are able to provide important information about the tidal forces acting on the earth.

Felsentreger, T. L.↗
NASA NTRS1993

Empirical wind model for the middle and lower atmosphere. Part 1: Local time average

The HWM90 thermospheric wind model was revised in the lower thermosphere and extended into the mesosphere and lower atmosphere to provide a single analytic model for calculating zonal and meridional wind profiles representative of the climatological average for various geophysical conditions. Gradient winds from CIRA-86 plus rocket soundings, incoherent scatter radar, MF radar, and meteor radar provide the data base and are supplemented by previous data driven model summaries. Low-order spherical harmonics and Fourier series are used to describe the major variations throughout the atmosphere including latitude, annual, semiannual, and longitude (stationary wave 1). The model represents a smoothed compromise between the data sources. Although agreement between various data sources is generally good, some systematic differences are noted, particularly near the mesopause. Root mean square differences between data and model are on the order of 15 m/s in the mesosphere and 10 m/s in the stratosphere for zonal wind, and 10 m/s and 4 m/s, respectively, for meridional wind.

Hedin, A. E.↗
NASA NTRS1999

Probing Ganymede's Magnetosphere with Field Line Resonances

We report on the spectrum of field line resonances identified in data acquired by the Galileo spacecraft within Ganymede's magnetosphere on a relatively low latitude pass. We infer properties of the plasma distribution and its transport from the observed spectrum. The harmonic structure in the spectrum of the magnetometer data agrees very well with the frequencies predicted for resonances of a dipole field. The spectrum implies a density of 2 amu per cubic centimeter near the equator on closed field lines of Ganymede's magnetic field inside of 2 RG (Ganymede radii). This density is significantly reduced relative to the local density of the Jovian plasma sheet near Ganymede (less than or equal to 8 electrons per cubic centimeter, or approximately equal to 100 amu per cubic centimeter for an average ion mass per charge of 20 amu and average charge of 1.5 electron charges). A shadowing effect of Ganymede for the flow of particles injected at a reconnection layer on the side of the moon downstream relative to the direction of torus plasma flow accounts for the marked density depletion. Implications for conducting paths near Ganymede's surface are considered.

Volwerk, M.↗
NASA NTRS1992

Annual and interannual variations of earth-emitted radiation based on a 10-year data set

The method of empirical orthogonal functions (EOFs) was applied to a 10-yr data set of outgoing longwave radiation. Spherical harmonic functions are used as a basis set for producing equal area map results. The first EOF accounts for 66 percent of the variance. After that, each EOF accounts for only a small variance, forming a slowly converging series. The first two EOFs describe mainly the annual cycle. The third EOF is primarily the semiannual cycle although many other EOFs also contain significant semiannual parts. These results reaffirm those based on a shorter data set. In addition, a much stronger spring/fall mode was found in the central equatorial Pacific Ocean for the second EOF than was found earlier. The fourth EOF describes much of the 1976 to 1977 and 1982 to 1983 ENSO phenomena. There is typically a gap in the spectrum between a semiannual peak and the annual cycle for all but the first EOF. A semiannual OLR dipole straddles the Asian-Australian monsoon track.

Bess, T. D.↗
NASA NTRS1986

DE 1 observations of harmonic auroral kilometric radiation

The plasma wave instrument on board the DE 1 spacecraft has observed several intervals of auroral kilometric radiation during which harmonic structure is clearly present. The paper presents evidence, some of which is based on unique capabilities of the DE instrument, which argues strongly that the harmonic structures are natural rather than instrumental in origin. The harmonic emissions occur infrequently, but when present may persist for intervals of up to an hour. The emissions are relatively narrow band and consist of a relatively weak fundamental accompanied by an even weaker second harmonic. The ratio of power in the fundamental band to the power in the harmonic ranges from 10 to 100. In all cases, polarization data indicate that the fundamental is a left-hand ordinary (L-O) mode emission while the harmonic is right-hand extraordinary (R-X) mode. These observations are consistent with predictions based on the cyclotron maser mechanism.

Mellott, M. M.↗
NASA NTRS2001

On the Application of Hilbert Spectral Analysis for Climate Studies

The Hilbert spectral analysis (Huang et al, 1998, Proceedings of the Royal Society of London, A 454, pp 903-995) consisted of two steps: First, the data has to be reduced into a finite number of Intrinsic Mode Function by the Empirical Mode Decomposition method, then the resulting Intrinsic Mode Functions are converted to time-frequency-energy distribution through Hilbert transform. In this approach, the Empirical Mode Functions served as the basis functions with which the data is expanded. This basis function is adaptive, and the decomposition is nonlinear. Furthermore, as the Hilbert transform is a singular transform, it retains a high degree of local information. The instantaneous frequency is determined by differentiation of the phase function; therefore, there is no restriction of the 'uncertainty principle' for all the time-frequency analysis resulting from a priori basis approach. With the adaptive basis and the instantaneous frequency, the Hilbert Spectral analysis can represent data from nonlinear and nonstationary processes without resorting to the harmonics. Another advantage of using instantaneous frequency is the ability to find out frequency from limited length of data, which is a critical problem in climate studies. As the processes driving the climate changes could be both nonlinear and nonstationary, the Hilbert Spectral Analysis could be of great use in examining the underlying mechanisms. A preliminary study based on the length of day data will be presented as example for the application of the Hilbert Spectral Analysis for climate study.

Huang, Norden E.↗
NASA NTRS1989

Annual and interannual variations of Earth-emitted radiation based on a 10-year data set

The method of empirical orthogonal functions (EOF) was applied to a 10-year data set of outgoing longwave radiation. Spherical harmonic functions are used as a basis set for producing equal area map results. The following findings are noted. The first EOF accounts for 66 percent of the variance. After that, each EOF accounts for only a small variance, forming a slowly converging series. The first two EOF's describe mainly the annual cycle. The third EOF is primarily the semiannual cycle although many other EOF's also contain significant semiannual parts. These results reaffirm those based on a shorter data set. In addition, a much stronger spring/fall mode was found in the central equatorial Pacific Ocean for the second EOF than was found earlier. This difference is attributed to the use of broadband radiometer data which were available for the present study. The earlier study used data from a window channel instrument which is not as sensitive to water vapor variations. The fourth EOF describes much of the 1976 to 1977 and 1982 to 1983 ENSO phenomena. There is typically a gap in the spectrum between a semiannual peak and the annual cycle for all but the first EOF. A semiannual OLR dipole straddles the Asian-Australian monsoon track.

Bess, T. Dale↗