Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Variables”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

time-resolved spectroscopy fit (trspecfit) v0.01

Analyze 2D time- and energy-resolved data, such as from a pump-probe spectroscopy experiment. User can select and input different peak shapes/ functions and background types to first fit a ground state/ unperturbed spectrum. This would be similar to how standard spectroscopy data is fit. Subsequently, to describe the time domain, users can choose functions that describe the temporal dynamics of one or more spectral features, such as a peak amplitude, peak position, etc. These time dynamics functions can be added or convoluted (e.g. describing an instrument response function) with each other. Functionality to integrate implicit variables leading to distributions of certain parameters/ functions is in development. Alternatively, 2D data can be analyzed one time step at a time to get an idea of the time dynamics of the system before deploying the global 2D fit described above. Typically people write custom software for this purpose. During my PhD I've seen five internal LBL and external researchers write one-off code in different languages to analyze time- and energy-resolved spectra. While this was specifically was for a laser pump - X-ray probe spectroscopy experiment, I'm trying to write a general package for the time-resolved spectroscopy community.

Mahl, Johannes [Lawrence Berkeley National Laborat↗
DOE OSTI2026

Predictive Model for Starlink Maritime Performance Using Multi-Horizon RandomForest

Low Earth orbit (LEO) satellite systems have become a crucial enabler of broadband access for maritime industries, where traditional networks are unavailable. However, the high mobility of LEO constellations and constantly changing weather conditions result in unpredictable link fluctuations, limiting the ability of maritime platforms to plan bandwidth usage proactively. To the best of our knowledge, no prior work has developed a short-term predictive model for maritime LEO connectivity using real experimental field measurements. This paper proposes a data-driven forecasting model that predicts future downlink throughput using multi-horizon RandomForest regression. The model is trained using real experimental coastal measurement data incorporating recent throughput history, network-layer indicators, and environmental variables. The proposed approach reduces mean absolute error by approximately 31% compared to a persistence baseline for 15-minute horizons. It maintains a measurable improvement at 30 minutes, despite increased stochasticity. These findings confirm that proactive bandwidth awareness is feasible on maritime platforms and can effectively support operational decisions such as adaptive streaming, routing, and resource scheduling. The performance gap between forecasting horizons also highlights the need for expanded offshore datasets to improve prediction robustness under harsher maritime environments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Internal Variability Increased Arctic Amplification During 1980–2022

Abstract Since 1980, the Arctic surface has warmed four times faster than the global mean. Enhanced Arctic warming relative to the global average warming is referred to as Arctic Amplification (AA). While AA is a robust feature in climate change simulations, models rarely reproduce the observed magnitude of AA, leading to concerns that models may not accurately capture the response of the Arctic to greenhouse gas emissions. Here, we use CMIP6 data to train a machine learning algorithm to quantify the influence of internal variability in surface air temperature trends over both the Arctic and global domains. Application of this machine learning algorithm to observations reveals that internal variability increases the Arctic warming but slows global warming in recent decades, inflating AA since 1980 by 38% relative to the externally forced AA. Accounting for the role of internal variability reconciles the discrepancy between simulated and observed AA.

58 GEOSCIENCES↗
DOE OSTI2025

Stochastic Ensemble Generation for Improved Characterization of Representing Geologic Variability in a Reservoir: IBDP Case Study for SMART Initiative

This document is a poster covering the findings from activities on training data generation, specifically geologic ensemble generation. The generated geologic realizations captured the range of possible permeability distributions of the subsurface at the Illinois Basin - Decatur Project (IBDP) site, based on available well log variabilities. The percentages of reservoirs and baffles in the injection zone and a truncation of baffle permeability led to more variance in the simulations. This will be used to build forward modeling, history matching, and optimization workflows. The geologic realizations were also ranked according to dynamic measures of hydraulic diffusivity, and simulations confirm a greater contrast between the reservoir and the baffles during injection.

stochastic ensemble generation↗
DOE OSTI2021

Method for determining a histogram of variable sample rate waveforms

A computer-implemented method comprises receiving a plurality of sampled data points, each data point including a y value and a t value; defining an array of bins, each bin identified by a unique number and including histogram data for a range of y values; for each consecutive pair of data points including a current data point and a next data point, determining a corresponding one of a plurality of linear equations, each linear equation defining a line between the current data point and the next data point; for each line, determining an amount of time that the y value of the line is within the range of values for each bin from the current data point to the next data point; and adding the time to the histogram data for each bin.

Tohlen, Michael Aaron↗
DOE OSTI2022

Method for determining a histogram of variable sample rate waveforms

A computer-implemented method comprises receiving a plurality of sampled data points, each data point including a y value and a t value; defining a plurality of bins; defining an array of elements; dividing the sampled data points into a plurality of sections; assigning a plurality of polynomial equations, one polynomial equation to each section, each polynomial equation having a waveform that fits the data points of the associated section; determining a plurality of section bin times, one section bin time for each bin in each section, each section bin time determined using the polynomial equation and indicating an amount of time that the waveform has values in the range of one of the bins; and adding the section bin time for each bin in each section to the histogram data in the array element pointed to by the number of the bin.

Tohlen, Michael Aaron↗
DOE OSTI2021

Forecasting Solar-Thermal Systems Performance under Transient Operation Using a Data-Driven Machine Learning Approach Based on the Deep Operator Network Architecture

Modeling and prediction of the dynamic behavior of thermal systems operating under intermittent energy input and variable load requirements represent one of the greatest challenges in the development of efficient and reliable renewable-based power generation technologies. In this work, a data-driven machine learning modeling framework was developed based on a modified version of the Deep Operator Network architecture where the time coordinate in the trunk net is replaced with historical data of the predicting quantity. The modeling framework can be used to accurately predict the performance of renewable-based energy conversion technologies including wind- and solar-based power plants. This novel framework was applied on a solar-thermal system that consists of a solar collection loop using a flat plate collector, a power generation loop comprising an Organic Rankine Cycle, and a thermal energy storage tank connecting both loops. Variable solar irradiance, air temperature, and power load profiles were used by the Deep Operator Network to predict the State-of-Charge and the efficiency of the thermal system for several days. The results were compared with the State-of-Charge and efficiency functions calculated using a physics-based model. For a simple operation scenario, characterized by a clear sky solar irradiance profile and constant load, the standard deviation in the State-of-Charge prediction by Deep Operator Network is below 0.9% during a seven-day prediction time horizon. For the most realistic operation scenario that considers real solar irradiance and a rough load profile, the maximum standard deviation in the predictions for the State-of-Charge and efficiency are below 6.8% and 2.5%, respectively. A comparison between Deep Operator Network and Long Short Term Memory network was also performed. In general, both networks predict very well the State-of-Charge for different data density conditions; however, a higher accuracy, with a standard deviation below 2.0%, is obtained by the Deep Operator Network during three and half days using sparser training data of 20-minute points. The same accuracy for the State-of-Charge prediction with the Long Short Term Memory network is achieved only for 14 h. Average standard deviations for the State-of-Charge prediction of 1.1% with the Deep Operator Network and 1.5% with the Long Short Term Memory network are obtained for a four-day prediction time using a denser training data of 5-minute points.

DeepONet↗
DOE OSTI2026

Disparities in the air quality monitoring stations and PM₂.₅ in Chicago’s air quality landscape

Fine particulate matter (PM₂.₅) poses significant public and environmental health risks in urban areas. Chicago’s dense industry and traffic create variable air quality, yet monitoring is unevenly distributed, resulting in undersampling of air quality data in some city areas. This study applied a hybrid approach using GIS-based kernel density mapping, interpolation modeling (IDW, Spline, Kriging) of USEPA monitoring data, multi-scale temporal trend analyses (hourly to annual), and ESDA. Accordingly, the density surface showed that monitors are concentrated in the affluent north, northwest, and southwest sides of Chicago (up to ~ 0.07 stations per sq mile), while the south and southeast regions, with predominantly minority communities, have virtually no coverage. Overall, citywide coverage is minimal (~ 4–5 monitors total; ~0.02 per sq mile; ≈1 per 600,000 residents). Temporal analyses showed that the city’s mean annual PM₂.₅ (~ 10.8 µg/m³) exceeds USEPA/WHO standards (9 µg/m³), with summer means (~ 17.1 µg/m³) significantly higher than other seasons. Diurnally, a clear pattern was observed, with PM₂.₅ concentrations peaking overnight (00:00–03:00) and during the morning rush hours, and dipping during midday to late afternoon. Spatial distribution of PM₂.₅ identified hotspots near O’Hare Airport, the downtown Loop area, and south-side neighborhoods, contrasting with lower concentrations on the north side, revealing Chicago’s socioeconomic divides and resulting environmental inequities. The findings underscore the need for expanded monitoring and targeted interventions in under-monitored, high-pollution communities to advance equitable community health.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Differentiable, Learnable, Regionalized Process-Based Models With Multiphysical Outputs can Approach State-Of-The-Art Hydrologic Prediction Accuracy

Predictions of hydrologic variables across the entire water cycle have significant value for water resources management as well as downstream applications such as ecosystem and water quality modeling. Recently, purely data-driven deep learning models like long short-term memory (LSTM) showed seemingly insurmountable performance in modeling rainfall runoff and other geoscientific variables, yet they cannot predict untrained physical variables and remain challenging to interpret. Here, we show that differentiable, learnable, process-based models (called δ models here) can approach the performance level of LSTM for the intensively observed variable (streamflow) with regionalized parameterization. We use a simple hydrologic model HBV as the backbone and use embedded neural networks, which can only be trained in a differentiable programming framework, to parameterize, enhance, or replace the process-based model's modules. Without using an ensemble or post-processor, δ models can obtain a median Nash-Sutcliffe efficiency of 0.732 for 671 basins across the USA for the Daymet forcing data set, compared to 0.748 from a state-of-the-art LSTM model with the same setup. For another forcing data set, the difference is even smaller: 0.715 versus 0.722. Meanwhile, the resulting learnable process-based models can output a full set of untrained variables, for example, soil and groundwater storage, snowpack, evapotranspiration, and baseflow, and can later be constrained by their observations. Both simulated evapotranspiration and fraction of discharge from baseflow agreed decently with alternative estimates. The general framework can work with models with various process complexity and opens up the path for learning physics from big data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Multitaper Magnitude‐Squared Coherence for Time Series With Missing Data: Understanding Oscillatory Processes Traced by Multiple Observables

To explore the hypothesis of a common source of variability in two time series, observers may estimate the magnitude-squared coherence (MSC), which is a frequency-domain view of the cross correlation. For time series that do not have uniform observing cadence, MSC can be estimated using Welch's overlapping segment averaging. However, multitaper has superior statistical properties to Welch's method in terms of the tradeoff between bias, variance, and bandwidth. The classical multitaper technique has recently been extended to accommodate time series with underlying uniform observing cadence from which some observations are missing. This situation is common for solar and geomagnetic data sets, which may have gaps due to breaks in satellite coverage, instrument downtime, or poor observing conditions. We demonstrate the scientific use of missing-data multitaper magnitude-squared coherence by detecting known solar mid-term oscillations in simultaneous, missing-data time series of solar Lyman α flux and geomagnetic Disturbance Storm Time index. Due to their superior statistical properties, we recommend that multitaper methods be used for all heliospheric time series with underlying uniform observing cadence.

Astro-statistics techniques (1886)↗
DOE OSTI2024

Modeling Si/SiGe quantum dot variability induced by interface disorder reconstructed from multiperspective microscopy

SiGe heteroepitaxial growth yields pristine host material for quantum dot qubits, but residual interface disorder can lead to qubit-to-qubit variability that might pose an obstacle to reliable SiGe-based quantum computing. By convolving data from scanning tunneling microscopy and high-angle annular dark field scanning transmission electron microscopy, we reconstruct 3D interfacial atomic structure and employ an atomistic multi-valley effective mass theory to quantify qubit spectral variability. The results indicate (1) appreciable valley splitting (VS) variability of ~50% owing to alloy disorder and (2) roughness-induced double-dot detuning bias energy variability of order 1–10 meV depending on well thickness. For measured intermixing, atomic steps have negligible influence on VS, and uncorrelated roughness causes spatially fluctuating energy biases in double-dot detunings potentially incorrectly attributed to charge disorder. Our approach yields atomic structure spanning orders of magnitude larger areas than post-growth microscopy or tomography alone, enabling more holistic predictions of disorder-induced qubit variability.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Dwarf AGNs from Optical Variability for the Origins of Seeds (DAVOS): insights from the dark energy survey deep fields

ABSTRACT We present a sample of 706, z < 1.5 active galactic nuclei (AGNs) selected from optical photometric variability in three of the Dark Energy Survey (DES) deep fields (E2, C3, and X3) over an area of 4.64 deg2. We construct light curves using difference imaging aperture photometry for resolved sources and non-difference imaging PSF photometry for unresolved sources, respectively, and characterize the variability significance. Our DES light curves have a mean cadence of 7 d, a 6-yr baseline, and a single-epoch imaging depth of up to g ∼ 24.5. Using spectral energy distribution (SED) fitting, we find 26 out of total 706 variable galaxies are consistent with dwarf galaxies with a reliable stellar mass estimate ($M_{\ast }\lt 10^{9.5}\, {\rm M}_\odot$; median photometric redshift of 0.9). We were able to constrain rapid characteristic variability time-scales (∼ weeks) using the DES light curves in 15 dwarf AGN candidates (a subset of our variable AGN candidates) at a median photometric redshift of 0.4. This rapid variability is consistent with their low black hole (BH) masses. We confirm the low-mass AGN nature of one source with a high S/N optical spectrum. We publish our catalogue, optical light curves, and supplementary data, such as X-ray properties and optical spectra, when available. We measure a variable AGN fraction versus stellar mass and compare to results from a forward model. This work demonstrates the feasibility of optical variability to identify AGNs with lower BH masses in deep fields, which may be more ‘pristine’ analogues of supermassive BH seeds.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Expanded Understanding of the Western Antarctic Peninsula Sea‐Ice Environment Through Local and Regional Observations at Palmer Station

Abstract The Western Antarctic Peninsula (WAP) has been experiencing rapid regional warming since at least the 1950s, however, the impacts of this warming at the local scale are variable and nuanced. Previous studies that have linked sea‐ice variability to biogeochemical cycles and food web dynamics often combine local‐scale biogeochemical data with coarse‐resolution regional satellite sea‐ice data, which may not adequately capture local sea‐ice conditions. In this study, we analyzed local‐scale in situ sea‐ice observations collected as part of a 28‐year record (1992–2020) from the Palmer Long‐Term Ecological Research site at Anvers Island, mid‐WAP, in conjunction with isotopically‐derived sea‐ice meltwater (SIM) fractions and satellite‐derived sea‐ice motion and concentration, to quantify the variability and long‐term trends in local sea‐ice behavior. In situ sea ice observations at Palmer Station displayed higher variability than satellite observations and showed no significant declines over this time, despite region‐wide declines identified in prior studies. Higher spring SIM fractions were attributed to strong northward sea‐ice motion throughout the winter. Applying these local‐scale sea‐ice insights to similarly scaled stratification and chlorophyll‐ a measurements, we found that a longer‐lasting, more consistent sea‐ice pack led to greater water column stratification following the spring sea‐ice retreat. Greater sea‐ice persistence and stronger stratification led to larger peaks in chlorophyll‐ a , though sea‐ice metrics did not explain the positive temporal trends in either stratification strength or chlorophyll‐ a . Through this study, we identify how local sea‐ice observations and meltwater data can enhance satellite data to build an understanding of the intricate connections between ice, water column dynamics, and phytoplankton.

Goodell, E.↗
DOE OSTI2021

Quantifying nitrogen loss hotspots and mitigation potential for individual fields in the US Corn Belt with a metamodeling approach

The high productivity in the US Corn Belt is largely enabled by the consumption of millions of tons of manufactured fertilizer. Excessive application of nitrogen (N) fertilizer has been pervasive in this region, and the unrecovered N eventually escaped from croplands in forms of nitrous oxide (N 2 O) emission and N leaching. Mitigating these negative impacts is hindered by a lack of practical information on where to focus and how much mitigation potential to expect. At a large scale, process-based crop models are the primary tools for predicting variables required by decision making, but their applications are prohibited by expensive computational and data storage costs. To overcome these challenges, we built a series of metamodels to learn the key mechanisms regarding the carbon (C) and N cycle from a well-validated process-based biogeochemical model, ecosys. The trained metamodel captures over 98% of the variability of the ecosys simulated outputs for 99 randomly selected counties in Iowa, Illinois, and Indiana. To identify hotspots with high mitigation potential, we introduce net societal benefit (NSB) as an indicator for synthesizing the loss in yield and social benefits through emissions and pollutants avoided. Our results show that reducing N fertilizer by 10% leads to 9.8% less N 2 O emissions and 9.6% less N leaching at the cost of 4.9% more SOC depletion and 0.6% yield reduction over the study region. The estimated total annual NSB is $\$395$ M (uncertainty ranges from $\$114$ M to $\$1271$ M), including $\$334$ from social benefits (uncertainty ranges from $\$46$ M to $\$1076$ M), $\$100$ M from saving fertilizer (uncertainty ranges from $\$13$ M to $\$455$ M), and –$\$40$ M due to yield changes (uncertainty ranges from –$\$261$ M to $\$69$ M). For the median scenario, we noted that 20% of the study area accounts for nearly 50% of the NSB, and thus represent hotspot locations for targeted mitigation. Although the uncertainty range suggests that developing such a high-resolution framework is not yet settled and the scenario based estimations are not appropriate to inform the management practices for individual farmers, our efforts shed light on the new generation of analytical tools for life cycle assessment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A Reanalysis of Public Galactic Bulge Gravitational Microlensing Events from OGLE-III and -IV

Abstract Modern surveys of gravitational microlensing events have progressed to detecting thousands per year, and surveys are capable of probing Galactic structure, stellar evolution, lens populations, black hole physics, and the nature of dark matter. One of the key avenues for doing this is the microlensing Einstein radius crossing time (t E) distribution. However, systematics in individual light curves as well as oversimplistic modeling can lead to biased results. To address this, we developed a model to simultaneously handle the microlensing parallax due to Earth's motion, systematic instrumental effects, and unlensed stellar variability with a Gaussian process model. We used light curves for nearly 10,000 OGLE-III and -IV Milky Way bulge microlensing events and fit each with our model. We also developed a forward model approach to infer the t E distribution by forward modeling from the data rather than using point estimates from individual events. We find that modeling the variability in the baseline removes a source of significant bias in individual events, and the previous analyses overestimated the number of t E > 100 day events due to their oversimplistic model ignoring parallax effects. We use our fits to identify the hundreds filling a regime in the microlensing parameter space that are 50% pure of black holes. Finally, we have released the largest-ever catalog of Markov Chain Monte Carlo parameter estimates for microlensing events.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

The use of seismic spatial gradients in a single layer neural network for seismic source discrimination: proof of concept

This report describes a proof-of-concept method of seismic source discrimination using seismic gradiometry and a common machine learning technique. The tests described here are purely numerical, using synthetic seismic data and well understood mathematical techniques. The primary innovation described here is the application of a richer seismic data set derived from seismic gradiometry. Seismic gradiometry is a method to estimate the time variable spatial gradient of the wavefield to compute various wavefield attributes such as slowness, dynamic strain, and rotational motions. With the addition of these wavefield attributes, we are afforded up to twenty "compo- nents" of time series data measured at a single point on, or in, the Earth. This is in direct contrast to conventional three-component seismic data collected at several locations using a seismic network. Using the gradiometrically-derived wavefield components directly in a single-layer neural network, I show that it is possible to discriminate between three common seismic source types (earthquakes, explosions, and opening fractures) for various noise conditions and gradiometry configurations.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗
DOE OSTI2023

Elastic functional changepoint detection of climate impacts from localized sources

Detecting changepoints in functional data has become an important problem as interest in monitoring of climate phenomenon has increased, where the data is functional in nature. Here, the observed data often contains both amplitude (y-axis) and phase (x-axis) variability. If not accounted for properly, true changepoints may be undetected, and the estimated underlying mean change functions will be incorrect. In this article, an elastic functional changepoint method is developed which properly accounts for these types of variability. The method can detect amplitude and phase changepoints which current methods in the literature do not, as they focus solely on the amplitude changepoint. This method can easily be implemented using the functions directly or can be computed via functional principal component analysis to ease the computational burden. We apply the method and its nonelastic competitors to both simulated data and observed data to show its efficiency in handling data with phase variation with both amplitude and phase changepoints. We use the method to evaluate potential changes in stratospheric temperature due to the eruption of Mt. Pinatubo in the Philippines in June 1991. Using an epidemic changepoint model, we find evidence of a increase in stratospheric temperature during a period that contains the immediate aftermath of Mt. Pinatubo, with most detected changepoints occurring in the tropics as expected.

54 ENVIRONMENTAL SCIENCES↗