Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Three-dimensional lattice modulations in the charge density wave system Lu 2 Ir 3 Si 5

Using total and resonant x-ray scattering coupled to large-scale computer modeling, we study the lattice modulations in the complex charge density wave (CDW) material Lu 2 ⁢Ir 3 ⁢Si 5 . Here, we find that it is a unique quantum system where periodic lattice modulations related to emergent CDW order occur in three orthogonal atomic planes of the crystal lattice, leading to the emergence of an unusual three-dimensional (3D) pattern of short and long Ir-Ir and Lu-Lu bonds. The 3D character of observed lattice modulations explains the largely isotropic character of the changes in the electronic properties occurring when the CDW order sets in, demonstrating the strong electron-lattice coupling in Lu 2 ⁢Ir 3 ⁢Si 5 . The result is supported by DFT calculations based on the experimental structure data. Altogether, our work provides strong evidence for the presence of a relationship between the dimensionality of emergent lattice distortions and that of concurrent changes in the electronic properties of CDW materials. The relationship may need to be accounted for when these materials are explored for practical applications.

36 MATERIALS SCIENCE↗
DOE OSTI2023

EMMA: a new method for computing multiple sequence alignments given a constraint subset alignment

Abstract Background Adding sequences into an existing (possibly user-provided) alignment has multiple applications, including updating a large alignment with new data, adding sequences into a constraint alignment constructed using biological knowledge, or computing alignments in the presence of sequence length heterogeneity. Although this is a natural problem, only a few tools have been developed to use this information with high fidelity. Results We present EMMA (Extending Multiple alignments using MAFFT--add) for the problem of adding a set of unaligned sequences into a multiple sequence alignment (i.e., a constraint alignment). EMMA builds on MAFFT--add, which is also designed to add sequences into a given constraint alignment. EMMA improves on MAFFT--add methods by using a divide-and-conquer framework to scale its most accurate version, MAFFT-linsi--add, to constraint alignments with many sequences. We show that EMMA has an accuracy advantage over other techniques for adding sequences into alignments under many realistic conditions and can scale to large datasets with high accuracy (hundreds of thousands of sequences). EMMA is available at https://github.com/c5shen/EMMA . Conclusions EMMA is a new tool that provides high accuracy and scalability for adding sequences into an existing alignment.

Shen, Chengze↗
DOE OSTI2024

Single-Particle Soot Photometer (SP2) Black Carbon Number and Mass Concentrations

The single-particle soot photometer (SP2) records particle-by-particle measurements of the intensity of both the scattering signature and incandescence signature of particles that enter its laser beam. These intensities are then used to calculate refractory black carbon (rBC) masses and particle diameters. In previous U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility field campaigns, the SP2 data was difficult to process because the manufacturer-supplied code was not scalable to distributed machines, making it unusable for the large amounts of data output by the SP2. This prohibited the SP2 from becoming an operational instrument for ARM. Therefore, PySP2 was developed to solve this issue and enable SP2 to be an operational instrument for ARM. This technical document summarizes the test data sets from the ARM North Slope of Alaska (NSA) site and the Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC) field campaign that were used to develop and test PySP2.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Reduced-form Cost Model for Prefeasibility Analysis of Hydropower at Non-Powered Dams

This study presents a reduced-form model to support a better understanding of the capacity potential and drivers of costs for hydropower development at U.S. non-powered dams (NPD), which are existing dams that are not currently used for hydropower. With information on nineteen reference sites, a set of reduced-form design and cost equations were estimated to enable rapid assessments of aggregate costs and their components for a large number of NPD sites. The model was then applied to 36,000+ potential U.S. NPD sites using the limited data commonly available. Although the cost estimates span a wide range, there exists a significant amount of U.S. NPD hydropower capacity potential, which are considered cost-competitive in the current market using baseline technologies.

13 HYDRO ENERGY↗
DOE OSTI2026

Analysis of PV Fleet Performance in Western United States During August 2020 Extreme Heat Wave

Starting in June 2020 through the end of that year, the western and central United States experienced a widespread heat wave and drought, which resulted in US$5.44 billion (CPI-adjusted) worth of damages. The ongoing heat and drought produced record large wildfires across the region, responsible for an additional US$19.9 billion in damage. These natural disasters directly impacted the energy system in the western US, leading to power blackouts in August 2020. In this work, we analyze the NLR PV Fleets data set, focusing on the geographic area covered by the Western Coordinating Council (WECC). We find that over the 10-day period from August 14 through 24, the median PV system produced 12% lower energy than expected, with some locations experiencing total losses of around 30%. Analyzing the spatial-temporal structure of the data and supplementing with limited operational current and voltage data where available, we find that system underperformance was more strongly impacted by irradiance reduction from wildfire smoke rather than by the high heat itself.

14 SOLAR ENERGY↗
DOE OSTI2022

Farpoint: A High-resolution Cosmology Simulation at the Gigaparsec Scale

Abstract In this paper we introduce the Farpoint simulation, the latest member of the Hardware/Hybrid Accelerated Cosmology Code (HACC) gravity-only simulation family. The domain covers a volume of (1000 h −1 Mpc) 3 and evolves close to two trillion particles, corresponding to a mass resolution of m p ∼ 4.6 × 10 7 h −1 M ⊙ . These specifications enable comprehensive investigations of the galaxy–halo connection, capturing halos down to small masses. Further, the large volume resolves scales typical of modern surveys with good statistical coverage of high-mass halos. The simulation was carried out on the GPU-accelerated system Summit, one of the fastest supercomputers currently available. We provide specifics about the Farpoint run and present an initial set of results. The high mass resolution facilitates precise measurements of important global statistics, such as the halo concentration–mass relation and the correlation function down to small scales. Selected subsets of the simulation data products are publicly available via the HACC Simulation Data Portal.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Machine Learning for Improving Surface-Layer-Flux Estimates

Abstract Flows in the atmospheric boundary layer are turbulent, characterized by a large Reynolds number, the existence of a roughness sublayer and the absence of a well-defined viscous layer. Exchanges with the surface are therefore dominated by turbulent fluxes. In numerical models for atmospheric flows, turbulent fluxes must be specified at the surface; however, surface fluxes are not known a priori and therefore must be parametrized. Atmospheric flow models, including global circulation, limited area models, and large-eddy simulation, employ Monin–Obukhov similarity theory (MOST) to parametrize surface fluxes. The MOST approach is a semi-empirical formulation that accounts for atmospheric stability effects through universal stability functions. The stability functions are determined based on limited observations using simple regression as a function of the non-dimensional stability parameter representing a ratio of distance from the surface and the Obukhov length scale (Obukhov in Trudy Inst Theor Geofiz AN SSSR 1:95–115, 1946), $$z/L$$ z / L . However, simple regression cannot capture the relationship between governing parameters and surface-layer structure under the wide range of conditions to which MOST is commonly applied. We therefore develop, train, and test two machine-learning models, an artificial neural network (ANN) and random forest (RF), to estimate surface fluxes of momentum, sensible heat, and moisture based on surface and near-surface observations. To train and test these machine-learning algorithms, we use several years of observations from the Cabauw mast in the Netherlands and from the National Oceanic and Atmospheric Administration’s Field Research Division tower in Idaho. The RF and ANN models outperform MOST. Even when we train the RF and ANN on one set of data and apply them to the second set, they provide more accurate estimates of all of the fluxes compared to MOST. Estimates of sensible heat and moisture fluxes are significantly improved, and model interpretability techniques highlight the logical physical relationships we expect in surface-layer processes.

Meteorology & Atmospheric Sciences↗
DOE OSTI2024

Parametric description of intermittent probability distribution functions in solar wind and magnetohydrodynamic turbulence

ABSTRACT In this work, we find empirical evidence that the scale-dependent statistical properties of solar wind and magnetohydrodynamic (MHD) turbulence can be described in terms of a family of parametric probability distribution functions (PDFs) known as Normal Inverse Gaussian (NIG). Understanding these PDFs is one of the most important goals in turbulence theory, as they are inherently connected to the intermittent properties of solar wind turbulence. We investigate the properties of PDFs of Elsasser increments based on a large statistical sample from solar wind observations and high-resolution numerical simulations of MHD turbulence. In order to measure the PDFs and their corresponding properties, three experiments are presented: fast and slow solar wind for experimental data and a simulation of reduced MHD (RMHD) turbulence. Conditional statistics on a 23-yr-long sample of WIND data near 1 au and high-resolution pseudo-spectral simulation of steadily driven RMHD turbulence on a $2048^3$ mesh are used to construct scale-dependent PDFs. The empirical PDFs are fitted to NIG distributions, which depend on four free parameters. Our analysis shows that NIG distributions accurately capture the evolution of the PDFs, with scale-dependent parameters, from large scales characterized by a Gaussian distribution, turning to exponential tails within the inertial range and stretched exponentials at dissipative scales. We also show that empirically-measured NIG parameters exhibit well-defined scaling properties that are similar across the three empirical data sets, which may be indicative of universal behaviour.

Astronomy & Astrophysics↗
DOE OSTI2024

Tree-based algorithms for weakly supervised anomaly detection

Weakly supervised methods have emerged as a powerful tool for model-agnostic anomaly detection at the Large Hadron Collider (LHC). While these methods have shown remarkable performance on specific signatures such as dijet resonances, their application in a more model-agnostic manner requires dealing with a larger number of potentially noisy input features. In this paper, we show that using boosted decision trees as classifiers in weakly supervised anomaly detection gives superior performance compared to deep neural networks. Boosted decision trees are well known for their effectiveness in tabular data analysis. Our results show that they not only offer significantly faster training and evaluation times, but they are also robust to a large number of noisy input features. By using advanced gradient boosted decision trees in combination with ensembling techniques and an extended set of features, we significantly improve the performance of weakly supervised methods for anomaly detection at the LHC. This advance is a crucial step toward a more model-agnostic search for new physics. Published by the American Physical Society 2024

Astronomy & Astrophysics↗
DOE OSTI2022

Delimiting the cryptic diversity and host preferences of Sycophila parasitoid wasps associated with oak galls using phylogenomic data

Abstract Cryptic species diversity is a major challenge regarding the species‐rich community of parasitoids attacking oak gall wasps due to a high degree of sexual dimorphism, morphological plasticity, small size and poorly known biology. As such, we know very little about the number of species present, nor the evolutionary forces responsible for generating this diversity. One hypothesis is that trait diversity in the gall wasps, including the morphology of the galls they induce, has evolved in response to selection imposed by the parasitoid community, with reciprocal selection driving diversification of the parasitoids. Using a rare, continental‐scale data set of Sycophila parasitoid wasps reared from 44 species of cynipid galls from 18 species of oak across the USA, we combined mitochondrial DNA barcodes, ultraconserved elements (UCEs), morphological and natural history data to delimit putative species. Using these results, we generate the first large‐scale assessment of ecological specialization and host association in this species‐rich group, with implications for evolutionary ecology and biocontrol. We find most Sycophila target specific subsets of available cynipid host galls with similar morphologies, and generally attack larger galls. Our results suggest that parasitoid wasps such as Sycophila have adaptations allowing them to exploit particular host trait combinations, while hosts with contrasting traits are resistant to attack. These findings support the tritrophic niche concept for the structuring of plant–herbivore–parasitoid communities.

Zhang, Yuanmeng M.↗
DOE OSTI2020

Search for direct production of electroweakinos in final states with one lepton, missing transverse momentum and a Higgs boson decaying into two b -jets in $pp$ collisions at $\sqrt{s} = 13$ TeV with the ATLAS detector

The results of a search for electroweakino pair production $pp \rightarrow \tilde\chi^\pm_1 \tilde\chi^0_2$ in which the chargino ($\tilde\chi^\pm_1$) decays into a $W$ boson and the lightest neutralino ($\tilde\chi^0_1$), while the heavier neutralino ($\tilde\chi^0_2$) decays into the Standard Model 125 GeV Higgs boson and a second $\tilde\chi^0_1$ are presented. The signal selection requires a pair of $b$-tagged jets consistent with those from a Higgs boson decay, and either an electron or a muon from the $W$ boson decay, together with missing transverse momentum from the corresponding neutrino and the stable neutralinos. The analysis is based on data corresponding to 139 $\mathrm{fb}^{-1}$ of $\sqrt{s}=13$ TeV $pp$ collisions provided by the Large Hadron Collider and recorded by the ATLAS detector. No statistically significant evidence of an excess of events above the Standard Model expectation is found. Limits are set on the direct production of the electroweakinos in simplified models, assuming pure wino cross-sections. Masses of $\tilde{\chi}^{\pm}_{1}/\tilde{\chi}^{0}_{2}$ up to 740 GeV are excluded at 95% confidence level for a massless $\tilde{\chi}^{0}_{1}$.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

TASTI-GRID: a holistic view of Florida's grid resilience opportunities

In December of 2025, the American Society of Civil Engineers updated Florida’s infrastructure grade to a ”C+” – reflecting overall investments in recent years. With the recommendation to further strengthen the electric grid and establish consistent building standards, extreme weather, aging infrastructure, and population in-migration are still compounding Florida’s grid vulnerabilities. Key challenges related to hurricane and other tropical & marine weather events are not unique to Florida. However, the state’s topography, location, demographics, and variation among rural and urban centers for tourism and industry, demonstrate the need for unique approaches to advancing critical infrastructure resilience, particularly for large concentrations of elderly residents or in areas of historic underinvestment. Florida’s grid asset advancements are credited with a reduction in average power outage durations. Yet, improvements since 2021 have set the stage for future resilience activities – as modernization efforts have greatly improved data collection – enabling better understanding of vulnerabilities and trends across counties and localities (particularly in Central Florida).

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

A Lagrangian analysis of pockets of open cells over the southeastern Pacific

Abstract. Pockets of open cells (POCs) have been shown to develop within closed-cell stratocumulus (StCu), and a large body of evidence suggests that the development of POCs result from changes in small-scale processes internal to the boundary layer rather than large-scale forcings. Precipitation is widely viewed as a key process important to POC development and maintenance. In this study, GOES-16 satellite observations are used in conjunction with MERRA-2 winds to track and compare the microphysical and environmental evolution of two populations of closed-cell StCu selected by visual inspection over the southeastern Pacific Ocean: one group that transitions to POCs and another comparison group (CLOSED) that does not. The high spatiotemporal resolution of the new GOES-16 data allows for a detailed examination of the temporal evolution of POCs in this region. We find that POCs tend to develop near the coast, last tens of hours, are larger than 104 km2, and often (88 % of cases) do not re-close before they exit the StCu deck. Most POCs are observed to form at night and tend to exit the StCu during the day when the StCu is contracting in area. Relative to the CLOSED trajectories, POCs have systematically larger effective radii, lower cloud drop number concentrations, a comparable conditional in-cloud liquid water path, and a higher frequency of more intense precipitation. Meanwhile, no systematic environmental differences other than boundary layer height are observed between POC and CLOSED trajectories. Interestingly, there are no differences in reanalysis aerosol optical depth between both sets of trajectories, which may lead one to the interpretation that differences in aerosol concentrations are not influencing POC development or resulting in a large number that re-close. However, this largely depends on the reanalysis treatment of aerosol–cloud interactions, and the product used in this study has no explicit handling of these important processes. These results support the consensus view regarding the importance of precipitation on the formation and maintenance of POCs and demonstrate the utility of modern geostationary remote sensing data in evaluating the POC life cycle.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Smart Scattering Scanning Near-Field Optical Microscopy

Scattering scanning near-field optical microscopy (s-SNOM) provides spectroscopic imaging from molecular to quantum materials with few nanometer deep subdiffraction limited spatial resolution. However, in its conventional implementation s-SNOM is slow to effectively acquire a series of spatio-spectral images, especially with large fields of view. This problem is further exacerbated for weak resonance contrast or when using light sources with limited spectral irradiance. Indeed, the generally limited signal-to-noise ratio prevents sampling a weak signal at the Nyquist sampling rate. Here, we demonstrate how acquisition time and sampling rate can be significantly reduced by using compressed sampling, matrix completion, and adaptive random sampling, while maintaining or even enhancing the physical or chemical image content. We use fully sampled real data sets of molecular, biological, and quantum materials as ground-truth physical data and show how deep under-sampling with a corresponding reduction of acquisition time by 1 order of magnitude or more retains the core s-SNOM image information. We demonstrate that a sampling rate of up to 6× smaller than the Nyquist criterion can be applied, which would provide a 30-fold reduction in the data required under typical experimental conditions. Furthermore, our smart s-SNOM approach is generally applicable and provides systematic full spatio-spectral s-SNOM imaging with a large field of view at high spectral resolution and reduced acquisition time.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT)

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from the noisy observation of a single solution trajectory. Identifying unknown differential equations from noisy data is a difficult task, and it is even more challenging with space and time varying coefficients in the PDE. The proposed algorithm, GP-IDENT, has three ingredients: (i) we use B-spline bases to express the unknown space and time varying coefficients, (ii) we propose Group Projected Subspace Pursuit (GPSP) to find a sequence of candidate PDEs with various levels of complexity, and (iii) we propose a new criterion for model selection using the Reduction in Residual (RR) to choose an optimal one among a pool of candidates. The new GPSP considers group projected subspaces which is more robust than existing methods in distinguishing correlated group features. We test GP-IDENT on a variety of PDEs and PDE systems, and compare it with the state-of-the-art parametric PDE identification algorithms under different settings to illustrate its outstanding performance. Furthermore, our experiments show that GP-IDENT is effective in identifying the correct terms from a large dictionary, and our model selection scheme is robust to noise.

Data-driven method↗
DOE OSTI2021

Evaluation of the PhaseNet Model Applied to the IMS Seismic Network

Producing a complete and accurate set of signal detections is essential for automatically building and characterizing seismic events of interest for nuclear explosion monitoring. Signal detection algorithms have been an area of research for decades, but still produce large quantities of false detections and misidentify real signals that must be detected to produce a complete global catalog of events of interest. Deep learning methods have shown promising capabilities in effectively characterizing seismic signals for complex tasks such as identifying phase arrival times. We use the PhaseNet model, a UNet-based Neural Network, trained on local distance data from northern California to predict seismic arrivals on data from the International Monitoring System (IMS) global network. We use an analyst-curated bulletin generated from this data set to compare the performance of PhaseNet to that of the Short-Term Average/Long-Term Average (STA/LTA) algorithm. We find that PhaseNet has the potential of outperforming traditional processing methods and recommend the training of a new model with the IMS data to achieve optimal performance.

58 GEOSCIENCES↗
DOE OSTI2022

Evaluation of hydrograph separation techniques with uncertain end-member composition

Hydrograph separation is one of many approaches used to analyse shifts in source water contributions to stream flow resulting from climate change in remote watersheds. Understanding these shifts is vital, as shifts in source water contributions to a stream can shape water management decisions. Because remote watersheds are often inaccessible and have poorly characterized contributing water sources, or end-members, it is critical to understand the implications of using different hydrograph separation techniques in these data-limited environments. To explore the uncertainty associated with different techniques, results from two hydrograph separation techniques, mass balance and principle component analysis, were compared using 3 years of aqueous geochemical data from the East River watershed located in the Elk Mountains of Central Colorado. Solute concentrations of the end-members were characterized by both a limited set of direct chemical measurements of different sources and detailed seasonal instream chemistry to examine the influences of uncertain end-member compositions in a data-limited environment. Annual volumetric end-member contributions to stream flow had relatively good agreement across separation techniques. Large variations in time were observed in the hydrograph separations, depending on the end-member type, and estimated flow contributions varied between the selected solutes. End-member concentrations characterized by stream chemistry showed several limitations including a reduced number of distinguishable end-members and differences in timing of flow contributions. Here the results highlight the benefits of using multiple hydrograph separation techniques by providing a ‘weight-of-evidence’ approach to environments with limited end-member concentration data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Subseasonal Forecasting and MJO Teleconnections in Machine Learning Weather Prediction Models

Abstract In recent years, machine‐learning (ML) models trained on reanalysis data have rivaled physics‐based forecast models in terms of performance skill for global weather forecasting. With increased rollout stability, the question of how these models perform for subseasonal to seasonal (S2S, week 3–8) forecasting has emerged. In this study we run a large set of subseasonal hindcasts over 2004–2023 to evaluate two ML weather forecast models at the S2S time scale, SFNO‐HENS (Nvidia, fully ML) and NeuralGCM (Google Research, hybrid). Corresponding hindcasts from the European Centre for Medium‐Range Weather Forecasts (ECMWF) are used as a baseline for comparison to a physics‐based model. Because our focus is on predicting moisture transport over the Western United States between October and March, we evaluate the models' prediction skill for the Madden‐Julian Oscillation (MJO) and its associated teleconnections in the North Pacific. We find that both ML models are competitive with the ECWMF model, with comparable skill in predicting the North Pacific large‐scale circulation and the MJO at week 3 and beyond. Even though overall the mid‐latitude subseasonal prediction skill remains low, the ML models exhibit interesting behavior such as a realistic propagation of the MJO across the Maritime Continent and realistic teleconnections. A SFNO‐HENS sensitivity experiment with altered initial conditions in the tropics demonstrates the stability of the model, and it illustrates the capability of ML models to represent important physical processes of the atmosphere at the S2S time scale. Plain Language Summary Predicting weather patterns and precipitation a few weeks in advance (subseasonal time scale) is of great interest for stakeholders such as water managers in the Southwest United States (US), where arid conditions prevail. Subseasonal forecasts from traditional weather forecast models exhibit low skill in the region, limiting their applicability. Here we examine whether the recent breakthrough in weather forecasting made with machine learning/artificial intelligence models can translate to improved subseasonal forecasts. Recently‐developed machine learning models exhibit comparable skill to a state‐of‐the‐art physics‐based model for predicting weather patterns in the North Pacific/North America region, and associated moisture transport. The same applies to their skill in predicting the tropical pattern, the Madden‐Julian Oscillation, and its important remote perturbations over the midlatitude East Pacific and Southwest US. Additionally, a perturbation experiment carried out with one of the machine learning models illustrates their ability to not only predict the evolution of atmospheric fields, but also to learn and represent physical processes such as tropics‐extratropics Rossby wave propagation. Key Points Two machine learning weather forecast models exhibit state‐of‐the‐art prediction skill at the subseasonal time scale in the Pacific sector The models equal ECWMF in terms of Madden‐Julian oscillation (MJO) prediction skill, and they accurately predict the MJO propagation and associated teleconnections The two machine‐learning models represent key physical processes for subseasonal prediction, despite being trained for weather forecasting

Peings, Yannick↗