Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

CryoDRGN-AI: neural ab initio reconstruction of challenging cryo-EM and cryo-ET datasets

Proteins and other biomolecules form dynamic macromolecular machines that are tightly orchestrated to move, bind, and perform chemistry. Cryo-electron microscopy (cryo-EM) and cryo-electron tomography (cryo-ET) can access the intrinsic heterogeneity of these complexes and are therefore key tools for understanding their function. However, 3D reconstruction of the collected imaging data presents a challenging computational problem, especially without any starting information, a setting termed ab initio reconstruction. Here, in this study, we introduce cryoDRGN-AI, a method leveraging an expressive neural representation and combining an exhaustive search strategy with gradient-based optimization to process challenging heterogeneous datasets. Using cryoDRGN-AI, we reveal new conformational states in large datasets, reconstruct previously unresolved motions from unfiltered datasets, and demonstrate ab initio reconstruction of biomolecular complexes from in situ data. With this expressive and scalable model for structure determination, we hope to unlock the full potential of cryo-EM and cryo-ET as a high-throughput tool for structural biology and discovery.

Levy, Axel [Stanford Univ., CA (United States); SL↗
DOE OSTI2023

Representative Phenomena of Cyclic Turbulent Combustion in High-Pressure Fuel Sprays

Abstract Cyclic variations in conventional diesel combustion engines can lead to large differences in engine out emissions even at steady operation. This study uses an optically accessible constant-pressure flow chamber to acquire fuel injections in quick succession to analyze mixing, auto-ignition, and combustion of diesel-surrogate n-heptane using multiple high-speed optical diagnostics. Prior studies have utilized fewer injections and/or they rely on analysis of ensemble average behavior. These approaches do not yield information on injection-to-injection variation or provide confidence in utilizing individual injection measurements for high-fidelity computational fluid dynamics(CFD) model validation. In this study, a large set of 500 injections is used to obtain global parameters including liquid length, vapor penetration length, ignition delay time, and lift-off length. Results for multiple injections are presented to illustrate large injection to injection variations. Potential sources for these variations are analyzed to conclude localized, small scale turbulence and rate of injection variations as the likely sources. Then, a statistical method based on z-scores is proposed and implemented to identify instantaneous injections that best represent the bulk data-set of jet boundaries measured independently by three different diagnostics. This synthesis of statistics-guided screening of data set and ensemble-average analysis offers higher confidence for CFD model validation relying upon both a representative single and average injection results.

42 ENGINEERING↗
DOE OSTI2022

The Arabidopsis T‐DNA mutant SALK_008491 carries a 14‐kb deletion on chromosome 3 that provides rare insights into the plant response to dynamic light stress

Abstract In nature, plants experience rapid changes in light intensity and quality throughout the day. To maximize growth, they have established molecular mechanisms to optimize photosynthetic output while protecting components of the light‐dependent reaction and CO 2 fixation pathways. Plant phenotyping of mutant collections has become a powerful tool to unveil the genetic loci involved in environmental acclimation. Here, we describe the phenotyping of the transfer‐DNA (T‐DNA) insertion mutant line SALK_008491, previously known as nhd1‐1 . Growth in a fluctuating light regime caused a loss in growth rate accompanied by a spike in photosystem (PS) II damage and increased non‐photochemical quenching (NPQ). Interestingly, an independent nhd1 null allele did not recapitulate the NPQ phenotype. Through bulk sequencing of a backcrossed segregating F 2 pool, we identified an ~14‐kb large deletion on chromosome 3 (Chr3) in SALK_008491 affecting five genes upstream of NHD1 . Besides NHD1 , which encodes for a putative plastid Na + /H + antiporter, the stromal NAD‐dependent D‐3‐phosphoglycerate dehydrogenase 3 ( PGDH3 ) locus was eradicated. Although some changes in the SALK_008491 mutant's photosynthesis can be assigned to the loss of PGDH3, our follow‐up studies employing respective single mutants and complementation with overlapping transformation‐competent artificial chromosome (TAC) vectors reveal that the exacerbated fluctuating light sensitivity in SALK_008491 mutants result from the simultaneous loss of PGDH3 and NHD1. Altogether, the data obtained from this large deletion‐carrying mutant provide new and unintuitive insights into the molecular mechanisms that function to protect the photosynthetic machinery. Moreover, our study renews calls for caution when setting up reverse genetic studies using T‐DNA lines. Although second‐site insertions, indels, and SNPs have been reported before, large deletion surrounding the insertion site causes yet another problem. Nevertheless, as shown through this research, such unpredictable genetic events following T‐DNA mutagenesis can provide unintuitive insights that allow for understanding complex phenomena such as the plant acclimation to dynamic high light stress.

Lopez, Laura S.↗
DOE OSTI2025

Search for single production of vector-like quarks decaying into W(ℓν)b in pp collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

A search for single production of a vector-like quark Q, which could be either a singlet T, with charge $\frac{2}{3}$, or a Y from a (T, B, Y) triplet, with charge $-\frac{4}{3}$, is performed using data from proton-proton collisions at a centre-of-mass energy of 13 TeV. The data correspond to the full integrated luminosity of 140 fb −1 recorded with the ATLAS detector during Run 2 of the Large Hadron Collider. The analysis targets Q → Wb decays where the W boson decays leptonically. The data are found to be consistent with the expected Standard Model background, so upper limits are set on the cross-section times branching ratio, and on the coupling of the Q to the Standard Model sector for these two benchmark models. Effects of interference with the Standard Model background are taken into account. For the singlet T, the 95% confidence level limit on the coupling strength κ ranges between 0.22 and 0.52 for masses from 1150 to 2300 GeV. For the (T, B, Y) triplet, the limits on κ vary from 0.14 to 0.46 for masses from 1150 to 2600 GeV.

beyond Standard Model↗
DOE OSTI2025

Observation of double parton scattering in same-sign W boson pair production in pp collisions at $\sqrt{s} = 13$ TeV with the ATLAS detector

This letter reports the measurement of double parton scattering in same-sign W boson pair production with the ATLAS detector. The data set used corresponds to an integrated luminosity of 140 fb -1 of proton–proton collisions at a center-of-mass energy of 13 TeV, collected during Run 2 of the Large Hadron Collider. The study is performed in final states including two same-charge leptons, electron or muon, missing transverse momentum, and up to one jet. An excess of events is observed over the expected background contributions with a significance of 8.8 standard deviations. The measured fiducial cross section times leptonic branching fraction is 4.59 ± 0.64 fb. The measurement corresponds to a double parton scattering effective cross section of 10.6 ± 1.8 mb.

DPS↗
DOE OSTI2020

Spin Splitting Energy of Transition Metals: A New, More Affordable Wave Function Benchmark Method and Its Use to Test Density Functional Theory

Accurately predicting the spin splitting energy of chemical species is important for understanding their reactivity and magnetic properties, but it is very challenging, especially for molecules containing transition metals. One impediment to progress is the scarcity of accurate benchmark data. Here we report a set of calculations designed to yield reliable benchmarks for simple transition-metal complexes that can be used to test density functional methods that are affordable for large systems of more practical interest. Various wave function methods are tested against experiment for Fe 2+ , Fe 3+ , and Co 3+ , including CASSCF, CASPT2, CASPT3, MRCISD, MRCISD+Q, ACPF, AQCC, CCSD(T), and CASPT2/CCSD(T) and also a new method called CASPT2.5, which is performed by taking the average of the CASPT2 and CASPT3 energies. Furthermore, we find that MRCISD+Q, ACPF, and AQCC require smaller active spaces for good accuracy than are required by CASPT2 and CASPT3, and this aspect may be important for calculations on larger molecules; here we find that CASPT2.5 extrapolated to a complete basis set is the most suitable method—in terms of computational cost and in terms of accuracy on monatomic systems—and therefore we chose this method for molecular benchmarks. Then Kohn–Sham density functional calculations with 60 exchange-correlation functionals are tested for FeF 2 , FeCl 2 , and CoF 2 . We find that MN15-L, M06-SX, and revM06 have very good agreement with CASPT2.5 benchmarks in terms of both the spin splitting energy and the optimized geometry for each spin state. In addition, we recommend def2-TZVP as the most suitable basis set to perform density functional calculations for molecular spin splitting energies; extra polarization functions in the basis set do not help to increase the accuracy of the spin splitting energy in KS calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

The growth of density perturbations in the last ~10 billion years from tomographic large-scale structure data

In order to investigate the origin of the ongoing tension between the amplitude of matter fluctuations measured by weak lensing experiments at low redshifts and the value inferred from the cosmic microwave background anisotropies, we reconstruct the evolution of this amplitude from z ~ 2 using existing large-scale structure data. To do so, we decouple the linear growth of density inhomogeneities from the background expansion, and constrain its redshift dependence making use of a combination of 6 different data sets, including cosmic shear, galaxy clustering and CMB lensing. We analyze these data under a consistent harmonic-space angular power spectrum-based pipeline. We show that current data constrain the amplitude of fluctuations mostly in the range 0.2 < z < 0.7, where it is lower than predicted by . This difference is mostly driven by current cosmic shear data, although the growth histories reconstructed from different data combinations are consistent with each other, and we find no evidence of systematic deviations in any particular experiment. In spite of the tension with , the data are well-described by the model, albeit with a lower value of S 8 ≡ σ 8 (Ω m /0.3) 0.5 . As part of our analysis, we find constraints on this parameter of S 8 = 0.7781 ± 0.0094 (68% confidence level), reaching almost percent-level errors comparable with CMB measurements, and 3.4σ away from the value found by .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Induced and natural variation affect traits independently in hybrid Populus

Abstract The genetic control of many plant traits can be highly complex. Both allelic variation (sequence change) and dosage variation (copy number change) contribute to a plant's phenotype. While numerous studies have investigated the effect of allelic or dosage variation, very few have documented both within the same system, leaving their relative contribution to phenotypic effects unclear. The Populus genome is highly polymorphic, and poplars are fairly tolerant of gene dosage variation. Here, using a previously established Populus hybrid F1 population, we assessed and compared the effect of natural allelic variation and induced dosage variation on biomass, phenology, and leaf morphology traits. We identified QTLs for many of these traits, but our results indicate limited overlap between the QTLs associated with natural allelic variation and induced dosage variation. Additionally, the integration of data from both allelic and dosage variation identifies a larger set of QTLs that together explain a larger percentage of the phenotypic variance. Finally, our results suggest that the effect of the large indels might mask that of allelic QTLs. Our study helps clarify the relationship between allelic and dosage variation and their effects on quantitative traits.

Guo, Weier (ORCID:0000000251789334)↗
DOE OSTI2022

Consistent lensing and clustering in a low- S 8 Universe with BOSS, DES Year 3, HSC Year 1, and KiDS-1000

ABSTRACT We evaluate the consistency between lensing and clustering based on measurements from Baryon Oscillation Spectroscopic Survey combined with galaxy–galaxy lensing from Dark Energy Survey (DES) Year 3, Hyper Suprime-Cam Subaru Strategic Program (HSC) Year 1, and Kilo-Degree Survey (KiDS)-1000. We find good agreement between these lensing data sets. We model the observations using the Dark Emulator and fit the data at two fixed cosmologies: Planck (S8 = 0.83), and a Lensing cosmology (S8 = 0.76). For a joint analysis limited to large scales, we find that both cosmologies provide an acceptable fit to the data. Full utilization of the higher signal-to-noise small-scale measurements is hindered by uncertainty in the impact of baryon feedback and assembly bias, which we account for with a reasoned theoretical error budget. We incorporate a systematic inconsistency parameter for each redshift bin, A, that decouples the lensing and clustering. With a wide range of scales, we find different results for the consistency between the two cosmologies. Limiting the analysis to the bins for which the impact of the lens sample selection is expected to be minimal, for the Lensing cosmology, the measurements are consistent with A = 1; A = 0.91 ± 0.04 (A = 0.97 ± 0.06) using DES+KiDS (HSC). For the Planck case, we find a discrepancy: A = 0.79 ± 0.03 (A = 0.84 ± 0.05) using DES+KiDS (HSC). We demonstrate that a kinematic Sunyaev–Zeldovich-based estimate for baryonic effects alleviates some of the discrepancy in the Planck cosmology. This analysis demonstrates the statistical power of small-scale measurements; however, caution is still warranted given modelling uncertainties and foreground sample selection effects.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

OptZConfig: Efficient Parallel Optimization of Lossy Compression Configuration

Lossless compressors have very low compression ratios that do not meet the needs of today's large-scale scientific applications that produce vast volumes of data. Error-bounded lossy compression (EBLC) is considered a critical technique for the success of scientific research. Although EBLC allows users to set an error bound for the compression, users have been unable to specify the requirements on the compression quality, limiting practical use. Our contributions are: (1) We formulate the problem of configuring EBLC to preserve a user-defined metric as an optimization problem. This allows many classes of new metrics to be preserved, which improves over current practices. (2) We present a framework, OptZConfig, that can adapt to improvements in the search algorithm, compressor, and metrics with minimal changes, enabling future advancements in this area. (3) We demonstrate the advantages of our approach against the leading methods to configure compressors to preserve specific metrics. Here, our approach improves compression ratios against a specialized compressor by up to 3 x, has a 56x speedup over FRaZ, 1000x speedup over MGARD-QOI post tuning, and 110x speedup over systematic approaches which had not been bounded by compressors before.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Global root traits (GRooT) database

Motivation: Trait data are fundamental to the quantitative description of plant form and function. Although root traits capture key dimensions related to plant responses to changing environmental conditions and effects on ecosystem processes, they have rarely been included in large-scale comparative studies and global models. For instance, root traits remain absent from nearly all studies that define the global spectrum of plant form and function. Thus, to overcome conceptual and methodological roadblocks preventing a widespread integration of root trait data into large-scale analyses we created the Global Root Trait (GRooT) Database. GRooT provides readyto- use data by combining the expertise of root ecologists with data mobilization and curation. Specifically, we (a) determined a set of core root traits relevant to the description of plant form and function based on an assessment by experts, (b) maximized species coverage through data standardization within and among traits, and (c) implemented data quality checks. Main types of variables contained: GRooT contains 114,222 trait records on 38 continuous root traits. Spatial location and grain: Global coverage with data from arid, continental, polar, temperate and tropical biomes. Data on root traits were derived from experimental studies and field studies. Time period and grain: Data were recorded between 1911 and 2019. Major taxa and level of measurement: GRooT includes root trait data for which taxonomic information is available. Trait records vary in their taxonomic resolution, with subspecies or varieties being the highest and genera the lowest taxonomic resolution available. It contains information for 184 subspecies or varieties, 6,214 species, 1,967 genera and 254 families. Owing to variation in data sources, trait records in the database include both individual observations and mean values. Software format: GRooT includes two csv files. A GitHub repository contains the csv files and a script in R to query the database.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

ML-based Dimension Reduction Strategies

Deep learning (DL)--based surrogate models have achieved success in various applications in carbon capture and storage (CCS). However, the model training on high-dimensional spaces is computationally expensive and impractical for large-scale and complex geological models, because the models usually contain hundreds of thousands to millions of grid cells, each with a set of parameters. Furthermore, the high cost of generating training data with sufficient variation is another limitation of model training on high-dimensional spaces, which may result in overfitting and reduce the model efficiency and prediction performance. We proposed the workflow incorporating dimension reduction methods and deep learning models, which aim to extract the latent variables of input parameters and output state variables, and then build the mapping function at the latent spaces. The proposed workflow can significantly reduce the computational complexity in solving both forward and inverse problems compared to models trained on high-dimensional spaces. Dimensionality reduction models showed great potential in workflows for fast reservoir simulation, history matching, prior model generation, visualization, and more, ultimately enhancing DL model performance in related SMART Work Packages.

Hosseini, Seyyed↗
DOE OSTI2023

Locating Partial Discharges in Power Transformers with Convolutional Iterative Filtering

The most common source of transformer failure is in the insulation, and the most prevalent warning signal for insulation weakness is partial discharge (PD). Locating the positions of these partial discharges would help repair the transformer to prevent failures. This work investigates algorithms that could be deployed to locate the position of a PD event using data from ultra-high frequency (UHF) sensors inside the transformer. These algorithms typically proceed in two steps: first determining the signal arrival time, and then locating the position based on time differences. This paper reviews available methods for each task and then propose new algorithms: a convolutional iterative filter with thresholding (CIFT) to determine the signal arrival time and a reference table of travel times to resolve the source location. The effectiveness of these algorithms are tested with a set of laboratory-triggered PD events and two sets of simulated PD events inside transformers in production use. Tests show the new approach provides more accurate locations than the best-known data analysis algorithms, and the difference is particularly large, 3.7X, when the signal sources are far from sensors.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Detecting Anomalous Images in Astronomical Datasets

Abstract Environmental and instrumental conditions can cause anomalies in astronomical images, which can potentially bias all kinds of measurements if not excluded. Detection of the anomalous images is usually done by human eyes, which is slow and sometimes not accurate. This is an important issue in weak lensing studies, particularly in the era of large-scale galaxy surveys, in which image qualities are crucial for the success of galaxy shape measurements. In this work we present two automatic methods for detecting anomalous images in astronomical data sets. The anomalous features can be divided into two types: one is associated with the source images, and the other appears on the background. Our first method, called the entropy method, utilizes the randomness of the orientation distribution of the source shapes and the background gradients to quantify the likelihood of an exposure being anomalous. Our second method involves training a neural network (autoencoder) to detect anomalies. We evaluate the effectiveness of the entropy method on the Canada–France–Hawaii Telescope Lensing Survey (CFHTLenS) and Dark Energy Camera Legacy Survey (DECaLS DR3) data. In CFHTLenS, with 1171 exposures, the entropy method outperforms human inspection by detecting 12 of the 13 anomalous exposures found during human inspection and uncovering 10 new ones. In DECaLS DR3, with 17112 exposures, the entropy method detects a significant number of anomalous exposures while keeping a low false-positive rate. We find that although the neural network performs relatively well in detecting source anomalies, its current performance is not as good as the entropy method.

Astronomy & Astrophysics↗
DOE OSTI2023

Towards an astronomical foundation model for stars with a transformer-based model

ABSTRACT Rapid strides are currently being made in the field of artificial intelligence using transformer-based models like Large Language Models (LLMs). The potential of these methods for creating a single, large, versatile model in astronomy has not yet been explored. In this work, we propose a framework for data-driven astronomy that uses the same core techniques and architecture as used by LLMs. Using a variety of observations and labels of stars as an example, we build a transformer-based model and train it in a self-supervised manner with cross-survey data sets to perform a variety of inference tasks. In particular, we demonstrate that a single model can perform both discriminative and generative tasks even if the model was not trained or fine-tuned to do any specific task. For example, on the discriminative task of deriving stellar parameters from Gaia XP spectra, we achieve an accuracy of 47 K in Teff, 0.11 dex in log g, and 0.07 dex in [M/H], outperforming an expert XGBoost model in the same setting. But the same model can also generate XP spectra from stellar parameters, inpaint unobserved spectral regions, extract empirical stellar loci, and even determine the interstellar extinction curve. Our framework demonstrates that building and training a single foundation model without fine-tuning using data and parameters from multiple surveys to predict unmeasured observations and parameters is well within reach. Such ‘Large Astronomy Models’ trained on large quantities of observational data will play a large role in the analysis of current and future large surveys.

Leung, Henry W. (ORCID:0000000200362752)↗
DOE OSTI2026

Data for KETCHUP: Parameterizing of Large-Scale Kinetic Models Using Multiple Datasets with Different Reference States

Repository for Kinetic Estimation Tool Capturing Heterogeneous Datasets Using Pyomo (KETCHUP), a flexible parameter estimation tool that leverages a primal-dual interior-point algorithm to solve a nonlinear programming (NLP) problem that identifies a set of parameters capable of recapitulating the steady-state fluxes and concentrations in wild-type and perturbed metabolic networks. KETCHUP can use K-FIT [2] input files. Example K-FIT input files are located in the K-FIT repository at https://github.com/maranasgroup/K-FIT.

Metabolomics↗
DOE OSTI2021

ExaWorks: Workflows for Exascale

Exascale computers will offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific discovery and insight. These software combinations and integrations, however, are difficult to achieve due to challenges of coordination and deployment of heterogeneous software components on diverse and massive platforms. We present the ExaWorks project, which can address many of these challenges: ExaWorks is leading a co-design process to create a workflow Software Development Toolkit (SDK) consisting of a wide range of workflow management tools that can be composed and interoperate through common interfaces. We describe the initial set of tools and interfaces supported by the SDK, efforts to make them easier to apply to complex science challenges, and examples of their application to exemplar cases. Furthermore, we discuss how our project is working with the workflows community, large computing facilities as well as HPC platform vendors to sustainably address the requirements of workflows at the exascale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Data Release Report for the Source Physics Experiment Phase II: Dry Alluvium Geology Experiments (DAG-1 through DAG-4), Nevada National Security Site

The Dry Alluvium Geology (DAG) project was Phase II of the Source Physics Experiment and consisted of a series of four chemical explosive tests conducted in the same source hole on the Nevada National Security Site. This hole is located at 37.1146°N and -116.0693°W, with a surface elevation of 1,285.2 meters (m) (4,216.5 feet [ft]) above sea level. The first test (DAG-1) was conducted on July 20, 2018, at 16:51:52.67838 Coordinated Universal Time (UTC). The explosive source for DAG-1 was nitromethane initiated by a small plastic-bonded explosive (PBX) charge, detonated at the depth of 385.0 m (1,263.2 ft) below ground surface. DAG-1 had a trinitrotoluene (TNT) equivalent yield of 0.908 metric tons (2,002 pounds [lbs]). DAG-2 was conducted on December 19, 2018, at 18:45:56.92115 UTC. This test was the largest in the series, with a TNT equivalent yield of 50.997 metric tons (112,429 lbs). The explosive source for DAG-2 was nitromethane initiated by a small PBX charge, detonated at the depth of 299.8 m (983.6 ft) below ground surface. DAG-3 was conducted on April 27, 2019, at 15:49:01.84183 UTC. The explosive source for this test was nitromethane initiated by a small PBX charge, detonated at the depth of 149.9 m (492.0 ft) below ground surface. DAG-3 had a TNT equivalent yield of 0.908 metric tons (2,002 lbs). The final DAG test (DAG-4) was conducted on June 22, 2019, at 21:06:19.87632 UTC. The explosive source for DAG-4 was nitromethane initiated by a small PBX charge, detonated at the depth of 51.6 m (169.3 ft) below ground surface. DAG-4 had a TNT equivalent yield of 10.357 metric tons (22,833 lbs). The four tests were recorded by an extensive set of instrumentation that included sensors both at near-field (less than 200 m) and far-field (200 m or greater) distances. The near-field instruments consisted of three-component (3C) accelerometers installed at various depths ranging from 51.6 to 385 m (169.3 to 1,263.1 ft) below ground surface in boreholes positioned around the source hole, and arrays of single-component and 3C accelerometers on the surface. The far-field network comprised a variety of seismic and acoustic sensors, including short-period geophones, broadband seismometers, and 3C accelerometers at distances of 200 m to 400 kilometers. In addition, the DAG-2, DAG-3, and DAG-4 explosions were recorded by a temporary array of 496 geophones arranged in a densely spaced grid pattern known as “Large N.” This report coincides with the release of these data for analysts and organizations that are not participants in this program. This report describes the four DAG tests and the various types of near-field, far-field, and other data that are available. Assembled data sets are accessible through: Incorporated Research Institutions for Seismology, Data Management Center 1408 NE 45th Street, Suite 201, Seattle, Washington 98105 USA. www.iris.washington.edu

58 GEOSCIENCES↗