Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed data structures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Incorporating new evaluation on angular distributions and energy spectra of neutron-induced charged particle reactions into the next ENDF library release (Technical Progress Report)

This project aims to provide the improved Evaluated Nuclear Data File (ENDF) using the newly measured data as well as the latest nuclear reaction model for calculating angular distributions and energy spectra on neutron-induced charged particle reactions through the collaboration of Korea Atomic Energy Research Institute (KAERI) and Los Alamos National Laboratory (LANL). The LANL group will provide the experimental data for angular distributions and spectra of (n,p) and (n,α) on several structural materials such as Fe, Ni and Zn isotopes using the Low Energy Neutron-induced Charged-particle (Z) Chamber (LENZ) instrument at Los Alamos Neutron Science Center (LANSCE). The KAERI group will provide the improved evaluated nuclear library which is based on the LANL experimental data, and further will predict angular distributions and spectra of (n,p) and (n,α) reactions on unmeasured nuclides, such as Cr, Mn, Co, Cu and so on. For the first year of this project, we planned to analyze (n,p) and (n,α) reactions for 54,56 Fe and perform new measurements on those reactions for 58,60 Ni isotopes with the LENZ instrument at LANSCE. For improving our evaluation quality, we have studied reaction models to reproduce LANL’s experimental angular distributions and energy spectra using the full Hauser-Feshbach model code, CoH3 with no approximations used. As the first year’s deliverables, we provided the experimental (n,p) and (n,α) reaction cross sections for 54,56 Fe and incorporate new evaluation on angular distributions and energy spectra of neutron-induced charged particle reactions into the current ENDF/B-VIII.0.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Learning epistatic polygenic phenotypes with Boolean interactions

Detecting epistatic drivers of human phenotypes is a considerable challenge. Traditional approaches use regression to sequentially test multiplicative interaction terms involving pairs of genetic variants. For higher-order interactions and genome-wide large-scale data, this strategy is computationally intractable. Moreover, multiplicative terms used in regression modeling may not capture the form of biological interactions. Building on the Predictability, Computability, Stability (PCS) framework, we introduce the epiTree pipeline to extract higher-order interactions from genomic data using tree-based models. The epiTree pipeline first selects a set of variants derived from tissue-specific estimates of gene expression. Next, it uses iterative random forests (iRF) to search training data for candidate Boolean interactions (pairwise and higher-order). We derive significance tests for interactions, based on a stabilized likelihood ratio test, by simulating Boolean tree-structured null (no epistasis) and alternative (epistasis) distributions on hold-out test data. Finally, our pipeline computes PCS epistasis p-values that probabilisticly quantify improvement in prediction accuracy via bootstrap sampling on the test set. We validate the epiTree pipeline in two case studies using data from the UK Biobank: predicting red hair and multiple sclerosis (MS). In the case of predicting red hair, epiTree recovers known epistatic interactions surrounding MC1R and novel interactions, representing non-linearities not captured by logistic regression models. In the case of predicting MS, a more complex phenotype than red hair, epiTree rankings prioritize novel interactions surrounding HLA-DRB1 , a variant previously associated with MS in several populations. Taken together, these results highlight the potential for epiTree rankings to help reduce the design space for follow up experiments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

In situ synchrotron X-ray total scattering measurements and analysis of colloidal CsPbX 3 nanocrystals during flow synthesis

In situ X-ray scattering measurements of CsPbX 3 (X = Cl, Br, I) nanocrystal formation and halide exchange at NSLS-II beamlines were performed in an automated flow reactor. Total scattering measurements were performed at the 28-ID-2 (XPD) beamline and small-angle X-ray scattering at the 16-ID (LiX) beamline. Nanocrystal structural parameters of interest, including size, size distribution and atomic structure, were extracted from modeling the total scattering data. The results highlight the potential of these beamlines and the measurement protocols described in this study for studying dynamic processes of colloidal nanocrystal synthesis in solution with timescales on the order of seconds.

nucleation↗
DOE OSTI2022

Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance ( > <#comment/> 8 d B ) denoising in less time than other fluorescence microscopy denoising methods.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Assessment of Local Observation of Atomic Ordering in Alloys via the Radial Distribution Function: A Computational and Experimental Approach

As a powerful analytical technique, atom probe tomography (APT) has the capacity to acquire the spatial distribution of millions of atoms from a complex sample. However, extracting information at the Ångstrom-scale on atomic ordering remains a challenge due to the limits of the APT experiment and data analysis algorithms. The development of new computational tools enable visualization of the data and aid understanding of the physical phenomena such as disorder of complex crystalline structures. Here, we report progress towards this goal using two steps. We describe a computational approach to evaluate atomic ordering in the crystal structure by generating radial distribution functions (RDF). Atomic ordering is rendered as the Fractional Cumulative Radial Distribution Function (FCRDF) which allows for greater visibility of local compositions at short range in the structure. Further, we accommodate in the analysis additional parameters such as uncertainty in the atomic coordinates and the atomic abundance to ascertain short-range ordering in APT data sets. We applied the FCRDF analysis to synthetic and experimental APT data sets for Ni 3 Al. The ability to observe a signal of atomic ordering consistent with the known L1 2 crystal structure is heavily dependent on spatial uncertainty, irrespective of abundance. Detection of atomic ordering is subject to an upper limit of spatial uncertainty of atoms described with Gaussian distributions with a standard deviation of 1.3 Å. The FCRDF analysis was also applied to the APT data set for a six-component alloy, Al 1.3 CoCrCuFeNi. In this case, we are currently able to visualize elemental segregation at the nanoscale, though unambiguous identification of atomic ordering at the Ångstrom (nearest-neighbor) scale remains a goal.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Measurements of the separated longitudinal structure function F L from hydrogen and deuterium targets at low Q 2

Structure functions, as measured in lepton-nucleon scattering, have proven to be very useful in studying the partonic dynamics within the nucleon. Furthermore, it is experimentally difficult to separately determine the longitudinal and transverse structure functions, and consequently there are substantially less data available in particular for the longitudinal structure function. Here, we present separated structure functions for hydrogen and deuterium at low four-momentum transfer squared, Q 2 < 1 GeV 2 , and compare them with parton distribution parametrization and k T factorization approaches. While differences are found, the parametrizations generally agree with the data, even at the very low-Q 2 scale of the data. The deuterium data show a smaller longitudinal structure function and a smaller ratio of longitudinal to transverse cross section, R, than the proton. This suggests either an unexpected difference in R for the proton and the neutron or a suppression of the gluonic distribution in nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Conflation of Geospatial POI Data and Ground-level Imagery via Link Prediction on Joint Semantic Graph

With the proliferation of smartphone cameras and social networks, we have rich, multi-modal data about points of interest (POIs) - like cultural landmarks, institutions, businesses, etc. - within a given areas of interest (AOI) (e.g., a county, city or a neighborhood) available to us. Data conflation across multiple modalities of data sources is one of the key challenges in maintaining a geographical information system (GIS) which accumulate data about POIs. Given POI data from nine different sources, and ground-level geo-tagged and scene-captioned images from two different image hosting platforms, in this work we explore the application of graph neural networks (GNNs) to perform data conflation, while leveraging a natural graph structure evident in geospatial data. The preliminary results demonstrate the capacity of a GNN operation to learn distributions of entity (POIs and images) features, coupled with topological structure of entity's local neighborhood in a semantic nearest neighbor graph, in order to predict links between a pair of entities.

Gurav, Rutuja↗
DOE OSTI2021

Gaussian Kernel Methods for Seismic Fragility and Risk Assessment of Mid-Rise Buildings

Seismic fragility functions can be evaluated using the cloud analysis method with linear regression which makes three fundamental assumptions about the relation between structural response and seismic intensity: log-linear median relationship, constant standard deviation, and Gaussian distributed errors. While cloud analysis with linear regression is a popular method, the degree to which these individual and compounded assumptions affect the fragility and the risk of mid-rise buildings needs to be systematically studied. This paper conducts such a study considering three building archetypes that make up a bulk of the building stock: RC moment frame, steel moment frame, and wood shear wall. Gaussian kernel methods are employed to capture the data-driven variations in the median structural response and standard deviation and the distributions of residuals with the intensity level. With reference to the Gaussian kernels approach, it is found that while the linear regression assumptions may not affect the fragility functions of lower damage states, this conclusion does not hold for the higher damage states (such as the Complete state). In addition, the effects of linear regression assumptions on the seismic risk are evaluated. For predicting the demand hazard, it is found that the linear regression assumptions can impact the computed risk for larger structural response values. However, for predicting the loss hazard with downtime as the decision variable, linear regression can be considered adequate for all practical purposes.

58 GEOSCIENCES↗
DOE OSTI2026

IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning

Heterogeneous Differential Privacy (HDP) in Federated Learning (FL) allows clients to select individual privacy budgets () according to institutional policies and data sensitivity. In practice, many HDP-FL systems employ -aware server aggregation to improve model utility by re-weighting client updates according to their declared privacy budgets. However, gradient updates in FL retain structural patterns induced by non-independent and identically-distributed (non-IID) data, and these additional signals exposed by -aware aggregation create new opportunities for inference by an honest-but-curious server. In this work, we first show that a server equipped with gradient denoising and surrogate modeling can mount a Privacy Inference Attack that infers distributional attributes of clients and links updates from the same client across training rounds, measured via surrogate inference accuracy and linkage success, under realistic knowledge constraints. The Shuffle-Model has been widely studied as a defense against such inference risks by anonymizing update sources, but it is fundamentally incompatible with HDP-FL -aware aggregation. To address this challenge, we propose IntraShuffler, a middleware defense framework designed for HDP-FL systems. IntraShuffler introduces a privacy-aware shuffling mechanism that groups clients into privacy-compatible buckets and performs parameter-level shuffling within each bucket to disrupt persistent gradient structure while preserving -aware aggregation. Experiments across four different datasets show that IntraShuffler reduces gradient recoverability by over 60% and decreases surrogate inference accuracy from 0.78 to 0.33 while maintaining comparable model utility across multiple FL aggregation rules.

Riya, Farhin Farhad [ORNL]↗
DOE OSTI2020

TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition

With this study, our goal is compression of massive-scale grid-structured data, such as the multi-terabyte output of a high-fidelity computational simulation. For such data sets, we have developed a new software package called TuckerMPI, a parallel C++/MPI software package for compressing distributed data. The approach is based on treating the data as a tensor, i.e., a multidimensional array, and computing its truncated Tucker decomposition, a higher-order analogue to the truncated singular value decomposition of a matrix. The result is a low-rank approximation of the original tensor-structured data. Compression efficiency is achieved by detecting latent global structure within the data, which we contrast to most compression methods that are focused on local structure. In this work, we describe TuckerMPI, our implementation of the truncated Tucker decomposition, including details of the data distribution and in-memory layouts, the parallel and serial implementations of the key kernels, and analysis of the storage, communication, and computational costs. We test the software on 4.5 and 6.7 terabyte data sets distributed across 100 s of nodes (1,000 s of MPI processes), achieving compression ratios between 100 and 200,000×, which equates to 99--99.999% compression (depending on the desired accuracy) in substantially less time than it would take to even read the same dataset from a parallel file system. Moreover, we show that our method also allows for reconstruction of partial or down-sampled data on a single node, without a parallel computer so long as the reconstructed portion is small enough to fit on a single machine, e.g., in the instance of reconstructing/visualizing a single down-sampled time step or computing summary statistics. The code is available at https://gitlab.com/tensors/TuckerMPI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A D-term Modeling Code (DMC) for Simultaneous Calibration and Full-Stokes Imaging of Very Long Baseline Interferometric Data

In this paper we present DMC, a model and associated tool for polarimetric imaging of very long baseline interferometry data sets that simultaneously reconstructs the full-Stokes emission structure along with the station-based gain and leakage calibration terms. DMC formulates the imaging problem in terms of posterior exploration, which is achieved using Hamiltonian Monte Carlo sampling. The resulting posterior distribution provides a natural quantification of uncertainty in both the image structure and the data calibration. We run DMC on both synthetic and real data sets, the results of which demonstrate its ability to accurately recover both the image structure and calibration quantities, as well as to assess their corresponding uncertainties. The framework underpinning DMC is flexible, and its specific implementation is under continued development.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Review of Current Software for Analyzing Total X-ray Scattering Data from Liquids

The popularity of the pair distribution function (PDF) analysis of X-ray total scattering data has steadily grown as access to ex situ synchrotron data has expanded. Due to the broadening of the PDF user community, there is a growing demand for software that can be used to extract PDFs and is accessible to non-expert users. While user-friendly options have been developed over the past decade for fast, streamlined data analysis, care must be taken in both processing the data and understanding any limitations, especially in the case of liquids. In this review, the same scattering data are analyzed using different total X-ray scattering software, in order to compare the accuracy of the extracted structure factors and associated pair distribution functions. The goal is to assess the best practices for extracting the most accurate liquid data for each software package. The importance of absolute normalization and the application of the most appropriate corrections are emphasized via quantitative comparisons between liquid sulfur and water. Additionally, an awareness of the competing conventions used to define the PDF in crystallography and liquids/glasses is crucial for both the downstream analyses of the data and a comparison with the previous results in the literature.

Gallington, Leighanne C. (ORCID:0000000203837522)↗
DOE OSTI2024

Development of Steady-State and Dynamic Mass and Energy Constrained Neural Networks for Distributed Chemical Systems Using Noisy Transient Data

The paper presents the development of algorithms for mass and energy constrained neural network models that can exactly conserve the overall mass and energy of distributed chemical process systems, even though the noisy transient data used for optimal model training violate the same. In contrast to approximately satisfying mass and energy balance constraints of a system by soft penalization of objective function, algorithms have been developed for solving equality-constrained nonlinear optimization problems, thus providing the guarantee of exactly satisfying the system mass and energy conservation laws. For developing dynamic mass-energy constrained network models for distributed systems, hybrid series and parallel dynamic-static neural networks have been leveraged. The developed algorithms for solving both the training and forward problems are validated using both steady-state and dynamic data in the presence of various noise characteristics. The developed data-driven algorithms are flexible to exactly satisfy mass and energy balance constraints for dynamic chemical processes if the system holdup information is available. The proposed network structures and algorithms are applied to the development of data-driven lumped and distributed models of an adiabatic superheater/reheater system, a nonisothermal continuous stirred tank reactor, as well as an electrically heated plug-flow reactor system where one form of energy gets transformed to another. It has been observed that the mass-energy constrained neural networks yield a root mean squared error of <1% with respect to the system truth for the case studies evaluated in this work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Luminescence, structure and antiferroelectric-type phase transition in Ca8ZnEu(PO4)7

Highlights: • Thermal, dielectric and luminescence properties were obtained for Ca{sub 8}ZnEu(PO{sub 4}){sub 7}. • Ca{sub 8}ZnEu(PO{sub 4}){sub 7} belongs to antiferroelectric with T{sub c} = 836 K. • First-order antiferroelectric/paraelectric phase transitions have been found. • Influence of composition on the luminescence properties has been shown. • Structure of Ca{sub 8}ZnEu(PO{sub 4}){sub 7} was refined by the Rietveld method. - Abstract: Photoluminescence excitation and emission spectra of new phosphate Ca{sub 8}ZnEu(PO{sub 4}){sub 7} have been investigated. The influence of the composition on the luminescence intensity has been shown. The substitution of Zn{sup 2+} for Ca{sup 2+} in Ca{sub 9}Eu(PO{sub 4}){sub 7} with the formation of Ca{sub 8}ZnEu(PO{sub 4}){sub 7} leads to the increased emission intensity {sup 5}D{sub 0} → {sup 7}F{sub 2} by about 1.5 times and to decreased number of bands from three to one in the range of {sup 5}D{sub 0} → {sup 7}F{sub 0} transition. Conditions of preparation do not influence the luminescent properties and distribution of Eu{sup 3+} cations in the structure. DSC, SHG data and dielectric spectroscopy reveal that Ca{sub 8}ZnEu(PO{sub 4}){sub 7} belongs to antiferroelectrics (T{sub c} = 836 K). The first-order antiferroelectric/paraelectric transformations are accompanied by a changing symmetry (R3-barC to R3-barm). The structure of Ca{sub 8}ZnEu(PO{sub 4}){sub 7} (sp. gr. R3-barc) was refined by the Rietveld method. The Zn{sup 2+} cations occupy the M5 site. The Eu{sup 3+} and Ca{sup 2+} ions are located in the M1 and M3 sites of β-Ca{sub 3}(PO{sub 4}){sub 2}-type structure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Probing lead acetate in solution using X-ray diffraction

Here, for the purpose of water purification involving toxic metal sensing and removal, high energy X-ray diffraction experiments have been performed on lead acetate Pb(Ac) 2 solutions, liquid and amorphous glutathione disulfide (GSSG), and their mixtures. The data have been interpreted using Empirical Potential Structure Refinement and pair distribution function analysis. At the highest concentration of 1 M Pb(Ac) 2 in water, the lead molecules are found to cluster and the second shell in the water structure becomes slightly more ordered as the water molecules become compressed. Liquid and amorphous GSSG are found to hydrogen bond primarily via OH-O interactions, while NH-O bonds are much more distorted. Aqueous solutions of Pb(Ac) 2 + GSSG show the closest Pb-O (carboxyl) and Pb-N (amine) bonds both at a distance of 2.5 ± 0.1 Å at a concentration of 1 M Pb(Ac) 2 in water. At 0.75 M Pb(Ac) 2 in water, strong Pb-S bonds are found at a distance of 2.8 ± 0.1 Å. The implications for lead removal using capacitive deionization are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Achievements and Prospects of Global Broadband Seismographic Networks After 30 Years of Continuous Geophysical Observations

Global seismographic networks (GSNs) emerged during the late nineteenth and early twentieth centuries, facilitated by seminal international developments in theory, technology, instrumentation, and data exchange. The mid- to late-twentieth century saw the creation of the World-Wide Standardized Seismographic Network (1961) and International Deployment of Accelerometers (1976), which advanced global geographic coverage as seismometer bandwidth increased greatly allowing for the recording of the Earth's principal seismic spectrum. The modern era of global observations and rapid data access began during the 1980s, and notably included the inception of the GEOSCOPE initiative (1982) and GSN (1988). Through continual improvements, GEOSCOPE and the GSN have realized near-real time recording of ground motion with state-of-art data quality, dynamic range, and timing precision to encompass 180 seismic stations, many in very remote locations. Data from GSNs are increasingly integrated with other geophysical data (e.g., space geodesy, infrasound and Interferometric Synthetic Aperture Radar). Globally distributed seismic data are critical to resolving crust, mantle, and core structure; illuminating features of the plate tectonic and mantle convection system; rapid characterization of earthquakes; identification of potential tsunamis; global nuclear test verification; and provide sensitive proxies for environmental changes. As the global geosciences community continues to advance our understanding of Earth structure and processes controlling elastic wave propagation, GSN infrastructure offers a springboard to realize increasingly multi-instrument geophysical observatories. Here, we review the historical, scientific, and monitoring heritage of GSNs, summarize key discoveries, and discuss future associated opportunities for Earth Science.

58 GEOSCIENCES↗
DOE OSTI2021

Generating synthetic occupants for use in building performance simulation

Occupant behaviour simulation frameworks can employ synthetic populations to characterize occupancy and behavioural patterns in buildings based on observed demographic data at a certain geographical location. For buildings, very few synthetic occupant populations have been generated. This paper uses a Bayesian Networks (BN) structural learning approach to synthesize populations of occupants in a multi-family housing case study. Two additional cases of office occupants and senior housing residents are considered as a cross-case comparison. Furthermore, we draw upon the extended version of drivers-needs-actions-systems (DNAS) framework to guide the selection of variables and data imputation. Our results show that the BN approach is powerful in learning the structure of data sets. The synthetic data sets successfully match the joint distributions of the underlying combined data sets. Experiments on the multi-family housing particularly show better performance than the office and senior housing cases.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Building a genome-based understanding of bacterial pH preferences

The environmental preferences of many microbes remain undetermined. This is the case for bacterial pH preferences, which can be difficult to predict a priori despite the importance of pH as a factor structuring bacterial communities in many systems. We compiled data on bacterial distributions from five datasets spanning pH gradients in soil and freshwater systems (1470 samples), quantified the pH preferences of bacterial taxa across these datasets, and compiled genomic data from representative bacterial taxa. While taxonomic and phylogenetic information were generally poor predictors of bacterial pH preferences, we identified genes consistently associated with pH preference across environments. We then developed and validated a machine learning model to estimate bacterial pH preferences from genomic information alone, a model that could aid in the selection of microbial inoculants, improve species distribution models, or help design effective cultivation strategies. More generally, we demonstrate the value of combining biogeographic and genomic data to infer and predict the environmental preferences of diverse bacterial taxa.

59 BASIC BIOLOGICAL SCIENCES↗