Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data intensive computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

BEYONDPLANCK XIII. Intensity foreground sampling, degeneracies, and priors

We present the intensity foreground algorithms and model employed within the BEYONDPLANCK analysis framework. The BEYONDPLANCK analysis is aimed at integrating component separation and instrumental parameter sampling within a global framework, leading to complete end-to-end error propagation in the Planck Low Frequency Instrument (LFI) data analysis. Given the scope of the BEYONDPLANCK analysis, a limited set of data is included in the component separation process, leading to foreground parameter degeneracies. In order to properly constrain the Galactic foreground parameters, we improve upon the previous Commander component separation implementation by adding a suite of algorithmic techniques. These algorithms are designed to improve the stability and computational efficiency for weakly constrained posterior distributions. These are: (1) joint foreground spectral parameter and amplitude sampling, building on ideas from MIRAMARE; (2) component-based monopole determination; (3) joint spectral parameter and monopole sampling; and (4) application of informative spatial priors for component amplitude maps. We find that the only spectral parameter with a significant signal-to-noise ratio using the current BEYONDPLANCK data set is the peak frequency of the anomalous microwave emission component, for which we find $ν$ p = 25.3 ± 0.5 GHz; all others must be constrained through external priors. Future works will be aimed at integrating many more data sets into this analysis, both map and time-ordered based, thereby gradually eliminating the currently observed degeneracies in a controlled manner with respect to both instrumental systematic effects and astrophysical degeneracies. When this happens, the simple LFI-oriented data model employed in the current work will need to be generalized to account for both a richer astrophysical model and additional instrumental effects. This work will be organized within the Open Science-based COSMOGLOBE community effort.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Rapid 3D nanoscale coherent imaging via physics-aware deep learning

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2025

Effect of alloying on intrinsic ductility in WTaCrV high entropy alloys

Tungsten (W) exhibits desirable properties for extreme applications, such as the divertor in magnetic fusion reactors, but its practicality remains limited due to poor formability and insufficient irradiation resistance. In this work, we study the intrinsic ductility of body-centered cubic WTaCrV based high entropy alloys (HEAs), which are known to exhibit excellent irradiation resistance. The ductility evaluations are carried out using a criterion based on the competition between the critical stress intensity factors for emission (K Ie ) and cleavage (K Ic ) in the {110} slip planes and {110} crack planes, which are evaluated within the linear elastic fracture mechanics framework and computed using density functional theory. The results suggest that increasing the alloying concentrations of V and reducing the concentrations of W can significantly improve the ductility in these HEAs. The elastic anisotropy for these HEAs is analyzed using the Zener anisotropy ratio and its correlation with the concentration of W in the alloys is studied. Results indicate that these alloys tend to be fairly isotropic independently from the concentration of W in them. The computed data for the elastic constants of these HEAs is also compared against available experimental data. The results are in good agreement, validating the robustness and accuracy of the computational methods. Multiple phenomenological ductility metrics were also computed and analyzed against the analytical model. Some metrics, mainly the surrogate D parameter, show a good correlation with the Rice model. The potential of these empirical metrics to serve as surrogate screening models for optimizing the compositional space is also discussed.

Anisotropy↗
DOE OSTI2025

A Modified Model Dielectric Function for Analyzing Optical Spectra of InGaN Nanofilms on Sapphire Substrates

Due to a lower InN bandgap energy Eg~0.7 eV, InxGa1−xN/Sapphire epifilms are considered valuable in the development of low-dimensional heterostructure-based photonic devices. Adjusting the composition x and thickness d in epitaxially grown films has offered many possibilities of light emission across a wide spectral range, from ultraviolet through visible into near-infrared regions. Optical properties have played important roles in making semiconductor materials useful in electro-optic applications. Despite the efforts to grow InxGa1−xN/Sapphire samples, no x- and d-dependent optical studies exist for ultrathin films. Many researchers have used computationally intensive methods to study the electronic band structures Ejk→, and subsequently derive optical properties. By including inter-band transitions at critical points from Ejk→, we have developed a semiempirical approach to comprehend the optical characteristics of InN, GaN and InxGa1−xN. Refractive indices of InxGa1−xN and sapphire substrate are meticulously integrated into a transfer matrix method to simulate d- and x-dependent reflectivity RE and transmission TE spectra of nanostructured InxGa1−xN/Sapphire epifilms. Analyses of RE and TE have offered accurate x-dependent shifts of energy gaps for InxGa1−xN (x = 0.5, 0.7) in excellent agreement with the experimental data.

Talwar, Devki N. (ORCID:0000000202723195)↗
DOE OSTI2015

Small-angle X-ray scattering: a bridge between RNA secondary structures and three-dimensional topological structures

Whereas the structures of small to medium-sized well folded RNA molecules often can be determined by either X-ray crystallography or NMR spectroscopy, obtaining structural information for large RNAs using experimental, computational, or combined approaches remains a major interest and challenge. RNA is very sensitive to small-angle X-ray scattering (SAXS) due to high electron density along phosphate-sugar backbones, whose scattering contribution dominates SAXS intensity. For this reason, SAXS is particularly useful in obtaining global RNA structural information that outlines backbone topologies and, therefore, molecular envelopes. Such information is extremely valuable in bridging the gap between the secondary structures and three-dimensional topological structures of RNAmolecules, particularly those that have proven difficult to study using other structuredetermination methods. Here we review published results of RNA topological structures derived from SAXS data or in combination with other experimental data, as well as details on RNA sample preparation for SAXS experiments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

Angular power spectrum of the diffuse gamma-ray emission as measured by the Fermi Large Area Telescope and constraints on its dark matter interpretation

The isotropic gamma-ray background arises from the contribution of unresolved sources, including members of confirmed source classes and proposed gamma-ray emitters such as the radiation induced by dark matter annihilation and decay. Clues about the properties of the contributing sources are imprinted in the anisotropy characteristics of the gamma-ray background. We use 81 months of Pass 7 Reprocessed data from the Fermi Large Area Telescope to perform a measurement of the anisotropy angular power spectrum of the gamma-ray background. Here, we analyze energies between 0.5 and 500 GeV, extending the range considered in the previous measurement based on 22 months of data. We also compute, for the first time, the cross-correlation angular power spectrum between different energy bins. The derived angular spectra are compatible with being Poissonian, i.e. constant in multipole. Furthermore, the energy dependence of the anisotropy suggests that the signal is due to two populations of sources, contributing, respectively, below and above ~ 2 GeV . Finally, using data from state-of-the-art numerical simulations to model the dark matter distribution, we constrain the contribution from dark matter annihilation and decay in Galactic and extra-Galactic structures to the measured anisotropy. These constraints are competitive with those that can be derived from the average intensity of the isotropic gamma-ray background.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Experimental study of multiple-orientation muon tomography with image optimization in sparse data environments

Due to the high penetrating power of cosmic-ray muons, they can be used to probe very thick and dense objects. As muons are charged particles, they can be tracked by ionization detectors, determining the position and direction of the muons. With detectors on either side of an object to measure particle direction change, scattering information within the object can be found. This can be used to produce a scattering-intensity image within the object related to density and atomic number. Such imaging is typically performed with a single detector-object orientation, taking advantage of the more intense downward flux of muons, producing planar imaging with some depth-of-field information in the third dimension. Several simulation studies were published with multiorientation tomography, which can form a three-dimensional representation faster than a single-orientation view. In this study, experimental muon-scatter-based tomography was performed using a concrete filled steel drum with several different metal wedges inside, with the drum between detector planes. Data were collected from different detector-object orientations by rotating the steel drum. The data collected from each orientation were combined using two different tomographic methods. A traditional inverse Radon transform approach used for computed tomography and a combination of multiple depth-of-field reconstructions were applied to the data. As cosmic-ray muon flux imaging is rate limited, the imaging techniques were compared for sparse data. Using the combined depth-of-field reconstruction technique, fewer detector-object orientations were needed to reconstruct images that could be used to differentiate the metal wedges.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Feedstock Carbon Intensity Calculator (FD-CIC) Users’ Manual and Technical Documentation

A transparent and easy-to-use tool for feedstock-specific, farm-level CI calculation of feedstocks is helpful. With the ARPA-E support, we have developed a tool–the Feedstock Carbon Intensity Calculator (FD-CIC). The first version of FD-CIC was released with the GREET® model in 2020 (Wang et al., 2020) so that corn feedstock producers could use this publicly available tool (https://greet.es.anl.gov/tool_fd_cic) to quantify corn grain CIs with farm-level input data and management practices. In the 2021 version, we expand the tool’s capabilities by including additional feedstocks such as soybeans, sorghum, and rice. Similar to corn, it calculates the farm-level CI for these feedstocks by allowing user-defined farm-level farming inputs and incorporating the GHG emission intensities of these inputs from GREET (in particular, GREET1, the fuel cycle model of GREET).

09 BIOMASS FUELS↗
DOE OSTI2023

Skewering the silos: using Brick to enable portable analytics, modeling and controls in buildings

Nearly all large commercial buildings have heating, ventilation and air conditioning (HVAC) systems, lighting systems, safety and other systems controlled by a computer—a dedicated server with a building energy management system (BMS). However, these BMSs are proprietary with each building’s assets (that is, fans, valves, pumps, and their setpoints) named and coded uniquely by the BMS vendor or engineer; building analytics and control algorithms are written specific to the assets and the building. Thus, any control updates or analytics to improve building performance—especially critical to reduce greenhouse emissions or improve load flexibility—are labor intensive and costly. The Brick schema was developed so the same analysis or control algorithms can work on a variety of buildings if each is digitally represented in a Brick data model. The goal of this project was to further the development of Brick to extend it beyond an academic project with demonstrated success in a small field study, to a practical choice for industrial and commercial stakeholders seeking to realize value from building data. To do this, we executed four objectives: (1) expand the Brick schema including its modeling capabilities and vocabulary, (2) develop tools for integrating Brick with existing digital technologies and representations in buildings, (3) develop an open-source analytics platform to facilitate use of Brick in delivering data value, and (4) demonstrate Brick-driven analytics and controls in real settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Suite of Comprehensive Rapid Analysis Tools for Estimation (SOCRATES) - 19076

Long-term monitoring and remedy implementation require ongoing assessment and analytics, much of which relies on intensive and time-consuming data integration and engineering, data manipulation, and 'big-data' analytics. Many of these analyses, such as groundwater flow direction, contaminant rate attenuation, and non-parametric statistics, are spatial-temporal in nature and involve coalescing disparate data sets from a variety of sources with measurement frequencies from milliseconds to years, as well as total data volumes often exceeding the petabyte scale. Web-based analytical tools are advantageous for ongoing real-time or near-real-time ingestion of data from various sources for general data access and visualization, and also allow for complex, data rich calculations by leveraging expansive networks and virtually unlimited compute power. A web-based framework offers a natural architecture for such endeavors, as access to compute nodes through auto-scaling and dynamic frameworks enables speedy data manipulation and unlimited access to any data set that is made available via an http request. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Software and Hardware Development for the Mu2e Trigger and Data Acquisition System

The Mu2e experiment at Fermilab will be 10,000 times more sensitive than previous experiments looking for muon-to-electron conversion. This precise and complex experimental apparatus will produce 200 million billion muons per year. The accelerator complex repurposes elements of the infrastructure that produced high energy proton and anti-protons beams for the Tevatron experiments to produce the high-intensity muon beams necessary for Mu2e and the Muon (g-2) experiments.

43 PARTICLE ACCELERATORS↗
DOE OSTI2017

The cross-correlation between 21 cm intensity mapping maps and the Lyα forest in the post-reionization era

We investigate the cross-correlation signal between 21cm intensity mapping maps and the Lyα forest in the fully non-linear regime using state-of-the-art hydrodynamic simulations. The cross-correlation signal between the Lyα forest and 21cm maps can provide a coherent and comprehensive picture of the neutral hydrogen (HI) content of our Universe in the post-reionization era, probing both its mass content and volume distribution. We compute the auto-power spectra of both fields together with their cross-power spectrum at z = 2.4 and find that on large scales the fields are completely anti-correlated. This anti-correlation arises because regions with high (low) 21cm emission, such as those with a large (low) concentration of damped Lyα systems, will show up as regions with low (high) transmitted flux. We find that on scales smaller than k ≅ 0.2 h Mpc{sup −1} the cross-correlation coefficient departs from −1, at a scale where non-linearities show up. We use the anisotropy of the power spectra in redshift-space to determine the values of the bias and of the redshift-space distortion parameters of both fields. We find that the errors on the value of the cosmological and astrophysical parameters could decrease by 30% when adding data from the cross-power spectrum, in a conservative analysis. Our results point out that linear theory is capable of reproducing the shape and amplitude of the cross-power up to rather non-linear scales. Finally, we find that the 21cm-Lyα cross-power spectrum can be detected by combining data from a BOSS-like survey together with 21cm intensity mapping observations by SKA1-MID with a S/N ratio higher than 3 in k element of [0.06,1] h Mpc{sup −1}. We emphasize that while the shape and amplitude of the 21cm auto-power spectrum can be severely affected by residual foreground contamination, cross-power spectra will be less sensitive to that and therefore can be used to identify systematics in the 21cm maps.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Raptor

Raptor is an efficient Python-based tool for predicting the formation and morphology of stochastic lack of fusion defects in metal AM processes. A major obstacle for the qualification and certification of additively manufactured parts in critical applications continues to be performance variability caused in part by porosity-related defects. High-fidelity process models that could predict these defect features are currently too computationally expensive for component-level analysis. To address this, Raptor employs a high-performance geometric method to model the dynamic melt pool rather than relying on computationally intensive thermal fluid dynamics. This allows Raptor to rapidly identify regions of unmelted material that correspond to lack of fusion pores. The efficiency of this approach significantly reduces the time and resources needed for generating 3D defect predictions, which enables users to conduct large-scale parameter studies and evaluate how process variations affect part quality. The framework offers operational flexibility; users can execute simulations through a simple command line interface or integrate core functions as a library within larger computational workflows. Simulation outputs include 3D porosity maps for visualization and tools for quantitative morphological analysis. These results are suitable for direct comparison with experimental characterization data from methods such as X-ray computed tomography and can be used for statistical process optimization.

Subraveti, Vamsi [Vanderbilt Univ., Nashville, TN ↗
DOE OSTI2024

Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation

Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.

computer vision↗
DOE OSTI2021

Inversion of dynamical Bragg intensities to complex structure factors by iterated projections. For Ultramic. 2020. ("Pico" Festschrift, May 2021)

We discuss a method for recovering complex structure factors from many simultaneously excited Bragg beam intensities is described. The method is applied to simulated transmission electron diffraction data over a wide range of crystal thickness and beam energies. The method is based on iterated projections between structure and scattering matrices, which are related by a matrix unitary transformation, exponential, which we invert. The algorithm removes multiple-scattering perturbations from diffraction data and might be extended to other fields, including X-ray and neutron diffraction and cryo-electron microscopy. Because coherent multiple scattering involves interference between Bragg beams, the method also solves the phase problem. Unlike dynamical inversion from electron microscope images or ptychography data, the method, which starts with Bragg beam intensities, provides complex structure factors unaffected by focusing errors or resolution limitations imposed by lenses. We provide inversions from simulated data with 441 simultaneously excited Bragg beams over a range of thickness and beam energy. We discuss the retrieval of chirality information from enantiomorphs, the efficient incorporation of symmetry information using the irreducible representation of the group of structure matrices, and the effect of HOLZ lines to provide three-dimensional information.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Baltimore Social-Environmental Collaborative (BSEC) Doppler Lidar & Derived Products

This repository contains all processed Doppler‐lidar outputs from the PSU lidar deployed for the Baltimore Social‐Environmental Collaborative (BSEC) project. Vertical Stare Scans (fixed‐beam, vertical profiling): 1 Hz backscatter intensity (m⁻¹ sr⁻¹), signal‐to‐noise ratio (unitless), and Doppler vertical‐velocity (m s⁻¹) on ~30 m range gates, stored as CF-compliant NetCDF. Wind Profiles (horizontal‐wind retrieval): daily NetCDF outputs of retrieved horizontal wind speed (m s⁻¹) and direction (degrees), computed from the angled‐scan returns. Profile Statistics (summary statistics on the vertical velocity): 15 min windows (default) of mean, variance, skewness, kurtosis, high-frequency variance, etc., as a function of height; saved as CF-compliant NetCDF files. Boundary Layer Height (BLH) (fuzzy-logic output): 15 min BLH estimates (m), with lower/upper fuzzy bounds (m) and a quality flag (0–4) indicating data status (e.g., no data, good, below range, ran out of signal, cloud-topped). Cloud Base Height (Haar-gradient detection): 15 min estimates of cloud-base height (m) with a cloud-detection quality flag (0–3: none, low, moderate, high). All five product streams are organized by year and date under their own top-level folders (01_Vertical_Stare_Scans/ through 05_Cloud_Height/). Each folder contains a data_ /YYYY/ subdirectory with daily CF-compliant NetCDF outputs (96 windows per day at 15 min intervals). Global attributes in each file include creation history, version (2.0.0), institution, and source. Instrument & MeasurementsThe PSU Doppler Lidar samples aerosol backscatter (m⁻¹ sr⁻¹), signal-to-noise ratio, and radial velocity at ~1 Hz. Vertical stare scans point the beam straight up; after collecting angled scans through multiple elevation angles, the "Wind Profiles" product contains the fully retrieved horizontal wind speed and direction. Data were collected continuously at ~30 m range resolution, with a typical height ceiling of ~12 km. How to Use Open any NetCDF with Python's xarray, MATLAB, or similar CF-compliant tools. Stare scans and angled-scan retrievals (Wind Profiles) are CF-compliant daily NetCDF files. Profile-Statistics, BLH, and Cloud Height files are daily 15 min summaries (96 time steps per file). Inspect the included variables (e.g., vertical_velocity_variance, wind_speed, BLH, cloud_base_height) for your analyses. Use the quality flags (BLH_flag, cloud_flag) to filter out poor-quality retrievals. For more information or questions about processing methods, please contact:Nicholas E. Prince ⟨nec5299@psu.edu⟩Penn State Department of Meteorology & Atmospheric Science

Air Quality↗
DOE OSTI2017

SCinet Architecture: Featured at the International Conference for High Performance Computing,Networking, Storage and Analysis 2016

SCinet is the purpose-built network that operates during the International Conference for High Performance Computing,Networking, Storage and Analysis (Super Computing or SC). Created each year for the conference, SCinet brings to life a high-capacity network that supports applications and experiments that are a hallmark of the SC conference. The network links the convention center to research and commercial networks around the world. This resource serves as a platform for exhibitors to demonstrate the advanced computing resources of their home institutions and elsewhere by supporting a wide variety of applications. Volunteers from academia, government and industry work together to design and deliver the SCinet infrastructure. Industry vendors and carriers donate millions of dollars in equipment and services needed to build and support the local and wide area networks. Planning begins more than a year in advance of each SC conference and culminates in a high intensity installation in the days leading up to the conference. The SCinet architecture for SC16 illustrates a dramatic increase in participation from the vendor community, particularly those that focus on network equipment. Software-Defined Networking (SDN) and Data Center Networking (DCN) are present in nearly all aspects of the design.

Lyonnais, Marc↗
DOE OSTI2023

ASC Data Science Infrastructure Project June 2023 [Slides]

Data Science Infrastructure (DSI) Project offers a standardized but flexible way of storing data and associated metadata to support AI/ML and data intensive scientific workflows: Establish requirements via use case interviews; Develop DSI framework to support flexible, secure, and accessible data stores tailored to researcher needs; Augment existing institutional frameworks for code management, performance testing and file indexing via automated DSI interfaces; Deploy DSI framework to support key use cases in collaboration with domain scientists.

97 MATHEMATICS AND COMPUTING↗