Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Advanced Interactive 3D Visualization Tool for Customizable Analyses of Tomography Datasets in Material Science

Current methods for visualizing and analyzing 3D tomography datasets in materials science often lack the interactivity and depth required for detailed structural insights. This limitation restricts a researchers' ability to accurately interpret complex data, which is critical for advancing material innovations and understanding structural properties. To address this issue, we have developed a novel, web-based interactive 3D visualization and analysis tool from the Trame framework that offers customizable features to enhance data interpretability. The tool allows users to adjust parameters such as visible range, slice planes, data rotation, and layering, providing a more detailed and dynamic view of complex structures. Its user-friendly web interface increases the accessibility and ease of use for both novice and experienced researchers, to visualize large volumetric datasets. The tool supports a diverse range of data formats, making it versatile for various research applications. Unique capabilities include real-time data manipulation, automated feature detection, context-sensitive feedback, and real-time volume calculations and distributions per sliced region or layer, alongside the ability to quickly generate high-quality screenshots and videos for presentations and reports. These advancements offer a comprehensive solution for enhanced 3D data exploration, significantly improving the analysis process and communication of results in materials science.

36 - MATERIALS SCIENCE↗
DOE OSTI2024

Building a framework to genetically characterize “feather spots” and understand demographic impacts of solar energy sites on migratory bird populations

The lack of data on the impact of utility-scale solar facilities on avian species and populations adds to the cost of siting and operation. As much as 32 percent of the avian biological material (feathers and carcasses) recovered from solar facilities remain unidentified, because they often take the form of “feather spots”. Feather spots are remains of impacted animals that can be separated into two broad categories: 1) those remains that may be visually identified to a species, or 2) those that cannot be visually identified to a species due to degradation from the environment and/or scavenger activity (listed as “unknown”). Even when feather spots can be identified to species, they cannot be visually assigned to particular breeding populations. In some cases, it is unknown whether multiple feather spots represent single or multiple individuals. This project’s objectives were to: 1. Use a developed, genetic-based technique to identify and determine the species, population of origin, and number of individuals found in feather spots recovered from solar facilities. 2. Implement collected data and resulting analyses to develop a publicly accessible web-based decision-making tool that can be used by the solar industry, regulators and other stakeholders to inform siting, mitigation, and conservation management efforts. 3. Establish a not-for-profit fee-for-service center at UCLA to ensure collection and identification of feather spots continue after the project period of performance. During the Project Period, we proposed to establish a pipeline for collecting, transporting, and storing of avian biological material collected at solar facilities and the collection and identification of feather spots to species and individual. We proposed the development of a genetic-based framework that would recover viable DNA from feather spots, amplify this DNA (i.e., make millions of copies of the original DNA), and use it to match the resulting sequences to a national database of known species of birds. The result would be the identification of feathers spots that were previously unidentified, and the incorporation of these samples into a larger database that included all samples recovered from solar facilities. The resulting report (below) details the result of this work and its alignment with proposed activities. We proposed the use of the data collected to assess the comparative risk to specific species or populations of species from solar facilities. For some species, we have already identified genomic markers of specific breeding populations and developed “genoscapes,” maps of unique genetic variation across the full breeding range of a species. We used these (previously and newly developed) genoscapes to probabilistically link a feather spot to the specific breeding populations from which it originated (assignment probabilities range from 75%-100% depending on species and population groups). For those species without genoscapes, we developed a vulnerability and susceptibility estimate that determines the relative local and regional risk to populations that are in geographic proximity to solar facilities, using citizen science data (Breeding Bird Survey (BBS) and eBird). These two feather spot processing pipelines (see Figure 1 below) provide quantitative estimates as to the numbers of individuals from a given population of origin that are affected by solar facilities, and ultimately can reduce costs to the consumer by reducing the industry costs associated with mitigation and siting strategies for future solar energy development.

14 SOLAR ENERGY↗
DOE OSTI2016

EXD HME MicroCT Data Acquisition, Processing and Data Request Overview

This document is a short summary of the steps required for MicroCT evaluation of a specimen. This includes data acquisition through image analysis, for the EXD HME program. Expected outputs for each stage are provided. Data shall be shipped to LLNL as described herein.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

In Situ Visualization for Computational Science

In situ visualization, i.e., visualizing simulation data as it is generated, is an emerging processing paradigm in response to trends in the area of high-performance computing. This paradigm holds great promise in its ability to access increased spatio-temporal resolution and leverage extensive computational power. However, the paradigm is also widely viewed as limiting when it comes to exploration-oriented use cases and further will require visualization systems to become more and more complicated and constrained. Additionally, there are many open research topics within situ visualization. The Dagstuhl seminar 18271 "In Situ Visualization for Computational Science" brought together researchers and practitioners from three communities (computational science, high-performance computing, and scientific visualization) to share interesting findings, to identify lines of open research, and to determine a medium-term research agenda that addresses the most pressing problems. This report summarizes the outcomes and findings of the seminar.

Computational Science↗
DOE OSTI2018

In Situ Visualization for Computational Science

In situ visualization, i.e., visualizing simulation data as it is generated, is an emerging processing paradigm in response to trends in the area of high-performance computing. This paradigm holds great promise in its ability to access increased spatio-temporal resolution and leverage extensive computational power. However, the paradigm is also widely viewed as limiting when it comes to exploration-oriented use cases and further will require visualization systems to become more and more complicated and constrained. Additionally, there are many open research topics with in situ visualization. The Dagstuhl seminar 18271 "In Situ Visualization for Computational Science" brought together researchers and practitioners from three communities (computational science, high-performance computing, and scientific visualization) to share interesting findings, to identify lines of open research, and to determine a medium-term research agenda that addresses the most pressing problems. This report summarizes the outcomes and findings of the seminar.

Bauer, Andy↗
DOE OSTI2023

AmeriFlux BASE data pipeline to support network growth and data sharing

Abstract AmeriFlux is a network of research sites that measure carbon, water, and energy fluxes between ecosystems and the atmosphere using the eddy covariance technique to study a variety of Earth science questions. AmeriFlux’s diversity of ecosystems, instruments, and data-processing routines create challenges for data standardization, quality assurance, and sharing across the network. To address these challenges, the AmeriFlux Management Project (AMP) designed and implemented the BASE data-processing pipeline. The pipeline begins with data uploaded by the site teams, followed by the AMP team’s quality assurance and quality control (QA/QC), ingestion of site metadata, and publication of the BASE data product. The semi-automated pipeline enables us to keep pace with the rapid growth of the network. As of 2022, the AmeriFlux BASE data product contains 3,130 site years of data from 444 sites, with standardized units and variable names of more than 60 common variables, representing the largest long-term data repository for flux-met data in the world. The standardized, quality-ensured data product facilitates multisite comparisons, model evaluations, and data syntheses.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Bootstrap estimation of the effect of instrument response function uncertainty on the reconstruction of fusion neutron sources

Neutron imagers are important diagnostics for the inertial confinement fusion implosions at the National Ignition Facility. They provide two- and three-dimensional reconstructions of the neutron source shape that are key indicators of the overall performance. To interpret the shape results properly, it is critical to estimate the uncertainty in those reconstructions. There are two main sources of uncertainties: limited neutron statistics, leading to random errors in the reconstructed images, and incomplete knowledge of the instrument response function (the pinhole-dependent point spread function). While the statistical errors dominate the uncertainty for lower yield deuterium-tritium (DT) shots, errors due to the instrument response function dominate the uncertainty for DT yields on the order of 10 16 neutrons or higher. In this work, a bootstrapping method estimates the uncertainty in a reconstructed image due to the incomplete knowledge of the instrument response function. The main reconstruction is created from the fixed collection of pinhole images that are best aligned with the neutron source. Additional reconstructions are then built using subsets of that collection of images. Variations in the shapes of these additional reconstructions originate solely from uncertainties in the instrument response function, allowing us to use them to provide an additional systematic uncertainty estimate.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Co-design for Particle Applications at Exascale

Co-design across the Exascale Computing Project (ECP) has been critical for both enabling science applications and bringing disparate communities together. Developing and porting applications to the various high-performance computing (HPC) architectures on pre-exascale and exascale computers has been quite challenging due to the diversity of hardware features and software stacks. The Co-design Center for Particle Applications (CoPA) has developed and enhanced the Cabana and PROGRESS/BML libraries to facilitate the creation of new particle applications, make existing particle applications exascale capable, and allow teams to explore new capabilities. Particle methods from atomistic, mesoscale, continuum, through cosmological scales have been built with Cabana, along with new possibilities for application coupling. Similarly, the PROGRESS/BML library has enabled quantum particle applications with linear algebra solvers to use advanced hardware. Across these CoPA-developed libraries, the co-design abstraction layer combines performance portability with math library support to facilitate separation of concerns and directly support science runs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Prior data assisted compressed sensing: A novel MR imaging strategy for real time tracking of lung tumors

Purpose: Hybrid radiotherapy-MRI devices promise real time tracking of moving tumors to focus the radiation portals to the tumor during irradiation. This approach will benefit from the increased temporal resolution of MRI's data acquisition and reconstruction. In this work, the authors propose a novel spatial-temporal compressed sensing (CS) imaging strategy for the real time MRI–-prior data assisted compressed sensing (PDACS), which aims to improve the image quality of the conventional CS without significantly increasing reconstruction times. Methods: Conventional 2D CS requires a random sampling of partial k-space data, as well as an iterative reconstruction that simultaneously enforces the image's sparsity in a transform domain as well as maintains the fidelity to the acquired k-space. PDACS method requires the additional acquisition of the prior data, and for reconstruction, it additionally enforces fidelity to the prior k-space domain similar to viewsharing. In this work, the authors evaluated the proposed PDACS method by comparing its results to those obtained from the 2D CS and viewsharing methods when performed individually. All three methods are used to reconstruct images from lung cancer patients whose tumors move and who are likely to benefit from lung tumor tracking. The patients are scanned, using a 3T MRI, under free breathing using the fully sampled k-space with 2D dynamic bSSFP sequence in a sagittal plane containing lung tumor. These images form a reference set for the evaluation of the partial k-space methods. To create partial k-space, the fully sampled k-space is retrospectively undersampled to obtain a range of acquisition acceleration factors, and reconstructed with 2D-CS, PDACS, and viewshare methods. For evaluation, metrics assessing global image artifacts as well as tumor contour shape fidelity are determined from the reconstructed images. These analyses are performed both for the original 3T images and those at a simulated 0.5T equivalent noise level. Results: In the 3.0T images, the PDACS strategy is shown to give superior results compared to viewshare and conventional 2D CS using all metrics. The 2D-CS tends to perform better than viewshare at the low acceleration factors, while the opposite is true at the high acceleration factors. At simulated 0.5T images, PDACS method performs only marginally better than the viewsharing method, both of which are superior compared to 2D CS. The PDACS image reconstruction time (0.3 s/image) is similar to that of the conventional 2D CS. Conclusions: The PDACS method can potentially improve the real time tracking of moving tumors by significantly increasing MRI's data acquisition speeds. In 3T images, the PDACS method does provide a benefit over the other two methods in terms of both the overall image quality and the ability to accurately and automatically contour the tumor shape. MRI's data acquisition may be accelerated using the simpler viewsharing strategy at the lower, 0.5T magnetic field, as the marginal benefit of the PDACS method may not justify its additional reconstruction times.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

The VLT LEGA-C spectroscopic survey: The physics of galaxies at a lookback time of 7 Gyr

The Large Early Galaxy Census (LEGA-C) is a Public Spectroscopic Survey of ∼3200 K-band selected galaxies at redshifts z = 0.6 − 1.0 with stellar masses M{sub ∗}>10{sup 10} M{sub ⊙}, conducted with VIMOS on ESO’s Very Large Telescope. The survey is embedded in the COSMOS field (R.A. = 10h00; decl. = +2 deg). The 20 hr long integrations produce high-signal-to-noise ratio continuum spectra that reveal ages, metallicities and velocity dispersions of the stellar populations. LEGA-C’s unique combination of sample size and depth will enable us for the first time to map the stellar content at large lookback time, across galaxies of different types and star formation activity. Observations started in 2014 December and are planned to be completed by mid 2018, with early data releases of the spectra and value-added products. In this paper we present the science case, the observing strategy, an overview of the data reduction process and data products, and a first look at the relationship between galaxy structure and spectral properties, as it existed 7 Gyr ago.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Bio-Optimized Technologies to Keep Thermoplastics out of Landfills and the Environment (BOTTLE)

Plastics have revolutionized modern life, but reliance on these fossil-based materials that persist for centuries is causing a pollution crisis and contributing to greenhouse gas (GHG) emissions. To develop new technologies to address this problem, the Bio-Optimized Technologies to keep Thermoplastics out of Landfills and the Environment (BOTTLE) Consortium will deliver selective, scalable technologies to enable cost-effective recycling, upcycling, and increased energy efficiency. BOTTLE is an interdisciplinary team of experts that aim to develop selective, scalable processes to deconstruct and upcycle today's plastics and thermosets, redesign tomorrow's plastics to be recyclable-by-design (RBD) and derived from both bio-based and plastic waste-based feedstocks, work with industrial partners across the value chain to catalyze the circular economy for plastics, and leverage AMO and BETO investments in analysis-guided R&D, integrated process development, chemical and biological catalysis, materials characterization, modeling, and data science. BOTTLE is guided by techno-economic analysis (TEA) and supply chain-based life-cycle assessment (LCA). BOTTLE comprises members from ten partner institutions. Primary outcomes to date include establishment of a full consortium, impactful, benchmarking analyses that will be important for the plastics recycling and upcycling community, and multiple impactful, high-impact publications across the breadth of our research portfolio.

bio-optimized↗
DOE OSTI2016

Invited Review Article: Pump-probe microscopy

Multiphoton microscopy has rapidly gained popularity in biomedical imaging and materials science because of its ability to provide three-dimensional images at high spatial and temporal resolution even in optically scattering environments. Currently the majority of commercial and home-built devices are based on two-photon fluorescence and harmonic generation contrast. These two contrast mechanisms are relatively easy to measure but can access only a limited range of endogenous targets. Recent developments in fast laser pulse generation, pulse shaping, and detection technology have made accessible a wide range of optical contrasts that utilize multiple pulses of different colors. Molecular excitation with multiple pulses offers a large number of adjustable parameters. For example, in two-pulse pump-probe microscopy, one can vary the wavelength of each excitation pulse, the detection wavelength, the timing between the excitation pulses, and the detection gating window after excitation. Such a large parameter space can provide much greater molecular specificity than existing single-color techniques and allow for structural and functional imaging without the need for exogenous dyes and labels, which might interfere with the system under study. In this review, we provide a tutorial overview, covering principles of pump-probe microscopy and experimental setup, challenges associated with signal detection and data processing, and an overview of applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Recent progress in atomic-scale controlled plasma processing

Atomic-scale control in plasma processing is becoming increasingly critical for fabricating of advanced semiconductor devices, particularly as the industry shifts toward three-dimensional (3D) architectures and high-aspect-ratio (HAR) structures. This review presents a comprehensive overview of recent developments in atomic-scale controlled plasma processes, organized along two key directions: the hierarchical structure of plasma–surface interactions and the generational evolution of atomic layer processing (ALP) technologies. We examined the gas phase, where molecular design enables selective generation of ions and radicals; the boundary layer, where transport phenomena govern species delivery into nanoscale features, and the surface, where temperature-dependent reactions and cyclic processing determine etching selectivity and precision. Building on this foundation, we outline five generations of ALP—from thermal atomic layer deposition to transport-aware, temporally and structurally decoupled processes—highlighting the increasing sophistication of process control. The review further explores the transition from empirical recipe development to science-based, data-driven methodologies. By integrating quantum-chemical modeling, advanced diagnostics, and machine learning, we demonstrated how predictive models can link plasma species composition to process outcomes, enabling autonomous and adaptive control strategies. Finally, this review discusses the broader societal implications of plasma process innovation through the E4 quartet: energy and resource efficiency, environmental sustainability, evolutionary advancement, and educational promotion. These principles guide the development of sustainable and intelligent atomic-scale manufacturing technologies that are not only technically advanced but also socially responsible.

Ishikawa, Kenji [Nagoya Univ. (Japan)] (ORCID:0000↗
DOE OSTI2017

Funding for the 2ND IAEA technical meeting on fusion data processing, validation and analysis

The International Atomic Energy Agency (IAEA) will organize the second Technical Meeting on Fusion Da Processing, Validation and Analysis from 30 May to 02 June, 2017, in Cambridge, MA USA. The meeting w be hosted by the MIT Plasma Science and Fusion Center (PSFC). The objective of the meeting is to provide a platform where a set of topics relevant to fusion data processing, validation and analysis are discussed with the view of extrapolation needs to next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge based understanding of the physical processes governing the dynamics of these plasmas. The meeting will aim at fostering, in particular, discussions of research and development results that set out or underline trends observed in the current major fusion confinement devices. General information on the IAEA, including its mission and organization, can be found at the IAEA websit Uncertainty quantification (UQ) Model selection, validation, and verification (V&V) Probability theory and statistical analysis Inverse problems & equilibrium reconstru ction Integrated data analysis Real time data analysis Machine learning Signal/image proc essing & pattern recognition Experimental design and synthetic diagnostics Data management

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Real-time data processing for serial crystallography experiments

We report the use of streaming data interfaces to perform fully online data processing for serial crystallography experiments, without storing intermediate data on disk. The system produces Bragg reflection intensity measurements suitable for scaling and merging, with a latency of less than 1 s per frame. Our system uses the CrystFEL software in combination with the ASAP::O data framework. In a series of user experiments at PETRA III, frames from a 16 megapixel Dectris EIGER2 X detector were searched for peaks, indexed and integrated at the maximum full-frame readout speed of 133 frames per second. The computational resources required depend on various factors, most significantly the fraction of non-blank frames ('hits'). The average single-thread processing time per frame was 242 ms for blank frames and 455 ms for hits, meaning that a single 96-core computing node was sufficient to keep up with the data, with ample headroom for unexpected throughput reductions. Further significant improvements are expected, for example by binning pixel intensities together to reduce the pixel count. We discuss the implications of real-time data processing on the `data deluge' problem from recent and future photon-science experiments, in particular on calibration requirements, computing access patterns and the need for the preservation of raw data.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

The LSST DESC DC2 Simulated Sky Survey

Here, we describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep area of approximately 300 deg 2 , as well as a deep drilling field of approximately 1 deg 2 . We simulate 5 yr of the planned 10 yr survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the data set to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic test bed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time domain cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗