Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Matrix phased array (MPA) imaging technology for resistance spot welds

A three-dimensional MPA probe has been incorporated with a high speed phased array electronic board to visualize nugget images of resistance spot welds. The primary application area of this battery operated portable MPA ultrasonic imaging system is in the automotive industry which a conventional destructive testing process is commonly adopted to check the quality of resistance spot welds in auto bodies. Considering an average of five-thousand spot welds in a medium size passenger vehicle, the amount of time and effort given to popping the welds and measuring nugget size are immeasurable in addition to the millions of dollars' worth of scrap metals recycled per plant per year. This wasteful labor intensive destructive testing process has become less reliable as auto body sheet metal has transitioned from thick and heavy mild steels to thin and light high strength steels. Consequently, the necessity of developing a non-destructive inspection methodology has become inevitable. In this paper, the fundamental aspects of the current 3-D probe design, data acquisition algorithms, and weld nugget imaging process are discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2015

A comprehensive data acquisition and management system for an ecosystem-scale peatland warming and elevated CO 2 experiment

Ecosystem-scale manipulation experiments represent large science investments that require well-designed data acquisition and management systems to provide reliable, accurate information to project participants and third party users. The SPRUCE project (Spruce and Peatland Responses Under Climatic and Environmental Change, http://mnspruce.ornl.gov ) is such an experiment funded by the Department of Energy's (DOE), Office of Science, Terrestrial Ecosystem Science (TES) Program. The SPRUCE experimental mission is to assess ecosystem-level biological responses of vulnerable, high carbon terrestrial ecosystems to a range of climate warming manipulations and an elevated CO 2 atmosphere. SPRUCE provides a platform for testing mechanisms controlling the vulnerability of organisms, biogeochemical processes, and ecosystems to climatic change (e.g., thresholds for organism decline or mortality, limitations to regeneration, biogeochemical limitations to productivity, and the cycling and release of CO 2 and CH 4 to the atmosphere). The SPRUCE experiment will generate a wide range of continuous and discrete measurements. In order to successfully manage SPRUCE data collection, achieve SPRUCE science objectives, and support broader climate change research, the research staff has designed a flexible data system using proven network technologies and software components. The primary SPRUCE data system components are the following; 1. data acquisition and control system – set of hardware and software to retrieve biological and engineering data from sensors, collect sensor status information, and distribute feedback to control components; 2. data collection system – set of hardware and software to deliver data to a central depository for storage and further processing; and 3. data management plan – set of plans, policies, and practices to control consistency, protect data integrity, and deliver data. This publication presents our approach to meeting the challenges of designing and constructing an efficient data system for managing high volume sources of in situ observations in a remote, harsh environmental location. Finally, the approach covers data flow starting from the sensors and ending at the archival/distribution points, discusses types of hardware and software used, examines design considerations that were used to choose them, and describes the data management practices chosen to control and enhance the value of the data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Next Generation Workload Management System For Big Data on Heterogeneous Distributed Computing

The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson. ATLAS and ALICE are the largest collaborations ever assembled in the sciences and are at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, both experiments rely on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System (WMS) for managing the workflow for all data processing on hundreds of data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. The scale is demonstrated by the following numbers: PanDA manages O(10 2 ) sites, O(10 5 ) cores, O(10 8 ) jobs per year, O(10 3 ) users, and ATLAS data volume is O(10 17 ) bytes. In 2013 we started an ambitious program to expand PanDA to all available computing resources, including opportunistic use of commercial and academic clouds and Leadership Computing Facilities (LCF). The project titled 'Next Generation Workload Management and Analysis System for Big Data' (BigPanDA) is funded by DOE ASCR and HEP. Extending PanDA to clouds and LCF presents new challenges in managing heterogeneity and supporting workflow. The BigPanDA project is underway to setup and tailor PanDA at the Oak Ridge Leadership Computing Facility (OLCF) and at the National Research Center "Kurchatov Institute" together with ALICE distributed computing and ORNL computing professionals. Our approach to integration of HPC platforms at the OLCF and elsewhere is to reuse, as much as possible, existing components of the PanDA system. Finally, we will present our current accomplishments with running the PanDA WMS at OLCF and other supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Considerations about future hard x-ray area detectors

X-ray sources continue to advance in both intensity and temporal domains, thereby opening new ways to analyze the structure and properties of matter, provided that the resultant x-ray images can be efficiently and quantitatively recorded. In this perspective we focus on specific limitations of pixel area x-ray detectors. Although pixel area x-ray detectors have also advanced in recent years, many experiments are still detector limited. Specifically, there is need for detectors that can acquire successive images at GHz rates; detectors that can accurately measure both single photon and millions of photons per pixel in the same image at frame rates of hundreds of kHz; and detectors that efficiently capture images of very hard x-rays (20 keV to several hundred keV). The data volumes and data rates of state-of-the-art detection exceeds most practical data storage options and readout bandwidths, thereby necessitating on-line processing of data prior to, or in lieu of full frame readouts.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Science Capsule - Capturing the Data Life Cycle

The data generated from scientific workflows often become unusable due to the lack or incompleteness of information required for processing and analyzing the data. Reproducibility of scientific data and workflows facilitates efficient processing and analyses. A key to enabling reproducibility is to capture the end-to-end workflow life cycle, and any contextual metadata and provenance.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2017

Software Defined Cyberinfrastructure

Within and across thousands of science labs, researchers and students struggle to manage data produced in experiments, simulations, and analyses. Largely manual research data lifecycle management processes mean that much time is wasted, research results are often irreproducible, and data sharing and reuse remain rare. In response, we propose a new approach to data lifecycle management in which researchers are empowered to define the actions to be performed at individual storage systems when data are created or modified: actions such as analysis, transformation, copying, and publication. We term this approach software-defined cyberinfrastructure because users can implement powerful data management policies by deploying rules to local storage systems, much as software-defined networking allows users to configure networks by deploying rules to switches.We argue that this approach can enable a new class of responsive distributed storage infrastructure that will accelerate research innovation by allowing any researcher to associate data workflows with data sources, whether local or remote, for such purposes as data ingest, characterization, indexing, and sharing. We report on early experiments with this approach in the context of experimental science, in which a simple if-trigger-then-action (IFTA) notation is used to define rules.

Foster, Ian↗
DOE OSTI2014

Data-Model Needs for Belowground Ecology. A Summary Report from the Terrestrial Ecosystem Science (TES) Mini-Workshop, May 8, 2014

Terrestrial life on Earth depends on belowground cycling and storage of a significant portion of the planet’s biologically-active carbon. The interplay among organic inputs by primary producers, soil organic matter stabilization, and assimilation and mineralization by soil organisms drives belowground ecology. Understanding belowground carbon dynamics, including the stability and vulnerability of soil organic carbon stocks, is necessary to project the responses and feedbacks of terrestrial ecosystems to a changing climate. Although conceptually understood, belowground hydrobiogeochemical systems are not well characterized with quantitative and mechanistic representations of critical functions. As a result, these systems are inadequately represented in modeling efforts, limiting our ability to understand and project terrestrial carbon source/sink relationships at various temporal and spatial scales. The belowground science community lacks robust databases and data libraries against which model sensitivities and performance can be tested and enhanced. Improved understanding of belowground ecosystems, including biotic and abiotic interactions, is needed to ensure that model structures include and provide adequate representations of critical belowground processes, functions, and dynamics. A one-day workshop brought together experimental and modeling representatives from the four Department of Energy (DOE) National Laboratories where the Office of Biological and Environmental Research (BER) Terrestrial Ecosystem Science (TES) program has investments in belowground ecology. The group focused on identifying and characterizing (1) critical experimental and observational datasets for testing and developing existing and future belowground-process models and land models; (2) the limitations and needs for modeling belowground processes within ecosystem models; and (3) key areas for leveraging current research activities across the National Laboratories and BER-funded projects. Discussion results are organized in this report as: (I) over-arching data requirements for advancing understanding of belowground ecosystems; (II) efforts that could rapidly improve understanding and model representations of belowground components of terrestrial ecosystems; and (III) longer-term research needs that would benefit from greater and more sustained support.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

EMP, Attachment 2: Data Management Plan

This Data Management Plan (DMP) is an attachment to the Pacific Northwest National Laboratory Environmental Radiological Air Monitoring Plan (EMP). PNNL is a U.S. Department of Energy Office of Science national laboratory. Radioactive effluent monitoring and environmental surveillance for PNNL operations in Washington State are the responsibility of the PNNL Environmental Protection and Regulatory Programs division and are conducted by the Environmental Radiation Task staff. This DMP describes the data management processes for PNNL radioactive air emissions (stack) monitoring and environmental radiological ambient air surveillance activities.

40 CFR 61 Subpart H↗
DOE OSTI2022

Can machine learning accelerate process understanding and decision‐relevant predictions of river water quality?

Abstract The global decline of water quality in rivers and streams has resulted in a pressing need to design new watershed management strategies. Water quality can be affected by multiple stressors including population growth, land use change, global warming, and extreme events, with repercussions on human and ecosystem health. A scientific understanding of factors affecting riverine water quality and predictions at local to regional scales, and at sub‐daily to decadal timescales are needed for optimal management of watersheds and river basins. Here, we discuss how machine learning (ML) can enable development of more accurate, computationally tractable, and scalable models for analysis and predictions of river water quality. We review relevant state‐of‐the art applications of ML for water quality models and discuss opportunities to improve the use of ML with emerging computational and mathematical methods for model selection, hyperparameter optimization, incorporating process knowledge into ML models, improving explainablity, uncertainty quantification, and model‐data integration. We then present considerations for using ML to address water quality problems given their scale and complexity, available data and computational resources, and stakeholder needs. When combined with decades of process understanding, interdisciplinary advances in knowledge‐guided ML, information theory, data integration, and analytics can help address fundamental science questions and enable decision‐relevant predictions of riverine water quality.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Book Review: Reiner Salzer and Heinz W. Siesler (Eds.): Infrared and Raman spectroscopic imaging, 2nd ed.

This second edition of "Infrared and Raman Spectroscopic Imaging" propels practitioners in that wide-ranging field, as well as other readers, to the current state of the art in a well-produced and full-color, completely revised and updated, volume. This new edition chronicles the expanded application of vibrational spectroscopic imaging from yesterday's time-consuming point-by-point buildup of a hyperspectral image cube, through the improvements afforded by the addition of focal plane arrays and line scan imaging, to methods applicable beyond the diffraction limit, instructs the reader on the improved instrumentation and image and data analysis methods, and expounds on their application to fundamental biomedical knowledge, food and agricultural surveys, materials science, process and quality control, and many others.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

First Constraint on Atmospheric Millicharged Particles with the LUX-ZEPLIN Experiment

We report on a search for millicharged particles (mCPs) produced in cosmic ray atmospheric interactions using data collected during the first science run of the LUX-ZEPLIN experiment. The mCPs produced by two processes—meson decay and proton bremsstrahlung—are considered in this study. This search utilized a novel signature unique to liquid xenon (LXe) time projection chambers, allowing sensitivity to mCPs with masses ranging from 10 to 1000 MeV/c 2 and fractional charges between 0.001 and 0.02 of the electron charge (𝑒). With an exposure of 60 live days and a 5.5 metric ton fiducial mass, we observed no significant excess over background. This represents the first experimental search for atmospheric mCPs and the first search for mCPs using an underground LXe experiment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2016

Storage and Read-Optimized Data Placement Structures for High-Performance Analysis [Book Chapter]

Here, we present state-of-art structures and methods for efficient data preparation and representation for analysis. Our intent is to introduce the data science and analytics communities to open source data placements, structures, and methods. These practices can make the foundational processes of data preparation and access dramatically more efficient than typical raw file or database representations and use more conservative storage. To illustrate this, we introduce two highly efficient data placement structures. We then present a tutorial, supported by step-by-step examples, of how to create, use, and access data, structured by Parquet or ORC (Optimized Row Columnar), using Apache Spark. Finally, we illustrate the benefits of using these structures with computational and storage volume benchmarks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A perspective on Bayesian methods applied to materials discovery and design

For more than two decades, there has been increasing interest in developing frameworks for the accelerated discovery and design of novel materials that could enable promising and transformative technologies. The Integrated Computational Materials Engineering (ICME) program called for integrating computational tools to establish linkages along process-structure-property-performance (PSPP) chains. The Materials Genome Initiative called for integrating experiments and computations within data science frameworks as a strategy to accelerate the materials development cycle. While these frameworks and paradigms have been quite influential, traditional ICME or data science-based approaches tend to have some limitations, mainly when querying the materials space is costly and very little information is available. Bayesian methods are more suitable in this context due to their efficiency gains. To this end, the materials discovery problem is framed as a Bayesian Optimization (BO). Different examples in which BO has been applied to solve materials discovery problems are presented. The methods/examples discussed include BO under model uncertainty, multi-information source BO, multi-objective and multi-constraint BO, and batch BO. Bayesian Materials Discovery is a promising area of research that is likely to become more influential as more attention is put on autonomous materials discovery platforms. Therefore, a discussion is provided on the potential development of such methods to increase the ability of existing platforms in materials discovery. Here, the ultimate goal is to pave the way to autonomous materials discovery.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Long Range Plan: Dense matter theory for heavy-ion collisions and neutron stars

Since the release of the 2015 Long Range Plan in Nuclear Physics, major events have occurred that reshaped our understanding of quantum chromodynamics (QCD) and nuclear matter at large densities, in and out of equilibrium. The US nuclear community has an opportunity to capitalize on advances in astrophysical observations and nuclear experiments and engage in an interdisciplinary effort in the theory of dense baryonic matter that connects low- and high-energy nuclear physics, astrophysics, gravitational waves physics, and data science. This is a white paper prepared by a group of nuclear physicists during the 2023 LRP process.

Lovato, Alessandro↗
DOE OSTI2015

SU-E-T-272: Direct Verification of a Treatment Planning System Megavoltage Linac Beam Photon Spectra Models, and Analysis of the Effects On Patient Plans

Purpose: For the photon dose calculation Philips Pinnacle Treatment Planning System (TPS) uses collapsed cone convolution algorithm, which relies on energy spectrum of the beam in computing the scatter component. The spectrum is modeled based on Linac’s standard commissioning data and typically is not independently verified. We explored a methodology of using transmission measurements in combination with regularization data processing to unfold Linac spectra. The measured spectra were compared to those modeled by the TPS, and the effect on patient plans was evaluated. Methods: Transmission measurements were conducted in narrow-beam geometry using a standard Farmer ionization chamber. Two attenuating materials and two build -up caps, having different atomic numbers, served to enhance discrimination between absorption of low and high-energy portions of the spectra, thus improving the accuracy of the results. The data was analyzed using a regularization technique implemented through spreadsheet-based calculations. Results: The unfolded spectra were found to deviate from the TPS beam models. The effect of such deviations on treatment planning was evaluated for patient plans through dose distribution calculations with either TPS modeled or measured energy spectra. The differences were reviewed through comparison of isodose distributions, and quantified based on maximum dose values for critical structures. While in most cases no drastic differences in the calculated doses were observed, plans with deviations of 4 to 8% in the maximum dose values for critical structures were discovered. The anatomical sites with large scatter contributions are the most vulnerable to inaccuracies in the modeled spectrum. Conclusion: An independent check of the TPS model spectrum is highly desirable and should be included as part of commissioning of a new Linac. The effect is particularly important for dose calculations in high heterogeneity regions. The developed approach makes acquisition of megavoltage Linac beam spectra achievable in a typical radiation oncology clinic.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

CROCUS Urban Fluxes of CO₂, H₂O, and Turbulence at University of Illinois Chicago

As of May 12, 2026 this dataset is currently being versioned to include data up to April 2026. Once the versioning process is complete, new data files will be available for access. The dataset metadata will also be updated to reflect the data availability of the new data being versioned. This dataset was collected at the UIC Plant Research Laboratory in Chicago, Illinois, as part of the Community Research on Climate and Urban Science (CROCUS) Urban Integrated Field Laboratory (UIFL) project, led by Argonne National Laboratory. The site provides continuous atmospheric flux measurements, focusing on CO₂, H₂O, and heat and momentum transport in an urban setting. The data is processed at 30 minutes interval using the Eddy Covariance method and includes quality control and diagnostic data generated by EddyPro software. The data is stored in the netCDF files following CF conventions. The UIC Plant Research Laboratory is located near major highways and urban infrastructure, including buildings and parking areas. The surrounding landscape consists of a mix of turf, plants, trees, and impervious surfaces such as concrete and asphalt, making it ideal for studying urban at for studies on urban sustainability, air quality, and the effects of urbanization on atmospheric processes on urban climate dynamics, air quality, and surface-atmosphere exchanges within the city of Chicago. This dataset is funded by the U.S. Department of Energy’s Office of Science, Biological and Environmental Research (BER) program.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

SU-C-207A-06: On-Line Beam Range Verification with Multiple Scanning Particle Beams: Initial Feasibility Study with Simulations

Purpose: To investigate the feasibility and requirement for intra-fraction on-line multiple scanning particle beam range verifications (BRVs) with in-situ PET imaging, which is beyond the current single-beam BRV with extra factors that will affect the BR measurement accuracy, such as beam diameter, separation between beams, and different image counts at different BRV positions. Methods: We simulated a 110-MeV proton beam with 5-mm diameter irradiating a uniform PMMA phantom by GATE simulation, which generated nuclear interaction-induced positrons. In this preliminary study, we simply duplicated these positrons and placed them next to the initial protons to approximately mimic the two spatially separated positron distributions produced by two beams parallel to each other but with different beam ranges. These positrons were then imaged by a PET (∼2-mm resolution, 10% sensitivity, 320×320×128 mm^3 FOV) with different acquisition times. We calculated the positron activity ranges (ARs) from reconstructed PET images and compared them with the corresponding ARs of original positron distributions. Results: Without further image data processing and correction, the preliminary study show the errors between the measured and original ARs varied from 0.2 mm to 2.3 mm as center-to-center separations and range differences were in the range of 8–12 mm and 2–8 mm respectively, indicating the accuracy of AR measurement strongly depends on the beam separations and range differences. In addition, it is feasible to achieve ≤ 1.0-mm accuracy for both beams with 1-min PET acquisition and 12 mm beam separation. Conclusion: This study shows that the overlap between the positron distributions from multiple scanning beams can significantly impact the accuracy of BRVs of distributed particle beams and need to be further addressed beyond the established method of single-beam BRV, but it also indicates the feasibility to achieve accurate on-line multi-beam BRV with further improved method.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

Performance Analysis, Design Considerations, and Applications of Extreme-Scale In Situ Infrastructures

A key trend facing extreme-scale computational science is the widening gap between computational and I/O rates, and the challenge that follows is how to best gain insight from simulation data when it is increasingly impractical to save it to persistent storage for subsequent visual exploration and analysis. One approach to this challenge is centered around the idea of in situ processing, where visualization and analysis processing is performed while data is still resident in memory. This paper examines several key design and performance issues related to the idea of in situ processing at extreme scale on modern platforms: Scalability, overhead, performance measurement and analysis, comparison and contrast with a traditional post hoc approach, and interfacing with simulation codes. We illustrate these principles in practice with studies, conducted on large-scale HPC platforms, that include a miniapplication and multiple science application codes, one of which demonstrates in situ methods in use at greater than 1M-way concurrency.

Ayachit, Utkarsh↗