Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Climate Science Performance, Data and Productivity on Titan

Climate Science models are flagship codes for the largest of high performance computing (HPC) resources, both in visibility, with the newly launched Department of Energy (DOE) Accelerated Climate Model for Energy (ACME) effort, and in terms of significant fractions of system usage. The performance of the DOE ACME model is captured with application level timers and examined through a sizeable run archive. Performance and variability of compute, queue time and ancillary services are examined. As Climate Science advances in the use of HPC resources there has been an increase in the required human and data systems to achieve programs goals. A description of current workflow processes (hardware, software, human) and planned automation of the workflow, along with historical and projected data in motion and at rest data usage, are detailed. The combination of these two topics motivates a description of future systems requirements for DOE Climate Modeling efforts, focusing on the growth of data storage and network and disk bandwidth required to handle data at an acceptable rate.

Mayer, Benjamin W↗
DOE OSTI2015

A Computing Environment to Support Repeatable Scientific Big Data Experimentation of World-Wide Scientific Literature

A principal tenant of the scientific method is that experiments must be repeatable and relies on ceteris paribus (i.e., all other things being equal). As a scientific community, involved in data sciences, we must investigate ways to establish an environment where experiments can be repeated. We can no longer allude to where the data comes from, we must add rigor to the data collection and management process from which our analysis is conducted. This paper describes a computing environment to support repeatable scientific big data experimentation of world-wide scientific literature, and recommends a system that is housed at the Oak Ridge National Laboratory in order to provide value to investigators from government agencies, academic institutions, and industry entities. The described computing environment also adheres to the recently instituted digital data management plan mandated by multiple US government agencies, which involves all stages of the digital data life cycle including capture, analysis, sharing, and preservation. It particularly focuses on the sharing and preservation of digital research data. The details of this computing environment are explained within the context of cloud services by the three layer classification of Software as a Service , Platform as a Service , and Infrastructure as a Service .

"Software as a Service↗
DOE OSTI2019

Positron annihilation lifetime spectroscopy using fast scintillators and digital electronics

Positron Annihilation Lifetime Spectroscopy (PALS) is a non-destructive radiological technique widely used in material science studies. PALS typically relies on an analog coincidence measurement setup and allows the estimate of the positron lifetime in a material sample under investigation. The positron trapping at vacancies in the material results in an increased positron lifetime. In this work, we have developed and optimized a PALS experimental setup using organic scintillators, fast digitizers, and advanced pulse processing algorithms. We tested three pairs of different organic scintillators: EJ-309 liquid, EJ-276 newly developed plastic, and BC- 418 plastic, and optimized the data processing parameters for each pair separately. Our high-throughput data analysis method is based on single-pulse interpolation and a constant fraction discrimination (CFD) algorithm. The setup based on the BC-418 detector achieved the best time resolution of 198.3 ± 0.8 ps. We used such optimized setup to analyze two single-crystal quartz samples and found lifetimes of 161 ± 4 ps, 343 ± 12 ps and 1.34 ± 0.05 ns, in good agreement with the characteristic time constants of this material. The proposed experimental set up achieves a time resolution comparable to the minimum positron lifetime in quartz, which makes it possible to accurately characterize material vacancies by discriminating between the lifetimes of either the spin singlet or triplet states of positronium. The optimized data processing algorithms are relevant to all the applications where fast timing is important, such as nuclear medicine and radiation imaging

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Automatic Determination of the Weak-Beam Condition in Dark Field X-ray Microscopy

Mechanical properties in crystals are strongly correlated to the arrangement of 1D line defects, termed dislocations. Recently, Dark field X-ray Microscopy (DFXM) has emerged as a new tool to image and interpret dislocations within crystals using multidimensional scans. However, the methods required to reconstruct meaningful dislocation information from high-dimensional DFXM scans are still nascent and require significant manual oversight (i.e. supervision). In this work, we present a new relatively unsupervised method that extracts dislocation-specific information (features) from a 3D dataset (x, y, Φ) using Gram-Schmidt orthogonalization to represent the large dataset as an array of 3-component feature vectors for each position, corresponding to the weak-beam conditions and the strong-beam condition. Finally, this method offers key opportunities to significantly reduce dataset size while preserving only the crystallographic information that is important for data reconstruction.

36 MATERIALS SCIENCE↗
DOE OSTI2016

BEAM: A Computational Workflow System for Managing and Modeling Material Characterization Data in HPC Environments

Improvements in scientific instrumentation allow imaging at mesoscopic to atomic length scales, many spectroscopic modes, and now—with the rise of multimodal acquisition systems and the associated processing capability—the era of multidimensional, informationally dense data sets has arrived. Technical issues in these combinatorial scientific fields are exacerbated by computational challenges best summarized as a necessity for drastic improvement in the capability to transfer, store, and analyze large volumes of data. The Bellerophon Environment for Analysis of Materials (BEAM) platform provides material scientists the capability to directly leverage the integrated computational and analytical power of High Performance Computing (HPC) to perform scalable data analysis and simulation via an intuitive, cross-platform client user interface. This framework delivers authenticated, “push-button” execution of complex user workflows that deploy data analysis algorithms and computational simulations utilizing the converged compute-and-data infrastructure at Oak Ridge National Laboratory's (ORNL) Compute and Data Environment for Science (CADES) and HPC environments like Titan at the Oak Ridge Leadership Computing Facility (OLCF). In this work we address the underlying HPC needs for characterization in the material science community, elaborate how BEAM's design and infrastructure tackle those needs, and present a small sub-set of user cases where scientists utilized BEAM across a broad range of analytical techniques and analysis modes.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2019

Informative Path Planning for Mapping Radiation

This project involves making measurements of contaminated areas using portable radiation detectors and small robots. Tasks involve operating detectors and small robots, combining data acquisition for the two systems, and automating the systems. The end result is a radiation map of contamination areas. Localization of radioactive sources and mapping of contamination distribution is essential when responding to emergencies, or when dealing with cleanup efforts. Radiation maps are used for situational awareness and for establishing a safe perimeter. However, it may be hazardous or impossible for humans to safely enter the site and survey the area. Informative Path Planning (IPP) is used to design a path for a robotic sensor platform to gather the most information about the radiation distribution while operating under the set of constraints given by the dynamics of the robot and other requirements such as minimizing the overall mission time. The key challenge for IPP is the tight coupling in multiple layers of decisions: Selection of locations to visit; Allocation of sensors to those locations; Processing of information gathered. Given a robot equipped with a basic gamma detector and Lidar sensor, how can we efficiently explore an unknown environment in such a way that we can satisfy the robot's constraints while simultaneously maximizing the accuracy of the map and minimizing the total runtime? This work presents a systematic procedure for IPP and environmental mapping that: Selects the best locations at which to sample; Finds the best path for robots; Estimates the measurement value at unknown locations using a Gaussian Process regression framework. Given a set of points where radiation measurements were taken, we are utilizing a Gaussian Process Regression with a Matern kernel to reconstruct the shape of the underlying ground truth. Mapping is done via the Robot Operating System's OpenSlam Gmapping package, which creates a 2D occupancy grid map. Simulated trials were run with a radiation source placed at random locations, and allowing the robot to select and move towards 20 samples at separate locations, as well as sampling along the path while moving. The simulated sensor model assumed an efficiency of 0.3, collection time of 1 second. Various weighting schemes were tested and compared. Quantitative evaluations often favored exploitation-heavy weighting schemes where μ was emphasized, with the Root Mean Squared Error (RMSE) quickly tending towards 2, whereas qualitative comparisons would favor exploration-biased schemes with greater weight on σ. The difference comes from operators often favoring knowing the general location of a source, rather than the exact properties of a source. Weighting of the path-length π often reduced the quality of the regression as less exploration occurred, however this may be deemed a worthwhile trade-off under certain circumstances, such as with sensitive robots. Successfully developed a methodology for informative path-planning for a robot to efficiently gather information and create a map of radiation. In the future, we would like to focus on: Hardware trials with integration of the robot platform and the IPP software; More refined sensor and environmental modeling; Multiple robot platforms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

The LSST DESC data challenge 1: generation and analysis of synthetic images for next-generation surveys

Data Challenge 1 (DC1) is the first synthetic data set produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST data set. DC1 is comprised of r -band observations of 40 deg 2 to 10 yr LSST depth. In this paper, we present each stage of the simulation and analysis process: (a) generation, by synthesizing sources from cosmological N -body simulations in individual sensor-visit images with different observing conditions; (b) reduction using a development version of the LSST Science Pipelines; and (c) matching to the input cosmological catalogue for validation and testing. We verify that testable LSST requirements pass within the fidelity of DC1. We establish a selection procedure that produces a sufficiently clean extragalactic sample for clustering analyses and we discuss residual sample contamination, including contributions from inefficiency in star–galaxy separation and imperfect deblending. We compute the galaxy power spectrum on the simulated field and conclude that: (i) survey properties have an impact of 50 per cent of the statistical uncertainty for the scales and models used in DC1; (ii) a selection to eliminate artefacts in the catalogues is necessary to avoid biases in the measured clustering; and (iii) the presence of bright objects has a significant impact (2σ–6σ) in the estimated power spectra at small scales (ℓ > 1200), highlighting the impact of blending in studies at small angular scales in LSST.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

A Thermodynamic Model Toward the Comprehension of Ferrous Burden Softening and Melting Using FactSage Macro-Processing

The softening and melting properties of iron-bearing materials play a decisive role in the formation of the cohesive zone, which greatly affects blast furnace gas flow distribution and heat-transfer efficiency. To improve the understanding regarding the evolution of condensed phases during reduction, softening, and melting, a thermodynamic model has been developed using FactSage™ thermodynamic software and macro-processing. The model was constructed using a series of equilibrium stages and splitters to determine flow directions of streams and to consider kinetic inhibitions. For all iron-bearing materials studied, the methodology proposed for modeling was capable of obtaining reduction degrees in very good agreement to its experimental data. The evolution of solid phases was qualitatively comparable to the available literature, with Fayalite, Kirschsteinite, Melilite, and FeO as the main solid phases in equilibrium before slag formation. The comparison between the profiles of the calculated slag mass fraction and the experimental pressure drop showed a close relation between these properties. Moreover, the level of heterogeneity of each raw material may play a significant role in the interpretation of its results.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Audacity of huge: overcoming challenges of data scarcity and data quality for machine learning in computational materials discovery

Machine learning (ML)-accelerated discovery requires large amounts of high-fidelity data to reveal predictive structure–property relationships. For many properties of interest in materials discovery, the challenging nature and high cost of data generation has resulted in a data landscape that is both scarcely populated and of dubious quality. Data-driven techniques starting to overcome these limitations include the use of consensus across functionals in density functional theory, the development of new functionals or accelerated electronic structure theories, and the detection of where computationally demanding methods are most necessary. When properties cannot be reliably simulated, large experimental data sets can be used to train ML models. In the absence of manual curation, increasingly sophisticated natural language processing and automated image analysis are making it possible to learn structure–property relationships from the literature. Finally, models trained on these data sets will improve as they incorporate community feedback.

36 MATERIALS SCIENCE↗
DOE OSTI2019

WHONDRS 48 Hour Diel Cycling Study at the Altamaha River in Georgia, USA

This dataset is from a sampling campaign completed over the course of 48 hours to investigate the effects of tidally induced water level variation on aqueous chemistry, dissolved organic matter chemistry, and metabolic potential of microbial communities at the Altamaha River, GA, USA. Filtered surface water (SW) and pore water (PP) samples were collected every three hours in October 2018. This dataset is one of seven companion datasets that were part of the WHONDRS 48 Hour Diel Cycling Study of freshwater rivers. All seven datasets are available on ESS-DIVE; they can be found by searching for WHONDRS 48 Hour. This package contains a variety of chemical and hydrologic variables. All data types are provided in a standard format. Basic geochemistry analyses (e.g., non-purgeable organic carbon concentration, cations, anions, SpC, pH) were conducted, standardized photos were taken, surface water hydrographs were collated from existing instrumentation, and extensive metadata were captured. Aqueous chemistry variables include USGS codes in the first portion of the variable name (e.g., 00940_Cl_mg_per_L). These codes allow for interoperability with USGS water quality data. In addition, samples were delivered to the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory) for high resolution characterization of dissolved organic matter via 12 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS). The data package contains instructions to process the FTICR data based on the user’s specific needs, and sample-level summary indices derived from the FTICR data will be added to the data package. Beyond the data in this data package, metagenomic data are being generated on associated microbial communities. When these data are available, the data package will be updated with information on accessing them. Please contact WHONDRS@pnnl.gov for more information. Please use the data package’s DOI to cite the data package. We ask that you email us at WHONDRS@pnnl.gov to let us know that you're using the data and acknowledge WHONDRS and the U.S. Department of Energy's Subsurface Biogeochemical Research program—which generously provides funding to WHONDRS—in your publications, proposals, presentations, etc. All data are free to be used for any purpose, such as for manuscripts, presentations, and grant proposals. Note that the included hydrograph has a separate DOI that should also be cited. There is no obligation to include WHONDRS members as co-authors. Please note that this data package was originally published in November 2019. It was updated in July 2020. See the readme file in the data package for details. None of the data values were altered. The units were updated in one column of the main metadata file and in one of the methods codes descriptions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Enabling discovery data science through cross-facility workflows

Experimental and observational instruments for scientific research (such as light sources, genome sequencers, accelerators, telescopes and electron microscopes) increasingly require High Performance Computing (HPC) scale capabilities for data analysis and workflow processing. Next-generation instruments are being deployed with higher resolutions and faster data capture rates, creating a big data crunch that cannot be handled by modest institutional computing resources. Often these big data analysis pipelines also require near real-time computing and have higher resilience requirements than the simulation and modeling workloads more traditionally seen at HPC centers. While some facilities have enabled workflows to run at a single HPC facility, there is a growing need to integrate capabilities across HPC facilities to enable cross-facility workflows, either to provide resilience to an experiment, increase analysis throughput capabilities, or to better match a workflow to a particular architecture. In this paper we describe the barriers to executing complex data analysis workflows across HPC facilities and propose an architectural design pattern for enabling scientific discovery using cross-facility workflows that includes orchestration services, application programming interfaces (APIs), data access and co-scheduling.

Antypas, Katerina B.↗
DOE OSTI2019

Materials informatics: From the atomic-level to the continuum

We report that in recent years materials informatics, which is the application of data science to problems in materials science and engineering, has emerged as a powerful tool for materials discovery and design. This relatively new field is already having a significant impact on the interpretation of data for a variety of materials systems, including those used in thermoelectrics, ferroelectrics, battery anodes and cathodes, hydrogen storage materials, polymer dielectrics, etc. Its practitioners employ the methods of multivariate statistics and machine learning in conjunction with standard computational tools (e.g., density-functional theory) to, for example, visualize and dimensionally reduce large data sets, identify patterns in hyperspectral data, parse microstructural images of polycrystals, characterize vortex structures in ferroelectrics, design batteries and, in general, establish correlations to extract important physics and infer structure-property-processing relationships. In this Overview, we critically examine the role of informatics in several important materials subfields, highlighting significant contributions to date and identifying known shortcomings. We specifically focus attention on the difference between the correlative approach of classical data science and the causative approach of physical sciences. From this perspective, we also outline some potential opportunities and challenges for informatics in the materials realm in this era of big data.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Editorial: Hydrology, ecology, and nutrient biogeochemistry at the terrestrial-aquatic interface

Terrestrial-aquatic interfaces (TAI) play important roles in mediating the exchange of water and chemicals between land, surface and subsurface water systems, which is tightly coupled with biogeochemical transformations that influence water quality and ecosystem health (Harvey and Gooseff, 2015; Harvey et al., 2019). Understanding and predicting the interactions between the hydrologic, ecologic, and biogeochemical processes at those interfaces is crucial for the sustainable management of water resources and promotion of healthy ecosystems under different environmental stresses and disturbances, including climate change, human activities, and more frequent occurrence of extreme events. Both process-based and data-driven approaches have emerged to address critical challenges at TAIs as integral parts of the Earth system (e.g., Ward and Packman, 2019; Chen et al., 2021; Dwivedi et al., 2022). In this Research Topic, we sought research that advances the understanding of coupled hydrologic, ecologic, and biogeochemical processes along various TAIs from the summit to sea, e.g., river corridors and coastal TAI systems. We invited observational, experimental, theoretical, analytical, numerical, and data-driven research that aims to understand hydro-biogeochemical processes such as the redox dynamics and biogeochemical transformations of carbon, nutrients, and metals occurring at the TAIs and address their heterogeneity and scaling challenges.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

NACHOS, a CubeSat-based high-resolution UV-Visible hyperspectral imager for remote sensing of trace gases: system overview and science objectives

Here, the Nano-satellite Atmospheric Chemistry Hyperspectral Observation System (NACHOS) is a high-throughput (f/2.9), high spectral resolution (~1.3 nm optical resolution, 0.6 nm sampling) Offner-design hyperspectral imager operating in the 300-500 nm spectral region. The 1.5U instrument payload (1U optical system, 0.5U electronics module) is hosted by a 1.5U LANL-designed CubeSat bus to comprise a 3U complete satellite. Spectroscopically similar to NASA’s Ozone Monitoring Instrument (OMI), which provides wide-field global mapping of ozone and other gases at coarse spatial resolution, NACHOS fills the complementary niche of targeted measurements at much higher spatial resolution. With 350 across-track spatial pixels and a 15-degree across-track field of view, NACHOS will provide spectral imaging at roughly 0.4 km per pixel from 500 km altitude. NACHOS incorporates highly streamlined gas-retrieval algorithms for rapid onboard processing, alleviating the need to routinely downlink massive hyperspectral data cubes. We will discuss the instrument design, challenges in achieving mechanical robustness to launch vibration in such a compact instrument, the onboard calibration system, and gas-retrieval data downlink strategy. We will also discuss potential science missions, including monitoring of NO 2 as an easily detected proxy for anthropogenic fossil-fuel greenhouse gases, monitoring lowlevel SO 2 degassing at pre-eruptive volcanoes, H 2 CO from wildfires, and characterization of aerosols. The long-term vision is for a many-satellite constellation that could provide both high spatial resolution and frequent revisits for selected targets of interest. As an initial technology demonstration of this vision, the NACHOS project is currently slated to launch two CubeSats in early 2022.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Data Quality Objectives Supporting Radiological Air Emissions Monitoring for the PNNL-Richland Campus: North Campus Construction (Rev. 3)

Starting in fiscal year 2023, the north area of the PNNL-Richland Campus will undergo development. Initially, infrastructure (water, electrical) improvements will be installed. Later development includes the construction of several new office buildings. The area to be developed currently contains no buildings but does have two existing solar-powered ambient air sampling stations. Under the requirements of Washington State Department of Health Radioactive Air Emissions License -005, the PNNL-Richland Campus must operate and maintain a radiological air monitoring program. This revision documents and evaluates how the new North Campus construction impacts ambient air surveillance stations within the development region. This revision also considers current stack configurations and uses an updated environmental dispersion model and updated meteorological data. The DQO team concluded that one sampling station in the construction area will be relocated and the other remain in place. The evaluations conducted for this DQO also identified a third sampling station outside the development area that is recommended for relocation as a result of updated dispersion modeling. Recommended sites for the relocations are presented. Considerations for sampling in and around a construction zone are also addressed. Additionally, programmatic improvements to the ambient air sampling program were identified in the DQO process.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Metabolic Pathway Engineering

Modern microbial and enzyme engineering and their advancement are increasingly dependent on the marriage of a wide range of sophisticated technologies. For students entering the field of biotechnology, the outlook is indeed daunting. Expertise at levels beyond that of simple familiarity will be needed to conduct competitive research. It goes without saying that to be competitive, all new researchers in this field will need basic preparation in molecular biology, biochemistry, and genetics. Further, experience working with concepts and experimental tools in enzyme biochemistry and kinetics, gene editing, computational metabolic pathway modeling, experimental pathway flux analysis, and computational clustering tools to process complex data sets will be vital for success. We speculate that most biotechnology researchers in early career at this time will build teams of collaborators to address these disparate science fields rather than attempt to become experts in one lab.

BASIC BIOLOGICAL SCIENCES,BIOMASS FUELS↗
DOE OSTI2018

Machine learning properties of binary wurtzite superlattices

The burgeoning paradigm of high-throughput computations and materials informatics brings new opportunities in terms of targeted materials design and discovery. The discovery process can be significantly accelerated and streamlined if one can learn effectively from available knowledge and past data to predict materials properties efficiently. Indeed, a very active area in materials science research is to develop machine learning based methods that can deliver automated and cross-validated predictive models using either already available materials data or new data generated in a targeted manner. In the present paper, we show that fast and accurate predictions of a wide range of properties of binary wurtzite superlattices, formed by a diverse set of chemistries, can be made by employing state-of-the-art statistical learning methods trained on quantum mechanical computations in combination with a judiciously chosen numerical representation to encode materials’ similarity. These surrogate learning models then allow for efficient screening of vast chemical spaces by providing instant predictions of the targeted properties. Moreover, the models can be systematically improved in an adaptive manner, incorporate properties computed at different levels of fidelities and are naturally amenable to inverse materials design strategies. Finally, while the learning approach to make predictions for a wide range of properties (including structural, elastic and electronic properties) is demonstrated here for a specific example set containing more than 1200 binary wurtzite superlattices, the adopted framework is equally applicable to other classes of materials as well.

36 MATERIALS SCIENCE↗