Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Sources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The DeepLynx Data Warehouse

Digital Engineering and the development of digital twins necessitate the use of highly sophisticated tools and software. These methodologies and systems bring many benefits but rely on accomplishing challenging goals such as disparate data and systems integration into a single cohesive and holistic system. Idaho National Laboratory has recently released an open-source data warehouse – DeepLynx – to help in the planning, creation, execution, and management of projects in the digital engineering space, with an emphasis on supporting digital twins in an operational space.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

An R shiny graphical user interface for highprecision mass spectrometric data analysis

• There is currently a lack of software that meets the needs for the analysis of raw data produced by modern isotope ratio mass spectrometers for both R&D and routine use at SRNL and other US national labs • Needs to accommodate multiple isotope systems, instruments, and manufacturers • Include modern statistical methods and handling/visualization of uncertainty • Flexible software with transparent (no “black box”) and reproducible methods • This project is inspired by existing discipline-specific data analysis software (e.g., Tripoli1 , ET_Redux2, IsoplotR3) used in the geochemical community • Our goal is to build an open source data analysis software package that focuses on flexibility, transparency, and reproducibility

LABONE, ELIZABETH↗
DOE OSTI2025

CLEAP Project: OR-SAGE Analysis for MT, UT, and CO States

The OR-SAGE tool is designed to use industry-accepted practices in screening sites and then employ the proper array of data sources through the considerable computational capabilities of GIS technology available at ORNL. The tool was developed to screen the potential for NPP siting on a national and regional basis. However, because of the tool granularity, it is often focused specifically on the immediate area around user sites of interest. If data center siting parameters can be added to OR-SAGE, the ability to evaluate data center siting on a localized scale will be beneficial.1 More than 60 data sets have been collected and processed by ORNL to develop exclusionary, avoidance, and suitability criteria for screening sites for a variety of power generation types, including nuclear power plants. Available site evaluation parameters include population density, slope, seismic activity, proximity to cooling-water sources, proximity to hazard facilities, avoidance of protected lands and floodplains, susceptibility to landslide hazards, and many others. All siting parameters should be considered as flags to inform siting decisions and should not be used to rule in or rule out any NPP site. Once data center siting parameters are identified, appropriate data sets will be collected and processed. The OR-SAGE process is very versatile. Essentially, OR-SAGE is a visual, relational database. The database partitions the contiguous United States, a total of 720 million hectares (~1.8 billion acres), into 100-m by 100-m (1 hectare or ~2.5 acre) cells. The database is tracking just under 700 million individual land cells. Successive suitability criterion is applied to each cell in the database. User-specified thresholds can be applied to each siting parameter data layer. In this manner, a variety of scenarios can be quickly and thoroughly evaluated. Data can be added and/or revised within OR-SAGE to address user interests. Siting security assessment capability is currently being added to OR-SAGE. Security is expected to be of concern at data centers whether it is collocated with a nuclear power generating technology or not. If data center is collocated with a nuclear power generating source, the security threat attractiveness level of both will likely increase. It will be of additional benefit if a potential data center site is also assessed for security vulnerability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Classical and quantum compression for edge computing: the ubiquitous data dimensionality reduction

Edge computing aims to address the challenges associated with communicating and transferring large amounts of data generated remotely to a data center in a timely and efficient manner. A central pillar of edge computing is local (i.e., at- or near-source) data processing capability so that data transfer to a data center for processing can be minimized. Data compression at the edge is therefore a natural component of edge workflows. Here we present a survey of data compression algorithms with a focus on edge computing. Not all compression algorithms can accommodate the data type heterogeneity, tight processing and communication time constraints, or energy efficiency requirement characteristics of edge computing. We discuss specific examples of compression algorithms that are being explored in the context of edge computing. We end our review with a brief survey of emerging quantum compression techniques that are of importance in quantum information processing, including the proposed concept of quantum edge computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Advanced data science toolkit for non-data scientists – A user guide

Emerging modern data analytics attracts much attention in materials research and shows great potential for enabling data-driven design. Data populated from the high-throughput CALPHAD approach enables researchers to better understand underlying mechanisms and to facilitate novel hypotheses generation, but the increasing volume of data makes the analysis extremely challenging. Here in this paper, we introduce an easy-to-use, versatile, and open-source data analytics frontend, ASCENDS (Advanced data SCiENce toolkit for Non-Data Scientists), designed with the intent of accelerating data-driven materials research and development. The toolkit is also of value beyond materials science as it can analyze the correlation between input features and target values, train machine learning models, and make predictions from the trained surrogate models of any scientific dataset. Various algorithms implemented in ASCENDS allow users performing quantified correlation analyses and supervised machine learning to explore any datasets of interest without extensive computing and data science background. The detailed usage of ASCENDS is introduced with an example of experimental high-temperature alloy data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

High event rate analysis technique for the dual-axis duo-lateral position-sensitive silicon detectors of FAUST

The dual-axis duo-lateral (DADL) position-sensitive silicon detector was developed to obtain precise position and energy information for detected charged particles. The Forward Array Using Silicon Technology (FAUST) is currently equipped with 68 DADL detectors backed by CsI(Tl) scintillators for the study of charged particle correlations in heavy-ion collisions where precise position and energy information is essential. When conventional signal processing electronics were used for the DADL detectors, a position dependence of the measured energy as well as distortions in the calculated particle positions were observed. In previous work, waveforms from the detector after preamplification were studied to better understand the features that give rise to these distortions; therein, a waveform analysis technique was developed to improve the energy resolution and linearity in position reconstruction. However, the reading and writing of waveforms for an entire detector array limits data collection rates and adds significant burden in data storage and analysis speed. In this work, the integrators of a Struck SIS3316 ADC were utilized to process 228 Th source data to develop and optimize a new analysis method that captures the benefits of the waveform analysis technique while circumventing the waveform writing requirement. This integrator method – capable of 59 keV (FWHM) energy resolution – was used in the collection of 35 MeV/nucleon 28 Si + 12 C collision data using FAUST to investigate exotic decays of highly excited highly deformed nuclei. In this data, a position resolution of 0.4 mm (FWHM) was obtained for 25 MeV α-particles; for α-particles near this energy that originate from 8 Be ground state decays, a 8 Be ground state width of 30 keV (FWHM) was obtained. The impact of the energy-dependent DADL position resolution emergent from electronic noise on the quality of excited state measurement was modeled and compared to the experimental data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

E-Area Low Level Waste Generator Inventory Uncertainty Estimation

This report describes the method used to estimate the uncertainty and bias in the low-level waste inventory, as reported by Waste Generators, for waste disposed in the E-Area Low-Level Waste Facility at SRS. The waste cut uncertainty and bias is summed to calculate the current total uncertainty and bias in each disposal unit in the E-Area Low-Level Waste Facility. This information is used to estimate the future uncertainty and bias when all disposal units are closed. For most waste cuts, there are two areas of inventory uncertainty and bias: in the isotopic characterization of the waste stream and in the measurement of total waste cut activity. Waste stream characterization is accomplished through a combination of process knowledge and analytical measurements. This characterization is documented by a technical baseline that describes the relative quantity of each isotope present in the waste stream. The total activity of each individual waste cut is usually measured directly or is calculated through a ratio of activity per weight or activity per volume. The waste cut total activity is multiplied by the waste stream isotopic fraction to calculate the total isotopic activity present in the waste cut. The waste cut uncertainty and bias is calculated by analyzing the uncertainties and biases in the waste stream characterization and waste cut measurements and adding the uncertainties in quadrature and multiplying the reported isotopic activities by the bias factors. The current isotopic inventory, uncertainty, and bias of a disposal unit is the sum of the currently disposed individual waste cut isotopic activities, uncertainties, and biases. The future uncertainty and bias is estimated based on the average “worst-case” (largest) uncertainties and biases of currently closed and operational disposal units. This report details the method, data sources, and calculation techniques used to calculate these values. It also presents some of the difficulties in working with the reported data and gives examples of the calculations and analysis. The software used to carryout the analysis is included and the location of the complete individual analyses is given. After discussion with waste generators, examination of multiple waste characterization documents, and a review of SRS Manual 1S, the reported ELLWF radionuclide activities are clearly conservative and likely represent reasonable upper bounds for the true activities. However, quantifying the bias and uncertainty in each waste cut requires detailed analysis of the documentation for each waste cut measurement and waste stream characterization.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Panorama 360 (Final Report)

This is the final technical report for the DOE-funded Panorama 360 project. Panorama 360 provided a resource for the collection, analysis, and sharing of performance data about end-to-end scientific workflows executing on DOE facilities. The work focused on workflows that include experimental data generation at DOE facilities. The main activities of Panorama 360 include the development of: 1. A distributed repository that stores different types of workflow execution data (e.g., point and time series performance traces at fine- and coarse-grained levels); 2. A set of open-source data capture, curation, and publishing tools fully integrated with a state-of-the-art workflow management system that automates data ingestion to the repository and enables users to discover, query, and process data from the repository; 3. A set of analysis algorithms and machine learning based tools to perform analysis and characterization of the gathered data, which can be used to detect anomalous performance or system faults; and 4. Best practices and recommendations for workflow evaluation, analysis, execution, and architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Panorama 360 (Final Report)

This final technical report from the lead institution, USC grant #DE-SC0012636, serves as the final technical report for collaborative institution UNC-CH grant #DE-SC0012390. The goal was to develop a repository and associated capabilities for data collection, ingestion, and analysis for a broad class of DOE applications that span experimental and simulation science workflows. In particular, this work focuses on workflows that include experimental data generation at DOE facilities. The main activities of Panorama 360 include the development of: (1) A distributed repository that stores different types of workflow execution data (e.g., point and time series performance traces at fine- and coarse-grained levels); (2) A set of open-source data capture, curation, and publishing tools fully integrated with a state-of-the-art workflow management system that automates data ingestion to the repository and enables users to discover, query, and process data from the repository; (3) A set of analysis algorithms and machine learning based tools to perform analysis and characterization of the gathered data, which can be used to detect anomalous performance or system faults; and (4) Best practices and recommendations for workflow evaluation, analysis, execution, and architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Emission factors of industrial boilers burning biomass-derived fuels

Boilers are combustion devices that provide process heat and are integral to many industrial facilities. Historically, outside of the pulp and paper industry, most boilers burned fossil fuels, although interest in decarbonization has been leading to an increased use of renewable fuels in boilers. These boilers, including those in the biorefineries, are often large sources of air pollutant emissions, and the characterization of these emissions is critical to obtaining air permits and ensuring protection of the surrounding air quality. Several industrial boilers and new biorefineries allow utilization of biomass-derived fuels (e.g. wastewater sludge, lignin, etc.) produced during their operation as a fuel for the boiler to meet process energy needs. However, there is limited empirical data on emission factors for the burning of unconventional fuels, such as solid-gas mixtures containing biomass residues. To fill this gap, we carry out a comprehensive data survey, collecting information on emission factors for boilers burning either a single or a mixture of solid and gaseous biomass-derived fuels. We review multiple hard-to-obtain and unconventional data sources, such as air permit applications, stack test data, and industry-sponsored data collection efforts, to compile emission factors for biomass-derived fuels. We then compare this data with wood residue emission factors from the U.S. Environmental Protection Agency’s AP-42 emission factor database. Our results indicate that the emission factors for boilers burning unconventional fuels vary widely depending on the fuel composition, boiler type, and fuel characteristics. Overall, we find that median emission factors of selected biomass-derived fuels are typically lower than those of wood residue boilers in AP-42. The information collected herein could be useful to permitting agencies and industries utilizing boilers who may want to reduce the carbon impact of their facilities by combusting biomass-derived wastes for process energy needs, for more accurate emission estimation for permitting.

09 BIOMASS FUELS↗
DOE OSTI2025

A Life Cycle Analysis Framework for Point Source Capture Systems

NETL studies the costs and benefits of PSC for electricity, industry, and mobile applications. Mobile point source capture (MPSC) and storage applied to freight modes captures emissions directly from exhaust. This poster presents a framework for conducting LCA of PSC systems applied to heavy-duty trucks, freight trains, and marine vessels. The framework defines a wheels-to-storage (gate-to-grave) boundary, including energy demands (electricity, heat, and cooling requirements), solvent use and cycling, onboard system components, carbon storage in a saline aquifer, and upstream manufacturing impacts for equipment, with a suggested functional unit of 1 tonne-km. Potential data sources for analysis include material, energy, and operational data from Oak Ridge National Laboratory, GREET (Greenhouse gases, Regulated Emissions, and Energy use in Technologies) model, and scientific literature. The suggested analytical approach includes comparison to publicly available business-as-usual systems without capture across all modes of transportation, sensitivity to composition of the capture solvent, and sensitivity to capture rate variation, all of which would support a wholistic PSC business case analysis. For future consideration, analysis can be augmented with consideration of different sources of electricity (e.g., nuclear), fuel substitution, deploying supportive infrastructure such as pipeline offloading points, and downstream applications like enhanced oil recovery (EOR).

life cycle analysis (LCA)↗
DOE OSTI2025

A product data network to enable faster, easier, and better planning of building envelopes

The building envelopes contributes significantly to the energy-efficiency of the building. Building performance simulation has made it possible to compare façade technologies regarding energy demand, daylighting, thermal and visual comfort in detail. Planners, such as architects and engineers, need experience to find product data with the right quality and level of detail, and to process the data to fit the calculation and the application. In the available time, planners can compare only a limited number of products, which means that better solutions could go unnoticed. This paper presents a new concept for making product data easily accessible for building façade planning. The concept consists of a network of databases for the efficient exchange and use of optical and calorimetric data of glazing units, shading devices, and combinations of both. The paper presents the research questions, an analysis of the current challenges, six design goals for the product data network and its implementation together with a discussion. Many product data sources can be connected to many planning software applications via the specified application programming interface. When planning software connects to the product data network, the planning of building envelopes can be much faster because planners do not need to spend so much time to search and process product data manually. The planning of building envelopes can also become much easier, especially for planners with limited experience. They do not need to understand all the details about which data fits which calculation if the software company implements this. The planning of building envelopes can become much more reliable when software companies validate their use of the product data network, because the current manual process is prone to errors. The planning of building envelopes can also improve because more products can be compared in the available time, allowing better solutions to be found.

Maurer, Christoph↗
DOE OSTI2021

Advanced Health Information Technology Analytic Framework and Application to Hazard Detection

Health Information Technology (HIT) aims to improve healthcare outcomes by organizing and analyzing various health-related data. With data accumulating at a staggering rate, the importance of real-time analytics has been increasing dramatically, shifting the focus of informatics from batch processing to streaming analytics. HIT is also facing unprecedented challenges in adapting to this new requirement and leveraging advanced IT technologies. This paper introduces a HIT data and compute platform that supports multi-granularity real-time analytics from heterogeneous data sources. The paper first identifies functional requirements and proposes a framework that satisfies the requirements using state-of-the-art big data technologies including Apache Kafka, Spark Structured Streaming Engine, and Delta Lake. To demonstrate its capability to support data analytics in multiple time granularities analytics, a statistical process control-based hazard detection algorithm has been implemented on top of the framework to detect unexpected hazards from order cancellation data of the Department of US Veterans Affairs (VA) in near real-time.

Kumar, Mohit↗
DOE OSTI2022

Exploring MDSplus data-acquisition software and custom devices

MDSplus is a software tool designed for data acquisition, storage, and analysis of complex scientific experiments. Over the years, MDSplus has primarily been used for data management for fusion experiments. This paper demonstrates that MDSplus can be used for a much wider variety of systems and experiments. We present a step-by-step tutorial describing how to create a simple experiment, manage the data, and analyze it using MDSplus and Python. To this end, a custom example device was developed to be used as the data source. This device was built on an opensource electronic hardware platform, and it consists of a microcontroller and two sensors. We read data from these sensors, store it in MDSplus, and use JupyterLab to visualize and process it. This project and code demo are available on the GitHub site at this URL: https://github.com/santorofer/MDSplusAndCustomeDevices

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Operational Focused Data Analytics for Optimizing Radiation Portal Monitor-Based Nuclear Smuggling Detection Systems at Global Ports of Entry

The National Nuclear Security Administration’s Office of Nuclear Smuggling Detection and Deterrence has deployed a fleet of radiation portal monitors (RPMs) across the world at global ports of entry including seaports, airports, and land border crossings. These RPMs are integrated into radiation detection systems (RDS) that also include fixed cameras, optical character recognition (OCR) systems, primary scanning systems (e.g., X-ray or gamma-ray), and secondary scanning systems (e.g., spectroscopic radiation portal monitors, portable radiation detection systems). The data from these sensing technologies is collected at the Central Alarm Station (CAS) where servers and computers reside to control and operate the system. Operators utilize the data collected by the CAS and declared cargo information to make decisions on how to respond to an alarm.This work explores the use of CAS-located data, looking at both the sensor data streams and operator inputs, to perform analysis which supports customs and border protection agencies to improve training capability and operational effectiveness. We focus on analyzing site level effectiveness and behavior by rolling up CAS-located data collected from individual occurrences. To-date, more than 15 sites (e.g., seaports, airports, border crossings) have been analyzed in this manner with the goal of understanding system operations to verify effectiveness and recommend potential improvements. This work first aims to provide background information on relevant CAS-located data sources and our current operational system analytics process including example results. After summarizing our current analytic techniques, we discuss how the future data analytics systems can provide key benefits to improving operational performance while minimizing the burden these detection systems place on operators.

Kuhn, Michael↗
DOE OSTI2024

Geospatial Data Platform for All

Spatiotemporal data has evolved in scale due to augmented use in cross-domain applications. Simultaneously, there is substantial growth in the availability of Geographic Information Systems (GIS) data provided by the United States Geological Survey (USGS) along with other federal, state, county, or local agencies through open-data portals and public access APIs. However, data availability does not equate with accessibility. Large-scale analyses and applications require robust, performant data management with co-location of data storage and computing. The insufficiency of data management infrastructure compels researchers to adopt ad hoc project- specific GIS data storage solutions (e.g., copying data to High-Performance computer file systems). As an ad hoc storage strategy does not scale, it hampers cross-domain analyses causing difficulty in data reuse and utilizing existing code bases. Furthermore, GIS data is complex and requires expertise to analyze and manipulate due to its intricate data structures and data-specific projection transformations. Despite the challenges, we recognize that derived GIS data products, e.g., satellite or LIDAR-based images, can be used in downstream applications such as AI by domain, but non-GIS experts. To address the data needs and overcome the challenges, we are working towards a GIS Data Platform focused on efficient data storage, data discovery and access, and an API to enable common workflows. We propose a knowledge-graph (KG) approach for data discovery, whereby datasets are semantically linked to higher- level constructs such as projects and research areas. The semantic data links enable researchers to explore datasets in a top-down approach by specifying relevant and meaningful terms (assists in finding hidden data). An advantage is that the nodes and edges in a knowledge graph create built-in semantic documentation. Deeper spatiotemporal connections between data sources can be encoded via Graph Neural Networks (GNN) (Zhang et al., 2021). The KG approach can be extended to integrate the data itself in a Virtual KG (VKG). Our work will derive inspiration from large-scale VKG efforts that have been undertaken or are currently underway as part of the OpenStreetMap project (Ding et al., 2021). For DOE Data Days, we share the proposed geospatial data platform hybrid (cloud/on-prem) architecture, our work-to-date on storing, retrieving, and transforming LiDAR and raster data relevant to two important NREL use-cases, including the Renewable Energy Potential (reV) Model, and present our proposal for a KG based data discovery engine.

data platform↗
DOE OSTI2021

Application of Point Precipitation Frequency Estimates to Watersheds

This report documents work sponsored by the U.S. Nuclear Regulatory Commission (NRC) at the Oak Ridge National Laboratory (ORNL) as part of the RES project, “Application of Point Precipitation Frequency Estimates to Watersheds.” This project was implemented as part of the Probabilistic Flood Hazard Assessment (PFHA) Research Program. The objective of the PFHA Research Program is to develop tools and guidance on the use of PFHA methods to risk-inform NRC’s licensing of new facilities as well as licensing and oversight of currently operating facilities as they relate to flooding hazards. Many nuclear power plants (NPPs) are located on or near rivers so riverine flooding hazards need to be considered in their design and operation. Probabilistic riverine flood models are important tools for realistic assessment of flooding risks. However, these models require areal estimates of the depth, duration, and frequency of rainfall distributed over the watershed, which are not often available. Point precipitation frequency estimates are more widely available. For example, the National Oceanic and Atmospheric Administration (NOAA) has published NOAA Atlas 14, which provides point precipitation frequency estimates for 5-minute through 60-day durations at average recurrence intervals of 1-year through 1,000-year. The research documented in this report addresses areal reduction factors (ARFs), which can be used to convert the widely available point precipitation frequency estimates, to estimates of areal precipitation frequency over a watershed. The most widely used ARF source is Technical Paper 29 (TP-29) published by the then U.S. Weather Bureau in 1958. However, both the methods and the underlying precipitation data used to produce TP-29 are seriously out of date. For example, due to the small gauge network available at the time of TP-29’s compilation, ARF estimates developed are only for watersheds smaller than about 400 square miles. Due to the relatively short record lengths of precipitation data available, frequency considerations could not be accurately determined. Other factors such as regional climate and seasonality were not addressed. Several newer methods have been published since TP-29 was developed and both the type and quantity of precipitation data have increased significantly, along with computational resources and analytical tools such as geographic information systems. This report reviewed and assessed the available precipitation products and methods for conducting ARF analysis. The work applied up-to-date precipitation data products and analysis methods with a novel watershed-based approach to investigate how ARF estimates vary across different methods, data sources, geographical locations, return periods, and seasons. The overall findings reported here regarding basic ARF trends are in line with other recent studies showing that ARFs decrease with increasing area, increase with increasing duration, and decrease with increasing return period. This study found significant differences among the available ARF methods. This work also found a strong geographical variability across different US hydrologic regions, suggesting that the ARF are specific to regional climate patterns and geographical characteristics and should not be applied arbitrarily to other locations. The results also reveal the importance of data record length, especially for high return level ARFs. The work reported in NUREG/CR-7271 will assist NRC staff in assessing different classes of ARF methods in conjunction with available rainfall data sets. It will also support the development of guidance for application of point precipitation data in PFHAs. It should be noted that the ARF values presented in this report for any location or region were developed for the purposes of comparing methods and investigating the factors that influence ARFs. They should not be considered official and should not be used in leu of a site-specific analysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Efficient Data Management in Neutron Scattering Data Reduction Workflows at ORNL

Oak Ridge National Laboratory (ORNL) experimental neutron science facilities produce 1.2 TB a day of raw event-based data that is stored using the standard metadata-rich NeXus schema built on top of the HDF5 file format. Performance of several data reduction workflows is largely determined by the amount of time spent on the loading and processing algorithms in Mantid, an open-source data analysis framework used across several neutron sciences facilities around the world. The present work introduces new data management algorithms to address identified input output (I/O) bottlenecks on Mantid. First, we introduce an in-memory binary-tree metadata index that resemble NeXus data access patterns to provide a scalable search and extraction mechanism. Second, data encapsulation in Mantid algorithms is optimally redesigned to reduce the total compute and memory runtime footprint associated with metadata I/O reconstruction tasks. Results from this work show speed ups in wall-clock time on ORNL data reduction workflows, ranging from 11% to 30% depending on the complexity of the targeted instrument-specific data. Nevertheless, we highlight the need for more research to address reduction challenges as experimental data volumes increase.

Godoy, William↗