Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

MSD CoP Webinar: AI and Extreme Events - Overcoming Data Challenges for Improved Characterization of Climate Extremes

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Abstract: Artificial Intelligence (AI) models require large volumes of data for training and testing. Data requirements present challenges for using AI to explore extreme events with limited observational data. This webinar will showcase two innovative methods developed by part of the European Climate Intelligence (CLINT) project to overcome data challenges and harness AI to improve our understanding of climate extremes. Dr. Ascenso will present his research on data augmentation methods to improve estimates of tropical cyclones using satellite data. His presentation will review established methods for data augmentation and explore opportunities and challenges for using generative AI to generate images of extreme, life-threatening tropical cyclones. Next, Dr. Plesiat will present his research on deep learning techniques to overcome limited observational data sets. His presentation will illustrate deep learning methods to develop AI reconstructions of four climate indices across Europe. Presenters : Dr. Guido Ascenso (post-doctoral researcher, Politecnico di Milano); Dr. Étienne Plésiat (German Climate Computing Centre - DKRZ) Moderator(s): Stefano Galelli (MSD CoP WG Co-Lead), David Gold (MSD CoP WG Co-Lead), Jillian Sturtevant (MSD CoP WG Communications Officer), Matteo Giuliani (Politecnico di Milano, MSD CoP WG Member, Moderator and Organizer) This webinar was held on: October 11, 2024 from 11AM - 1PM ET

AI↗
DOE OSTI2021

Investigating User Experiences with Data Abstractions on High Performance Computing Systems

Scientific exploration generates expanding volumes of data that commonly require High Performance Computing (HPC) systems to facilitate research. HPC systems are complex ecosystems of hardware and software that frequently are not user friendly. The Usable Data Abstractions (UDA) project set out to build usable software for scientific workflows in HPC environments by undertaking multiple rounds of qualitative user research. Qualitative research investigates how individuals accomplish their work and our interview-based study surfaced a variety of insights about the experiences of working in and with HPC ecosystems. This report examines multiple facets to the experiences of scientists and developers using and supporting HPC systems. We discuss how stakeholders grasp the design and configuration of these systems, the impacts of abstraction layers on their ability to successfully do work, and the varied perceptions of time that shape this work. Examining the adoption of the Cori HPC at NERSC we explore the anticipations and lived experiences of users interacting with this system’s novel storage feature, the Burst Buffer. We present lessons learned from across these insights to illustrate just some of the challenges HPC facilities and their stakeholders need to account for when procuring and supporting these essential scientific resources to ensure their usability and utility to a variety of scientific practices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

COVID-19: Spatiotemporal social data analytics and machine learning for pandemic exploration and forecasting

This task focused on developing a preliminary approach to use machine learning (ML) to explore the relationship between county-level societal variables and COVID-19 parameters, including COVID-19 cases rates and counts and COVID-19 death rates and counts. The objective was to develop and test a prototype approach for linking COVID-19 and county-level data. The task focused on enhancing and applying existing LANL ML techniques to COVID-19. Our novel ML methods have been a subject of a recently approved U.S. patent. The codes based on these methods are already open-source released. Our ML tools (NMFk/NTFk) are applied to extract hidden features (signals, waves) in the analyzed datasets and automatically identify their optimal number. The features are extracted by identifying counties that have similarities between the county-level societal variables and the COVID-19 parameters. These demonstration analyses will facilitate the ongoing pandemic simulations and predictions performed by Los Alamos other institutions, as well as lay the groundwork for future work.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

A Deterministic Multivariate Clustering Method for Drive Cycle Generation from In-Use Vehicle Data

Accurately characterizing vehicle drive cycles plays a fundamental role in assessing the performance of new vehicle technologies. Repeatable, short duration representative drive cycles facilitate more informed decision making, resulting in improved test procedures and more successful vehicle designs. With continued growth in the deployment of onboard telematics systems employing global positioning systems (GPS), large scale, low cost collection of real-world vehicle drive cycle data has become a reality. As a result of these technological advances, researchers, designers, and engineers are no longer constrained by lack of operating data when developing and optimizing technology, but rather by resources available for testing and simulation. Experimental testing is expensive and time consuming, therefore the need exists for a fast and accurate means of generating representative cycles from large volumes of real-world driving data. This paper explores the development and initial validation of a method of generating representative drive cycles from large collections of real-world vehicle data using a deterministic multivariate clustering approach. Starting with theory and diving into the methodology behind representative cycle generation, the paper aims to also present graphical and tabular results of initial validation via vehicle simulation and chassis dynamometer testing. Additional topics for further research and areas for ongoing development will also be presented.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Development of an ERT‐Based Framework for Bentonite Buffers Monitoring From Laboratory Tests: 1. Characterizing Thermal–Hydrological–Mechanical Processes

Abstract Bentonite clay is widely used in engineered barrier systems for the permanent disposal of high‐level radioactive waste due to its low permeability, high swelling capacity, and thermal stability. However, the complex thermal‐hydrological‐mechanical (THM) processes induced by heating from decaying radioactive waste and hydration from surrounding rock can lead to heterogeneous changes that are difficult to measure and predict. This study develops an Electrical Resistivity Tomography (ERT)‐based framework for monitoring THM processes, progressing from sample‐scale to bench‐scale tests, to inform field‐scale applications. Sample‐scale tests analyzed small bentonite samples under controlled variations in water content, temperature, and porosity to establish fundamental resistivity relationships. Bench‐scale tests involved larger bentonite columns subjected to heating (up to 200°C) and hydration under controlled pressure, simulating repository conditions. ERT measurements, complemented by X‐ray CT imaging, temperature monitoring, and tracing sensors, revealed coupled THM processes, such as hydration‐induced compression, swelling, and thermal gradients, leading to complex resistivity patterns. The results demonstrate the potential of ERT for capturing THM‐induced resistivity changes, though challenges remain in upscaling and quantitative analysis. This study evaluates laboratory test capabilities and proposes future improvements for understanding THM‐induced resistivity responses. A conceptual framework for ERT implementation in field‐scale monitoring is presented, synthesizing findings from both scales and exploring how ERT data can inform long‐term modeling and reduce prediction uncertainties. Overall, this ERT‐based framework offers a robust method for monitoring bentonite buffers, aiding in early issue detection and supporting the safe long‐term disposal of radioactive waste in geological repositories, while highlighting the need for future development. Plain Language Summary Bentonite clay is crucial in engineered barrier systems (EBS) for containing high‐level radioactive waste due to its ability to absorb water, swell, seal and remain stable under high temperatures. When bentonite absorbs water and heats up from radioactive decay, it experiences complex changes in its physical and mechanical properties. Understanding these changes is important for ensuring the long‐term safety and effectiveness of EBS. This study used Electrical Resistivity Tomography (ERT), a non‐invasive method that measures electrical conductivity to monitor these changes during laboratory experiments. The ERT data revealed significant variations in resistivity corresponding to changes in water content, temperature, and density, providing detailed spatial and temporal insights into the behavior of bentonite. These findings enhance our ability to predict the long‐term performance of bentonite barriers, ensuring the safe containment of radioactive waste. By improving our understanding of bentonite's behavior, this research supports the development of more reliable and effective barrier systems for radioactive waste disposal, protecting the environment and public health. Key Points ERT monitoring was employed to capture resistivity changes in bentonite during controlled heating and hydration experiments, providing insights into THM processes ERT data reveal significant resistivity changes correlated with water content, temperature, and mechanical effects, enhancing the understanding of THM dynamics in bentonite This study explores the potential of the framework for application in field‐scale EBS monitoring, emphasizing the need for integrating additional geophysical methods for comprehensive subsurface imaging

Chen, Hang↗
DOE OSTI2022

A FAIR-compliant parts catalogue for genome engineering and expression control in Saccharomyces cerevisiae

The synthetic biology toolkit for baker's yeast, Saccharomyces cerevisiae, includes extensive genome engineering toolkits and parts repositories. However, with the increasing complexity of engineering tasks and versatile applications of this model eukaryote, there is a continued interest to expand and diversify the rational engineering capabilities in this chassis by FAIR (findable, accessible, interoperable, and reproducible) compliance. In this study, we designed and characterised 41 synthetic guide RNA sequences to expand the CRISPR-based genome engineering capabilities for easy and efficient replacement of genomically encoded elements. Moreover, we characterize in high temporal resolution 20 native promoters and 18 terminators using fluorescein and LUDOX CL-X as references for GFP expression and OD600 measurements, respectively. Additionally, all data and reported analysis is provided in a publicly accessible jupyter notebook providing a tool for researchers with low-coding skills to further explore the generated data as well as a template for researchers to write their own scripts. We expect the data, parts, and databases associated with this study to support a FAIR-compliant resource for further advancing the engineering of yeasts.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Automatic Traffic Queue-End Identification using Location-Based Waze User Reports

Traffic queues, especially queues caused by non-recurrent events such as incidents, are unexpected to high-speed drivers approaching the end of queue (EOQ) and become safety concerns. Though the topic has been extensively studied, the identification of EOQ has been limited by the spatial-temporal resolution of traditional data sources. This study explores the potential of location-based crowdsourced data, specifically Waze user reports. It presents a dynamic clustering algorithm that can group the location-based reports in real time and identify the spatial-temporal extent of congestion as well as the EOQ. The algorithm is a spatial-temporal extension of the density-based spatial clustering of applications with noise (DBSCAN) algorithm for real-time streaming data with an adaptive threshold selection procedure. Here, the proposed method was tested with 34 traffic congestion cases in the Knoxville, Tennessee area of the United States. It is demonstrated that the algorithm can effectively detect spatial-temporal extent of congestion based on Waze report clusters and identify EOQ in real-time. The Waze report-based detection are compared to the detection based on roadside sensor data. The results are promising: The EOQ identification time of Waze is similar to the EOQ detection time of traffic sensor data, with only 1.1 min difference on average. In addition, Waze generates 1.9 EOQ detection points every mile, compared to 1.8 detection points generated by traffic sensor data, suggesting the two data sources are comparable in respect of reporting frequency. The results indicate that Waze is a valuable complementary source for EOQ detection where no traffic sensors are installed.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Scientific Data Compression for Large Scale Computational Fluid Dynamics (CFD) Simulations

This Cooperative Research and Development Agreement (CRADA) between Oak Ridge National Laboratory (ORNL) and General Electric (GE) investigated methods for reducing the size of large computational fluid dynamics (CFD) simulation datasets using scientific data compression techniques. The work focused on adapting the MultiGrid Adaptive Reduction of Data (MGARD) compression framework and integrating it with high-performance I/O and visualization tools used in CFD workflows. MGARD uses hierarchical multilevel decomposition to enable error-controlled compression of floating-point scientific data while preserving quantities of interest. During the project, MGARD compression was integrated with the ADIOS I/O framework and visualization tools such as ParaView to enable efficient storage, transfer, and analysis of simulation data. The collaboration also explored approaches for improving compression performance for CFD data defined on unstructured meshes. Results demonstrate that scientific data compression can significantly reduce storage requirements and improve data management for large-scale CFD simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Nitrogen Metabolism in Pseudomonas putida : Functional Analysis Using Random Barcode Transposon Sequencing

Pseudomonas putida KT2440 has long been studied for its diverse and robust metabolisms, yet many genes and proteins imparting these growth capacities remain uncharacterized. Using pooled mutant fitness assays, we identified genes and proteins involved in the assimilation of 52 different nitrogen containing compounds. To assay amino acid biosynthesis, 19 amino acid drop-out conditions were also tested. From these 71 conditions, significant fitness phenotypes were elicited in 672 different genes including 100 transcriptional regulators and 112 transport-related proteins. We divide these conditions into 6 classes, and propose assimilatory pathways for the compounds based on this wealth of genetic data. To complement these data, we characterize the substrate range of three promiscuous aminotransferases relevant to metabolic engineering efforts in vitro. So we examine the specificity of five transcriptional regulators, explaining some fitness data results and exploring their potential to be developed into useful synthetic biology tools. In addition, we use manifold learning to create an interactive visualization tool for interpreting our BarSeq data, which will improve the accessibility and utility of this work to other researchers.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Multiphysics FISPACT-II and TENDL-2019 simulation: neutron-induced damage metrics

Nuclear interactions can be the source of atomic displacement, irradiation-induced defects and transmutation in structural materials. Such quantities are derived from, or can be correlated to, nuclear kinematic simulations of primary atomic energy distributions spectra and the quantification of the numbers of secondary defects produced per primary as a function of the available recoils, residual and emitted, energies. Recoil kinematics of neutral, residual, gas, proton, alpha particle emissions are now more rigorously treated based on recent, complete and enhanced nuclear data parsed in state-of-the-art processing tools. Defect production metrics are the starting point in the complex problem of correlating and simulating the behaviour of materials under irradiation, as experimental information is rare or scattered. Detailed, segregated primary knock-on-atom metrics are now becoming available as the starting point of further simulation processes of isolated and clustered defects in material lattices. This allows more materials, lattices, neutron incident energy ranges, and irradiation conditions to be explored with sufficient data to adequately cover both standard and novel applications and materials: the broader reactor applications landscape. The damage metrics of of materials are systematically explored under typical but different reactor's type environment. The inventory code FISPACT-II combined with the enhanced nuclear data forms of the TENDL-2019 libraries allow one to not only calculate dpa from mostly scattering events but to also properly predict gas production, nuclear heating and transmutation under the same conditions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

A Safe Response to Renewable Energy Hazards

The International Association of Fire Fighters (IAFF) and Underwriters Laboratories, LLC (UL) in conjunction with UL Solutions initiated a joint project in 2022 under an agreement with the United States Department of Energy-Office of Energy Efficiency and Renewable Energy (DOE-EERE). This project focused on two separate and important initiatives related to energy efficiency in residential buildings. Initiative 1: Fire Performance on Energy Efficient Exterior Walls. Initiative 2: Firefighting Tactics in Residential Properties with Building Energy Storage Systems (BESS). The project’s first initiative addresses concerns surrounding new technologies with enhanced, energy-efficient exterior walls installed on residential properties. The concerns of fire rapidly traveling vertically up the exterior of these walls were examined. This addressed a growing concern from the first responder community that many times, the fires on the exterior of residential buildings have already evolved into an attic fire by the time of arrival – making it problematic to address the fire scenario. The test plan for Initiative 1 incorporated a modified version of an American Society for Testing and Materials (ASTM) test method, ASTM E2707, Standard Test Method for Determining Fire Penetration of Exterior Wall Assemblies Using a Direct Flame Impingement Exposure, as the foundation of the research. The test method involved a wall structure intended to represent retrofit construction to evaluate how fire would spread vertically or laterally. The second aspect of the UL-IAFF Project focuses on the fire service response to Residential Battery Energy Storage System (RBESS) incidents. These simulation tests were constructed in the large-scale fire test facility at UL Solutions’ Northbrook, IL campus. A baseline test was conducted that involved a test structure with no batteries—shelving units populated with standardized commodities, representing a typical garage with cellulosic and plastic contents. Three additional tests have been conducted to generate data with the contribution of energy storage system (ESS) batteries to compare fire and explosion hazards against the baseline test. Through this work, fire service tactical considerations can be explored. From the data, the team can determine 1) the visual indicators of a residential fire that has involved an RBESS (or, potentially, other large batteries) and 2) the impact of fire service-initiated ventilation of the structure on the fire conditions and explosion risks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Knowledge extraction and transfer in data-driven fracture mechanics

Significance Data-driven approaches have launched a new paradigm in scientific research that is bound to have an impact on all disciplines of science and engineering. However, at this juncture, the exploration of data-driven techniques in the century-old field of fracture mechanics is highly limited, and there are key challenges including accurate and intelligent knowledge extraction and transfer in a data-limited regime. Here, we propose a framework for data-driven knowledge extraction in fracture mechanics with rigorous accuracy assessment which employs active learning for optimizing data usage and for data-driven knowledge transfer that allows efficient treatment of three-dimensional fracture problems based on two-dimensional solutions.

Liu, Xing↗
DOE OSTI2020

Nuclear Data Covariances and Sampling

In this report, we present an overview of the task of producing sample nuclear data sets for the purpose of exploring the effects of nuclear data uncertainties on physics simulations. These sample data sets (or, as we sometimes call them variations) are produced based on uncertainties specified in the ENDF/B-VIII nuclear data library, although the principles discussed here apply to sampling based on similar libraries, such as JENDL. The uncertainties in ENDF and similar libraries are given in the form of mean values (a mean vector) and a covariance matrix. The components of the mean vector are what are normally thought of as the values of the nuclear data (cross sections, $\bar{v}$, the prompt fission neutron spectrum, etc.) and the covariance matrix contains the information about the uncertainties in these values and correlations between them, including correlations across different energies in a single channel and correlations across different channels.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

The Pierre Auger Observatory open data

The Pierre Auger Collaboration has embraced the concept of open access to their research data since its foundation, with the aim of giving access to the widest possible community. A gradual process of release began as early as 2007 when 1% of the cosmic-ray data was made public, along with 100% of the space-weather information. In February 2021, a portal was released containing 10% of cosmic-ray data collected by the Pierre Auger Observatory from 2004 to 2018, during the first phase of operation of the Observatory. The Open Data Portal includes detailed documentation about the detection and reconstruction procedures, analysis codes that can be easily used and modified and, additionally, visualization tools. Since then, the Portal has been updated and extended. In 2023, a catalog of the highest-energy cosmic-ray events examined in depth has been included. A specific section dedicated to educational use has been developed with the expectation that these data will be explored by a wide and diverse community, including professional and citizen scientists, and used for educational and outreach initiatives. This paper describes the context, the spirit, and the technical implementation of the release of data by the largest cosmic-ray detector ever built and anticipates its future developments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

pvlib iotools—Open-source Python functions for seamless access to solar irradiance data

Access to accurate solar resource data is critical for numerous applications, including estimating the yield of solar energy systems, developing radiation models, and validating irradiance datasets. However, lack of standardization in data formats and access interfaces across providers constitutes a major barrier to entry for new users. pvlib python’s iotools subpackage aims to solve this issue by providing standardized Python functions for reading local files and retrieving data from external providers. All functions follow a uniform pattern and return convenient data outputs, allowing users to seamlessly switch between data providers and explore alternative datasets. The pvlib package is community-developed on GitHub: https://github.com/pvlib/pvlib-python. As of pvlib python version 0.9.5, the iotools subpackage supports 12 different datasets, including ground measurement, reanalysis, and satellite-derived irradiance data. The supported ground measurement networks include the Baseline Surface Radiation Network (BSRN), NREL MIDC, SRML, SOLRAD, SURFRAD, and the US Climate Reference Network (CRN). Additionally, satellite-derived and reanalysis irradiance data from the following sources are supported: PVGIS (SARAH & ERA5), NSRDB PSM3, and CAMS Radiation Service (including McClear clear-sky irradiance).

14 SOLAR ENERGY↗
DOE OSTI2022

Experimental Wargaming with SIGNAL

Wargames are a common tool for investigating complex conflict scenarios and have a long history of informing military and strategic study. Historically, these games have often been one-offs, may not rigorously collect data, and have been built primarily for exploration rather than developing data-driven analytical conclusions. Experimental wargaming, a new wargaming approach that employs the basic principles of experimental design to facilitate an objective basis for exploring fundamental research questions around human behavior (such as understanding conflict escalation), is a potential tool that can be used in combination with existing wargaming approaches. The Project on Nuclear Gaming, a consortium involving the University of California, Berkeley, Sandia National Laboratories, and Lawrence Livermore National Laboratory, developed an experimental wargame, SIGNAL, to explore questions surrounding conflict escalation and strategic stability in the nuclear context. To date, the SIGNAL experimental wargame has been played hundreds of times by thousands of players from around the world, creating the largest database of wargame data for academic purposes known to the authors. Here, this paper discusses the design of SIGNAL, focusing on how the principles of experimental design influenced this design.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

RNTuple: A CMS Perspective

ROOT is planning to move from TTree to RNTuple as the data storage format for HL-LHC in order to, for example, speed up the IO, make the files smaller, and have a modern C++ API. Initially, RNTuple was not planned to support the same set of C++ data structures as TTree supports. CMS has explored the necessary transformations in its standard persistent data types to switch to RNTuple. Many challenges were encountered as alternative data structures were explored. This contribution will discuss the challenges uncovered and how collaboration with the ROOT team allowed them to be overcome. The solution to the challenges allows progressive changes to the CMS data types rather than requiring a sudden change to all data types to be stored in RNTuple. Once the solution was achieved, storage performance comparisons using the CMS data types were possible between RNTuple and TTree. This contribution will also present the results of those comparisons.

Smith, Nick↗