SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2024

A comprehensive guide to CAN IDS data and introduction of the ROAD dataset

Although ubiquitous in modern vehicles, Controller Area Networks (CANs) lack basic security properties and are easily exploitable. A rapidly growing field of CAN security research has emerged that seeks to detect intrusions or anomalies on CANs. Producing vehicular CAN data with a variety of intrusions is a difficult task for most researchers as it requires expensive assets and deep expertise. To illuminate this task, we introduce the first comprehensive guide to the existing open CAN intrusion detection system (IDS) datasets. We categorize attacks on CANs including fabrication (adding frames, e.g., flooding or targeting and ID), suspension (removing an ID’s frames), and masquerade attacks (spoofed frames sent in lieu of suspended ones). We provide a quality analysis of each dataset; an enumeration of each datasets’ attacks, benefits, and drawbacks; categorization as real vs. simulated CAN data and real vs. simulated attacks; whether the data is raw CAN data or signal-translated; number of vehicles/CANs; quantity in terms of time; and finally a suggested use case of each dataset. State-of-the-art public CAN IDS datasets are limited to real fabrication (simple message injection) attacks and simulated attacks often in synthetic data, lacking fidelity. In general, the physical effects of attacks on the vehicle are not verified in the available datasets. Only one dataset provides signal-translated data but is missing a corresponding “raw” binary version. This issue pigeon-holes CAN IDS research into testing on limited and often inappropriate data (usually with attacks that are too easily detectable to truly test the method). The scarcity of appropriate data has stymied comparability and reproducibility of results for researchers. As our primary contribution, we present the Real ORNL Automotive Dynamometer (ROAD) CAN IDS dataset, consisting of over 3.5 hours of one vehicle’s CAN data. ROAD contains ambient data recorded during a diverse set of activities, and attacks of increasing stealth with multiple variants and instances of real (i.e. non-simulated) fuzzing, fabrication, unique advanced attacks, and simulated masquerade attacks. To facilitate a benchmark for CAN IDS methods that require signal-translated inputs, we also provide the signal time series format for many of the CAN captures. Our contributions aim to facilitate appropriate benchmarking and needed comparability in the CAN IDS research field.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Multi-modal dynamic radiography using short-pulse laser-generated probe beams

Radiography is an important tool for the interrogation of dynamic experiments in the fields of dynamic properties of materials, and in condensed matter, high explosive, and high-energy-density physics. Multi-modal radiography advances the hypothesis that combining the information delivered by multiple radiographic modalities can lead to more constrained (improved) “reconstruction” of the scene than can be obtained from a single probe. We identify four modalities: multi-probe, time sequence, multi-view, and multi-messenger. Multi-probe radiography is a promising candidate for a next-generation dynamic radiographic facility. High-energy X-rays are the most frequently used probe for dynamic radiography, although recent developments show the utility of proton (pRad), electron (eRad), and neutron probe beams. Because each probing species interacts with material in the radiographic scene through quantitatively different mechanisms, each returns independent information about the scene, which can add extra constraints to the reconstruction process. How to conduct detailed, quantitative “co-analysis” of multiple data streams remains an area of active research. Multi-beam, short-pulse, laser-generated probes offer sufficient dose, an appropriate spectrum, and appropriate spatio-temporal resolution to produce high-quality dynamic radiographs. This paper reports on technology development to advance the state of the art of multi-modal/multi-probe radiography and the pursuit of both deterministic and inferential (AI/ML assisted) co-analysis methodologies to produce more constrained reconstructions from multi-modal data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

The ICARUS light detection system (Fermilab Italian summer student program 2023)

The ICARUS T600 detector is the largest Liquid Argon Time Projection Chamber ever used on a neutrino beam, and it acts as the far detector of the Short Baseline Neutrino program at Fermilab. Its purpose is the study of the possibility of the existence of a fourth sterile neutrino in the O(eV2) mass range that could take part in the neutrino oscillations. The light detection system of the ICARUS detector plays the role of localising in space and time the neutrino interactions taking place inside the detector, collecting the argon scintillation photons generated when an event occurs. This light detection system also has a crucial role in the trigger system and the rejection of the huge amount of background cosmic events, working together with the trigger request signals sent by the beam complex. In August 2023 part of the cables that are used to carry the signals from the photomultipliers to the electronics were replaced with a new model, because a deterioration of the quality of the signal inside the cables had previously been observed. An analysis of the performance of the new cables was carried out, comparing laser run data collected before and after the change of the cable model, and it was proved that the introduction of the new cables lead to a general improvement of the quality of the signals reaching the electronics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

European residential wood pellet trade and prices dataset

The European market for wood pellets used in small-scale heating systems has been expanding significantly over the past decade. For an analysis of market efficiency in the Journal Energy with the title “The European wood pellets for heating market - price developments, trade and market efficiency“ wood pellet prices have been collected as well as trade flows downloaded for the trade relations between Austria, Germany, Italy and France. Only since January 2012 monthly wood pellet trade data is published by Eurostat. This, now monthly expanding data-set provides new opportunities for analysing the development of this important renewable energy commodity. Furthermore, national wood pellet prices published by national authorities and interest groups are improving in quality in the recent years. The collection and combination of these data-sets are a chance for novel econometric analysis. This paper presents valuable tools and processes to acquire and prepare this data and connects to a data and code repository for downloading the resources described in this and the related Journal Energy publication.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

Square Kilometre Array Science Data Challenge 1: analysis and results

ABSTRACT As the largest radio telescope in the world, the Square Kilometre Array (SKA) will lead the next generation of radio astronomy. The feats of engineering required to construct the telescope array will be matched only by the techniques developed to exploit the rich scientific value of the data. To drive forward the development of efficient and accurate analysis methods, we are designing a series of data challenges that will provide the scientific community with high-quality data sets for testing and evaluating new techniques. In this paper, we present a description and results from the first such Science Data Challenge 1 (SDC1). Based on SKA MID continuum simulated observations and covering three frequencies (560, 1400, and 9200 MHz) at three depths (8, 100, and 1000 h), SDC1 asked participants to apply source detection, characterization, and classification methods to simulated data. The challenge opened in 2018 November, with nine teams submitting results by the deadline of 2019 April. In this work, we analyse the results for eight of those teams, showcasing the variety of approaches that can be successfully used to find, characterize, and classify sources in a deep, crowded field. The results also demonstrate the importance of building domain knowledge and expertise on this kind of analysis to obtain the best performance. As high-resolution observations begin revealing the true complexity of the sky, one of the outstanding challenges emerging from this analysis is the ability to deal with highly resolved and complex sources as effectively as the unresolved source population.

Bonaldi, A.↗

DOE OSTI2022

Recent advances and applications of deep learning methods in materials science

Deep learning (DL) is one of the fastest-growing topics in materials data science, with rapidly emerging applications spanning atomistic, image-based, spectral, and textual data modalities. DL allows analysis of unstructured data and automated identification of features. The recent development of large materials databases has fueled the application of DL methods in atomistic prediction in particular. In contrast, advances in image and spectral data have largely leveraged synthetic data enabled by high-quality forward models as well as by generative unsupervised DL methods. In this article, we present a high-level overview of deep learning methods followed by a detailed discussion of recent developments of deep learning in atomistic simulation, materials imaging, spectral analysis, and natural language processing. For each modality we discuss applications involving both theoretical and experimental data, typical modeling approaches with their strengths and limitations, and relevant publicly available software and datasets. We conclude the review with a discussion of recent cross-cutting work related to uncertainty quantification in this field and a brief perspective on limitations, challenges, and potential growth areas for DL methods in materials science.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Wide‐Field Bond Quality Evaluation Using Frequency Domain Thermoreflectance with Deep Neural Network Feature Reconstruction

Heterogeneous integration of microelectronic components provides a pathway to improve circuit/component performance; however, this comes with assembly challenges, in particular due to complex interfaces via subsurface bump bonds. The ability of these bonds to transmit electrical signals and conduct heat to the carrier substrate limits component performance. In this work, hyperspectral frequency‐domain thermoreflectance (FDTR) imaging is demonstrated as a robust technique for evaluating the quality of subsurface indium bump bonds in a surrogate microelectronic sample. By performing microscale FDTR imaging with coarse motion image stitching, thermal phase maps that cover a 4 mm by 4 mm field‐of‐view with subsurface feature sensitivity at depths greater than 50 µm are obtained. The resulting FDTR hyperspectral data contains more than three million pixels and reveal the quality of subsurface microbump arrays. Wide‐field analysis of bonded versus gap regions is enabled by deep neural network feature reconstruction, that after training, rapidly provides an interpretable representation of bond quality. Utility of noisy higher frequency FDTR phase maps, i.e., near the computationally predicted sensing depth limit, results in an average prediction error of 11%. Taken together, FDTR with neural network‐based analysis demonstrates subsurface bond monitoring at length scales relevant for heterogeneously integrated microelectronics.

FDTR↗

DOE OSTI2026

A Comprehensive Comparison of Building Height Products at a Global Level

The built environment continues to expand due to increasing human populations with some projections indicating additional growth of 2.5 billion persons by 2050. Buildings are a key component of the built environment and information on building height and urban morphology in general can help to better understand and address a host of development and urban planning issues including energy consumption, urbanization, population dynamics, urban heat islands, environmental degradation, and others. To date, several approaches have been developed to address the need for mapping building height at scale. These approaches can be grouped into two main categories: 1) directly measure height from remote sensing products or 2) indirectly estimate height from footprint morphology features at the building-by-building level. Due to a number of these global height datasets now being available for consumption and use across domains, there is a critical need to understand the differences displayed between these products and how the use of these may influence the outcome when applied. In this analysis, we compare and evaluate 5 global building height datasets: Global Human Settlement, World Settlement Footprint 3D, Global Building Morphology dataset, three-dimensional Global Building Footprints, and an approach developed at Oak Ridge National Laboratory (ORNL). Our analysis shows that, across 5 cities at a global scale with high-quality building height reference data, the approach developed by ORNL of inferring height at the building-by-building level is more accurate and consistent. This was evidenced by the ORNL product improving upon the baseline in all 5 cities, the only product to do so. These findings will aid researchers in choosing a global building height product that best meets their needs and provides global availability, consistency, and accuracy.

42 ENGINEERING↗

DOE OSTI2023

WAP Workforce Needs Analysis

As identified through stakeholder dialogue, Weatherization Assistance Program (WAP) Grantees and Subgrantees face challenges in hiring and retaining field staff in the following positions: Retrofit Installers/Technicians (RITs), Crew Leaders (CLs), Energy Auditors (EAs), and Quality Control Inspectors (QCIs). To gain a baseline understanding of workforce needs, NREL collected voluntary workforce data from May 4-June 30, 2022. This presentation includes a qualitative analysis of this data, key takeaways, and an introduction to new tools supporting WAP workforce development.

ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Clinical knowledge extraction via sparse embedding regression (KESER) with multi-center large scale electronic health record data

The increasing availability of electronic health record (EHR) systems has created enormous potential for translational research. However, it is difficult to know all the relevant codes related to a phenotype due to the large number of codes available. Traditional data mining approaches often require the use of patient-level data, which hinders the ability to share data across institutions. In this project, we demonstrate that multi-center large-scale code embeddings can be used to efficiently identify relevant features related to a disease of interest. We constructed large-scale code embeddings for a wide range of codified concepts from EHRs from two large medical centers. We developed knowledge extraction via sparse embedding regression (KESER) for feature selection and integrative network analysis. We evaluated the quality of the code embeddings and assessed the performance of KESER in feature selection for eight diseases. Besides, we developed an integrated clinical knowledge map combining embedding data from both institutions. The features selected by KESER were comprehensive compared to lists of codified data generated by domain experts. Features identified via KESER resulted in comparable performance to those built upon features selected manually or with patient-level data. The knowledge map created using an integrative analysis identified disease-disease and disease-drug pairs more accurately compared to those identified using single institution data. Analysis of code embeddings via KESER can effectively reveal clinical knowledge and infer relatedness among codified concepts. KESER bypasses the need for patient-level data in individual analyses providing a significant advance in enabling multi-center studies using EHR data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2020

Annual PM2.5 and cardiovascular mortality rate data: Trends modified by county socioeconomic status in 2,132 US counties

This article contains data on county-level socioeconomic status for 2132 US counties and each county's average annual cardiovascular mortality rate (CMR) and fine particulate matter (PM2.5) concentration for 21 years (1990e2010). County CMR, PM2.5, and socioeconomic data were obtained from the US National Center for Health Statistics, US Environmental Protection Agency's Community Multiscale Air Quality modeling system, and the US Census, respectively. Annual socioeconomic indices were created using seven county-level measures from the 1990, 2000, and 2010 US Census using factor analysis. Quintiles of this index were used to generate categories of county socioeconomic status. This national data set contains data for annual PM2.5 and CMR changes over a time-period when there was a significant reduction in US air pollutants (following the enactment of the 1970 Clean Air Act). These data are associated with the article “The contribution of improved air quality to reduced cardiovascular mortality: Declines in socioeconomic differences over time” [1]. Data are stored in a comma separated value format and can be downloaded from the USEPA ScienceHub data repository (https://doi.org/10.23719/ 1506014).

Socioeconomic status↗

DOE OSTI2021

Beyond optimization—supervised learning applications in relativistic laser-plasma experiments

We explore the applications of machine learning techniques in relativistic laser-plasma experiments beyond optimization purposes. We predict the beam charge of electrons produced in a laser wakefield accelerator given the laser wavefront change caused by a deformable mirror. Machine learning enables feature analysis beyond merely searching for an optimal beam charge, showing that specific aberrations in the laser wavefront are favored in generating higher beam charges. Supervised learning models allow characterizing the measured data quality as well as recognizing irreproducible data and potential outliers. Furthermore, we also include virtual measurement errors in the experimental data to examine the model robustness under these conditions. This work demonstrates how machine learning methods can benefit data analysis and physics interpretation in a highly nonlinear problem of relativistic laser-plasma interaction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Time Delay of Wide Area Damping Control in Urban Power Grid: Model-Based Analysis and Data-Driven Compensation

Due to the rapid development of economies, large urban cities consume an increasing amount of energy and have a higher requirement for power quality. Voltage source converter based high voltage direct current (VSC-HVDC) is a promising device to transmit clean power from remote regions to urban power systems, while also providing wide area damping control (WADC) for frequency stabilization. However, the time-delay naturally existing in the VSC-HVDC system may degrade the performance of WADC and even result in instability. To address this issue, this paper develops a time-delay correction control strategy for VSC-HVDC damping control in urban power grids. First, a small signal model of WADC is built to analyze the negative impacts of time delay. Then, a data-driven approach is proposed to compensate for the inherent time delay in VSC-HVDC damping control. The extensive training data will be generated under various disturbances. After offline training, the long short-term memory network (LSTM) can be implemented online to predict the actual frequency deviation based on real-time measurements. Finally, the proposed method is validated through MATLAB-Simulink in a two-area four-machine system. The results indicate that the data-driven compensation has a strong generalization ability for random delay time constants and can improve the performance of WADC significantly.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Crack detection in fuel cell electrodes using a spatial filtering technique for overcoming noisy backgrounds

Image processing is a powerful tool that allows for rapid and automated data parsing in settings that occupy large variable spaces and require large data sets. Feature detection on difficultly discerned backgrounds is a subset of image processing that facilitates the extraction of quantitative metrics from otherwise subjective data. Crack detection and quantification is an important capability in polymer electrolyte membrane fuel cell quality control, failure analysis, and optimization. This work presents a technique to perform crack detection and quantification which overcomes challenges faced by commonly used image segmentation techniques. We demonstrate the use of a geometrically filtered noise‐level detection technique to select a binary threshold value from which we then quantify how cracked a sample is. Furthermore, we demonstrate the accuracy of our technique using programmatically generated test images of known crack amounts and their performance on real‐world fuel cell catalyst layer samples.

30 DIRECT ENERGY CONVERSION↗

DOE OSTI2025

Comparing Outdoor to Indoor Performance for Bifacial Modules Affected by Polarization-Type Potential-Induced Degradation

Bifacial photovoltaic (PV) modules have the advantage of using light reflected off of the ground to contribute to power production. Predicting the energy gain is challenging and requires complex models to do so accurately. Often, module degradation over time is neglected in models for the sake of simplicity or is underestimated. Comparing outdoor and indoor current–voltage (I–V) performance for bifacial modules is more challenging than for monofacial modules, as there are additional variables to consider such as rear albedo non-uniformity, cell mismatch, and their effects on temperature. This challenge is compounded when heterogeneous degradation modes occur, such as polarization-type potential-induced degradation (PID-p). To examine the effects of PID-p on I–V predictions using an empirical data-driven approach, 16 bifacial PERC modules are installed outdoors on racks with different albedo conditions. A subset is exposed to high-voltage biases of −1500 V or +1500 V. Outdoor data are traced at irradiance ranges of 150–250 W/m 2 , 500–600 W/m 2 , and 900–1000 W/m 2 . These curves are corrected using control module temperature, wire resistivity, and module resistance measured indoors. We examine several methods to transform indoor I–V curves to accurately, and more simply than existing methods, approximate outdoor performance for bifacial modules without and with varying levels of PID-p degradation. This way, bifacial performance modeling can be more accessible and informed by fielded, degraded modules. Distributions of percent errors between indoor and outdoor performance parameters and Mean Absolute Percent Errors (MAPEs) are used to assess method quality. Results including low-irradiance data (150–250 W/m 2 ) are discussed but are filtered for quantifying method quality as these data introduce substantial errors. The method with the most optimal tradeoff between low MAPE and analysis simplicity involves measuring the front side of a module indoors at an irradiance equal to plane-of-array irradiance plus the product of module bifaciality and albedo irradiance. This method gives MAPE values of 1–6.5% for non-degraded and 1.6–5.9% for PID-p degraded module performance.

14 SOLAR ENERGY↗

DOE OSTI2020

Crowd-Sourced Data and Analysis Tools for Advancing the Chemical Vapor Deposition of Graphene: Implications for Manufacturing

Industrial production of graphene by chemical vapor deposition (CVD) requires more than the ability to synthesize large domain, high-quality graphene in a lab reactor. The integration of graphene in the fabrication process of electronic devices requires the cost-effective and environmentally friendly production of graphene on dielectric substrates, but current approaches can only produce graphene on metal catalysts. Sustainable manufacturing of graphene should also conserve the catalyst and reaction gases, but today the metal catalysts are typically dissolved after synthesis. Progress toward these objectives is hindered by the hundreds of coupled synthesis parameters that can strongly affect CVD of low-dimensional materials and poor communication in the published literature of the rich experimental data that exists in individual laboratories. We report here on a platform, "graphene recipes for synthesis of high quality material" (Gr-ResQ: pronounced graphene rescue), which includes powerful new tools for data-driven graphene synthesis. At the core of Gr-ResQ is a crowd-sourced database of CVD synthesis recipes and associated experimental results. The database captures similar to 300 parameters ranging from synthesis conditions such as a catalyst material and preparation steps, to ambient lab temperature and reactor details, as well as resulting Raman spectra and microscopy images. These parameters are carefully selected to unlock the potential of machine-learning models to advance synthesis. A suite of associated tools enable fast, automated, and standardized processing of Raman spectra and scanning electron microscopy images. To facilitate community-based efforts, Gr-ResQ provides tools for cyber-physical collaborations among research groups, allowing experiments to be designed, executed, and analyzed by different teams. Gr-ResQ also allows publication and discovery of recipes via the Materials Data Facility, which assigns each recipe a unique identifier when published and collects parameters in a search index. We envision that this holistic approach to data-driven synthesis can accelerate CVD recipe discovery and production control and open opportunities for advancing not only graphene but also many other 1D and 2D materials.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Examination of synthetic gas puff imaging diagnostic data from a gyrokinetic turbulence code

A synthetic gas puff imaging (GPI) diagnostic has been developed for the purpose of validating the three-dimensional gyrokinetic turbulence code XGC. The synthetic diagnostic is described and applied to XGC simulations of two Alcator C-Mod discharges. The turbulence characteristics deduced from the resulting simulated GPI frames, using analysis techniques similar to those applied to experimental data, are compared with locally derived characteristics extracted directly from the XGC output. The comparison of the two is shown to be potentially impacted by misalignment between the GPI view and the magnetic field, the dependence of the light emission on the electron density and temperature, and spatial and temporal variations in the neutral gas cloud induced by the turbulent plasma fluctuations. We conclude that quantitative and, in some cases even qualitative, validation of turbulence simulations need to account for these effects. While we cannot directly compare our results with experimental data due to the absence of high quality GPI data from the shots and times simulated by XGC, we do relate the overall characteristics obtained from the synthetic GPI analysis to published Alcator C-Mod GPI data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Circularity Futures Workshop Series: Summary Report

The aim of this report is to synthesize key feedback received from the three-part Circularity Futures workshop series held in Spring 2024. The workshop series was conducted by the National Renewable Energy Laboratory (NREL) on behalf of U.S. Department of Energy, Office Energy Efficiency and Renewable Energy (EERE), and was broken into three workshops: Workshop 1 - Circularity Analysis Needs and Priorities; Workshop 2 - Circularity Metrics and Indicators; and Workshop 3 - Circularity Data. Together, the workshops focused on identifying the existing priorities and gaps in the circularity modeling space, understanding different stakeholders' use and interpretation of circularity metrics and indicators, identifying common data gaps and data quality challenges, and assessing the robustness of available solutions. The workshop series brought a diverse group of stakeholders - including representatives from U.S. government offices, national labs, nonprofit organizations, industry, and academia - to collect first-hand feedback on needs, priorities, challenges and opportunities in the circularity modeling and analysis space. The workshop discussions highlighted numerous common needs, priorities and challenges among the interviewed groups. Several topics were frequently discussed, including: 1) Circularity as a pathway for sustainable economic growth: While circularity is generally defined in terms of resource conservation and reducing wasteful disposal of materials, participants agreed that circular strategies should serve broader economic, environmental, and social goals. It is therefore crucial for circularity analysis to look beyond waste reduction and instead evaluate a variety of impact metrics such as cost savings, job creation, air quality, and pollutant emissions. Mutli-criteria decision-making frameworks may be useful for making sense of disparate metrics and evaluating tradeoffs between impact categories.; 2) Economic and social factors are not well understood: Underdevelopment of existing end-of-life (EOL) management infrastructure, inconsistent standardization codes and policy space in reusing recycled content, and suboptimal collection and sorting strategies collectively contribute to uncertainty about the economic potential of circular pathways. The latter observation is consistent among all technologies but more emphasized for renewable energy systems. Social impacts of circularity practices are less understood and less researched than other sustainability aspects.; 3) Inconsistent methods for assessing emerging technologies: LCA and TEA results vary widely depending on the assumptions made with regards to market adoption of new technologies. Emerging technologies suffer limited availability of data needed to conduct a robust circularity analysis. Yet, understanding projected impacts of proposed nascent technology is a key need for different stakeholder groups.; and 4) Lack of temporally and geospatially explicit data: There is a need for open data that represents variations in circularity technologies over time and location. The lack thereof leads to aggregated and potentially misrepresented results in circularity analysis. Sensitivity analyses should be included to verify whether options perceived as more sustainable align with real-world practices.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗