Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Quality Control Methods for Advanced Metering Infrastructure Data

While urban-scale building energy modeling is becoming increasingly common, it currently lacks standards, guidelines, or empirical validation against measured data. Empirical validation necessary to enable best practices is becoming increasingly tractable. The growing prevalence of advanced metering infrastructure has led to significant data regarding the energy consumption within individual buildings, but is something utilities and countries are still struggling to analyze and use wisely. In partnership with the Electric Power Board of Chattanooga, Tennessee, a crude OpenStudio/EnergyPlus model of over 178,000 buildings has been created and used to compare simulated energy against actual, 15-min, whole-building electrical consumption of each building. In this study, classifying building type is treated as a use case for quantifying performance associated with smart meter data. This article attempts to provide guidance for working with advanced metering infrastructure for buildings related to: quality control, pathological data classifications, statistical metrics on performance, a methodology for classifying building types, and assess accuracy. Advanced metering infrastructure was used to collect whole-building electricity consumption for 178,333 buildings, define equations for common data issues (missing values, zeros, and spiking), propose a new method for assigning building type, and empirically validate gaps between real buildings and existing prototypes using industry-standard accuracy metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Classification of Volatile Engine Particles

Volatile particles cannot be detected at the engine exhaust by an aerosol detector. They are formed when the exhaust is mixed with ambient air downstream. Lack of a precise definition of volatile engine particles has been an impediment to engine manufacturers and regulatory agencies involved in the development of an effective control strategy. It is beyond doubt that volatile particles from combustion sources contribute to the atmospheric particulate burden, and the effect of that contribution is a critical issue in the ongoing research in the areas of air quality and climate change. A new instrument, called volatile particle separator (VPS), has been developed. It utilizes a proprietary microporous metallic membrane to separate particles from vapors. VPS data were used in the development of a two-parameter function to quantitatively classify, for the first time, the volatilization behavior of engine particles. The value of parameter A describes the volatilization potential of an aerosol. A nonvolatile particle has a larger A-value than a volatile one. The value of parameter k, an effective evaporation energy barrier, is found to be much smaller for small engine particles than that for large engine particles. The VPS instrument provides a means beyond just being a volatile particle remover; it enables a numerical definition to characterize volatile engine particles.

Engine emission↗

AQuaRef: machine learning accelerated quantum refinement of protein structures

Cryo-EM and X-ray crystallography provide crucial experimental data for obtaining atomic-detail models of biomacromolecules. Refining these models relies on library-based stereochemical data, which, in addition to being limited to known chemical entities, do not include meaningful noncovalent interactions. Quantum mechanical (QM) calculations could alleviate these issues but are too expensive for large molecules. Here we present a novel AI-enabled Quantum Refinement (AQuaRef) based on AIMNet2 machine learned interatomic potential (MLIP) mimicking QM at substantially lower computational costs. By refining 41 cryo-EM and 30 X-ray structures, we show that this approach yields atomic models with superior geometric quality compared to standard techniques, while maintaining an equal or better fit to experimental data. Notably, AQuaRef aids in determining proton positions, as illustrated in the challenging case of short hydrogen bonds in the parkinsonism-associated human protein DJ-1 and its bacterial homolog YajL.

Zubatyuk, Roman [Carnegie Mellon University, Pitts↗

Setting up a STAR Tier 2 Site at Golias/Prague Farm

High Energy Nuclear Physics (HENP) collaborations experience show that the computing resources available at a single site are often neither sufficient nor satisfy the need of remote collaborators eager to carry their analysis in the fastest and most convenient way. From latencies in the network connectivity to the lack of interactivity, work at distant computing centers is often inefficient. Having fully functional software stack on local resources is a strong enabler of science opportunities for any local group who can afford the time investment. The situation becomes more complex as vast amount of data are often needed to perform meaningful analysis. Prague's heavy-ions group participating in STAR experiment at RHIC has been a strong advocate of local computing as the most efficient means of data processing and physics analyses. To create an environment where science can freely thrive, a Tier 2 computing center was set up at a Regional Computing Center for Particle Physics called 'Golias'. It is the biggest farm in the Czech Republic fully dedicated for particle physics experiments. We report on our experience in setting up a fully functional Tier 2 center leveraging the minimal locally available human and financial resources. We discuss the solutions chosen to address storage space and analysis issues and the impact on the farms overall functionality. This includes a locally built STAR analysis framework, integration with a local DPM system (a cost effective storage solution), the influence of the availability and quality of the network connection to Tier 0 via a dedicated CESNET/ESnet link and the development of light-weight yet fully automated data transfer tools allowing the movement of entire datasets from BNL (Tier 0) to Golias (Tier 2). We will summarize the impact of the gained computing performance on the efficiency of the local physics group at offline physics analysis and show the feasibility of such a solution that can used by other groups as well.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Empirical thermophotovoltaic performance predictions and limits

Significant progress has been made in the field of thermophotovoltaics, with efficiency recently rising to over 40% due to improvements in cell design and material quality, higher emitter temperatures, and better spectral management. However, inconsistencies in trends for efficiency with semiconductor bandgap energy across various temperatures pose challenges in predicting optimal bandgaps or expected performance for different applications. To address these issues, here we present realistic performance predictions for various types of single-junction cells over a broad range of emitter temperatures using an empirical model based on past cell measurements. Our model is validated using data from different authors with various bandgaps and emitter temperatures, and an excellent agreement is seen between the model and the experimental data. Using our model, we show that in addition to spectral losses, it is important to consider practical electrical losses associated with series resistance and cell quality to avoid overestimation of system efficiency. Here, we also show the effect of modifying various system parameters such as bandgap, above and below-bandgap reflectance, saturation current, and series resistance on the efficiency and power density of thermophotovoltaics at different temperatures. Finally, we predict the bandgap energies for best performance over a range of emitter temperatures for different cell material qualities.

14 SOLAR ENERGY↗

Trials, tribulations, and pitfalls using commercial instruments for data acquisition

Brookhaven National Laboratory's Relativistic Heavy Ion Collider (RHIC) uses many commercially available instruments - for example spectrum analyzers, oscilloscopes, digital volt meters, signal generators - as integral parts of instrumentation and control systems. Typically these systems are remotely controlled. Using commercial instruments has many benefits. Manufactures have the skill, knowledge, and experience to produce high quality products. The price performance ratio is hard to duplicate. There are also disadvantages. Proprietary interfaces, single platform drivers, and reliable operation provide challenges for implementation and unattended operation. Several of the systems used at RHIC will be described. Their issues and solutions will be presented.

43 PARTICLE ACCELERATORS↗

Ignition and pusher adiabat

In the last five years, large amounts of high quality experimental data in inertial confinement fusion (ICF) were produced at the National Ignition Facility (NIF). From the NIF data, we have significantly advanced our scientific understanding of the physics of thermonuclear (TN) ignition in ICF and identified the critical physical issues important to achieve ignition, such as implosion energetics, pusher adiabat, tamping effects in fuel confinement, and confinement time. In this article, we will present recently developed TN ignition theory and implosion scaling laws [1, 2] characterizing the thermodynamic properties of the hot spot and the TN ignition metrics at NIF. We compare our theoretical predictions with NIF data with good agreement between theory and experiments. We will also demonstrate the fundamental effects of the pusher adiabat on the energy partition between the cold shell and the hot deuterium-tritium and on the neutron yields of ICF capsules. Applications [3–5] to NIF experiments and physical explanations of the discrepancies among theory, data and simulations will be presented. In our theory, the actual adiabat of the cold DT fuel can be inferred from neutron image data of a burning capsule. With the experimentally inferred hot spot mix, the CH mix in the cold fuel could be estimated, as well as the preheat. Lastly, possible path forwards to reach high yields are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

H2@Scale Program Multi-Party Cooperative Research and Development Agreement: California Hydrogen Infrastructure Research Consortium Task (Cooperative Research and Development Final Report, CRADA Number CRD-18-00754)

Many stakeholders are working on hydrogen and fuel cell products, markets, requirements, mandates, and policies. California has been leading the way for hydrogen infrastructure and fuel cell electric vehicle (FCEV) deployment. This leadership has advanced a hydrogen network that is not duplicated anywhere in the United States and is unique in the world for its focus on providing a retail fueling experience. In addition, the advancements have identified many lessons learned for hydrogen infrastructure development, deployment, and operation. Other interested states and countries are using California's experience as a model case, making success in California paramount to enabling market acceleration and uptake in the United States. The technical research capability of the national laboratories can be used to assist California in decisions and evaluations, as well as to verify solutions to problems impacting the industry. Because these challenges cannot be addressed by one agency or one laboratory, a hydrogen research consortium has been organized to combine and collaborate. The collaboration aims to ensure that data are available to evaluate projects and inform decision makers, independently verify and validate component solutions, provide experimental results for future hydrogen infrastructure, increase the availability of technical experts for quick-need issues for California hydrogen infrastructure development, deployment, operation, and technology advances. The proposed tasks include data collection from operational stations, component failure fix verification (i.e. nozzle freeze lock), new fueling methods for medium and heavy duty applications, and ensuring hydrogen quality is maintained. U.S. leadership for hydrogen technologies is rooted in California, a location for implementing many H2@Scale pathways such as reducing curtailment and stranded resources, reducing petroleum use and emissions, and developing and creating jobs.

08 HYDROGEN↗

Commercial Off-the-Shelf (COTS) Components and Enterprise Component Information System (eCIS)

The purpose of the project was to develop the processes for using commercial off-the-shelf (COTS) parts for WR production and to put in place a system for implementing the data management tools required to disseminate, store, track procurement, and qualify vendors. Much of the effort was devoted to determining if the use of COTS parts was possible. A basic question: How does the Nuclear Weapons Complex (NWC) begin to use COTS in the weapon Stockpile Life Extension Programs with high reliability, affordability, while managing risk at acceptable levels? In FY00, it was determined that a certain weapon refurbishment program could not be accomplished without the use of COTS components. The elements driving the use of COTS components included decreased cost, greater availability, and shorter delivery time. Key factors that required implementation included identifying the best suppliers and components, defining life cycles and predictions of obsolescence, testing the feasibility of using COTS components with a test contractor to ensure capability, as well as quality and reliability, and implementing the data management tools required to disseminate, store, track procurement, and qualify vendors. The primary effort of this project then was to concentrate on the risks involved in the use of COTS and address the issues of part and vendor selection, procurement and acceptance processes, and qualification of the parts via part and sample testing. The Enterprise Component Information System (eCIS) was used to manage the information generated by the COTS process. eCIS is a common interface for both the design and production of NWC components and systems integrating information between SNL National Laboratory (SNL) and the Kansas City Plant (KCP). The implementation of COTS components utilizes eCIS from part selection through qualification release. All part related data is linked across an unclassified network for access by both SNL and KCP personnel. The system includes not only NWC part information but also includes technical reference data for over 25 Million electronic and electromechanical commercial and military parts via a data subscription. With the capabilities added to the system through this project, eCIS provides decision support, parts list/BOM analysis, editing, tracking, workflows, reporting, and history/legacy information integrating manufacturer reference, company technical, company business, and design data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Reliability of temperature determination from curve-fitting in multi-wavelength pyrometery

Abstract This paper examines the reliability of a widely used method for temperature determination by multi-wavelength pyrometry. In recent WDM experiments with ion-beam heated metal foils, we found that the statistical quality of the fit to the measured data is not necessarily a measure of the accuracy of the inferred temperature. We found a specific example where a second-best fit leads to a more realistic temperature value. The physics issue is the wavelength-dependent emissivity of the hot surface. We discuss improvements of the multi-frequency pyrometry technique, which will give a more reliable determination of the temperature from emission data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Global optimization of data quality checks on 2-D and 3-D networks of GPR cross-well tomographic data for automatic correction of unknown well deviations

Significant errors related to poor time zero estimation, well deviation or mislocation of the transmitter (TX) and receiver (RX) stations can render even the most sophisticated modeling and inversion routine useless. Previous examples of methods for the analysis and correction of data errors in geophysical tomography include the works of Maurer and Green (1997), Squires et al. (1992) and Peterson (2001). Here we follow the analysis and techniques of Peterson (2001) for data quality control and error correction. Through our data acquisition and quality control procedures we have very accurate control on the surface locations of wells, the travel distance of both the transmitter and receiver within the boreholes, and the change in apparent zero time. However, we often have poor control on well deviations, either because of economic constraints or the nature of the borehole itself prevented the acquisition of well deviation logs. Also, well deviation logs can sometimes have significant errors. Problems with borehole deviations can be diagnosed prior to inversion of travel-time tomography data sets by plotting the apparent velocity of a straight ray connecting a transmitter (TX) to a receiver (RX) against the take-off angle of the ray. Issues with the time-zero pick or distances between wells appear as symmetric smiles or frown in these QC plots. Well deviation or dipping-strong anisotropy will result in an asymmetric correlation between apparent velocity and take-off angle (Figure 1-B). In addition, when a network of interconnected GPR tomography data is available, one has the additional quality constraint of insuring that there is continuity in velocity between immediately adjacent tomograms. A sudden shift in the mean velocity indicates that either position deviations are present or there is a shift in the pick times. Small errors in well geometry may be effectively treated during inversion by including weighting, or relaxation, parameters into the inversion (e.g. Bautu et al., 2006). In the technique of algebraic reconstruction tomography (ART), which is used herein for the travel time inversion (Peterson et al., 1985), a small relaxation parameter will smooth imaging artifacts caused by data errors at the expense of resolution and contrast (Figure 2). However, large data errors such as unaccounted well deviations cannot be adequately suppressed through inversion weighting schemes. Previously, problems with tomograms were treated manually. However, in large data sets and/or networks of data sets, trial and error changes to well geometries become increasingly difficult and ineffective. Mislocation of the transmitter and receiver stations of GPR cross-well tomography data sets can lead to serious imaging artifacts if not accounted for prior to inversion. Previously, problems with tomograms have been treated manually prior to inversion. In large data sets and/or networks of tomographic data sets, trial and error changes to well geometries become increasingly difficult and ineffective. Our approach is to use cross-well data quality checks and a simplified model of borehole deviation with particle swarm optimization (PSO) to automatically correct for source and receiver locations prior to tomographic inversion. We present a simple model of well deviation, which is designed to minimize potential corruption of actual data trends. We also provide quantitative quality control measures based on minimizing correlations between take-off angle and apparent velocity, and a quality check on the continuity of velocity between adjacent wells. This methodology is shown to be accurate and robust for simple 2-D synthetic test cases. Plus, we demonstrate the method on actual field data where it is compared to deviation logs. This study shows the promise for automatic correction of well deviations in GPR tomographic data. Analysis of synthetic data shows that very precise estimates of well deviation can be made for small deviations, even in the presence of static data errors. However, the analysis of the synthetic data and the application of the method to a large network of field data show that the technique is sensitive to data errors varying between neighboring tomograms.

54 ENVIRONMENTAL SCIENCES↗

Overview and first measurements of the MAST Upgrade bolometer diagnostic

Here, a suite of multi-channel resistive bolometers has been implemented to measure the total radiation from Mega Amp Spherical Tokamak Upgrade plasmas, with cameras covering the core plasma and lower divertor chamber. Data are digitized and processed using novel field-programmable gate array-based electronics, offering improved compactness and new operational capabilities. A synthetic diagnostic has been developed to explore the quality of 2D reconstructions available from the system and to quantify the uncertainty on quantities such as the total radiated power. Measurements in the first campaign have demonstrated correct functioning of the diagnostic while also highlighting issues with electrical noise and some failure mechanisms of the detectors, as well as significant neutral beam fast-particle losses.

47 OTHER INSTRUMENTATION↗

Integrated Imaging and Vision Techniques for Industrial Inspection: A Special Issue on Machine Vision and Applications

Imaging- and vision-based techniques play an important role in industrial inspection. The sophistication of the techniques assures high- quality performance of the manufacturing process through precise positioning, online monitoring, and real-time classification. Advanced systems incorporating multiple imaging and/or vision modalities provide robust solutions to complex situations and problems in industrial applications. A diverse range of industries, including aerospace, automotive, electronics, pharmaceutical, biomedical, semiconductor, and food/beverage, etc., have benefited from recent advances in multi-modal imaging, data fusion, and computer vision technologies. Many of the open problems in this context are in the general area of image analysis methodologies (preferably in an automated fashion). This editorial article introduces a special issue of this journal highlighting recent advances and demonstrating the successful applications of integrated imaging and vision technologies in industrial inspection.

data fusion↗

E-transit-bench: simulation platform for analyzing electric public transit bus fleet operations

When electrified transit systems make grid aware choices, improved social welfare is achieved by reducing grid stress, reducing system loss, and minimizing power quality issues. Electrifying transit fleet has numerous challenges like non availability of buses during charging, varying charging costs and so on, that are related the electric grid behavior. However, transit systems do not have access to the information about the co-evolution of the grid's power flow and therefore cannot account for the power grid's needs in its day-to-day operation. In this paper we propose a framework of transportation-grid co-simulation, analyzing the spatio-temporal interaction between the transit operations with electric buses and the power distribution grid. Real-world data for a day's traffic from Chattanooga city's transit system is simulated in SUMO and integrated with a realistic distribution grid simulation (using GridLAB-D) to understand the grid impact due to transit electrification. Charging information is obtained from the transportation simulation to feed into grid simulation to assess the impact of charging. We also discuss the impact to the grid with higher degree of transit electrification that further necessitates such an integrated transportation-grid co-simulation to operate the integrated system optimally. Our future work includes extending the platform for optimizing the charging and trip assignment operations.

Sen, Rishav↗

Implementation of the PR&PP methodology: the role of formal expert elicitations

The application of the methodology developed by the GenIV International Forum's (GIF's) Proliferation Resistance and Physical Protection (PR&PP) Working Group is an expert elicitation. Although the framework of the methodology is structured and systematic, it does not by itself constitute or require a formal elicitation. However, formal elicitation can be utilized in the PR&PP context to provide a systematic, credible and transparent qualitative analysis and develop input for quantitative analyses. This section provides an overview of expert elicitations, a discussion of the role formal expert elicitations can play in the PR&PP methodology, an outline of the formal expert elicitation process and a brief practical guide to conducting formal expert elicitations. Expert elicitation is a process utilizing knowledgeable people in cases, for example, when an assessment is needed but physically based data is absent or open to interpretation. More specifically, it can be used to: (1) predict future events; (2) provide estimates on new, rare, complex or poorly understood phenomena; (3) integrate or interpret existing information; or (4) determine what is currently known, how well it is known or what is worth learning in a field. Expert elicitation can be informal or formal. The informal application of expert judgment is frequently used. Although it can produce good results, it often provides demonstrably biased or otherwise flawed answers to problems. This along with the absence of transparency can result in a loss of confidence when experts speak on issues. More formal expert elicitation is a structured process that makes use of people knowledgeable in certain areas to make assessments. The reason for advocating formal use is that the quality and accuracy of expert judgment comes from the completeness of the expert's understanding of the phenomena and the process used to elicit and analyze the data. The use of a more formal process to obtain, lU1derstand and analyze expert judgment has led to an improved acceptance of expert judgment because of the rigor and transparency of the results.

99 GENERAL AND MISCELLANEOUS↗

COMBLE Radar b1 Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) user facility recently concluded its Cold-Air Outbreaks in the Marine Boundary Layer Experiment (COMBLE), with its campaign emphasis on marine boundary-layer clouds and mixed-phase clouds during cold-air outbreaks. The COMBLE campaign featured the deployment of the first ARM Mobile Facility (AMF1) to northern Scandinavia (Andenes, Norway), including its standard complement of ARM cloud radars. In keeping with user demands stemming from the previous AMF Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign in Argentina, a post-campaign radar mentor effort was initiated for COMBLE. This activity was intended to improve the usability of the ARM cloud radar data sets in response to overall demands for calibrated, corrected data sets for downstream studies and retrieval applications. In addition to the terrain complexities previously important to CACTI data sets (e.g., clutter designation and/or removal), COMBLE presented new challenges to existing ARM radar mentor capabilities. These included the extension of existing methodologies (e.g., relative calibration adjustment [RCA] target techniques) to frozen environments and the potential issues with their applicability when considering mixed-phase precipitation conditions. As in the previous CACTI documentation (Hardin et al. 2020), the overall calibration and conditioning process in ARM nomenclature is referred to as generating a “b1” datastream. For the radars, these “b1” standards refer to a datastream that has been calibrated (and cross-calibrated), with effort to deliver the highest-quality (well-characterized) data possible. The “b1” radar mentor reporting (this current document) is intended to detail (i) the status/quality of the original “a1” (raw) data sets during the COMBLE AMF campaign, (ii) the corrections and calibrations that are applied to generate the b1 datastreams available on ARM’s Data Discovery, and (iii) the details of the applied methods, e.g., how radar offset/calibration numbers were determined.

54 ENVIRONMENTAL SCIENCES↗

Assessment of the frequency and nature of erroneous x-ray photoelectron spectroscopy analyses in the scientific literature

Here, this study was undertaken to understand the extent and nature of problems in x-ray photoelectron spectroscopy (XPS) data reported in the literature. It first presents an assessment of the XPS data in three high-quality journals over a six-month period. This analysis of 409 publications showing XPS spectra provides insight into how XPS is being used, identifies the common mistakes or errors in XPS analysis, and reveals which elements are most commonly analyzed. More than 65% of the 409 papers showed fitting of XP spectra. An ad hoc group (herein identified as “the committee”) of experienced XPS analysts reviewed these spectra and found that peak fitting was a common source of significant errors. The papers were ranked based on the perceived seriousness of the errors, which ranged from minor to major. Major errors, which, in the opinion of the ad hoc committee, can render the interpretation of the data meaningless, occurred when fitting protocols ignored underlying physics and chemistry or contained major errors in the analysis. Consistent with other materials analysis data, ca. 30% of the XPS data or analysis was identified as having major errors. Out of the publications with fitted spectra, ca. 40% had major errors. The most common elements analyzed by XPS in the papers sampled and researched at an online database, include carbon, oxygen, nitrogen, sulfur, and titanium. A scrutiny of the papers showing carbon and oxygen XPS spectra revealed the classes of materials being studied and the extent of problems in these analyses. As might be expected, C 1s and O 1s analyses are most often performed on sp2-type materials and inorganic oxides, respectively. These findings have helped focus a series of XPS guides and tutorials that deal with common analysis issues. The extent of problematic data is larger than the authors had expected. Quantification of the problem, examination of some of the common problem areas, and the development of targeted guides and tutorials may provide both the motivation and resources that enable the community to improve the overall quality and reliability of XPS analysis reported in the literature.

Major, George H.↗

Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing

A main challenge towards ensuring large-scale and seamless integration of photovoltaic systems is to improve the accuracy of energy yield forecasts, especially in grid areas of high photovoltaic shares. The scope of this paper is to address this issue by presenting a unified methodology for hourly-averaged day-ahead photovoltaic power forecasts with improved accuracy, based on data-driven machine learning techniques and statistical post-processing. More specifically, the proposed forecasting methodology framework comprised of a data quality stage, data-driven power output machine learning model development (artificial neural networks), weather clustering assessment (K-means clustering), post-processing output optimisation (linear regressive correction method) and the final performance accuracy evaluation. The results showed that the application of linear regression coefficients to the forecasted outputs of the developed day-ahead photovoltaic power production neural network improved the performance accuracy by further correcting solar irradiance forecasting biases. The resulting optimised model provided a mean absolute percentage error of 4.7% when applied to historical system datasets. Finally, the model was validated both, at a hot as well as a cold semi-arid climatic location, and the obtained results demonstrated close agreement by yielding forecasting accuracies of mean absolute percentage error of 4.7% and 6.3%, respectively. Finally, the validation analysis provides evidence that the proposed model exhibits high performance in both forecasting accuracy and stability.

42 ENGINEERING↗