Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Combined Statistical Analyses of Peptide Intensities and Peptide Occurrences Improves Identification of Significant Peptides from MS-based Proteomics Data

Liquid chromatography-mass spectrometry-based (LC-MS) proteomics uses peak intensities of proteolytic peptides to infer the differential abundance of peptides/proteins. However, substantial run-to-run variability in peptide intensities and observations (presence/absence) of peptides makes data analysis quite challenging. The missing abundance values in LC-MS proteomics data are difficult to address with traditional imputation-based approaches because the mechanisms by which data are missing are unknown a priori. Data can be missing due to random mechanisms such as experimental error, or non-random mechanisms such as a true biological effect. We present a statistical approach that uses a test of independence known as a G-test to test the null hypothesis of independence between the number of missing values and the experimental groups. We pair the G-test results evaluating independence of missing data (IMD) with a standard analysis of variance (ANOVA) that uses only means and variances computed from the observed data. Each peptide is therefore represented by two statistical confidence metrics, one for qualitative differential observation and one for quantitative differential intensity. We use two simulated and two real LC-MS datasets to demonstrate the robustness and sensitivity of the ANOVA-IMD approach for assigning confidence to peptides with significant differential abundance among experimental groups.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Using the {delta}{sub 3} statistic to test for missed levels in neutron resonance data

The {delta}{sub 3}(L) statistic is studied as a possible tool to detect missing levels in the neutron resonance data of odd-A nuclei. A {delta}{sub 3}(L) analysis of neutron resonance data is compared with the results of a maximum likelihood method applied to the level spacing distribution. The {delta}{sub 3}(L) statistic compares favorably with the level spacing distribution as a tool to gauge the completeness of the data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DShaper: An approach for handling missing low-Q data in pair distribution function analysis of nanostructured systems

In this work we discuss the potential problems and currently available solutions in modeling powder-diffraction based pair-distribution function (PDF) data from systems where morphological feature information content includes distances in the nanometer length scale, such as finite nanoparticles, nanoporous networks, and nanoscale precipitates in bulk materials. The implications of an experimental finite minimum Q-value are addressed by simulation, which also demonstrates the advantages of combining PDF data with small angle scattering data (SAS). In addition, we introduce a simple Fortran90 code, DShaper , which may be incorporated into PDF data fitting routines in order to approximate the so-called shape-function for any atomistic model.

36 MATERIALS SCIENCE↗

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗

Performance of the CMS missing transverse momentum reconstruction in pp data at $\sqrt{s}$ = 8 TeV

The performance of missing transverse energy reconstruction algorithms is presented by our team using√s=8 TeV proton-proton (pp) data collected with the CMS detector. Events with anomalous missing transverse energy are studied, and the performance of algorithms used to identify and remove these events is presented. The scale and resolution for missing transverse energy, including the effects of multiple pp interactions (pileup), are measured using events with an identified Z boson or isolated photon, and are found to be well described by the simulation. Novel missing transverse energy reconstruction algorithms developed specifically to mitigate the effects of large numbers of pileup interactions on the missing transverse energy resolution are presented. These algorithms significantly reduce the dependence of the missing transverse energy resolution on pileup interactions. Furthermore, an algorithm that provides an estimate of the significance of the missing transverse energy is presented, which is used to estimate the compatibility of the reconstructed missing transverse energy with a zero nominal value.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Probing Few-Body Nuclear Dynamics via H 3 and He 3 ( e , e ' p ) pn Cross-Section Measurements

Here, we report the first measurement of the (e, e' p) three-body breakup reaction cross sections in helium-3 ( 3 He) and tritium ( 3 H) at large momentum transfer ($\langle{Q^2}\rangle$ ≈ 1.9 (GeV/c) 2 ) and x B > 1 kinematics, where the cross section should be sensitive to quasielastic (QE) scattering from single nucleons. The data cover missing momenta 40 ≤ p miss ≤ 500 MeV/c that, in the QE limit with no rescattering, equals the initial momentum of the probed nucleon. The measured cross sections are compared with state-of-the-art ab-initio calculations. Overall good agreement, within ±20%, is observed between data and calculations for the full p miss range for 3 H and for 100 ≤ p miss ≤ 350 MeV/c for 3 He. Including the effects of rescattering of the outgoing nucleon improves agreement with the data at p miss > 250 MeV/c and suggests contributions from charge-exchange (SCX) rescattering. The isoscalar sum of 3 He plus 3 H, which is largely insensitive to SCX, is described by calculations to within the accuracy of the data over the entire pmiss range. This validates current models of the ground state of the three-nucleon system up to very high initial nucleon momenta of 500 MeV/c.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quality control of solar radiation data within the RMIB solar measurements network

Assessment of the solar resource is based upon measured data, where available. However, with any measurement there exist errors. Consequently, solar radiation data do not exhibit necessarily the same reliability and it often happens that users face time series of measurements containing questionable values though preliminary technical control has been done before the data release. To overcome such a situation, a major effort has been undertaken at the Royal Meteorological Institute of Belgium (RMIB) to develop procedures and software for performing post-measurement quality control of solar data from the radiometric stations of our in situ solar monitoring network. Moreover, because solar energy applications usually need continuous time series of solar radiation data, additional procedures have also been established to fill missing values (data initially lacking or removed via quality checks). (author)

14 SOLAR ENERGY↗

AGC-4 Experiment Irradiation Monitoring Data Qualification Interim Report

The Graphite Technology Development Program is running a series of six experiments to quantify the effects of irradiation on nuclear grade graphite. The fourth experiment, Advanced Graphite Creep 4 (AGC 4), began with Advanced Test Reactor (ATR) cycle 157D on May 30, 2015, and has been irradiated for two cycles. The capsule was removed from the reactor after ATR cycle 158A, which ended on January 2, 2016, due to interference with another experiment. Irradiation will resume when the interfering experiment is removed from the reactor. This report documents qualification of AGC 4 experiment irradiation monitoring data for use by the Advanced Reactor Technologies (ART) Technology Development Office (TDO) Program for research and development activities required to design and license the first HTR nuclear plant. Qualified data meet the requirements for use as described in the experiment planning and quality assurance documents. Failed data do not meet the requirements and provide no useable information. Trend data may not meet all requirements, but still provide some useable information. Use of Trend data requires assessment of how any deficiencies affect a particular use of the data. All thermocouples (TCs) have functioned throughout the AGC-4 experiment. All temperature data are Qualified for use by the ART TDO Program. Argon, helium, and total gas flow data were within expected ranges and are Qualified for use by the ART TDO Program. Discharge gas line moisture values were consistently low during cycle 157D. At the start of cycle 158A, gas moisture briefly spiked to over 600 ppmv and then declined throughout the cycle. Moisture values are within the measurement range of the instrument and are Qualified for use by the ART TDO Program. Graphite creep specimens were subjected to one of three loads, 393, 491, or 589 lbf. For a brief period during cycle 157D between 12:19 on June 2, 2015 and 08:23 on June 11, 2015 the load cells were wired incorrectly resulting in missing stack load data. Missing stack loads were estimated from measured ram pressures using regression equations developed from the existing data from cycle 157D. Estimated stack loads during this period are considered to be an accurate representation of actual load applied to the stacks. These loads deviate slightly from the planned loads. This deviation does not prevent the data from being Qualified for use, but must be taken into account when analyzing the effect of load on creep. Stack displacement increased consistently throughout the first two cycles with total displacement ranging from 0.4 to 0.8 in. During ATR outages, a set of pneumatic rams raised the stacks of graphite creep specimens to ensure the specimens were not stuck within the test train. This stack raising was performed twice. All stacks were raised successfully each time. The load and displacement data are Qualified for use by the ART TDO Program.

36 MATERIALS SCIENCE↗

Estimation of missing values in solar radiation data using piecewise interpolation methods: Case study at Penang city

The solar radiation values have been composed by automatic weather station using the device that namely pyranometer. The device is functions to records all the radiation values that have been dispersed, and these data are very useful for it experimental works and solar device’s development. In addition, for modeling and designing on solar radiation system application is needed for complete data observation. Unfortunately, lack for obtained the complete solar radiation data frequently occur due to several technical problems, which mainly contributed by monitoring device. Into encountering this matter, estimation missing values in an effort to substitute absent values with imputed data. This paper aimed to evaluate several piecewise interpolation techniques likes linear, splines, cubic, and nearest neighbor into dealing missing values in hourly solar radiation data. Then, proposed an extendable work into investigating the potential used of cubic Bezier technique and cubic Said-ball method as estimator tools. As result, methods for cubic Bezier and Said-ball perform the best compare to another piecewise imputation technique.

14 SOLAR ENERGY↗

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗

Using gap-filled MAIAC AOD and WRF-Chem to estimate daily PM 2.5 concentrations at 1 km resolution in the Eastern United States

To link short-term exposures of air pollutants to health outcomes, scientists must use high temporal and spatial resolution estimates of PM 2.5 concentrations. We develop a daily PM 2.5 product at 1 × 1 km 2 spatial resolution across the eastern United States (east of 90° W) with the aid of 1 × 1 km 2 MAIAC aerosol optical depth (AOD) data, 36 × 36 km 2 WRF-Chem output, 1 × 1 km 2 land-use type from the National Land Cover Database, and 0.125° × 0.125° ERA-Interim re-analysis meteorology. A gap-filling technique is applied to MAIAC AOD data to construct robust daily estimates of AOD when the satellite data are missing (e.g., areas obstructed by clouds or snow cover). The input data are incorporated into a multiple-linear regression model trained to surface observations of PM 2.5 from the EPA Air Quality System (AQS) monitoring network. The model generates a high-fidelity estimate (r 2 = 0.75 using a 10-fold random cross-validation) of daily PM 2.5 throughout the eastern United States. Of the inputs to the statistical model, WRF-Chem output (r 2 = 0.66) is the most important contributor to the skill of the model. MAIAC AOD is also a strong contributor (r 2 = 0.52). Daily PM 2.5 output from our statistical model can be easily integrated into county-level epidemiological studies. The novelty of this project is that we are able to simulate PM 2.5 in a computationally efficient manner that is constrained to ground monitors, satellite data, and chemical transport model output at high spatial resolution (1 × 1 km 2 ) without sacrificing the temporal resolution (daily) or spatial coverage (>2,000,000 km 2 ).

47 OTHER INSTRUMENTATION↗

Leveraging Application Data Constraints to Optimize Database-Backed Web Applications

Exploiting the relationships among data is a classical query optimization technique. As persistent data is increasingly being created and maintained programmatically, prior work that infers data relationships from data statistics misses an important opportunity. We present Coco, the first tool that identifies data relationships by analyzing database-backed applications. Once identified, Coco leverages the constraints to optimize the application's physical design and query execution. Instead of developing a fixed set of predefined rewriting rules, Coco employs an enumerate-test-verify technique to automatically exploit the discovered data constraints to improve query execution. Each resulting rewrite is provably equivalent to the original query. Using 14 real-world web applications, our experiments show that Coco can discover numerous data constraints from code analysis and improve real-world application performance significantly.

Computer Science↗

MPS dose reconstruction for internal emitters: some site-specific issues and approaches

Background: As part of the Million Person Study (MPS), dose reconstructions for internal emitters have been performed for several U.S. facilities where large quantities of radionuclides were handled. The main challenges and dominant sources of potential error in retrospective dose estimates for internally exposed workers have been found to vary from site to site. Here in this paper, we discuss some important issues encountered in dose reconstructions performed for selected MPS sites and the approaches used to address those issues. The focus is on some foundational components of retrospective dose assessments that have received little attention in the literature. Methods: The discussion is built around illustrative exposure data and dose reconstructions for workers at selected facilities addressed in the MPS. Related findings at some non-MPS sites are also discussed. Results: Each of the following items has been found to be a major source of potential error in reconstructed tissue doses for some MPS sites: identification of all dosimetrically important internal emitters; the time pattern of intake; the mode(s) of intake; reliability of bioassay measurements; application of surrogate (coworker) information in lieu of, or in conjunction with, worker-specific monitoring data; the chemical and physical forms of inhaled radionuclide; and the relation of air monitoring data to actual intake. Conclusions: (1) Much of the dose reconstruction effort for internal emitters should be devoted to development of best feasible exposure scenarios. (2) Coworker data should be used to assign exposure scenarios or dose estimates to workers with missing exposure data only if there is compelling evidence of similar coworker exposure. (3) Bioassay data for some radionuclides and periods of operation at MPS sites are of questionable reliability due to sizable uncertainties associated with contamination, recovery, or background issues. (4) Dose estimates derived solely from air monitoring data should be treated as highly uncertain values in the absence of site-specific information demonstrating that the data are reasonably predictive of intake. (5) For intakes known or assumed to be via inhalation, the uncertainty in lung dose typically is much greater than the uncertainty in dose to systemic tissues, when dose estimates are based on urinary excretion data. (6) The lung dose estimate often can be improved through development of site-specific respiratory absorption parameter values. (7) There is generally insufficient site-specific information to justify development of site-specific systemic models.

61 RADIATION PROTECTION AND DOSIMETRY↗

An Approach for Setting Priorities for Experimental Studies in Support of Safety Assessments - 19393

Many experiments have been conducted, in both academia and industry, to support the understanding of the disposal of radioactive waste. For the disposal of low-level radioactive waste (LLW) into radioactive waste repositories, it is important to develop an approach to tackle which datasets are able to directly underpin safety assessments, and what future research experiments could address the gaps in this understanding. In this paper, we present an approach to identify which future experiments should be considered to underpin safety assessments for disposals of LLW in a near-surface repository. The approach involves 6-steps: define the disposal problem (e.g. the disposal of LLW in engineered vaults); determine what key processes may affect the disposal of the waste; establish the assumptions underpinning the key processes; determine how sensitive the key process parameters are to variation; determine whether key data are available and assess the quality of that data with respect to the disposal problem; and determine attributes for experiments needed to supply missing key data. We show, in this paper, how this approach can be used to develop a better understanding of C-14 gas generation, under varying degrees of groundwater saturation, for the disposal of LLW into engineered vaults, in the near-surface. Furthermore, we have developed an approach that identifies the types of experiments and their attributes to aid researchers to help select appropriate types of experiments to underpin safety assessments. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗