SEARCH · Engineering Papers
Results for “missing data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A Data Quality-Aware Framework to Reliably Forecast Photovoltaic Generation and Consumer Load for an Improved Resilience of Microgrids
Photovoltaic (PV) power and consumer load forecasting plays a critical role to ensure operational resilience of the electric grid. Most data-driven forecasting algorithms rely heavily on the continuous availability of good quality data for periodic training and validation. When deployed at the grid’s edge, prolonged disruptions to communications during extreme events degrade data quality. Factors such as missing observations, epistemic uncertainties, data drift, and concept drift are manifestations of data quality that impact the generalization of such field-deployed forecasting models. Currently, there exists no mechanism in the literature to dynamically switch between models under varying degrees of data quality as quantified by certain metrics for each factor highlighted above. This paper addresses this shortcoming by conceptually introducing a data qualityaware framework for reliable PV generation and consumer load forecasting. The framework’s design incorporates components of missing values, divergence tests, and continuous monitoring of generalization performance to detect changes in data quality caused by communications disruptions and trigger specific classes of forecasting models grouped under three use cases (UC1- UC3). As a first step towards validating this framework, real data collected from an actual field microgrid system is used to demonstrate the viability of the three use cases. Results show that the performance is the best in UC1 with an unadjusted R-square value of 0.954, followed by 0.939 for UC2 and 0.757 for UC3.
An algorithm to estimate the object support in truncated images
Purpose: Truncation artifacts in CT occur if the object to be imaged extends past the scanner field of view (SFOV). These artifacts impede diagnosis and could possibly introduce errors in dose plans for radiation therapy. Several approaches exist for correcting truncation artifacts, but existing correction algorithms do not accurately recover the skin line (or support) of the patient, which is important in some dose planning methods. The purpose of this paper was to develop an iterative algorithm that recovers the support of the object. Methods: The authors assume that the truncated portion of the image is made up of soft tissue of uniform CT number and attempt to find a shape consistent with the measured data. Each known measurement in the sinogram is interpreted as an estimate of missing mass along a line. An initial estimate of the object support is generated by thresholding a reconstruction made using a previous truncation artifact correction algorithm (e.g., water cylinder extrapolation). This object support is iteratively deformed to reduce the inconsistency with the measured data. The missing data are estimated using this object support to complete the dataset. The method was tested on simulated and experimentally truncated CT data. Results: The proposed algorithm produces a better defined skin line than water cylinder extrapolation. On the experimental data, the RMS error of the skin line is reduced by about 60%. For moderately truncated images, some soft tissue contrast is retained near the SFOV. As the extent of truncation increases, the soft tissue contrast outside the SFOV becomes unusable although the skin line remains clearly defined, and in reformatted images it varies smoothly from slice to slice as expected. Conclusions: The support recovery algorithm provides a more accurate estimate of the patient outline than thresholded, basic water cylinder extrapolation, and may be preferred in some radiation therapy applications.
Search for supersymmetry in final states with jets, missing transverse momentum and one isolated lepton in s = 7 TeV pp collisions using 1 fb − 1 of ATLAS data
Not Available
Search for squarks and gluinos with the ATLAS detector in final states with jets and missing transverse momentum using $\sqrt{s}=8 $ TeV proton-proton collision data
A search for squarks and gluinos in final states containing high-p T jets, missing transverse momentum and no electrons or muons is presented. The data were recorded in 2012 by the ATLAS experiment in $ \sqrt{s} $ = 8 TeV proton-proton collisions at the Large Hadron Collider, with a total integrated luminosity of 20.3 fb -1 . Results are interpreted in a variety of simplified and specific supersymmetry-breaking models assuming that R-parity is conserved and that the lightest neutralino is the lightest supersymmetric particle. An exclusion limit at the 95% confidence level on the mass of the gluino is set at 1330 GeV for a simplified model incorporating only a gluino and the lightest neutralino. For a simplified model involving the strong production of first- and second-generation squarks, squark masses below 850 GeV (440 GeV) are excluded for a massless lightest neutralino, assuming mass degenerate (single light-flavour) squarks. In mSUGRA/CMSSM models with tan β = 30, A 0 = -2m 0 and μ > 0, squarks and gluinos of equal mass are excluded for masses below 1700 GeV. Additional limits are set for non-universal Higgs mass models with gaugino mediation and for simplified models involving the pair production of gluinos, each decaying to a top squark and a top quark, with the top squark decaying to a charm quark and a neutralino. These limits extend the region of supersymmetric parameter space excluded by previous searches with the ATLAS detector.
Some indication for a missing chiral partner {eta}{sub 4} around 2 GeV
The high-lying mesons in the light quark sector previously obtained from the partial wave analysis of the proton-antiproton annihilation in flight at 1.9-2.4 GeV region at CERN reveal a very high degree of degeneracy. This degeneracy can be explained as due to an effective restoration of both SU(2){sub L}xSU(2){sub R} and U(1){sub A} symmetries combined with a principal quantum number {approx}n+J. In this case there must be chiral partners for the highest spin states in the 2 and 2.3 GeV bands presently missing in the data. Here we reanalyze the Crystal Barrel data and show an indication for existence of the missing 4{sup -+} state around 2 GeV. This result calls for further experimental search of the missing states both in the proton-antiproton annihilation and in the production reactions.
Sensor Data Management, Validation, Correction, and Provenance for Building Technologies
Oak Ridge National Laboratory (ORNL) conducts research on technologies that use a wide range of sensors to develop and characterize building energy performance. The management of high-resolution sensor data, analysis, and tracing lineage of such activities is challenging. Missing or corrupt data due to sensor failure, fouling, drifting, calibration error, or data logger failure is another issue. This paper focuses on sensor data management, validation, correction, and provenance to combat these issues, ensuring complete and accurate sensor datasets for building technologies applications and research. The design and development of two integrated software products are discussed: Sensor Data Validation and Correction (SensorDVC) and the Provenance Data Management System (ProvDMS) platform.
Observation of large missing-momentum ( e , e ' p ) cross-section scaling and the onset of correlated-pair dominance in nuclei
Herein we report the first measurement of $x_B$-scaling in $(e,e'p)$ cross-section ratios off nuclei relative to deuterium at large missing-momentum of $350 \leq p_{miss} \leq 600$ MeV/c. The observed scaling extends over a kinematic range of $0.7 \leq x_B \leq 1.8$, which is significantly wider than $1.4 \leq x_B \leq 1.8$ previously observed for inclusive $(e,e')$ cross-section ratios. The $x_B$-integrated cross-section ratios become constant (i.e., scale) beginning at $p_{miss}\approx k_F$, the nuclear Fermi momentum. Comparing with theoretical calculations we find good agreement with Generalized Contact Formalism calculations for high missing-momentum ($> 375$ MeV/c), suggesting the observed scaling results from interacting with nucleons in short-range correlated (SRC) pairs. For low missing-momenta, mean-field calculations show good agreement with the data for $p_{miss}\le k_F$, and suggest that contributions to the measured cross-section ratios from scattering off single, un-correlated, nucleons are non-negligible up to $p_{miss}\approx 350$ MeV/c. Therefore, SRCs become dominant in nuclei at $p_{miss}\approx 350$ MeV/c, well above the nuclear Fermi Surface of $k_F \approx 250$ MeV/c.
First Observation of Large Missing-Momentum (e,e'p) Cross-Section Scaling and the onset of Correlated-Pair Dominance in Nuclei
We report the first measurement of $x_B$-scaling in $(e,e'p)$ cross-section ratios off nuclei relative to deuterium at large missing-momentum of $350 \leq p_{miss} \leq 600$ MeV/c. The observed scaling extends over a kinematic range of $0.7 \leq x_B \leq 1.8$, which is significantly wider than $1.4 \leq x_B \leq 1.8$ previously observed for inclusive $(e,e')$ cross-section ratios. The $x_B$-integrated cross-section ratios become constant (i.e., scale) beginning at $p_{miss}\approx k_F$, the nuclear Fermi momentum. Comparing with theoretical calculations we find good agreement with Generalized Contact Formalism calculations for high missing-momentum ($> 375$ MeV/c), suggesting the observed scaling results from interacting with nucleons in short-range correlated (SRC) pairs. For low missing-momenta, mean-field calculations show good agreement with the data for $p_{miss}\le k_F$, and suggest that contributions to the measured cross-section ratios from scattering off single, un-correlated, nucleons are non-negligible up to $p_{miss}\approx 350$ MeV/c. Therefore, SRCs become dominant in nuclei at $p_{miss}\approx 350$ MeV/c, well above the nuclear Fermi Surface of $k_F \approx 250$ MeV/c.
Improving Quality of Observational Streaming Medical Data by Using Long Short-Term Memory Networks (LSTMs)
We present an exploration of the encoder-decoder structured Long Short-Term Memory Network (LSTM) as a detector of the anomalous missing observations in streaming medical data by using the difference between the LSTM-reconstructed and observed values as the anomaly detector. We experiment with time-series data from bedside monitoring devices from the available Medical Information Mart for Intensive Care Database (MIMIC). Our results show that not only encoder-decoder LSTM approach works well for detecting the difference between anomalous and normal missing observations in streaming medical data, but also has an imputation potential for the missing data.
Search for dark matter candidates and large extra dimensions in events with a photon and missing transverse momentum in p p collision data at s = 7 TeV with the ATLAS detector
CERN-LHC. Search for new phenomena in events with a final state containing an energetic photon and large missing transverse momentum in proton-proton collisions at a centre-of-mass energy off 7 TeV. The data were collected during 2011 and have a total integrated luminosity of 4.6 fb-1. Agreement with Standard Model predictions is found to be good with an observed number of events in the data compared with a predicted number of 137.
A DARK ENERGY CAMERA SEARCH FOR AN OPTICAL COUNTERPART TO THE FIRST ADVANCED LIGO GRAVITATIONAL WAVE EVENT GW150914
We report the results of a deep search for an optical counterpart to the gravitational wave (GW) event GW150914, the first trigger from the Advanced LIGO GW detectors. We used the Dark Energy Camera (DECam) to image a 102 deg{sup 2} area, corresponding to 38% of the initial trigger high-probability sky region and to 11% of the revised high-probability region. We observed in the i and z bands at 4–5, 7, and 24 days after the trigger. The median 5 σ point-source limiting magnitudes of our search images are i = 22.5 and z = 21.8 mag. We processed the images through a difference-imaging pipeline using templates from pre-existing Dark Energy Survey data and publicly available DECam data. Due to missing template observations and other losses, our effective search area subtends 40 deg{sup 2}, corresponding to a 12% total probability in the initial map and 3% in the final map. In this area, we search for objects that decline significantly between days 4–5 and day 7, and are undetectable by day 24, finding none to typical magnitude limits of i = 21.5, 21.1, 20.1 for object colors ( i − z ) = 1, 0, −1, respectively. Our search demonstrates the feasibility of a dedicated search program with DECam and bodes well for future research in this emerging field.
Search for supersymmetry in events with large missing transverse momentum, jets, and at least one tau lepton in 7 TeV proton-proton collision data with the ATLAS detector
A search for supersymmetry (SUSY) in events with large missing transverse momentum, jets, and at least one hadronically decaying τ lepton, with zero or one additional light lepton (e/μ), has been performed using 4.7 fb -1 of proton-proton collision data at √s = 7 TeV recorded with the ATLAS detector at the Large Hadron Collider. No excess above the Standard Model background expectation is observed and a 95 % confidence level visible cross-section upper limit for new phenomena is set. In the framework of gauge-mediated SUSY-breaking models, lower limits on the mass scale Λ are set at 54 TeV in the regions where the τ 1 is the next-to-lightest SUSY particle (tanβ > 20). These limits provide the most stringent tests to date of GMSB models in a large part of the parameter space considered.
Search for Dark Matter Candidates and Large Extra Dimensions in Events with a Photon and Missing Transverse Momentum in pp Collision Data at root s=7 TeV with the ATLAS Detector
N/A
Real-Time Highly Resolved Spatial-Temporal Vehicle Energy Consumption Estimation Using Machine Learning and Probe Data
Real-time highly resolved spatial-temporal vehicle energy consumption is a key missing dimension in transportation data. Most roadway link-level vehicle energy consumption data are estimated using average annual daily traffic measures derived from the Highway Performance Monitoring System; however, this method does not reflect day-to-day energy consumption fluctuations. As transportation planners and operators are becoming more environmentally attentive, they need accurate real-time link-level vehicle energy consumption data to assess energy and emissions; to incentivize energy-efficient routing; and to estimate energy impact caused by congestion, major events, and severe weather. This paper presents a computational workflow to automate the estimation of time-resolved vehicle energy consumption for each link in a road network of interest using vehicle probe speed and count data in conjunction with machine learning methods in real time. The real-time pipeline can deliver energy estimates within a couple seconds on query to its interface. The proposed method was evaluated on the transportation network of the metropolitan area of Chattanooga, Tennessee. The volume estimation results were validated with ground truth traffic volume data collected in the field. To demonstrate the effectiveness of the proposed method, the energy consumption pipeline was applied to real-world data to quantify road transportation-related energy reduction because of mitigation policies to slow the spread of COVID-19 and to measure energy loss resulting from congestion.
Multimodal Data Fusion via Entropy Minimization
The use of gradient-based data-driven models to solve a range of real-world remote sensing problems can in practice be limited by the uniformity of available data. Use of data from disparate sensor types, resolutions, and qualities typically requires compromises based on assumptions that are made prior to model training and may not necessarily be optimal given over-arching objectives. For example, while deep neural networks (NNs) are state-of-the-art in a variety of target detection problems, training them typically requires either limiting the training data to a subset over which uniformity can be enforced or training independent models which subsequently require additional score fusion. The method we introduce here seeks to leverage the benefits of both approaches by allowing correlated inputs from different data sources to co-influence preferred model solutions, while maintaining flexibility over missing and mismatching data. In this work we propose a new data fusion technique for gradient updated models based on entropy minimization and experimentally validate it on a hyperspectral target detection dataset. We demonstrate superior performance compared to currently available techniques using a range of realistic data scenarios, where available data has limited spacial overlap and resolution.
United States Industrial Sector Energy End Use Analysis
The United States Department of Energy’s (DOE) Energy Information Administration (EIA) conducts the Manufacturing Energy Consumption Survey (MECS) to provide detailed data on energy consumption in the manufacturing sector. The survey is a sample of approximately 15,000 manufacturing establishments selected from the Economic Census - Manufacturing Sector. MECS provides statistics on the consumption of energy by end uses (e.g., boilers, process, electric drives, etc.) disaggregated by North American Industry Classification System (NAICS) categories. The manufacturing sector (NAICS Sector 31-33) consists of all manufacturing establishments in the 50 States and the District of Columbia. According to the NAICS, the manufacturing sector comprises establishments engaged in the mechanical, physical, or chemical transformation of materials, substances, or components into new products. The establishments are physical facilities such as plants, factories, or mills. For many of the sectors in the MECS datasets, information is missing because the reported energy use is less than 0.5 units or BTUs, or is withheld to avoid disclosing data for individual establishments, or is withheld because the standard error is greater than 50%. We infer what the missing information likely are using several approximations techniques. First, much of the missing data can be easily calculated by adding or subtracting other values reported by MECS. If this is not possible (e.g. two data are missing), we look at historic MECS reports to help identify the breakdown of energy use in the past and assume it remained the same for the current MECS. Lastly, if historic data is also missing, we assume that 3 digit NAICS classifications predict energy use in their 4, 5, or 6 digit NAICS sub-classifications, or vice versa. Along with addressing data gaps, end use energy is disaggregated beyond the specified MECS allocations using additional industry specific energy consumption data. The result is a completed table of energy end use by sector with mechanical drives broken down by pumps, fans, compressed air, and drives.