Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Loss tolerant speech decoder for telecommunications

A method and device for extrapolating past signal-history data for insertion into missing data segments in order to conceal digital speech frame errors. The extrapolation method uses past-signal history that is stored in a buffer. The method is implemented with a device that utilizes a finite-impulse response (FIR) multi-layer feed-forward artificial neural network that is trained by back-propagation for one-step extrapolation of speech compression algorithm (SCA) parameters. Once a speech connection has been established, the speech compression algorithm device begins sending encoded speech frames. As the speech frames are received, they are decoded and converted back into speech signal voltages. During the normal decoding process, pre-processing of the required SCA parameters will occur and the results stored in the past-history buffer. If a speech frame is detected to be lost or in error, then extrapolation modules are executed and replacement SCA parameters are generated and sent as the parameters required by the SCA. In this way, the information transfer to the SCA is transparent, and the SCA processing continues as usual. The listener will not normally notice that a speech frame has been lost because of the smooth transition between the last-received, lost, and next-received speech frames.

Prieto, Jr., Jaime L.↗
NASA NTRS2012

NLSI Focus Group on Recovery of Missing ALSEP Data: Status Update for 2012 NLSI Science Forum

On the six Apollo lunar landed missions, the Astronauts deployed the Apollo Lunar Surface Experiments Package (ALSEP) science stations which measured active and passive seismic events, magnetic fields, charged particles, solar wind, heat flow, the diffuse atmosphere, meteorites and their ejecta, lunar dust, etc. Today s investigators are able to extract new information and make new discoveries from the old ALSEP data utilizing recent advances in computer capabilities and new analysis techniques. However, current-day investigators are encountering problems in trying to use the ALSEP data. The data were in formats often not well described in the published reports and contained rerecording anomalies which required tape experts to resolve. To solve these problems the DPS Lunar Data Node was established at NASA Goddard Space Flight Center (GSFC) NASA Space Science Data Center (NSSDC) in 2008 and is currently in the process of making the existing archived ALSEP data available to current-day investigators in easily useable forms. However, current estimates by NSSDC archivists are that only about 60 percent of the PI processed ALSEP data and less than 30 percent of the raw experiment ALSEP data-of-interest to current lunar science investigators are currently in the NSSDC archives.

Lewis, Lyach R.↗
DOE OSTI2025

Predicting Large‐Scale Systematic Missing Pipe Attributes in Water Distribution Networks

Water distribution network (WDN) models are an essential tool used by water utilities for hydraulic analysis. Unfortunately, missing data and insufficient resources often make creating and maintaining these models unfeasible. Existing methods to address missing pipe properties, like sequential imputation for missing values and reconstruction using graph metrics, are designed to accommodate random patterns of missing information and require a significant percentage of the system's attributes to be known. However, these data completeness assumptions do not always align with real‐world scenarios where large sections of the WDN model have missing data. To address this challenge, this study proposes a data‐driven approach for estimating pipe diameter when considering different spatial patterns and degrees of data completeness (i.e., 0%–90%). Using data from 16 WDNs in Kentucky, this study compares the use of machine learning (ML) using topological and geospatial features against an existing deterministic approach. Results demonstrate that WDN models with pipe diameters predicted by the proposed ML method had comparable hydraulic performance to the ground truth models. Moreover, results showed that ML method performance varies between WDNs of differing topological classification. Insights from this study help advance the ability to leverage partial data to create and maintain WDN models amid uncertainty and inadequate resources.

Poff, Jason W. [Oregon State Univ., Corvallis, OR ↗
DOE OSTI2020

Key Nuclear Data Impacting Reactivity in Advanced Reactors

Advanced reactor concepts currently being developed throughout the industry are significantly different from light water reactor (LWR) designs with respect to geometry, materials, and operating conditions, and consequently, with respect to their reactor physics behavior. Given the limited operating experience with non-LWRs, the accurate simulation of reactor physics and the quantification of associated uncertainties are critical for ensuring that advanced reactor concepts operate within the appropriate safety margins. Nuclear data are a major source of input uncertainties in reactor physics analysis. As part of an ongoing project at Oak Ridge National Laboratory (ORNL), the effects of nuclear data uncertainties on key figures of merit associated with advanced reactor safety are being assessed for selected advanced reactor technologies. Key nuclear data relevant for reactor safety analysis for each selected advanced reactor technology were identified, and their impact on important key figures of merit was assessed. Available advanced reactor specifications were reviewed, results from studies performed at ORNL and other research institutions were consulted, and available evaluated nuclear data libraries were analyzed. This report summarizes the key nuclear data for nuclides in the fuel, as well as other significant data, including scattering and neutron capture in various materials for the moderator, coolant, and structure of the considered advanced reactors. For the considered advanced reactors that use low-enriched uranium (LEU) fuel, results from LWR studies provided insight into relevant nuclear data given the lack of available studies specifically addressing these new systems. The major nominal missing data that were identified consist of thermal scattering data and 135m Xe cross section data for molten salt reactor (MSR) analysis. The identified major gaps with respect to nuclear data uncertainties are missing uncertainties of thermal scattering data for high temperature gas-cooled reactors and moderated MSR systems, and incomplete uncertainties on angular distributions in particular for fast spectrum systems, such as sodiumcooled fast reactors, fast molten salt reactors, and heat pipe reactors. Furthermore, it was found that special attention should be paid to cross section and uncertainty differences between different evaluated nuclear data library releases, because significant differences in nuclear data that can lead to major differences in reactivity calculations were found, even for well-known nuclides.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2015

AWARE Shortwave Spectroradiometer Data

Shortwave spectral irradiance was measured at the West Antarctic Ice Sheet (WAIS) Divide Ice Camp as part of the ARM West Antarctic Radiation Experiment (AWARE). A Panalytical (Inc.) FieldSpec Pro Jr spectroradiometer belonging to Scripps Oceanography recorded downwelling spectral irradiance every minute covering the wavelength interval 350-2200 nm . Spectral resolution is 3 nm (10 nm) for wavelengths shorter (longer) than 1000 nm. Temporal coverage is nearly continuous between 8 December 2015 and 18 January 2016, with a few minutes of data missing during each day for data backup and optical collector hygiene. Spectral irradiances, particularly in the near infrared, are sensitive to cloud optical depth, thermodynamic phase, and effective particle size.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Gaseous Ammonia Measurements at the S2 site for the CoURAGE campaign

This dataset contains measurements of gaseous ammonia (NH3(g)) at the S2 (Mt. Airy) site during the CoURAGE study from April to June 2025. This dataset includes 10-minute and 30-minute average NH3(g) concentrations in units of micrograms per cubic meter. Measurements are conducted with an AiRRmonia NH3 analyzer manufactured by RR Mechatronics. A data flag of -999 indicates missing data due to the instrument being offline (maintenance, calibration, etc.) while a data flag of -888 indicates measurements below the instrument LOD (LOD = 0.1 micrograms per cubic meter). The uncertainty of the measurements is 15%.

AiRRmonia NH3 analyzer↗
NASA NTRS1982

Worst case earth charging environment

The Applications Technology Satellite-6 (ATS-6) geosynchronous satellite charged up to -2200 V in sunlight on day 178, 1974. This event, being the highest known spacecraft charging event in sunlight, is used to estimate a worst case geosynchronous plasma environment for predicting the spacecraft potential in eclipse. The advantage of using this sunlight spectrum as opposed to an eclipse case is that the ion and electron fluxes to the detectors are shifted only slightly due to the spacecraft potential. After correcting the available data for satellite potential and missing data above 81 KeV, it is found that the plasma can be characterized by a single Maxwellian approximation having an electron density of 1.22/cu cm, electron temperature of 16 KeV, hydrogen ion density of 0.24/cu cm, and hydrogen ion temperature of 29 KeV. In eclipse the spacecraft would have charged up to -28 kV, the highest estimated potential to date in the earth's plasma environment.

Deutsch, M.-J. C.↗
NASA NTRS1999

Bond Dissociation Energies of the Tungsten Fluorides and Their Singly-Charged Ions: A Density Functional Survey

The dissociation of WF6 and the related singly-charged cations and anions into the lower fluorides and fluorine atoms has been investigated theoretically using density functional theory (B3LYP) and relativistic effective core potentials, with estimates of spin-orbit effects included using a simple model. The inclusion of spin-orbit is essential for a correct description of the thermochemistry. The total atomization energy of the neutral and anionic WF6 is reproduced to within 25 kcal/mol, but comparison of individual bond dissociation energies with available experimental data shows discrepancies of up to 10 kcal/mol. The results are nevertheless useful to help resolve discrepancies in experimental data and provide estimates of missing data.

Dyall, Kenneth G.↗
NASA NTRS2008

Visual Data Analysis for Satellites

The Visual Data Analysis Package is a collection of programs and scripts that facilitate visual analysis of data available from NASA and NOAA satellites, as well as dropsonde, buoy, and conventional in-situ observations. The package features utilities for data extraction, data quality control, statistical analysis, and data visualization. The Hierarchical Data Format (HDF) satellite data extraction routines from NASA's Jet Propulsion Laboratory were customized for specific spatial coverage and file input/output. Statistical analysis includes the calculation of the relative error, the absolute error, and the root mean square error. Other capabilities include curve fitting through the data points to fill in missing data points between satellite passes or where clouds obscure satellite data. For data visualization, the software provides customizable Generic Mapping Tool (GMT) scripts to generate difference maps, scatter plots, line plots, vector plots, histograms, timeseries, and color fill images.

Lau, Yee↗
DOE OSTI2018

Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) Winter Intensive Operational Period: Aerodynamic Particle Sizer Field Campaign Report

An aerodynamic particle sizer spectrometer (APS, model 3321 by TSI Inc., Shoreview, Minnesota) was deployed at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility Eastern North Atlantic (ENA) observatory during the second (winter) intensive operational period (IOP) of the Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) field campaign. Data were collected from January 9 through February 26, 2018, covering the second deployment of the ARM Aerial Facility (AAF) aircraft within ACE-ENA. The standard ENA instrument suite does not provide measurements of aerosol particle size distribution for diameters greater than one micron. Properties of coarse-mode (super-micron) aerosols are rarely measured, although super-micron particles can play an important role in the aerosol life cycle, affecting aerosol optical properties and cloud nuclei activity (e.g., Clarke et al. 2003). The APS was deployed to fill this gap in particle size measurements: it is capable of measuring size-resolved concentration of the aerosols in the 0.5-20 μm range (aerodynamic diameter). The APS was installed in the aerosol trailer to sample through the main stack. Special attention was given to selection of the instrument location (just below the main stack) to minimize particle losses in the connecting lines. Most atmospheric aerosols are hygroscopic, so the measurement of the aerosol size distributions should either be performed in a controlled humidity environment or accompanied by concurrent measurement of the temperature and humidity of the sample air. The latter strategy was used during this deployment: a high-precision humidity/temperature transmitter (model EE08 by E+E Elektonik GMBH, Engerwitzdorf, Germany) was mounted in the APS sampling line immediately upstream of the APS inlet. A dedicated laptop computer was used for data collection and communications. The APS was controlled with vendor-supplied software (Aerosol Instrument Manager, ver. 10.1, TSI); aerosol size distribution data were collected over a period of 55 seconds and converted to one-minute averages. Temperature and humidity analog signals were acquired via analog-to-digital converter (ADC) module (model WTAIN-M by Weeder Technologies, Fort Walton Beach, Florida) using vendor-supplied software (ModCom) with 1- sec resolution. In post-processing, the APS data were exported from TSI proprietary format into “comma-separated value” American Standard Code for Information Interchange (ASCII) files and matched with appropriately averaged temperature and humidity data. Two significant periods of missing data were caused by local power outages. Vendor-supplied software was not designed for unattended operation: it needs to be manually restarted including sensor configuration setup.

ACE-ENA, Azores, ultra-high-sensitivity aerosol sp↗
DOE OSTI2014

SU-E-T-524: Web-Based Radiation Oncology Incident Reporting and Learning System (ROIRLS)

Purpose: Describe a Web-based Radiation Oncology Incident Reporting and Learning system that has the potential to improve quality of care for radiation therapy patients. This system is an important facet of continuing effort by our community to maintain and improve safety of radiotherapy.Material and Methods: The VA National Radiation Oncology Program office has embarked on a program to electronically collect adverse events and near miss data of radiation treatment of over 25,000 veterans treated with radiotherapy annually. Software used for this program is deployed on the VAs intranet as a Website. All data entry forms (adverse event or near miss reports, work product reports) utilize standard causal, RT process step taxonomies and data dictionaries defined in AAPM and ASTRO reports on error reporting (AAPM Work Group Report on Prevention of Errors and ASTROs safety is no accident report). All reported incidents are investigated by the radiation oncology domain experts. This system encompasses the entire feedback loop of reporting an incident, analyzing it for salient details, and developing interventions to prevent it from happening again. The operational workflow is similar to that of the Aviation Safety Reporting System. This system is also synergistic with ROSIS and SAFRON. Results: The ROIRLS facilitates the collection of data that help in tracking adverse events and near misses and develop new interventions to prevent such incidents. The ROIRLS electronic infrastructure is fully integrated with each registered facility profile data thus minimizing key strokes and multiple entries by the event reporters. Conclusions: OIRLS is expected to improve the quality and safety of a broad spectrum of radiation therapy patients treated in the VA and fulfills our goal of Effecting Quality While Treating Safely The Radiation Oncology Incident Reporting and Learning System software used for this program has been developed, conceptualized and maintained by TSG Innovations Inc. and is deployed on the VA intranet as a Website. The Radiation Oncology Incident Reporting and Learning System software used for this program has been developed, conceptualized and maintained by TSG Innovations Inc. and is deployed on the VA intranet as a Website.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

SU-E-T-469: Implementation of VAs Web-Based Radiotherapy Incident Reporting and Analysis System (RIRAS)

Purpose: This Web-based Radiotherapy Incident Reporting and Analysis System (RIRAS) is a tool to improve quality of care for radiation therapy patients. This system is an important facet of continuing effort by our community to maintain and improve safety of radiotherapy.Material and Methods: VA’s National Radiation Oncology Program office has embarked on a program to electronically collect adverse events and good-catch data of radiation treatment of over 25,000 veterans treated with radiotherapy annually. This VA-Intranet based software design has made use of dataset taxonomies and data dictionaries defined in AAPM/ASTRO reports on error reporting. We used proven industrial and medical event reporting techniques to avoid several common problems faced in effective data collection such as incomplete data due to data entry fatigue by the reporters, missing data due to data difficult to obtain or not familiar to most reporters, missing reports due to fear of reprisal etc. This system encompasses the entire feedback loop of reporting an incident, analyzing it for salient details, and developing interventions to prevent it from happening again. The analysis reports with corrective, learning actions are shared with the reporter/facility and made public to the community (after deidentification) as part of the learning process. Results: Till date 50 incident/good catches have been reported in RIRAS and we have completed analysis on 100% of these reports. This is done due to the fact that each reported incidents is investigated and a complete analysis/patient-safety-work-product report is generated by radiation oncology domain-experts. Conclusions Because of the completeness of the data, the system has enabled us to analyze process steps and track trends of major errors which in the future will lead to implementing system wide process improvement steps and safe standard operating procedures for each radiotherapy treatment modality/technique and fulfills our goal of “Effecting Quality While Treating Safely”. RIRAS developed and copyrighted by TSG Innovations Inc.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Generalized Canonical Polyadic Tensor Decomposition

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor decomposition that allows other loss functions besides squared error. For instance, we can use logistic loss or Kullback--Leibler divergence, enabling tensor decomposition for binary or count data. We present a variety of statistically motivated loss functions for various scenarios. We provide a generalized framework for computing gradients and handling missing data that enables the use of standard optimization methods for fitting the model. Furthermore, we demonstrate the flexibility of the GCP decomposition on several real-world examples including interactions in a social network, neural activity in a mouse, and monthly rainfall measurements in India.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

How robust are estimates of key parameters in standard viral dynamic models?

Mathematical models of viral infection have been developed, fitted to data, and provide insight into disease pathogenesis for multiple agents that cause chronic infection, including HIV, hepatitis C, and B virus. However, for agents that cause acute infections or during the acute stage of agents that cause chronic infections, viral load data are often collected after symptoms develop, usually around or after the peak viral load. Consequently, we frequently lack data in the initial phase of viral growth, i.e., when pre-symptomatic transmission events occur. Missing data may make estimating the time of infection, the infectious period, and parameters in viral dynamic models, such as the cell infection rate, difficult. However, having extra information, such as the average time to peak viral load, may improve the robustness of the estimation. Here, we evaluated the robustness of estimates of key model parameters when viral load data prior to the viral load peak is missing, when we know the values of some parameters and/or the time from infection to peak viral load. Although estimates of the time of infection are sensitive to the quality and amount of available data, particularly pre-peak, other parameters important in understanding disease pathogenesis, such as the loss rate of infected cells, are less sensitive. Viral infectivity and the viral production rate are key parameters affecting the robustness of data fits. Fixing their values to literature values can help estimate the remaining model parameters when pre-peak data is missing or limited. We find a lack of data in the pre-peak growth phase underestimates the time to peak viral load by several days, leading to a shorter predicted growth phase. On the other hand, knowing the time of infection (e.g., from epidemiological data) and fixing it results in good estimates of dynamical parameters even in the absence of early data. While we provide ways to approximate model parameters in the absence of early viral load data, our results also suggest that these data, when available, are needed to estimate model parameters more precisely.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗
DOE OSTI2021

Cleaning Images with Gaussian Process Regression

Many approaches to astronomical data reduction and analysis cannot tolerate missing data: corrupted pixels must first have their values imputed. This paper presents astrofix, a robust and flexible image imputation algorithm based on Gaussian process regression. Through an optimization process, astrofix chooses and applies a different interpolation kernel to each image, using a training set extracted automatically from that image. It naturally handles clusters of bad pixels and image edges and adapts to various instruments and image types. For bright pixels, the mean absolute error of astrofix is several times smaller than that of median replacement and interpolation by a Gaussian kernel. We demonstrate good performance on both imaging and spectroscopic data, including the SBIG 6303 0.4 m telescope and the FLOYDS spectrograph of Las Cumbres Observatory and the CHARIS integral-field spectrograph on the Subaru Telescope.

42 ENGINEERING↗