Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

The Role of Fire in Global Forest Loss Dynamics

Fires, among other forms of natural and anthropogenic disturbance, play a central role in regulating the location, composition and biomass of forests. Understanding the role of fire in global forest loss is crucial in constraining land-use change emissions and the global carbon cycle. We analysed the relationship between forest loss and fire at 500 m resolution based on satellite-derived data for the 2003–2018 period. Satellite fire data included burned area and active fire detections, to best account for large and small fires, respectively. We found that, on average, 38 ± 9% (± range) of global forest loss was associated with fire, and this fraction remained relatively stable throughout the study period. However, the fraction of fire-related forest loss varied substantially on a regional basis, and showed statistically significant trends in key tropical forest areas. Decreases in the fraction of fire-related forest loss were found where deforestation peaked early in our study period, including the Amazon and Indonesia while increases were found for tropical forests in Africa. The inclusion of active fire detections accounted for 41%, on average, of the total fire-related forest loss, with larger contributions in small clearings in interior tropical forests and human-dominated landscapes. Comparison to higher-resolution fire data with resolutions of 375 and 20 m indicated that commission errors due to coarse resolution fire data largely balanced out omission errors due to missed small fire detections for regional to continental-scale estimates of fire-related forest loss. Besides an improved understanding of forest dynamics, these findings may help to refine and separate fire-related and non-fire-related land-use change emissions in forested ecosystems.

Dan van Wees↗
NASA NTRS2022

MLtool: Universal Supervised Machine Learning Tool to Model Tabulated Data

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine learning↗
NASA NTRS2022

MLtool Python Code

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine Learning↗
NASA NTRS2012

Influence of Primary Gage Sensitivities on the Convergence of Balance Load Iterations

The connection between the convergence of wind tunnel balance load iterations and the existence of the primary gage sensitivities of a balance is discussed. First, basic elements of two load iteration equations that the iterative method uses in combination with results of a calibration data analysis for the prediction of balance loads are reviewed. Then, the connection between the primary gage sensitivities, the load format, the gage output format, and the convergence characteristics of the load iteration equation choices is investigated. A new criterion is also introduced that may be used to objectively determine if the primary gage sensitivity of a balance gage exists. Then, it is shown that both load iteration equations will converge as long as a suitable regression model is used for the analysis of the balance calibration data, the combined influence of non linear terms of the regression model is very small, and the primary gage sensitivities of all balance gages exist. The last requirement is fulfilled, e.g., if force balance calibration data is analyzed in force balance format. Finally, it is demonstrated that only one of the two load iteration equation choices, i.e., the iteration equation used by the primary load iteration method, converges if one or more primary gage sensitivities are missing. This situation may occur, e.g., if force balance calibration data is analyzed in direct read format using the original gage outputs. Data from the calibration of a six component force balance is used to illustrate the connection between the convergence of the load iteration equation choices and the existence of the primary gage sensitivities.

Ulbrich, Norbert Manfred↗
DOE OSTI2013

Search for new physics in events with photons, jets, and missing transverse energy in pp collisions at $ \sqrt{s}=7 $ TeV

A search for physics beyond the standard model involving events with one or more photons, jets, and missing transverse energy has been performed by the CMS experiment. The data sample corresponds to an integrated luminosity of 4.93 fb -1 of proton-proton collisions at TeV, produced at the Large Hadron Collider. No excess of events with large missing transverse energy is observed beyond expectations from standard model processes, and upper limits on the signal production cross sections for new physics processes are set at the 95% confidence level. The results of this search are interpreted in the context of three models of new physics: a general model of gauge-mediated supersymmetry breaking, Simplified Models, and a theory involving universal extra dimensions. In the absence of evidence for new physics, exclusion regions are derived in the parameter spaces of the respective models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Photo- and Electro-Induced Hadron Production from Nuclei at Jefferson Laboratory

Understanding many-body knockout processes is crucial for nuclear physics, particularly in photo- and electro-induced reactions. In turn, understanding two- and three-body forces, including higher-order forces, is vital for a complete understanding of atoms. We present photo-induced many-proton knockout processes, with multiplicities from 1 to 6, using 12C, CH2, and C4H9OH targets in the g9a FROST dataset. Our analysis covers photon energies from 600 to 4500 MeV, significantly expanding current world data. Comparing our experimental data to the state-of-the-art GiBUU model offers a new challenge in the model’s theoretical description of many-body processes. GiBUU reasonably describes the data at lower photon energies but struggles at higher energies and missing masses, likely due to missing processes, such as initial 3-pion photoproduction. Our results will inform future developments in describing proton knockout processes, indicating GiBUU’s overall reasonable description of many-proton knockout data up to around 2.2 GeV. We also assess various electro-induced reactions using 2D, 12C, and 40Ar targets in the RGM dataset. Our results, obtained at electron beam energies of 2, 4, and 6 GeV, are compared in detail to GENIE and GiBUU, two widely used theory models in neutrino oscillation experiments. Discrepancies between model predictions and experimental data underscore the need for refining the two theoretical models. Despite discrepancies, GiBUU provides a more accurate modelling of electro-induced reactions, especially for 40Ar - crucial for future neutrino oscillation facilities such as DUNE. Understanding the fundamental nuclear physics involved in neutrino-nuclei interactions is essential for reducing the systematic uncertainties in extracting neutrino oscillation parameters. Many-body processes significantly contribute to the background processes observed in neutrino-nuclei interactions, hence the results from both analyses are crucial for developing the theoretical framework for the underlying nuclear physics.

Williams, Rhidian↗
DOE OSTI2016

Effective Padding of Multi-Dimensional Arrays to Avoid Cache Conflict Misses

Caches are used to significantly improve performance. Even with high degrees of set-associativity, the number of accessed data elements mapping to the same set in a cache can easily exceed the degree of associativity, causing conflict misses and lowered performance, even if the working set is much smaller than cache capacity. Array padding (increasing the size of array dimensions) is a well known optimization technique that can reduce conflict misses. In this paper, we develop the first algorithms for optimal padding of arrays for a set associative cache for arbitrary tile sizes, In addition, we develop the first solution to padding for nested tiles and multi-level caches. The techniques are in implemented in PAdvisor tool. Experimental results with multiple benchmarks demonstrate significant performance improvement from use of PAdvisor for padding.

array padding↗
DOE OSTI2026

Mesogenesis through the ephemeral dark decay of Beauty

Mesogenesis provides a path for generating the baryon asymmetry of the Universe, using only the CP violation furnished by the Standard Model in the decay of B mesons. While this is an intriguing possibility, it is largely constrained by the data on B meson branching fractions into baryons and missing energy carried into the dark sector. We point out that it is possible to make this branching fraction dominant only in the early Universe, through an ultralight scalar coupled to the dark sector and the Standard Model leptons. A scenario is examined where the thermal density of muons in the early Universe temporarily lowers the mass of a dark fermion, allowing for efficient B meson decays. This `dark’ decay channel is shut off later when the muon number density falls, making the scenario compatible with flavor data. Our model can be consistent with the LHC constraints on color-charged heavy bosons required to implement Mesogenesis; such states may be discovered in the future runs as their masses cannot be far above the current bounds. We also outline other possible signals, which can arise in future displaced vertex searches, long range force searches, and observations of neutron star binary mergers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

IPN Absorption Coefficients

The dataset contains aerosol light absorption and scattering coefficients measured by three single-wavelength Integrated Photoacoustic Nephelometers (IPN). The absorption coefficients were measured at 405, 721, and 1047 nm, while the scattering coefficients were measured at 405 and 721 nm. The single scattering albedo (SSA) at 405 and 721 nm were also calculated from the IPN measurements. The three IPNs shared a common inlet without impactor/cyclone in July; in August, a PM2.5 cyclone inlet was installed to reduce measurement noise and improve data quality. The 721-nm IPN experienced laser shutdown issues, causing missing of a large fraction of the 721-nm measurements, especially in July. As described before, the 721-nm laser issue was less frequent in August after the cyclone installation, improving the data completeness and quality. The IPN raw data were noisy, making identifying patterns and trends difficult; therefore, the hourly average data are recommended over the raw data. The hourly average data were cross-checked with the filter-based TAP and PSAP measurements, which showed that their patterns, trends, and peaks matched. However, due to the differences in working mechanisms and principles of the filter-based and photoacoustic particle-phase instruments, the IPN measurements are lower than the filter-based measurements despite that they have consistent patterns, trends, and peaks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Applying a Template of Expected Uncertainties to Updating 239 Pu(n,f) Cross-section Covariances in the Neutron Data Standards Database

Templates of uncertainties expected in specific measurement types were recently developed. One aim of these templates is to help evaluators in identifying (1) missing or suspiciously low uncertainties and (2) missing correlations between uncertainties of the same and different experiments, when estimating covariances for experimental data employed in their evaluations. These templates also provide realistic estimates of standard deviations and correlations for a particular uncertainty source and measurement type that can be used by evaluators in situations where they are not supplied by the experimenters. This information allows for a more comprehensive uncertainty analysis across all measurements considered in an evaluation and, thus, more realistic evaluated covariances. Here, in this work, we extend a template that is applicable to uncertainties expected in neutron-induced fission, (n,f), cross-section measurements. It is applied to improving covariances of 239 Pu(n,f) cross-section measurements in the database underlying the Neutron Data Standards evaluations. This particular example was chosen since this evaluation is primarily based on experimental information. Also, some uncertainties of individual 239 Pu(n,f) cross-section experiments in this database were suspected to be underestimated. The evaluated uncertainties obtained after updating the covariances in the database by means of the template indeed do increase compared to their original values. Even more importantly, the evaluated mean values change noticeably. These modified cross sections impact application calculations significantly, as is demonstrated by employing them in simulations of the effective neutron multiplication factor for a few selected critical assemblies. However, this updated evaluated 239 Pu(n,f) cross section should not be interpreted as the final one that should replace values of the current Neutron Data Standards project. Evaluations for the Neutron Data Standards of the 239 Pu(n,f) cross section must be linked to many other observables included in the associated database, most notably to cross sections for 235 U(n,f), but also to those for 10 B(n, α ), 6 Li(n,t), 238 U(n,f), and 238 U(n, γ ), because of included measurements of the 239 Pu(n,f) cross section that appear as ratios to these reactions. Some of these other reactions are correlated to further observables in the database. Hence, updating uncertainties of data sets of any of these observables can potentially impact the 239 Pu(n,f) cross section. Uncertainties for all measurements of these linked physical observables have to be updated before a comprehensive evaluation of the 239 Pu(n,f) cross section and its corresponding uncertainties can be provided.

239Pu Neutron-induced fission cross-section↗
DOE OSTI2022

Toward a machine-guided approach to energetic material discovery

In this article, we trained a machine learning (ML) model to connect microstructural details of an energetic material formulation to its performance for the purpose of guiding the discovery of new explosive formulations. Our hypothesis was that the algorithm would robustly learn the training data and produce an accurate surrogate model. Specifically, the algorithm learned the relationship between details of the void size distribution (VSD), initiating shock pressure, and the energetic material performance. We used realistic constraints on the VSD and a range of cases were ingested by a physically informed reactive flow model working within a hydrodynamic solver running on high-performance computing resources. The ML algorithm produced a surrogate model that accurately predicted known test points around the parameter space. In addition to the utility of the model and the process used for its development, we noted interesting comparisons between what we, the authors—subject matter experts, would heuristically conclude from the training data and the surrogate model predictions. We detected nuanced details that were missed by the surrogate model; however, these details are not important to an energetic material formulator. We concluded that the algorithm did indeed robustly learn the training data and produce an accurate surrogate model. We further concluded that the surrogate model is a powerful tool to guide the formulator in the absence of subject matter experts and limited-access computing resources.

42 ENGINEERING↗
DOE OSTI2013

Resolution enhancement of lung 4D-CT data using multiscale interphase iterative nonlocal means

Purpose: Four-dimensional computer tomography (4D-CT) has been widely used in lung cancer radiotherapy due to its capability in providing important tumor motion information. However, the prolonged scanning duration required by 4D-CT causes considerable increase in radiation dose. To minimize the radiation-related health risk, radiation dose is often reduced at the expense of interslice spatial resolution. However, inadequate resolution in 4D-CT causes artifacts and increases uncertainty in tumor localization, which eventually results in extra damages of healthy tissues during radiotherapy. In this paper, the authors propose a novel postprocessing algorithm to enhance the resolution of lung 4D-CT data. Methods: The authors' premise is that anatomical information missing in one phase can be recovered from the complementary information embedded in other phases. The authors employ a patch-based mechanism to propagate information across phases for the reconstruction of intermediate slices in the longitudinal direction, where resolution is normally the lowest. Specifically, the structurally matching and spatially nearby patches are combined for reconstruction of each patch. For greater sensitivity to anatomical details, the authors employ a quad-tree technique to adaptively partition the image for more fine-grained refinement. The authors further devise an iterative strategy for significant enhancement of anatomical details. Results: The authors evaluated their algorithm using a publicly available lung data that consist of 10 4D-CT cases. The authors' algorithm gives very promising results with significantly enhanced image structures and much less artifacts. Quantitative analysis shows that the authors' algorithm increases peak signal-to-noise ratio by 3-4 dB and the structural similarity index by 3%-5% when compared with the standard interpolation-based algorithms. Conclusions: The authors have developed a new algorithm to improve the resolution of 4D-CT. It outperforms the conventional interpolation-based approaches by producing images with the markedly improved structural clarity and greatly reduced artifacts.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Quantifying and Reducing Curve-Fitting Uncertainty in Isc: Preprint

Current-voltage (I-V) curve measurements of photovoltaic (PV) devices are used to determine performance parameters and to establish traceable calibration chains. Measurement standards specify localized curve fitting methods, e.g., straight-line interpolation/extrapolation of the I-V curve points near short-circuit current, Isc. By considering such fits as statistical linear regressions, uncertainties in the performance parameters are readily quantified. However, the legitimacy of such a computed uncertainty requires that the model be a valid (local) representation of the I-V curve and that the noise be sufficiently well characterized. Using more data points often has the advantage of lowering the uncertainty. However, more data points can make the uncertainty in the fit arbitrarily small, and this fit uncertainty misses the dominant residual uncertainty due to so-called model discrepancy. Using objective Bayesian linear regression for straight-line fits for Isc, we investigate an evidence-based method to automatically choose data windows of I-V points with reduced model discrepancy. We also investigate noise effects. Uncertainties, aligned with the Guide to the Expression of Uncertainty in Measurement (GUM), are quantified throughout.

14 SOLAR ENERGY↗
NASA NTRS2008

Atomic Oxygen Erosion Yield Predictive Tool for Spacecraft Polymers in Low Earth Orbit

A predictive tool was developed to estimate the low Earth orbit (LEO) atomic oxygen erosion yield of polymers based on the results of the Polymer Erosion and Contamination Experiment (PEACE) Polymers experiment flown as part of the Materials International Space Station Experiment 2 (MISSE 2). The MISSE 2 PEACE experiment accurately measured the erosion yield of a wide variety of polymers and pyrolytic graphite. The 40 different materials tested were selected specifically to represent a variety of polymers used in space as well as a wide variety of polymer chemical structures. The resulting erosion yield data was used to develop a predictive tool which utilizes chemical structure and physical properties of polymers that can be measured in ground laboratory testing to predict the in-space atomic oxygen erosion yield of a polymer. The properties include chemical structure, bonding information, density and ash content. The resulting predictive tool has a correlation coefficient of 0.914 when compared with actual MISSE 2 space data for 38 polymers and pyrolytic graphite. The intent of the predictive tool is to be able to make estimates of atomic oxygen erosion yields for new polymers without requiring expensive and time consumptive in-space testing.

Bank, Bruce A.↗
DOE OSTI2021

Challenging problems of quality assurance and quality control (QA/QC) of meteorological time series data

Abstract Representativeness and quality of collected meteorological data impact accuracy and precision of climate, hydrological, and biogeochemical analyses and predictions. We developed a comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework, consisting of three major phases: Phase I—Preliminary data exploration, i.e., processing of raw datasets, with the challenging problems of time formatting and combining datasets of different lengths and different time intervals; Phase II—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme data; and Phase III—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The paper includes two use cases based on the time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado), and the Barro Colorado Island (BCI, Panama) meteorological station. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A Short-Term Solar Forecasting Platform Using a Physics-Based Smart Persistence Model and Data Imputation Method

Electrical energy plays vital role in our socio-economic activity and therefore ensuring the reliability of the electric grid, from the generation, transmission and distribution level is critical. In order to maintain the power system parameter viz., frequency, voltage, etc., optimally, balancing of generation and consumption is very much essential. However, solar energy is infirm power by nature this is due to cloud cover / other local phenomena. Hence, Photovoltaic (PV) power generation brings a significant challenge to the grid operator due to the variability of the solar energy. The complexity of this challenge in terms of planning and dispatch ability of PV resources, aggravates with the high penetration of solar energy into the electric grid. In this setting, reliable solar radiation forecasting models based on accurate and quality input data become essential. In order to develop a suitable model for predicting solar radiation, quality historical / real time measurement is also needed. Under this study NIWE and NREL jointly developed / tested short-term solar forecasting frameworks using a smart persistence and physics-based smart persistence models for intra-hour forecasting of solar radiation (PSPI) and benchmarked 9 different data imputation techniques in 15 Solar Radiation Resource Assessment (SRRA) stations, located at different parts of India. During any measurement campaign, due to various technical reasons, we may miss few observations. However, the missing observation often reduce the performance of any forecasting model. Therefore, suitable data imputation method would assist us to obtain continuous observation of solar radiation. A station-by-station and method-by-method analysis was carried out to understand the performance of each model. Based on our analysis, among all the data imputation methods, the Kalman data imputation method is better for Indian Weather condition. In addition, Kalman StructTS, Linear, Stine and Arima methods yield slightly inferior accuracy compared to Kalman, but outperform the other methods. The extended solar radiation data are used by solar forecasting models to provide the prediction of solar radiation at 15 SRRA stations. As far as short term forecasting model is concerned, the PSPI model outperforms the Smart Persistence model. However, the forecast error is increases with the forecasting horizon.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

Fusing geophysical signatures of locally recorded surface explosions to improve blast detection

We recorded acoustic, seismic and radio-frequency signatures of 70 solid charge (~2–12 kg) surface explosions (shots) at local distances (0.1–1.5 km) to determine if such signals could be fused for blast monitoring. We observed that each geophysical signature was sufficiently repeatable between similar shots to be identifiable with multichannel correlation detectors. Using template signals from a large explosion, we then processed heavily contaminated data recording a smaller shot with these detectors, and missed or marginally detected the resultant target signals. By then fusing the p-values of these statistics through Fisher's combined probability test, we clearly identified the same explosion signals at thresholds consistent with the false alarm on noise rates of the correlation detectors. This resulting Fisher test thereby provided high-probability detections, zero false alarms and higher theoretical detection capability.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗