Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sparse Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Intercepted photosynthetically active radiation in wheat canopies estimated by spectral reflectance

The interception of photosynthetically active radiation (PAR) was evaluated relative to greenness and normalized difference (MSS 7-5/7+5) for five planting dates of wheat for 1978-79 and 1979-80 in Phoenix. Intercepted PAR was calculated from a model driven by leaf area index and stage of growth. Linear relationships were found between greenness and normalized difference with a separate model representing growth and senescence of the crop. Normalized difference was a significantly better model and would be easier to apply than the empirically derived greenness parameter. For the leaf area growth portion of the season the model between PAR interception and normalized difference was the same over years, however, for the leaf senescence the models showed more variability due to the lack of data on measured interception in sparse canopies. Normalized difference could be used to estimate PAR interception directly for crop growth models.

Hatfield, J. L.↗

Intercepted photosynthetically active radiation estimated by spectral reflectance

Interception of photosynthetically active radiation (PAR) was evaluated relative to greenness and normalized difference (MSS (7-5)/(7+5) for five planting dates of wheat for 1978-79 and 1979-80 at Phoenix, Arizona. Intercepted PAR was calculated from leaf area index and stage of growth. Linear relatinships were found with greeness and normalized difference with separate relatinships describing growth and senescence of the crop. Normalized difference was significantly better than greenness for all planting dates. For the leaf area growth portion of the season the relation between PAR interception and normalized difference was the same over years and planting dates. For the leaf senescence phase the relationships showed more variability due to the lack of data on light interception in sparse and senescing canopies. Normalized difference could be used to estimate PAR interception throughout a growing season.

Hatfield, J. L.↗

The Yilgarn Craton western Australia: A tectonic synthesis

The Yilgarn Craton in Western Australia is one of the larger contiguous preserved Archaean crustal fragments, with an area of about 650,000 square kilometres. Of this, by area, about 70% is granitoid and 30% greenstone. The Craton is defined by the Darling Fault on its western margin, by Proterozoic deformation belts on its southern and northwestern margins, and by unconformable younger sediments on its eastern and northeastern margins. A regional geotectonic synthesis at a scale of 1:500,000 is being prepared. This is based largely upon the 1:250,000 scale mapping of the Geological Survey of Western Australia together with interpretation using geophysical data, mainly airborne magnetic surveys. On a regional basis the granitoids are classied as pre-, syn- and post-tectonic with respect to greenstone belt deformation. The post-tectonic granitoids yield Rb-Sr isochrons of about 2.6 b.y., close to Rb-Sr ages for the greenstones themselves which are up to about 2.8 b.y. old, although data for the latter is sparse. Contacts between earlier granitoids and greenstones which are not obscured by the post-tectonic granitoids are most commonly tectonic contacts, intensely deformed and with mylonitic fabrics. The general concensus however is that there is a pre-tectonic, pre-greenhouse sialic gneiss preserved in places. A discussion follows.

Fripp, R. E. P.↗

Solar cell angle of incidence corrections

Literature on solar array angle of incidence corrections was found to be sparse and contained no tabular data for support. This lack along with recent data on 27 GaAs/Ge 4 cm by 4 cm cells initiated the analysis presented in this paper. The literature cites seven possible contributors to angle of incidence effects: cosine, optical front surface, edge, shadowing, UV degradation, particulate soiling, and background color. Only the first three are covered in this paper due to lack of sufficient data. The cosine correction is commonly used but is not sufficient when the incident angle is large. Fresnel reflection calculations require knowledge of the index of refraction of the coverglass front surface. The absolute index of refraction for the coverglass front surface was not known nor was it measured due to lack of funds. However, a value for the index of refraction was obtained by examining how the prediction errors varied with different assumed indices and selecting the best fit to the set of measured values. Corrections using front surface Fresnel reflection along with the cosine correction give very good predictive results when compared to measured data, except there is a definite trend away from predicted values at the larger incident angles. This trend could be related to edge effects and is illustrated by a use of a box plot of the errors and by plotting the deviation of the mean against incidence angle. The trend is for larger deviations at larger incidence angles and there may be a fourth order effect involved in the trend. A chi-squared test was used to determine if the measurement errors were normally distributed. At 10 degrees the chi-squared test failed, probably due to the very small numbers involved or a bias from the measurement procedure. All other angles showed a good fit to the normal distribution with increasing goodness-of-fit as the angles increased which reinforces the very small numbers hypothesis. The contributed data only went to 65 degrees from normal which prevented any firm conclusions about extreme angle effects although a trend in the right direction was seen. Measurement errors were estimated and found to be consistent with the conclusions that were drawn. A controlled experiment using coverglasses and cells from the same lots and extending to larger incidence angles would probably lead to further insight into the subject area.

Burger, Dale R.↗

The 2010 May Flaring Episode of Cygnus X-3 in Radio, X-Rays, and gamma-Rays

In 2009, Cygnus X-3 (Cyg X-3) became the first microquasar to be detected in the GeV gamma-ray regime, via the satellites Fermi and AGILE. The addition of this new band to the observational toolbox holds promise for building a more detailed understanding of the relativistic jets of this and other systems. We present a rich dataset of radio, hard and soft X-ray, and gamma-ray observations of Cyg X-3 made during a flaring episode in 2010 May. We detect a approx.3-d softening and recovery of the X-ray emission, followed almost immediately by a approx.1-Jy radio flare at 15 GHz, followed by a 4.3sigma gamma-ray flare (E > 100 MeV) approx.1.5 d later. The radio sampling is sparse, but we use archival data to argue that it is unlikely the gamma-ray flare was followed by any significant unobserved radio flares. In this case, the sequencing of the observed events is difficult to explain in a model in which the gamma-ray emission is due to inverse Compton scattering of the companion star's radiation field. Our observations suggest that other mechanisms may also be responsible for gamma-ray emission from Cyg X-3.

Williams, Peter K. G.↗

Characterization of OCO-2 and ACOS-GOSAT biases and errors for flux estimates

We characterize the magnitude of seasonally and spatially varying biases in the National Aeronautics and Space Administration (NASA) Orbiting Carbon Observatory-2 (OCO-2) Version 8 (v8) and the Atmospheric CO2 Observations from Space (ACOS) Greenhouse Gas Observing SATellite (GOSAT) version 7.3 (v7.3) satellite CO2 retrievals by comparisons to measurements collected by the Total Carbon Column Observing Network (TCCON), Atmospheric Tomography (ATom) experiment, and National Oceanic and Atmospheric Administration (NOAA) Earth System Research Laboratory (ESRL) and U. S. Department of Energy (DOE) aircraft, and surface stations. Although the ACOS-GOSAT estimates of the column averaged carbon dioxide (CO2) dry air mole fraction (XCO2) have larger random errors than the OCO-2 XCO2 estimates, and the space-based estimates over land have larger random errors than those over ocean, the systematic errors are similar across both satellites and surface types, 0.6 ± 0.1 ppm. We find similar estimates of systematic error whether dynamic versus geometric coincidences or ESRL/DOE aircraft versus TCCON are used for validation (over land), once validation and co-location errors are accounted for. We also find that areas with sparse throughput of good quality data (due to quality flags and preprocessor selection) over land have ~double the error of regions of high-throughput of good quality data. We characterize both raw and bias-corrected results, finding that bias correction improves systematic errors by a factor of 2 for land observations and improves errors by ~0.2 ppm for ocean. We validate the lowermost tropospheric (LMT) product for OCO-2 and ACOS-GOSAT by comparison to aircraft and surface sites, finding systematic errors of ~1.1 ppm, while having 2-3 times the variability of XCO2. We characterize the time and distance scales of correlations for OCO-2 XCO2 errors, and find error correlations on scales of 0.3 degrees, 5-10 degrees, and 60 days. We find comparable scale lengths for the bias correction term. Assimilation of the OCO-2 bias correction term is used to estimate flux errors resulting from OCO-2 seasonal biases, finding annual flux errors on the order of 0.3 and 0.4 PgC/yr for Transcom-3 ocean and land regions, respectively.

Susan S Kulawik↗

Central Valley Water Resources II: Groundwater Sustainability Management Support in the California Central Valley using GRACE and InSAR Datasets

California’s Central Valley is one of the most productive agricultural regions in the United States, producing a fourth of the nation’s food supply. The water demand in this region is heavily dependent on groundwater resources, resulting in over pumping of aquifers at unsustainable rates during recent periods of severe drought. Over the past century, Central Valley aquifers have experienced a significant decline in groundwater levels, resulting in land subsidence and irreversible loss in groundwater storage. In 2014, the state enacted the Sustainable Groundwater Management Act, requiring high and medium priority subbasins to suspend overdraft and achieve sustainable levels of pumping and recharge by 2042.The California Department of Water Resources (DWR) oversees subbasin groundwater management; however, monitoring remains challenging due to sparse and inconsistent in situ data. To assist the DWR, this project developed a user-friendly executable application and an interactive visualization tool to quantify groundwater storage and land subsidence trends using remotely sensed and in situ data. The team utilized NASA’s Gravity Recovery and Climate Experiment (GRACE), GRACE Follow-On (GRACE-FO), Sentinel-1 C-band Synthetic Aperture Radar (C-SAR) interferograms, and Advanced Land Observing Satellite 2 (ALOS-2) Phased Array L-band Synthetic Aperture Radar 2 (PALSAR-2) interferograms in conjunction with well and GPS measurements to analyze groundwater and subsidence trends. GRACE and well data returns produced a strong Pearson correlation of .84, while Sentinel-1 and GPS data returns produced a Pearson correlation of .41 over the entire Central Valley. These findings suggest remotely sensed GRACE and interferometric SAR data can be used in the absence of in situ data.

DEVELOP Project Summary↗

(abstract) Navigating through the Venus Atmosphere

This paper presents the problems and challenges of the Magellan Navigation Team. The challenges are: 1) to predict the periapsis time to an accuracy of less than 100 seconds, 2) to accurately predict the dynamic pressure incurred by the spacecraft, 3) to model and to generate this prediction in a timely manner, 4) to provide navigation support 7 days per week for 70 days with 3 navigators and one graphic specialist to generate a daily package for presentation and display. The problems encountered by the Navigation Team in order to meet the above challenges are: 1) the uncertainty in the Venus atmosphere model, 2) the uncertainty in the Venus gravity model, 3) the uncertainty in predicting the attitude control thruster firing, 4) the sparse amount of radiometric tracking data, 5) the radiometric data editing is complicated by the effects of the Venus atmosphere fluctuations.

Venus↗

A Mechanical Test Frame for Property Evaluations at Cryogenic Temperature

On-board storage of hydrogen fuel has been designated as a limiting factor in the advancement of fuel cell technologies in the automotive industry. The use of cryo-compressed Type III pressure vessels presents one option to overcome this barrier. These multi-material vessels will be expected to perform at high pressure and extreme low temperatures, which creates a complex engineering design challenge. Many materials exhibit highly temperature-dependent properties, which must be considered for the efficient design of cryo-compressed pressure vessels. Complicating this issue, mechanical property data at cryogenic temperatures is sparse. This technical paper provides a description of a test apparatus commissioned specifically to help address this shortcoming. A mechanical test frame was retrofitted with a continuous flow cryostat capable to evaluate various mechanical properties throughout a broad temperature range of 25 °C to -269 °C with a load limit of 10 kN. An investigation of the thermomechanical properties of an epoxy resin was carried out as a demonstration.

Mechanical characterization, cryogenic pressure ve↗

Improving Reliability of Large Language Models for Nuclear Power Plant Diagnostics Technical Presentation

Large Language Models (LLMs) struggle out of the box when answering factually about detailed questions, especially in domains that are sparsely represented in their training data. This causes hallucinations and reduces reliability making it difficult for them to be used in practice. This work shows that using RAG techniques can improve factual accuracy and reliability, allowing for the application of LLMs in specialized areas, even when those areas that aren’t extensively covered in their initial training.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Heterogeneous Point Set Transformers for Segmentation of Multiple View Particle Detectors

NOvA is a long-baseline neutrino oscillation experiment that detects neutrino particles from the NuMI beam at Fermilab. Before data from this experiment can be used in analyses, raw hits in the detector must be matched to their source particles, and the type of each particle must be identified. This task has commonly been done using a mix of traditional clustering approaches and convolutional neural networks (CNNs). Due to the construction of the detector, the data is presented as two sparse 2D images: an XZ and a YZ view of the detector, rather than a 3D representation. We propose a point set neural network that operates on the sparse matrices with an operation that mixes information from both views. Our model uses less than 10% of the memory required using previous methods while achieving a 96.8% AUC score, a higher score than obtained when both views are processed independently (85.4%).

Robles, Edgar E. [UC, Irvine (main)]↗

Calorimeter Pileup Deconvolution for Online Trigger Primitives

In high energy physics experiment, as the luminosity increases, pile-up issues on detectors such as calorimeters become non-negligible. Deconvolution approaches with mathematic pre-assumptions such as Sparse Representation are developed for data analysis stage. For online computation tasks such as for trigger primitive creation, signal availability is significantly different as in offline data analysis stage, and therefore, different (yet simpler) algorithms should be explored. In this document, several approaches of deconvolution suitable for FPGA implementation are discussed.

Wu, Jin-yuan [Fermilab] (ORCID:0000000344329521)↗

Global Assimilation of EOS-Aura Data as a Means of Mapping Ozone Distribution in the Lower Stratosphere and Troposphere

Ozone in the lower stratosphere and the troposphere plays an important role in forcing the climate. However, the global ozone distribution in this region is not well known because of the sparse distribution of in-situ data and the poor sensitivity of satellite based observations to the lowermost of the atmosphere. The Ozone Monitoring Instrument (OMI) and Microwave Limb Sounder (MLS) instruments on EOS-Aura provide information on the total ozone column and the stratospheric ozone profile. This data has been assimilated into NASA s Global Earth Observing System, Version 5 (GEOS-5) data assimilation system (DAS). We will discuss the results of assimilating three years of OMI and MLS data into GEOS-5. This data was assimilated alongside meteorological observations from both conventional sources and satellite instruments. Previous studies have shown that combining observations from these instruments through the Trajectory Tropospheric Ozone Residual methodology (TTOR) or using data assimilation can yield useful, yet low biased, estimates of the tropospheric ozone budget. We show that the assimilated ozone fields in this updated version of GEOS-5 exhibit an excellent agreement with ozone sonde and High Resolution Dynamics Limb Sounder (HIRDLS) data in the lower stratosphere in terms of spatial and temporal variability as well as integrated ozone abundances. Good representation of small-scale vertical features follows from combining the MLS data with the assimilated meteorological fields. We then demonstrate how this information can be used to calculate the Stratosphere - Troposphere Exchange of ozone and its contribution to the tropospheric ozone column in GEOS-5. Evaluations of tropospheric ozone distributions from the assimilation will be made by comparisons with sonde and other in-situ observations.

Wargan, Krzysztof↗

Apollo Crew Loads Data Mining

INTRODUCTION Human exposure data to dynamic loads in spaceflight are sparse not only because very few crewmembers have flown in space, but also because much of the historic data is no longer readily available. Earth and Moon landings of the Apollo missions are unique and valuable for understanding human tolerance in water landing conditions for both short-duration and long-duration crewmembers as well as informing crew tolerance in standing postures during planetary landings. The goal of this task was to find relevant Apollo data to better understand human tolerance in these scenarios, in order to apply this knowledge to future missions. METHODS The goal of this task was to recover time history data from dynamic phases of flight from crewed Apollo missions. The first phase of the task was to search available records at JSC and other centers to locate the appropriate records at the National Archives in Fort Worth, TX. Once the possible data locations were located, it was planned that one researcher would travel to the National Archives in Fort Worth, TX to collect the relevant Apollo data. Once the data was retrieved, they would be digitized for future use and evaluation, and archived within the Human Physiology, Performance, Protection, and Operations (H-3PO) laboratory within the Human Health and Performance Directorate. These data would be used to assess the feasibility and acceptability of current standards and vehicle design requirements for lunar and Mars missions. Additionally, any medical monitoring required, or physiological changes noted in crewmembers based on dynamic loads would be documented for future use. RESULTS Relevant records were found at Ft. Worth, TX and College Park, MD using the National Archives Online Catalog. In addition to the online catalog, an Archives staff member was able to share an additional inventory list of NASA JSC records held in Ft. Worth, TX. Due to COVID-19, NASA has only recently allowed non-mission essential travel. In addition, the National Archives has also been closed to the public since March 2020. Because of this, travel to the National Archives to search records there has not been possible. CONCLUSION The findings include collections at the National Archives at both Ft. Worth, TX and College Park, MD that could possibly hold the data we are looking for. Unfortunately, the descriptions of each collection are very broad. Though we are hopeful that relevant data is stored in one of these collections, we cannot be sure that we will find what we are looking for. At this time, it is not clear when the Archives will reopen to the public or when NASA will allow travel. Travel to the Archives has been postponed, and will be reassessed at a future date.

T Reiber↗

Characterizing Spatiotemporal Uncertainty in Interpolated Meteorological Data

Interpolated meteorological data invariably contain errors. These errors have structure in time and space, particularly autocorrelation, which can cause the effects of errors to compound when model outputs are aggregated temporally or spatially. One way to account for this uncertainty is with a probabilistic model from which samples can be drawn that are coherent with respect to underlying spatial and temporal covariance structure. This work describes a probabilistic method for spatial interpolation of point-wise meteorological time series. Observational data from weather stations are generally sparse in space and dense in time (but sometimes missing). The method works by projecting time series onto orthogonal basis vectors and spatially interpolating each resulting component independently. Under suitable assumptions, and data transformations to better satisfy those assumptions, Gaussian process regression provides a complete description of the joint predictive distribution over a Gaussian random field. Spatiotemporally coherent realizations are generated as the sum of conditional (spatial) simulations of each orthogonal (temporal) component. Data-derived and generic orthogonal bases are considered. In addition to spatial interpolation, imputation of missing observational data is examined. The method is applied using near-surface air temperature over the Western United States and validated by comparing theoretical versus actual coverage of predictive distributions and analyzing the degree to which spatial and temporal covariance structure is reproduced. Computational considerations, relating to conditional simulation of random fields, are also addressed.

Conor T Doherty↗

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗

Foundation Models for Zero-Shot Segmentation of Scientific Images without AI-Ready Data

Zero-shot and prompt-based models have excelled at visual reasoning tasks by leveraging large-scale natural image corpora, but they often fail on sparse and domain-specific scientific image data. We introduce Zenesis, a no-code interactive computer vision platform designed to reduce data readiness bottlenecks in scientific imaging workflows. Zenesis integrates lightweight multimodal adaptation for zero-shot inference on raw scientific data, human-in-the-loop refinement, and heuristic-based temporal enhancement. We validate our approach on Focused Ion Beam Scanning Electron Microscopy (FIB-SEM) datasets of catalyst-loaded membranes. Zenesis outperforms baselines, achieving an average accuracy of 0.947, Intersection over Union (IoU) of 0.858, and Dice score of 0.923 on amorphous catalyst samples; and 0.987 accuracy, 0.857 IoU, and 0.923 Dice on crystalline samples. These results represent a significant performance gain over conventional methods such as Otsu thresholding and standalone models like the Segment Anything Model (SAM). Zenesis enables effective image segmentation in domains where annotated datasets are limited, offering a scalable solution for scientific discovery.

Mukherjee, Shubhabrata↗

Data traffic reduction schemes for Cholesky factorization on asynchronous multiprocessor systems

Communication requirements of Cholesky factorization of dense and sparse symmetric, positive definite matrices are analyzed. The communication requirement is characterized by the data traffic generated on multiprocessor systems with local and shared memory. Lower bound proofs are given to show that when the load is uniformly distributed the data traffic associated with factoring an n x n dense matrix using n to the alpha power (alpha less than or equal 2) processors is omega(n to the 2 + alpha/2 power). For n x n sparse matrices representing a square root of n x square root of n regular grid graph the data traffic is shown to be omega(n to the 1 + alpha/2 power), alpha less than or equal 1. Partitioning schemes that are variations of block assignment scheme are described and it is shown that the data traffic generated by these schemes are asymptotically optimal. The schemes allow efficient use of up to O(n to the 2nd power) processors in the dense case and up to O(n) processors in the sparse case before the total data traffic reaches the maximum value of O(n to the 3rd power) and O(n to the 3/2 power), respectively. It is shown that the block based partitioning schemes allow a better utilization of the data accessed from shared memory and thus reduce the data traffic than those based on column-wise wrap around assignment schemes.

Naik, Vijay K.↗