Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data needs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

The Virtual Climate Data Server (vCDS): An iRODS-Based Data Management Software Appliance Supporting Climate Data Services and Virtualization-as-a-Service in the NASA Center for Climate Simulation

Scientific data services are becoming an important part of the NASA Center for Climate Simulation's mission. Our technological response to this expanding role is built around the concept of a Virtual Climate Data Server (vCDS), repetitive provisioning, image-based deployment and distribution, and virtualization-as-a-service. The vCDS is an iRODS-based data server specialized to the needs of a particular data-centric application. We use RPM scripts to build vCDS images in our local computing environment, our local Virtual Machine Environment, NASA s Nebula Cloud Services, and Amazon's Elastic Compute Cloud. Once provisioned into one or more of these virtualized resource classes, vCDSs can use iRODS s federation capabilities to create an integrated ecosystem of managed collections that is scalable and adaptable to changing resource requirements. This approach enables platform- or software-asa- service deployment of vCDS and allows the NCCS to offer virtualization-as-a-service: a capacity to respond in an agile way to new customer requests for data services.

Schnase, John L.↗
NASA NTRSDate not supplied

Quantum-Compatible Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

Wildfire occurrences have been increasing for the past decade, leaving devastating traces across the world. In the recent efforts, remote sensing and airborne missions have been utilized to better understand and manage wildfires. This has resulted in an exponential increase in volume of remote sensing data, which has pushed the need for intelligent automation of data extraction for wildfire studies. Machine learning offers accurate automation in detecting such natural anomalies and enable decision-makers to take actions in a timely manner. Recent advances in machine learning algorithms, namely probabilistic generative methods, allow researchers and decisionmakers to step beyond detection and study “what-if” scenarios for wildfire occurrences. Additionally, they offer better imitations to the stochastic behavior of nature, and wildfire events. However, optimizing the performance of these probabilistic generative models is a computationally expensive process, specially using digital computers. On the other hand, quantum computers have recently shown a promise to reduce computationally costly training of such models and provide performance improvements. There is a body of research investigating the potential for improved machine learning methods in which key operations are performed on a quantum computer. In this study, we propose a probabilistic image-toimage segmentation approach combining a very well-known segmentation method, U-NET, with a Conditional Variational Auto-Encoder (CVAE) to not only detect wildfires but also describe the stochasticity of the phenomenon and be capable of running “what-if” scenarios. Our proposed model is compatible with training on quantum computers, which results in a quantum-assisted image-to-image segmentation approach and can be used to benchmark the potential benefit of quantum computing over the classical one.

quantum↗
NASA NTRSDate not supplied

Image-to-Image Wildfire Detection via Quantum-Compatible Variational Segmentation from Remotely-sensed Data

Over the last decade, the incidence of wildfires has surged, causing widespread destruction globally. To better comprehend and manage these incidents, remote sensing and aerial missions have been implemented in recent efforts. However, this has resulted in an exponential rise in the amount of remote sensing data utilization, leading to a need for intelligent automation of data extraction in wildfire studies. Machine learning provides an accurate automated approach for detecting these natural anomalies and facilitates decision-makers to take prompt actions. To make insightful decisions in wildfire management, it is imperative to move beyond simple detection and explore the potential of probabilistic generative machine learning for creating "what-if" scenarios for various wildfire conditions. Such models offer improved representation of the stochastic nature of wildfire events. However, the optimization of these models can be computationally expensive, especially when using classical computers. Quantum computers have recently emerged as a promising solution to reduce the computational cost of training such models and improve their performance. In this study, we aim to utilize quantum-compatible machine learning techniques to implement our probabilistic generative approach. To that end, we propose a supervised probabilistic variational model consisting of a U-NET-based image-to-image component along with encoder and decoder networks which work as a variational autoencoder (VAE) component. Additionally, we explore the type of latent distribution type in the VAE component and implement different means for modeling the prior distribution. We further investigate the quantum-compatible versions of the model compared to the classical counterpart and benchmark potential benefits of quantum compatibility over the classical model.

quantum machine learning↗
NASA NTRS2019

Role of CEOS Working Group on Calibration and Validation in Analysis Ready Data Products

The Committee on Earth Observation Satellites (CEOS) is leading the CEOS Analysis Ready Data for Land (CARD4L) initiative. A goal of analysis ready data products is to limit the effort needed by users to pre-process the data allowing them to concentrate on the end products. CARD4L provides a set of specifications that data providers need to meet to be considered to satisfy CARD4L. One of the working groups within CEOS, the Working Group on Calibration and Validation (WGCV) is providing a peer review process to evaluate the documentation of the data providers validation and data product accuracy assessment. The approach makes use of the expertise within WGCV to collaborate with both the CEOS Land Surface Imaging Virtual Constellation and the data providers to work towards acceptance of the...

Thome, K.↗
NASA NTRS2014

Analyzing a 35-Year Hourly Data Record: Why So Difficult?

At the Goddard Distributed Active Archive Center, we have recently added a 35-Year record of output data from the North American Land Assimilation System (NLDAS) to the Giovanni web-based analysis and visualization tool. Giovanni (Geospatial Interactive Online Visualization ANd aNalysis Infrastructure) offers a variety of data summarization and visualization to users that operate at the data center, obviating the need for users to download and read the data themselves for exploratory data analysis. However, the NLDAS data has proven surprisingly resistant to application of the summarization algorithms. Algorithms that were perfectly happy analyzing 15 years of daily satellite data encountered limitations both at the algorithm and system level for 35 years of hourly data. Failures arose, sometimes unexpectedly, from command line overflows, memory overflows, internal buffer overflows, and time-outs, among others. These serve as an early warning sign for the problems likely to be encountered by the general user community as they try to scale up to Big Data analytics. Indeed, it is likely that more users will seek to perform remote web-based analysis precisely to avoid the issues, or the need to reprogram around them. We will discuss approaches to mitigating the limitations and the implications for data systems serving the user communities that try to scale up their current techniques to analyze Big Data.

computational performance↗
DOE OSTI2026

Frameworks, Algorithms, and Scalable Technologies for Mathematics (FASTMath) SciDAC Institute

As computational models scale to larger computers, the rate at which they produce data has far outstripped the same computers ability to write that data and further the file systems ability to store that data. Almost all of the SciDAC applications, but especially those related to fusion solve very large scale PDEs whose scientific output his impacted by this problem. To gain access to dynamics in an exascale simulation that are not identifiable a priori and to make that dynamical data available to machine learning requires fundamental research in the area of in situ data data analytics. Here data analytics includes compression, visualization, uncertainty quantification, and machine learning. This in situ data analytics will enable on-the-fly spatial and temporal compression of solution dynamics, expose that space-time compressed field to machine learning algorithms that have been specialized to work with dynamically evolving data (existing machine learning algorithms treat data sets as static), greatly improving the opportunity for machine learning to provide feedback to the compression, all within an ongoing simulation, without the need to write data to files. The same concepts are also being applied to uncertainty quantification and multi-fidelity modeling which have similar needs for spatial and temporal compression of the ongoing exascale simulation to perform either without the typical, unacceptable writing of data to files.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Evolving radon diffusion through earthen barriers at uranium waste disposal sites

Field measurements of Rn-222 fluxes from the tops and bottoms of compacted clay radon barriers were used to calculate effective Rn diffusion coefficients (D Rn ) at four uranium waste disposal sites in the western United States to assess cover performance after more than 20 years of service. Values of D Rn ranged from 7.4 × 10 -7 to 6.0 × 10 -9 m 2 /s, averaging 1.42 × 10 -7 . Water saturation (S W ) from soil cores indicated that there was relatively little control of D Rn by S W , especially at higher moisture levels, in contrast to estimates from most steady-state diffusion models. Further, this is attributed to preferential pathways intrinsic to construction of the barriers or to natural process that have developed over time including desiccation cracks, root channels, and insect burrows in the engineered earthen barriers. A modification to some models in which fast and slow pathway D Rn values are partitioned appears to give a good representation of the data; 4% of the fast pathway was needed to fit the data regression. For locations with high S w and highest D Rn (and fluxes) at each site, the proportion of fast pathway ranged from 1.7% to 34%, but for many locations with lower fluxes, little if any fast pathway was needed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1990

MODIS-N - Moderate Resolution Imaging Spectrometer-Nadir

The Moderate Resolution Imaging Spectrometer-Nadir (MODIS-N) for the Earth Observing System (EOS) is intended to provide daily global surveys for the atmosphere, the oceans, and the land. To achieve this capability, MODIS-N requires an at-least 2300-km swath width, and provides geometric-instantaneous-fields-of-view (GIFOVs) that are either 856 m, 428 m, or 214 m in size with reference to a 705 km satellite altitude. The 214 m GIFOV may or may not be used depending on total data rate impact assessments traded with science needs. To achieve the data for the multiplicity of science investigations MODIS-N provides nominally 36 spectral bands that are selected for specific locations and bandpasses in the spectral range from the visible to the long wave infrared. Another driver of this instrument combination is the need for long term spectral and radiometric calibration stability. Specific calibration capabilities are to be built into MODIS-N to achieve calibration knowledge over a 5 year operational life.

Weber, Richard R.↗
DOE OSTI2020

Autonomous Radiation Mapping and Quantification using an Unmanned Ground Vehicle. Part I - Environment Mapping

When characterizing facilities, advanced autonomous systems are safe, efficient, and cost-effective tools, which can safely deploy state-of-the-art instrumentation without exposing workers to radiation risks. One main focus of the research is the visual mapping of the environment.This paper presents a framework for the mapping aspect that utilizes lidar and SLAM technologies coupled with a monocular camera to create a point cloud of the environment. Upon completion, the present research work aims to provide an autonomous mobile robot the capability to localize itself and aid the user with visualizing the radiation data. Challenges: C++ node needs to properly synchronize image and point cloud data. 3D lidar has resolution of ± 3 cm. Proper camera calibration needed. Transforms need to be precise for proper alignment of image and point-cloud. Results: Voxelated point clouds. Accurate colors from calibrated cameras including details smaller than lidar resolution. Developed Robotics Operating System (ROS) package for ease of transfer to other robot platforms.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2000

KDD Services at the Goddard Earth Sciences Distributed Active Archive Center

NASA's Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) processes, stores and distributes earth science data from a variety of remote sensing satellites. End users of the data range from instrument scientists to global change and climate researchers to federal agencies and foreign governments. Many of these users apply data mining techniques to large volumes of data (up to 1 TB) received from the GES DAAC. However, rapid advances in processing power are enabling increases in data processing that are outpacing tape drive performance and network capacity. As a result, the proportion of data that can be distributed to users continues to decrease. As mitigation, we are migrating more data mining and mining preparation activities into the data center in order to reduce the data volume that needs to be distributed and to offer the users a more useful and manageable product. This migration of activities faces a number of technical and human-factor challenges. As data reduction and mining algorithms are normally quite specific to the user's research needs, the user's algorithm must be integrated virtually unchanged into the archive environment. Also, the archive itself is busy with everyday data archive and distribution activities and cannot be dedicated to, or even impacted by, the mining activities. Therefore, we schedule KDD 'campaigns' (similar to reprocessing campaigns), during which we schedule a wholesale retrieval of specific data products, offering users the opportunity to extract information from the data being retrieved during the campaign.

Lynnes, Christopher↗
DOE OSTI2021

Research challenges and directions in HVAC fault prevalence

This study provides a review of the current state of knowledge, gaps, and potential value in research on the prevalence of faults in commercial buildings. Two separate efforts were made in this study: (1) we performed a literature review to determine the extent of currently available fault prevalence data for heating, ventilation, and air-conditioning (HVAC) systems, and (2) we conducted dozens of interviews with subject matter experts and stakeholders to determine the HVAC fault data that would be of greatest value. Through the literature review and interviews, we discovered unmet needs for empirical data on the prevalence of faults at the desired level of granularity, consistency, and scale; this lack of data leads us to recommend future work studying commercial buildings’ HVAC fault prevalence, with robust fault taxonomy and a variety of meaningful fault prevalence metrics.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Hubble WFC3 Spectroscopy of the Habitable-zone Super-Earth LHS 1140 b

Atmospheric characterization of temperate, rocky planets is the holy grail of exoplanet studies. These worlds are at the limits of our capabilities with current instrumentation in transmission spectroscopy and challenge our state-of-the-art statistical techniques. Here we present the transmission spectrum of the temperate super-Earth LHS 1140b using the Hubble Space Telescope (HST). The Wide Field Camera 3 (WFC3) G141 grism data of this habitable-zone (T {sub eq} = 235 K) super-Earth (R = 1.7 R {sub ⊕}) shows tentative evidence of water. However, the signal-to-noise ratio, and thus the significance of the detection, is low and stellar contamination models can cause modulation over the spectral band probed. We attempt to correct for contamination using these models and find that, while many still lead to evidence for water, some could provide reasonable fits to the data without the need for molecular absorption although most of these cause features in the visible ground-based data which are nonphysical. Future observations with the James Webb Space Telescope would be capable of confirming, or refuting, this atmospheric detection.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2003

Atmospheric Pressure Corrections in Geodesy and Oceanography: a Strategy for Handling Air Tides

Global pressure data are often needed for processing or interpreting modern geodetic and oceanographic measurements. The most common source of these data is the analysis or reanalysis products of various meteorological centers. Tidal signals in these products can be problematic for several reasons, including potentially aliased sampling of the semidiurnal solar tide as well as the presence of various modeling or timing errors. Building on the work of Van den Dool and colleagues, we lay out a strategy for handling atmospheric tides in (re)analysis data. The procedure also offers a method to account for ocean loading corrections in satellite altimeter data that are consistent with standard ocean-tide corrections. The proposed strategy has immediate application to the on-going Jason-1 and GRACE satellite missions.

Ponte, Rui M.↗
NASA NTRS1993

The warped disk of Centaurus A in the near-infrared

We present infrared images of Cen A (NGC 5128) in the J, H, and K bands. The infrared morphology is primarily determined by the presence of a thin absorptive warped disk. By integrating the light of the underlying prolate galaxy through such a disk, we construct models which we compare with infrared and X-ray data. The geometry of the warped disk needed to fit the IR data is consistent with a warped disk which has evolved as a result of differential precession in a prolate potential. The disk has an inclination, with respect to the principal axis of the underlying elliptical galaxy, that is higher at larger radii than in the inner region. A scenario is proposed where a small gas-rich galaxy infalling under the force of dynamical friction is tidally stripped. Stripping occurs at different times during its infall. The orientation of the resulting gas disk depends upon the angular momentum of the infalling galaxy. We find that the resulting precession angle of the disk is well described by the precession model, but that the inclination angle may vary as a function of radius. We propose an orbit for the infalling galaxy that is consistent with the geometry of the warped disk needed to fit our infrared data, and rotation observed in the outer part of the galaxy.

Quillen, A. C.↗
DOE OSTI2021

Expanding Benchmarks for Nuclear Data Validation [Slides]

The presentation discusses benchmarking in comparison to experimental truth, the integral experiments that were performed, and that benchmarks are evaluated experiments. It also discusses validation testing, and that the ultimate goal of the validation end product is to improve evaluated nuclear data for applications It does state that validation highlights errors in the Nuclear Data Pipeline that affect applications, for example: Missing Cd Capture Gammas in ENDF/B-VII.1. It acknowledges that additional types of experiments are needed to test data used in applications, and that validation experiments do not have to be complicated and expensive. The presentation also discusses different types of measurements including activation foil and fission chamber measurements, reactor kinetics measurements, and subcritical measurements. The presentation concludes with an experiment summary and states that all applications need validation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1995

Effect Of Transition Density On Performance Of A DTTL

One estimates minimum transition density needed to limit symbol-error rate. Theoretical calculations and accompanying computer simulations provide numerical basis for specification of minimum data-transition density needed for adequate performance of radio receiver processing noisy signal containing non-return-to-zero (NRZ) stream of data symbols (bits). By use of digital-data-transition-tracking loop (DTTL), receiver strives to synchronize operation with data symbols. Performance of receiver in terms of ability to keep symbol-error rate (SER) in output of receiver below specified level depends on symbol signal-to-noise ratio (SSNR) of incoming signal and on degree of synchronization. Ability of DTTL to maintain synchronization depends partly on SSNR and partly on data-transition density.

Nguyen, Tien M.↗
DOE OSTI2021

Accelerating Multigrid-based Hierarchical Scientific Data Refactoring on GPUs

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth make it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data volumes: ideally, methods that can scale data volumes adaptively so as to enable negotiation of performance and fidelity tradeoffs in different situations. Multigrid-based hierarchical data representations hold promise as a solution to this problem, allowing for flexible conversion between different fidelities so that, for example, data can be created at high fidelity and then transferred or stored at lower fidelity via logically simple and mathematically sound operations. However, the effective use of such representations has been hindered until now by the relatively high costs of creating, accessing, reducing, and otherwise operating on such representations. We describe here highly optimized data refactoring kernels for GPU accelerators that enable efficient creation and manipulation of data in multigrid-based hierarchical forms. We demonstrate that our optimized design can achieve up to 250 TB/s aggregated data refactoring throughput—83% of theoretical peak—on 1024 nodes of the Summit supercomputer. We showcase our optimized design by applying it to a large-scale scientific visualization workflow and the MGARD lossy compression software.

Data refactoring↗