Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

CALIBRATED ULTRA FAST IMAGE SIMULATIONS FOR THE DARK ENERGY SURVEY

Image simulations are becoming increasingly important in understanding the measurement process of the shapes of galaxies for weak lensing and the associated systematic effects. For this purpose we present the first implementation of the Monte Carlo Control Loops (MCCL), a coherent framework for studying systematic effects in weak lensing. It allows us to model and calibrate the shear measurement process using image simulations from the Ultra Fast Image Generator (UFig) and the image analysis software SExtractor. We apply this framework to a subset of the data taken during the Science Verification period (SV) of the Dark Energy Survey (DES). We calibrate the UFig simulations to be statistically consistent with one of the SV images, which covers ∼0.5 square degrees. We then perform tolerance analyses by perturbing six simulation parameters and study their impact on the shear measurement at the one-point level. This allows us to determine the relative importance of different parameters. For spatially constant systematic errors and point-spread function, the calibration of the simulation reaches the weak lensing precision needed for the DES SV survey area. Furthermore, we find a sensitivity of the shear measurement to the intrinsic ellipticity distribution, and an interplay between the magnitude-size and the pixel value diagnostics in constraining the noise model. This work is the first application of the MCCL framework to data and shows how it can be used to methodically study the impact of systematics on the cosmic shear measurement.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Data Imbalance, Uncertainty Quantification, and Transfer Learning in Data‐Driven Parameterizations: Lessons From the Emulation of Gravity Wave Momentum Transport in WACCM

Abstract Neural networks (NNs) are increasingly used for data‐driven subgrid‐scale parameterizations in weather and climate models. While NNs are powerful tools for learning complex non‐linear relationships from data, there are several challenges in using them for parameterizations. Three of these challenges are (a) data imbalance related to learning rare, often large‐amplitude, samples; (b) uncertainty quantification (UQ) of the predictions to provide an accuracy indicator; and (c) generalization to other climates, for example, those with different radiative forcings. Here, we examine the performance of methods for addressing these challenges using NN‐based emulators of the Whole Atmosphere Community Climate Model (WACCM) physics‐based gravity wave (GW) parameterizations as a test case. WACCM has complex, state‐of‐the‐art parameterizations for orography‐, convection‐, and front‐driven GWs. Convection‐ and orography‐driven GWs have significant data imbalance due to the absence of convection or orography in most grid points. We address data imbalance using resampling and/or weighted loss functions, enabling the successful emulation of parameterizations for all three sources. We demonstrate that three UQ methods (Bayesian NNs, variational auto‐encoders, and dropouts) provide ensemble spreads that correspond to accuracy during testing, offering criteria for identifying when an NN gives inaccurate predictions. Finally, we show that the accuracy of these NNs decreases for a warmer climate (4 × CO 2 ). However, their performance is significantly improved by applying transfer learning, for example, re‐training only one layer using ∼1% new data from the warmer climate. The findings of this study offer insights for developing reliable and generalizable data‐driven parameterizations for various processes, including (but not limited to) GWs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluating the factors influencing accuracy, interpretability, and reproducibility in the use of machine learning classifiers in biology to enable standardization

The complexity and variability of biological data has promoted the increased use of machine learning methods to understand processes and predict outcomes. These same features complicate reliable, reproducible, interpretable, and responsible use of such methods, resulting in questionable relevance of the derived. outcomes. Here we systematically explore challenges associated with applying machine learning to predict and understand biological processes using a well- characterized in vitro experimental system. We evaluated factors that vary while applying machine learning classifers: (1) type of biochemical signature (transcripts vs. proteins), (2) data curation methods (pre- and post-processing), and (3) choice of machine learning classifier. Using accuracy, generalizability, interpretability, and reproducibility as metrics, we found that the above factors significantly mod- ulate outcomes even within a simple model system. Our results caution against the unregulated use of machine learning methods in the biological sciences, and strongly advocate the need for data standards and validation tool-kits for such studies.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1979

Future planetary probes for Jupiter and Saturn

The paper describes a study conducted to identify the technology developments that would allow deep atmospheric investigations of Jupiter and Saturn to proceed beyond currently planned investigation of the upper atmosphere. The study considered a deep probe mission that would provide the capability to scientifically examine planetary atmospheres to the 1000-bar level and 1400-K level. The major conclusions of the study are that (1) a probe designed for Jupiter can be used with minor changes for Saturn, (2) new science instrument technology developments are required, and (3) the only new technology developments required in the engineering subsystem are high pressure thermal insulation materials and advanced data processing techniques.

Butts, A. J.↗
NASA NTRS1992

Data Distribution Satellite

The Data Distribution Satellite (DDS) is described in terms of its role in providing space-data and communication services for the National Research and Education Network. The DDS is envisioned as a processing link in the microwave network that would connect academic, industrial, and government institutions to a high-data-rate service of space data. The general need for science communications is assessed, and it is shown that the data potential exceeds the available spectrum. The DDS could act as a bridge between terrestrial facilities the space network, and other space platforms to provide efficient access to space science data. Government demand for this type of data is high suggesting that the DDS could make use of hopping beams to provide more data at reduced costs.

Stevens, Grady H.↗
NASA NTRS1992

The Global Ocean Observing System

A Global Ocean Observing System (GOOS) should be established now with international coordination (1) to address issues of global change, (2) to implement operational ENSO forecasts, (3) to provide the data required to apply global ocean circulation models, and (4) to extract the greatest value from the one billion dollar investment over the next ten years in ocean remote sensing by the world's space agencies. The objectives of GOOS will focus on climatic and oceanic predictions, on assessing coastal pollution, and in determining the sustainability of living marine resources and ecosystems. GOOS will be a complete system including satellite observations, in situ observations, numerical modeling of ocean processes, and data exchange and management. A series of practical and economic benefits will be derived from the information generated by GOOS. In addition to the marine science community, these benefits will be realized by the energy industries of the world, and by the world's fisheries. The basic oceanic variables that are required to meet the oceanic and predictability objectives of GOOS include wind velocity over the ocean, sea surface temperature and salinity, oceanic profiles of temperature and salinity, surface current, sea level, the extent and thickness of sea ice, the partial pressure of CO2 in surface waters, and the chlorophyll concentration of surface waters. Ocean circulation models and coupled ocean-atmosphere models can be used to evaluate observing system design, to assimilate diverse data sets from in situ and remotely sensed observations, and ultimately to predict future states of the system. The volume of ocean data will increase enormously over the next decade as new satellite systems are launched and as complementary in situ measuring systems are deployed. These data must be transmitted, quality controlled, exchanged, analyzed, and archived with the best state-of-the-art computational methods.

Kester, Dana↗
NASA NTRS1992

Global views of Venus from Magellan

Magellan data for Venus reveal a planet with a great diversity of volcanic and tectonic landforms, with good evidence of continuing volcanism and tectonism. Weathering, mass wasting and wind erosion and deposition have modified the surface only to the extent of a few meters, thereby preserving an excellent record of tectonic and volcanic processes on a terrestrial-size planet. All cycle 1 mosaics, radiometry, and altimeter data will be made available through the Planetary Data System and the National Space Science Data Center.

Arvidson, R. E.↗
NASA NTRS2000

BOREAS Level-0 ER-2 Navigation Data

The BOREAS Staff Science effort covered those activities that were BOREAS community-level activities or required uniform data collection procedures across sites and time. These activities included the acquisition, processing, and archiving of aircraft navigation/attitude data to complement the digital image data. The level-0 ER-2 navigation data files contain aircraft attitude and position information acquired during the digital image and photographic data collection missions. Temporally, the data were acquired from April to September 1994. Data were recorded at intervals of 5 seconds. The data are stored in tabular ASCII files.

Strub, Richard↗
NASA NTRS2002

NASA IKONOS Radiometric Characterization

The objective of this program: Perform radiometric vicarious calibrations of IKQNOS imagery and compare with Space Imaging calibration coefficients The approach taken: utilize multiple well-characterized sites which are widely used by the NASA science community for radiometric characterization of airborne and spaceborne sensors; and to Perform independent characterizations with independent teams. Each team has slightly different measurement techniques and data processing methods.

Pagnutti, Mary↗
NASA NTRS2010

NASA Tech Briefs, March 2010

Topics covered include: Software Tool Integrating Data Flow Diagrams and Petri Nets; Adaptive Nulling for Interferometric Detection of Planets; Reducing the Volume of NASA Earth-Science Data; Reception of Multiple Telemetry Signals via One Dish Antenna; Space-Qualified Traveling-Wave Tube; Smart Power Supply for Battery-Powered Systems; Parallel Processing of Broad-Band PPM Signals; Inexpensive Implementation of Many Strain Gauges; Constant-Differential-Pressure Two-Fluid Accumulator; Inflatable Tubular Structures Rigidized with Foams; Power Generator with Thermo-Differential Modules; Mechanical Extraction of Power From Ocean Currents and Tides; Nitrous Oxide/Paraffin Hybrid Rocket Engines; Optimized Li-Ion Electrolytes Containing Fluorinated Ester Co-Solvents; Probabilistic Multi-Factor Interaction Model for Complex Material Behavior; Foldable Instrumented Bits for Ultrasonic/Sonic Penetrators; Compact Rare Earth Emitter Hollow Cathode; High-Precision Shape Control of In-Space Deployable Large Membrane/Thin-Shell Reflectors; Rapid Active Sampling Package; Miniature Lightweight Ion Pump; Cryogenic Transport of High-Pressure-System Recharge Gas; Water-Vapor Raman Lidar System Reaches Higher Altitude; Compact Ku-Band T/R Module for High-Resolution Radar Imaging of Cold Land Processes; Wide-Field-of-View, High-Resolution, Stereoscopic Imager; Electrical Capacitance Volume Tomography with High-Contrast Dielectrics; Wavefront Control and Image Restoration with Less Computing; Polarization Imaging Apparatus; Stereoscopic Machine-Vision System Using Projected Circles; Metal Vapor Arcing Risk Assessment Tool; Performance Bounds on Two Concatenated, Interleaved Codes; Parameterizing Coefficients of a POD-Based Dynamical System; Confidence-Based Feature Acquisition; Algorithm for Lossless Compression of Calibrated Hyperspectral Imagery; Universal Decoder for PPM of any Order; Algorithm for Stabilizing a POD-Based Dynamical System; Mission Reliability Estimation for Repairable Robot Teams; Processing AIRS Scientific Data Through Level 3; Web-Based Requesting and Scheduling Use of Facilities; AutoGen Version 5.0; Time-Tag Generation Script; PPM Receiver Implemented in Software; Tropospheric Emission Spectrometer Product File Readers; Reporting Differences Between Spacecraft Sequence Files; Coordinating "Execute" Data for ISS and Space Shuttle; Database for Safety-Oriented Tracking of Chemicals; Apparatus for Cold, Pressurized Biogeochemical Experiments; Growing B Lymphocytes in a Three-Dimensional Culture System; Tissue-like 3D Assemblies of Human Broncho-Epithelial Cells; Isolation of Resistance-Bearing Microorganisms; Oscillating Cell Culture Bioreactor; and Liquid Cooling/Warming Garment.

Source record↗
NASA NTRS2019

HelioSwarm: Swarm Mission Design in High Altitude Orbit for Heliophysics

Resolving the complex three-dimensional turbulent structures that characterize the solar wind requires contemporaneous spatially and temporally distributed measurements. HelioSwarm is a mission concept that will deploy multiple, co-orbiting satellites to use the solar wind as a natural laboratory for understanding the fundamental, universal process of plasma turbulence. The HelioSwarm transfer trajectory and science orbit use a lunar gravity assist to deliver the ESPA-class nodes attached to a large data transfer hub to a P/2 lunar resonant orbit. Once deployed in the science orbit, the free-flying, propulsive nodes use simple Cartesian relative motion patterns to establish baseline separations both along and across the solar wind flow direction.

lunar resonant orbit↗
NASA NTRS2019

HelioSwarm: Swarm Mission Design in High Altitude Orbit for Heliophysics

Resolving the complex three-dimensional turbulent structures that characterize the solar wind requires contemporaneous spatially and temporally distributed measurements. HelioSwarm is a mission concept that will deploy multiple, co-orbiting satellites to use the solar wind as a natural laboratory for understanding the fundamental, universal process of plasma turbulence. The HelioSwarm transfer trajectory and science orbit use a lunar gravity assist to deliver the ESPA-class nodes attached to a large data transfer hub to a P/2 lunar resonant orbit. Once deployed in the science orbit, the free-flying, propulsive nodes use simple Cartesian relative motion patterns to establish baseline separations both along and across the solar wind flow direction.

lunar resonant orbit↗
NASA NTRS2021

Campaign: Telemetry-based Biology for the Artemis Era and Beyond

We call for a major dedicated campaign to develop and fly autonomous biological payloads in lunar orbit and on the lunar surface during the next decade, followed by subsequent expansion to Martian orbit. This ambitious goal will require dedicated effort to develop hardware, biological models and data acquisition and processing techniques. We believe that it would be best achieved as a single comprehensive, NASA-led and funded mission project, analogous to planetary science missions. Furthermore, technological developments should be accompanied by collaborations within and between agencies and a robust program for acquisition and retention of talented scientists and engineers.

Egle Cekanaviciute↗
NASA NTRS2022

Mitigation Strategies for the Impact of Low Energy Laser Pulses in CALIOP Calibration and Level 2 Retrievals

Since mid-2016, the frequency of low energy laser pulses emitted by the CALIPSO lidar has been slowly increasing due to pressure losses in the canister housing the laser. While originally confined primarily to the South Atlantic Anomaly (SAA) region, these low energy pulses now occur intermittently around the globe. Low energy pulses can cause calibration biases and degrade the science quality of level 2 retrievals. We describe a new low energy mitigation (LEM) algorithm that will be implemented incrementally in future versions of the CALIOP data processing to identify and reject affected profiles during calibration and feature detection. The LEM algorithm effectively eliminates low energy calibration biases, improves level 2 retrievals, and minimizes level 2 data loss.

Jason Tackett↗
NASA NTRSDate not supplied

An Analytic Collaborative Framework for the Earth System Observatory

NASA's Earth System Observatory groundbreaking observations will provide critical measurements to address societal relevant problems in climate change, natural hazard mitigation, fighting forest fires, and improving real-time agricultural processes. Central to the ESO vision is the notion of Open-Source Science (OSS), a collaborative culture enabled by technology that promotes the open sharing of data, information, and knowledge aiming to facilitate and accelerate scientific understanding, and the agile development of applications for the benefit of society. The larger vision of an Earth System Digital Twin (ESDT) calls for integrated Earth science frameworks that mirror the Earth by a proxy digital construct that includes km-scale resolution Earth system models and data assimilation systems along with an integrated set of analytic tools to enable the next generation of science discoveries and evidence-based decision making. The goal of this project is to develop an Analytic Collaborative Framework for ESO missions, based on realistic, science-based observing system simulations and the Program of Record (PoR). Tying it all together is a cloud-based cyberinfrastructure that will enable each uniquely designed satellite in the Earth System Observatory to work in tandem to create a 3D, holistic view of Earth. In this presentation, we lay the technological groundwork for enabling such a vision. Our approach consists of the 3 main interconnected building blocks: 1. Cloud-optimized representative datasets for ESO missions and the PoR to serve as basis for developing and prototyping an Analytic Collaborative Framework. 2. An Algorithm Workbench for enabling experimentation and exploration of synergistic algorithms not only for instruments within a mission, but also including the PoR and other ESO missions. 3. A series of concrete Open-Source Science demonstrations including use cases that span science discovery and end-user applications with direct societal impact. While our ultimate goal is to include all of the main missions comprising the Earth System Observatory, in our initial 2 years we will focus on AOS and SBG, two missions for which specific synergisms have been identified in a recent workshop. In this presentation we will describe our approach and discuss some illustrative examples of our framework.

Arlindo da SIlva↗
NASA NTRSDate not supplied

An Analytic Collaborative Framework for the Earth System Observatory

NASA's Earth System Observatory groundbreaking observations will provide critical measurements to address societal relevant problems in climate change, natural hazard mitigation, fighting forest fires, and improving real-time agricultural processes. Central to the ESO vision is the notion of Open-Source Science (OSS), a collaborative culture enabled by technology that promotes the open sharing of data, information, and knowledge aiming to facilitate and accelerate scientific understanding, and the agile development of applications for the benefit of society. The larger vision of an Earth System Digital Twin (ESDT) calls for integrated Earth science frameworks that mirror the Earth by a proxy digital construct that includes km-scale resolution Earth system models and data assimilation systems along with an integrated set of analytic tools to enable the next generation of science discoveries and evidence-based decision making. The goal of this project is to develop an Analytic Collaborative Framework for ESO missions, based on realistic, science-based observing system simulations and the Program of Record (PoR). Tying it all together is a cloud-based cyberinfrastructure that will enable each uniquely designed satellite in the Earth System Observatory to work in tandem to create a 3D, holistic view of Earth. In this presentation, we lay the technological groundwork for enabling such a vision. Our approach consists of the 3 main interconnected building blocks: 1. Cloud-optimized representative datasets for ESO missions and the PoR to serve as basis for developing and prototyping an Analytic Collaborative Framework. 2. An Algorithm Workbench for enabling experimentation and exploration of synergistic algorithms not only for instruments within a mission, but also including the PoR and other ESO missions. 3. A series of concrete Open-Source Science demonstrations including use cases that span science discovery and end-user applications with direct societal impact. While our ultimate goal is to include all of the main missions comprising the Earth System Observatory, in our initial 2 years we will focus on AOS and SBG, two missions for which specific synergisms have been identified in a recent workshop. In this presentation we will describe our approach and discuss some illustrative examples of our framework.

Arlindo da SIlva↗
DOE OSTI2021

Enabling modern data discovery for atmospheric measurements

The Atmospheric Radiation Measurement (ARM) user facility is a US Department of Energy Office of Science user facility that is managed and operated through a collaborative effort led by nine US Department of Energy national laboratories. The ARM Data Center, located at Oak Ridge National Laboratory, is responsible for the timely collection, processing, and delivery of data products to the scientific community. The ARM Data Center holds more than 11,000 data products, including metadata collected from field campaigns, instruments, value-added products, and principal investigator–contributed data. These data sets are checked for successful transfer (for most data, this transfer is carried out automatically via the network; however, some of the largest data sets and some of the most remote sites require manual shipping of hard disks) and both the data and metadata are processed to a standard format, which is an ARM-standardized structure, via the Network Common Data Form. The Network Common Data Form is a self-describing binary format with many compatible software tools. Once processed, the data are cataloged, stored in the ARM Data Archive, and made discoverable through association with an array of metadata-characterizing information, such as location and measurement classification. These metadata enable powerful search capabilities through the ARM Data Center Data Discovery interface. This paper discusses the workflow of how the new discovery system has been redesigned from user requirements and how the data are distributed to the scientific community.

54 ENVIRONMENTAL SCIENCES↗