SEARCH · Engineering Papers

Results for “scientific data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88

All sources NASA NTRS DOE OSTI

NASA NTRS2001

Instrument technologies for the detection of extraterrestrial intersteller robotic probes.

In the continuing endeavor to detect evidence of ETI (Extraterrestrial Intelligence) in the solar neighborhood, instrument technologies now exist that allow the formation of a scientific method to carry out a search for interstellar robotic probes of possible extraterrestrial origin. The range of currently observable probe features/manifestations will be shown and how they influence search space, instrument selection and deployment. Autonomous instrument platforms (i.e. robotic observatories) to search for anomalous energy signatures can be designed and assembled using Commercial off-the-shelf (COTS) hardware and software. The COTS approach to observatory design provides an economical, flexible and robust path toward collecting reliable data. The present variety of COTS instruments permits the necessary observational sensitivity , bandwidth and embedded processing speed to establish a nearby robotic probe detection envelope. A survey of these instrument technologies will be presented and how they can be applied to the challenge of collecting enough scientific data on anomalous observational phenomena to determine whether or not a robotic probe was detected

Stride, Scot Lloyd↗

NASA NTRS2000

Wavelet-Based Interpolation and Representation of Non-Uniformly Sampled Spacecraft Mission Data

A well-documented problem in the analysis of data collected by spacecraft instruments is the need for an accurate, efficient representation of the data set. The data may suffer from several problems, including additive noise, data dropouts, an irregularly-spaced sampling grid, and time-delayed sampling. These data irregularities render most traditional signal processing techniques unusable, and thus the data must be interpolated onto an even grid before scientific analysis techniques can be applied. In addition, the extremely large volume of data collected by scientific instrumentation presents many challenging problems in the area of compression, visualization, and analysis. Therefore, a representation of the data is needed which provides a structure which is conducive to these applications. Wavelet representations of data have already been shown to possess excellent characteristics for compression, data analysis, and imaging. The main goal of this project is to develop a new adaptive filtering algorithm for image restoration and compression. The algorithm should have low computational complexity and a fast convergence rate. This will make the algorithm suitable for real-time applications. The algorithm should be able to remove additive noise and reconstruct lost data samples from images.

Bose, Tamal↗

DOE OSTI2022

A thermoelectric materials database auto-generated from the scientific literature using ChemDataExtractor

An auto-generated thermoelectric-materials database is presented, containing 22,805 data records, automatically generated from the scientific literature, spanning 10,641 unique extracted chemical names. Each record contains a chemical entity and one of the seminal thermoelectric properties: thermoelectric figure of merit, ZT; thermal conductivity, κ; Seebeck coefficient, S; electrical conductivity, σ; power factor, PF; each linked to their corresponding recorded temperature, T. The database was auto-generated using the automatic sentence-parsing capabilities of the chemistry-aware, natural language processing toolkit, ChemDataExtractor 2.0, adapted for application in the thermoelectric-materials domain, following a rule-based sentence-simplification step. Data were mined from the text of 60,843 scientific papers that were sourced from three scientific publishers: Elsevier, the Royal Society of Chemistry, and Springer. To the best of our knowledge, this is the first automatically-generated database of thermoelectric materials and their properties from existing literature. The database was evaluated to have a precision of 82.25% and has been made publicly available to facilitate the application of data science in the thermoelectric-materials domain, for analysis, design, and prediction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Profile observations of the Arctic atmospheric boundary layer with the BELUGA tethered balloon during MOSAiC

During the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition, the Balloon-bornE moduLar Utility for profilinG the lower Atmosphere (BELUGA) was deployed from an ice floe drifting in the Fram Strait from 29 June to 27 July 2020. The BELUGA observations aimed to characterize the cloudy Arctic atmospheric boundary layer above the sea ice using a modular setup of five instrument packages. The in situ measurements included atmospheric thermodynamic and dynamic state parameters (air temperature, humidity, pressure, and three-dimensional wind), broadband solar and terrestrial irradiance, aerosol particle microphysical properties, and cloud particle images. In total, 66 profile observations were collected during 33 balloon flights from the surface to maximum altitudes of 0.3 to 1.5 km. The profiles feature a high vertical resolution of 0.01 m to 1 m, including measurements below, inside, and above frequently occurring low-level clouds. This publication describes the balloon operations, instruments, and the obtained data set. We invite the scientific community for joint analysis and model application of the freely available data on PANGAEA.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

47 Tuc in Rubin Data Preview 1. Exploring Early LSST Data and Science Potential

We present analyses of the early data from Rubin Observatory’s Data Preview 1 (DP1) for the field of the globular cluster 47 Tuc. The DP1 data set for 47 Tuc includes four nights of observations from the Rubin Commissioning Camera (LSSTComCam), covering multiple bands (ugriy). We address challenges of crowding in the inner region of the cluster and toward the SMC in DP1, and demonstrate improved star–galaxy separation by fitting fifth-degree polynomials to the stellar loci in color–color diagrams and applying multidimensional sigma clipping. We compile a catalog of 3576 probable 47 Tuc member stars selected via a combination of isochrone, Gaia proper-motion, and color–color space matched filtering. We explore the sources of photometric scatter in the 47 Tuc color–color sequence, evaluating contributions from various potential sources, including differential extinction within the cluster. Finally, of the 72 well-characterized variables in the field, we recover three known variable stars, including two RR Lyrae and one eclipsing binary, in the coadd-based object catalog, and identify 62 in the difference image-based object catalog. Although the DP1 lightcurves have sparse temporal sampling, they appear to follow the patterns of densely sampled literature lightcurves well. Despite some data limitations for crowded-field stellar analysis, DP1 demonstrates the promising scientific potential for future LSST data releases.

Choi, Yumi [NSF National Optical-Infrared Astronom↗

NASA NTRS1982

Data processing for a cosmic ray experiment onboard the solar probes Helios 1 and 2: Experiment 6

The data processing system for the Helios experiment 6, measuring energetic charged particles of solar, planetary and galactic origin in the inner solar system, is described. The aim of this experiment is to extend knowledge on origin and propagation of cosmic rays. The different programs for data reduction, analysis, presentation, and scientific evaluation are described as well as hardware and software of the data processing equipment. A chronological presentation of the data processing operation is given. Procedures and methods for data analysis which were developed can be used with minor modifications for analysis of other space research experiments.

Mueller-Mellin, R.↗

NASA NTRS2008

Hyperspectral Sun Photometer for Atmospheric Characterization and Vicarious Calibrations

A hyperspectral sun photometer and associated methods have been developed and demonstrated. Accurate sun photometer calibration is critical to properly measure the solar irradiance and characterize the atmosphere. Traditional sun photometer calibration requires solar observations over several hours. In contrast, the procedures for operating this photometer entail less data acquisition time and embody a more direct approach to calibration. The scientific value of the measurement data produced by this instrument is not adversely affected by atmospheric instability. In addition, this instrument yields hyperspectral data covering a large spectral range (350-2,500 nm) not available from most traditional sun photometers. The hyperspectral sun photometer components include (1) a commercially available spectroradiometer that has been laboratory-calibrated and (2) a commercially available reflectance standard panel that exhibits nearly Lambertian 99% reflectance. The spectroradiometer is positioned above, and aimed downward at, the panel. The procedure for operating this instrument calls for a series of measurements: one in which the panel is fully illuminated by the sun, one in which a shade is positioned between the panel and the sun, and two in which the shade is positioned to cast a shadow to either side of the panel. The total sequence of measurements can be performed in less than a minute. From these measurements, the total radiance, the diffuse radiance, and the direct solar radiance are calculated. The direct solar irradiance is calculated from the direct solar radiance and the known reflectance factor of the panel as a function of the solar zenith angle. Atmospheric characteristics are estimated from the optical depth at various wavelengths calculated from (1) the direct solar irradiance obtained as described above, (2) the air mass along a column from the measurement position to the Sun, and (3) the top-of-atmosphere solar irradiance. The instrumentation used to implement the sun photometer is the same as that used to characterize targets used in radiometric vicarious calibrations. Utilizing this type of sun photometer thus reduces the amount of instrumentation and labor required to perform these studies.

Pagnutti, Mary↗

DOE OSTI2021

X-composer: enabling cross-environments in-situ workflows between HPC and cloud

As large-scale scientific simulations and big data analyses become more popular, it is increasingly more expensive to store huge amounts of raw simulation results to perform post-analysis. To minimize the expensive data I/O, "in-situ" analysis is a promising approach, where data analysis applications analyze the simulation generated data on the fly without storing it first. However, it is challenging to organize, transform, and transport data at scales between two semantically different ecosystems due to the distinct software and hardware difference. To tackle these challenges, we design and implement the X-Composer framework. X-Composer connects cross-ecosystem applications to form an "in-situ" scientific workflow, and provides a unified approach and recipe for supporting such hybrid in-situ workflows on distributed heterogeneous resources. X-Composer reorganizes simulation data as continuous data streams and feeds them seamlessly into the Cloud-based stream processing services to minimize I/O overheads. For evaluation, we use X-Composer to set up and execute a cross-ecosystem workflow, which consists of a parallel Computational Fluid Dynamics simulation running on HPC, and a distributed Dynamic Mode Decomposition analysis application running on Cloud. Our experimental results show that X-Composer can seamlessly couple HPC and Big Data jobs in their own native environments, achieve good scalability, and provide high-fidelity analytics for ongoing simulations in real-time.

Wang, Dali↗

DOE OSTI2024

Effective Visualization of Radar Data for Users Impacted by Color Vision Deficiency

Color vision deficiency (CVD) is a decreased ability to discern between particular colors. Eight percent of genetic males and half a percent of genetic females have some form of CVD, with many in the radar community falling into this group. When presenting data on a two-dimensional plane, it is common to use colors to represent values via a colormap. Colormap choice in the radar community is influenced by the ability to highlight scientifically interesting features in data, institutional choices, and domain dominance of legacy colormaps. The problem with these current colormaps is that many do not project well for those with CVD (i.e., green next to red). In working with the CVD community to address this problem, multiple colormaps for moments such as equivalent reflectivity factor and Doppler velocity were created for users with forms of CVD such as deuteranomaly, protanomaly, protanopia, and deuteranopia using Python tools such as colorspacious and viscm. We show how these colormaps can improve interpretability for four cases: a mesoscale convective system, a pyrocumulonimbus storm, a wintertime midlatitude cyclone, and widespread storms with a large bird migration. These new radar equivalent reflectivity factor, Doppler velocity, and polarization colormaps are designed to highlight rain, frozen precipitation, nonmeteorological targets, and velocity-based items, are perceptually uniform, and are visually friendly for those with CVD.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2017

An Innovative Infrastructure with a Universal Geo-Spatiotemporal Data Representation Supporting Cost-Effective Integration of Diverse Earth Science Data

The SpatioTemporal Adaptive Resolution Encoding (STARE) is a unifying scheme encoding geospatial and temporal information for organizing data on scalable computing/storage resources, minimizing expensive data transfers. STARE provides a compact representation that turns set-logic functions into integer operations, e.g. conditional sub-setting, taking into account representative spatiotemporal resolutions of the data in the datasets. STARE geo-spatiotemporally aligns data placements of diverse data on massive parallel resources to maximize performance. Automating important scientific functions (e.g. regridding) and computational functions (e.g. data placement) allows scientists to focus on domain-specific questions instead of expending their efforts and expertise on data processing. With STARE-enabled automation, SciDB (Scientific Database) plus STARE provides a database interface, reducing costly data preparation, increasing the volume and variety of interoperable data, and easing result sharing. Using SciDB plus STARE as part of an integrated analysis infrastructure dramatically eases combining diametrically different datasets.

Rilee, Michael Lee↗

NASA NTRS2024

Effective Visualization of Radar Data for Users Impacted By Color Vision Deficiency

Color Vision Deficiency (CVD) is a decreased ability to discern between particular colors. Eight percent of genetic males and half a percent of genetic females have some form of CVD, with many in the radar community falling into this group. When presenting data on a two-dimensional plane, it is common to use colors to represent values via a colormap. Colormap choice in the radar community is influenced by the ability to highlight scientifically interesting features in data, institutional choices, and domain dominance of legacy colormaps. The problem with these current colormaps is that many do not project well for those with CVD (i.e., green next to red). In working with the CVD community to address this problem, multiple colormaps for moments such as equivalent reflectivity factor and Doppler velocity were created for users with forms of CVD such as deuteranomaly, protanomaly, protanopia, and deuteranopia using Python tools such as colorspacious and viscm. We show how these colormaps can improve interpretability for four cases: a mesoscale convective system, a pyrocumulonimbus storm, a wintertime mid-latitude cyclone, and widespread storms with a large bird migration. These new radar equivalent reflectivity factor, Doppler velocity, and polarization colormaps are designed to highlight rain, frozen precipitation, non-meteorological targets, velocity-based items, be perceptually uniform, and visually friendly for those with CVD.

Zachary Sherman↗

DOE OSTI2024

A Survey of Open-Source Tools for Transmission and Distribution Systems Research

This work presents a review of open-source electric power transmission and distribution systems analysis tools suitable for use by industry professionals and academic researchers. Due to the high complexity of the electric grid, there exist numerous tools and extensive research pertaining to nearly every aspect of the design, operation, and control of transmission and distribution networks. In addition to the commercial tools, a wide range of free, open-source tools, models, and data usable by the scientific community for related research have been developed by different organizations, including both international and US universities and national laboratories. However, due to the absence of a catalog of available tools, models and data, researchers often lack a knowledge of existing capabilities and may develop duplicative software and tools. Increasing awareness of these available resources seeks to accelerate their broader use, leading to more efficient and standardized grid analysis. This review paper (which is part of a larger survey effort that studied over 400 tools in the transmission, distribution, buildings, and electric vehicles space) outlines selected open-source resources that have been developed in power transmission and distribution systems research. It is anticipated that this work can serve as a guide for industry and academic researchers alike, ensuring that research efforts are well-channeled.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Geophysical Observations of the 2023 September 24 OSIRIS-REx Sample Return Capsule Reentry

Sample return capsules (SRCs) entering Earth's atmosphere at hypervelocity from interplanetary space are a valuable resource for studying meteor phenomena. The 2023 September 24 arrival of the Origins, Spectral Interpretation, Resource Identification, and Security-Regolith Explorer SRC provided an unprecedented chance for geophysical observations of a well-characterized source with known parameters, including timing and trajectory. A collaborative effort involving researchers from 16 institutions executed a carefully planned geophysical observational campaign at strategically chosen locations, deploying over 400 ground-based sensors encompassing infrasound, seismic, distributed acoustic sensing, and Global Positioning System technologies. Additionally, balloons equipped with infrasound sensors were launched to capture signals at higher altitudes. This campaign (the largest of its kind so far) yielded a wealth of invaluable data anticipated to fuel scientific inquiry for years to come. The success of the observational campaign is evidenced by the near-universal detection of signals across instruments, both proximal and distal. This paper presents a comprehensive overview of the collective scientific effort, field deployment, and preliminary findings. The early findings have the potential to inform future space missions and terrestrial campaigns, contributing to our understanding of meteoroid interactions with planetary atmospheres. Furthermore, the data set collected during this campaign will improve entry and propagation models and augment the study of atmospheric dynamics and shock phenomena generated by meteoroids and similar sources.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS1980

Data processing system for the Sneg-2MP experiment

The data processing system for scientific experiments on stations of the "Prognoz" type provides for the processing sequence to be broken down into a number of consecutive stages: preliminary processing, primary processing, secondary processing. The tasks of each data processing stage are examined for an experiment designed to study gamma flashes of galactic origin and solar flares lasting from several minutes to seconds in the 20 kev to 1000 kev energy range.

Gavrilova, Y. A.↗

DOE OSTI2020

Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been recently reported that successfully solve PDEs, with examples including deep feed forward networks, generative networks, and deep encoder-decoder networks. However, practical adoption of these approaches is limited by the difficulty in training these models, especially to make predictions at large output resolutions (≥1024×1024). Here we report on a software framework for data parallel distributed deep learning that resolves the twin challenges of training these large SciML models - training in reasonable time as well as distributing the storage requirements. Our framework provides several out of the box functionality including (a) loss integrity independent of number of processes, (b) synchronized batch normalization, and (c) distributed higher-order optimization methods. We show excellent scalability of this framework on both cloud as well as HPC clusters, and report on the interplay between bandwidth, network topology and bare metal vs cloud. We deploy this approach to train generative models of sizes hitherto not possible, showing that neural PDE solvers can be viably trained for practical applications. We also demonstrate that distributed higher-order optimization methods are 2-3× faster than stochastic gradient-based methods and provide minimal convergence drift with higher batch-size.

PDEs↗

DOE OSTI2019

DOE Data Day 2019 Report

The Department of Energy (DOE) has joined the larger scientific community in the promotion of data management as a means to higher quality, more efficient research and analysis, and as a critical component of data science. Tools and platforms to support data management and analysis are rapidly evolving and provide enormous opportunities. They also pose challenges that can be specific to DOE but are common across DOE mission areas and organizations. The DOE Data Day (D3) workshop was held on September 25–26, 2019, and organized by a team at Lawrence Livermore National Laboratory (LLNL) in an effort to gather the data management practitioners at the DOE labs together to share their work and results, facilitating knowledge transfers and best practices across project teams. Over 100 attendees participated from multiple national labs—LLNL, Sandia (SNL), Lawrence Berkeley (LBNL), Los Alamos (LANL), Oak Ridge (ORNL), Argonne (ANL), Pacific Northwest (PNNL), Stanford Linear Accelerator (SLAC)—along with Mission Support and Test Services (MSTS), National Energy Technology Laboratory (NETL), Pantex, National Security Complex (Y-12), National Nuclear Security Administration (NNSA), the DOE Office of Scientific and Technical Information (OSTI), and elsewhere in the DOE complex.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

NASA NTRS1972

Monitoring of solar far ultraviolet radiation from the OSO-5 satellite

A spectrophotometer for monitoring the solar EUV in three broad wavelength bands is described. The kind of data obtained, along with sources of error, are presented. The content of the tape library which contains the data is outlined. The scientific results are discussed. These include the following: solar flares in the EUV, solar eclipse observations in the EUV, SFD's and relationship to solar flares, and the application of satellite sunrise and sunset data for the study of model upper atmospheres for the earth.

Rense, W. A.↗

NASA NTRS2018

Overview of SAND-E: Semi-Autonomous Navigation for Detrital Environments

Rovers are the state of the art for the exploration and detection of past habitability and life on other worlds. One of the most basic functions of a rover is terrain navigation. Information collected by the rover is used autonomously to mitigate terrain hazards such large rocks, while humans qualitatively assess hazardous geologic terrain such as soil type and degree of rock cover. Planetary scientists use the same information to select targets such as drill sites, and for basic scientific analysis such as characterization of rock outcrops. Although the data is complementary, data from terrain analysis for navigation and terrain analysis for scientific investigations are poorly integrated. The lack of integration creates science and operation inefficiencies that limit exploration of habitable environments. As new modes of exploration come online, such as unmanned aerial systems (UAS) (e.g., the Mars Helicopter Scout and Titan Dragonfly), a need exists to integrate terrain data and science analysis to improve operational and scientific outcomes during exploration. We present an overview of a project aimed at evaluating the effectiveness and capability rover and UAS-based semi-automated terrain analysis using the Automated Soil Assessment Systems (ASAS) developed by Mission Control Space Services for navigating, selecting targets for sampling, and characterizing mafic detrital sediments along glacio-fluvial-aeolian sand transport pathways in Iceland. We describe recent advances in automated terrain analysis in sandy environments and scientific uses of terrain assessment from sandy environments. We assess fluvial and aeolian terrains in Iceland and show how terrain analysis data can inform scientific characterization of these environments.

Ewing, Ryan C.↗