Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data sciences”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Evaluating Cloud Computing in the Proposed NASA DESDynI Ground Data System

The proposed NASA Deformation, Ecosystem Structure and Dynamics of Ice (DESDynI) mission would be a first-of-breed endeavor that would fundamentally change the paradigm by which Earth Science data systems at NASA are built. DESDynI is evaluating a distributed architecture where expert science nodes around the country all engage in some form of mission processing and data archiving. This is compared to the traditional NASA Earth Science missions where the science processing is typically centralized. What's more, DESDynI is poised to profoundly increase the amount of data collection and processing well into the 5 terabyte/day and tens of thousands of job range, both of which comprise a tremendous challenge to DESDynI's proposed distributed data system architecture. In this paper, we report on a set of architectural trade studies and benchmarks meant to inform the DESDynI mission and the broader community of the impacts of these unprecedented requirements. In particular, we evaluate the benefits of cloud computing and its integration with our existing NASA ground data system software called Apache Object Oriented Data Technology (OODT). The preliminary conclusions of our study suggest that the use of the cloud and OODT together synergistically form an effective, efficient and extensible combination that could meet the challenges of NASA science missions requiring DESDynI-like data collection and processing volumes at reduced costs.

Benchmark↗
DOE OSTI2021

Integrated parameter and process learning for hydrologic and biogeochemical modules in Earth System Models

Focus area: Primary focal area #2; secondary focal area #3: Learning about parameters and processes of land surface hydrologic and biogeochemical models in Earth System models by integrating machine learning, physics, and big data. Science challenges: How do we maximally leverage big-data observations to improve hydrobiogeochemical process description and parameterization so that such modules more realistically capture hydrologic and vegetation responses and feedbacks under the future climate? For example, how can we leverage physics, limited observations of vegetation and streamflow to better estimate evapotranspiration, and, relatedly, net primary productivity, especially for drought areas? Vegetation plays a critical role in regional and global water cycles; however, existing vegetation models have failed to predict vegetation response to droughts (McDowell & Xu, 2017) , arctic greening (Keenan & Riley, 2018) , and critical transitions between forest and savanna (Hirota et al., 2011) . These studies suggest that when we build process-based models (PBM) parameterized from regional and global plant traits, we tend to poorly describe plant adaptation and local-scale competition processes. The models and their associated parameters assigned for different regions in the world are not capturing essential heterogeneity in vegetation responses at finer spatial scales. Many parameters of the land surface models control hydrology and vegetation dynamics at the same time. The heterogeneity in vegetation response is a function of (i) plant type, (ii) plant size, (iii) competition and succession, (iv) environmental controls, and (v) local variations due to the unique ecological community that are very difficult to describe (e.g., the size of gaps resulting from fire that facilitated the coexistence of pioneering species). In the demographic models, only factors (i) and (iv) were captured, and plant types were generally described only by leaf phenology and climate zones. With current demographic models, we generally consider more traits to define plant types (i) and calibrate these traits to consider factors (ii), (iii) and (iv); however, it is substantially challenging to scale to regional and global simulations due to trait variations across space (Ali et al., 2016). Moreover, it has been noted that hillslope processes, including ridge-to-valley flow and sunny vs. shady slopes are primary organizers of water, energy, and vegetation (Clark et al., 2015; Fan et al., 2019) . Although gradual improvements in the hydrologic model component in earth system models may reduce this error (at a remarkably slow pace), the long-term, gradual impact of hydrology on plant traits are not well captured. Recent work showed that the hydrologic controls exerted by groundwater and lateral flow are primary regulators of rooting depth (Fan et al., 2017) . Such hydrologic controls have seldom been reflected in vegetation model parameterizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Crowdsourcing the Frontier: Advancing Hybrid Physics‐ML Climate Simulation via a $\$$50,000 Kaggle Competition

Subgrid machine-learning (machine learning [ML]) parameterizations have the potential to introduce a new generation of climate models that incorporate the effects of higher-resolution physics without incurring the prohibitive computational cost associated with more explicit physics-based simulations. However, important issues, ranging from online instability to inconsistent online performance, have limited their operational use for long-term climate projections. To more rapidly drive progress in solving these issues, domain scientists and ML researchers opened up the offline aspect of this problem to the broader ML and data science community with the release of ClimSim, a NeurIPS Data sets and Benchmarks publication, and an associated Kaggle competition. This paper reports on the downstream results of the Kaggle competition by coupling emulators inspired by the winning teams' architectures to an interactive climate model (including full cloud microphysics, a regime historically prone to online instability) and systematically evaluating their online performance. Our results demonstrate that online stability in the low-resolution real-geography setting is reproducible across multiple diverse architectures, which we consider a key milestone. All tested architectures exhibit strikingly similar offline and online biases, though their responses to architecture-agnostic design choices (e.g., expanding the list of input variables) can differ significantly. Multiple Kaggle-inspired architectures achieve state-of-the-art results on certain metrics such as zonal mean bias patterns and global Root Mean Squared Error, indicating that crowdsourcing the essence of the offline problem is one path to improving online performance in hybrid physics-AI climate simulation.

Environmental sciences↗
DOE OSTI2023

Measuring stellar populations, dust attenuation and ionized gas at kpc scales in 10010 nearby galaxies using the integral field spectroscopy from MaNGA

As one of the three major experiments of the fourth-generation Sloan Digital Sky Survey (SDSS-IV), the Mapping Nearby Galaxies at Apatch Point Observatory (MaNGA) survey has obtained high-quality integral field spectroscopy (IFS) with a resolution of 1–2 kpc for ∼ 10 4 galaxies in the local universe during its six-year operation from July 2014 through August 2020. It is crucial to reliably measure the physical properties of the different components in each spectrum before one can use the data for any scientific study. In the past years we have made lots of efforts to develop a novel technique of full spectral fitting, which estimates a model-independent dust attenuation curve from each spectrum, thus allowing us to break the degeneracy between dust attenuation and stellar population properties when fitting the spectrum with stellar population synthesis models. We have applied our technique to the final data release of MaNGA, and obtained measurements of stellar population properties and emission line parameters, as well as the kinematics and dust attenuation of both stellar and ionized gas components. In this paper we describe our technique and the content and format of our data products. The whole dataset is publicly available in Science Data Bank with the link https://doi.org/10.57760/sciencedb.j00113.00088 .

Physics↗
DOE OSTI2020

Interactive Mobility Data Landscape

This is the companion repository to NREL's Interactive Mobility Landscape App (SEE: DOE Code ID 61291. NREL SWR-21-10). The Interactive Mobility Data Landscape is a project intended as a map through the previously uncharted, growing mobility data science field. This attempts to categorize most of the data sources, specifications, and tools in the field of mobility. It has been built by the National Renewable Energy Laboratory's (NREL) Mobility, Behavior, and Advanced Powertrains (MBAP) research group. The software for the interactive landscape is located at https://github.com/NREL/mobility_landscapeapp This repo includes all of the data and images specific to the Interactive Mobility Data Landscape.

Shankari, Kalyanaraman↗
DOE OSTI2024

AMReX and pyAMReX: Looking beyond the exascale computing project

AMReX is a software framework for the development of block-structured mesh applications with adaptive mesh refinement (AMR). AMReX was initially developed and supported by the AMReX Co-Design Center as part of the U.S. DOE Exascale Computing Project (ECP), and is continuing to grow post-ECP. In addition to adding new functionality and performance improvements to the core AMReX framework, we have also developed a Python binding, pyAMReX, that provides a bridge between AMReX-based application codes and the data science ecosystem. pyAMReX provides zero-copy application GPU data access for AI/ML, in situ analysis and application coupling, and enables rapid, massively parallel prototyping. In this paper we review the overall functionality of AMReX and pyAMReX, focusing on new developments, new functionality, and optimizations of key operations. We also summarize capabilities of ECP projects that used AMReX and provide an overview of new, non-ECP applications.

Myers, Andrew↗
DOE OSTI2020

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗
DOE OSTI2021

Safeguards-Informed Hybrid Imagery Dataset [Poster]

Deep Learning computer vision models require many thousands of properly labelled images for training, which is especially challenging for safeguards and nonproliferation, given that safeguards-relevant images are typically rare due to the sensitivity and limited availability of the technologies. Creating relevant images through real-world staging is costly and limiting in scope. Expert-labeling is expensive, time consuming, and error prone. We aim to develop a data set of both realworld and synthetic images that are relevant to the nuclear safeguards domain that can be used to support multiple data science research questions. In the process of developing this data, we aim to develop a novel workflow to validate synthetic images using machine learning explainability methods, testing among multiple computer vision algorithms, and iterative synthetic data rendering. We will deliver one million images – both real-world and synthetically rendered – of two types uranium storage and transportation containers with labelled ground truth and associated adversarial examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Studies in Nuclear and Nucleon Structure, and Neutrino Physics

We have provided training to students in skill sets relevant to job placement in areas of national needs. These trainings are tuned towards placing graduating students in the workforce related to sciences at national laboratories, national security, information systems, and data sciences. The support for undergraduate students will address the academic retention shortfalls by providing opportunities in mentored research experiences.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1973

The Harvard experiment on OSO-6 - Instrumentation, calibration, operation, and description of observations.

The Harvard experiment carried by OSO-6 was an extreme-ultraviolet (EUV) spectrometer-spectroheliometer with a wavelength range of 285 to 1385 A, a spatial and spectral bandwidth of 35 x 35(arc sec) squared and 3 A, respectively. The instrument acquired data that have been deposited with the National Space Science Data Center and World Data Center A at the Goddard Space Flight Center in Greenbelt, Maryland, and are now available in their entirety to the scientific community. Aspects of the experiment that are relevant to potential users of the data are described - namely, instrument configuration and parameters, laboratory and inflight calibrations, as well as operational capabilities and procedures. The observations obtained are reported, and the nature, number, and dates of observation, where relevant, are listed.

Huber, M. C. E.↗
NASA NTRS1987

Ion mass spectrometer experiment for ISIS-2 spacecraft

The International Satellite for Ionospheric Studies (ISIS) program of NASA was the longest duration program in NASA history. A number of satellites were flown under this program, the last being called ISIS-2, which was launched on April 1, 1971 and operated successfully for over 13 years. An experiment called the Ion Mass Spectrometer (IMS) was flown on the ISIS-2 spacecraft. It operated for 10 years providing a large data base of positive ion composition and ion flow velocities along the orbit of the satellite, the latter being circular at 1400 km with a 90 degree inclination. The data were processed and reside in the National Space Sciences Data Center.

Hoffman, John H.↗
NASA NTRS1986

NSSDC activities with 12-inch optical disk drives

The development status of optical-disk data transfer and storage technology at the National Space Science Data Center (NSSDC) is surveyed. The aim of the R&D program is to facilitate the exchange of large volumes of data. Current efforts focus on a 12-inch 1-Gbyte write-once/read-many disk and a disk drive which interfaces with VAX/VMS computer systems. The history of disk development at NSSDC is traced; the results of integration and performance tests are summarized; the operating principles of the 12-inch system are explained and illustrated with diagrams; and the need for greater standardization is indicated.

Lowrey, Barbara E.↗
NASA NTRS1993

EOSDIS - Its role in the EOS program and its importance to the scientific community

In order to manage the global data sets required to understand the earth as a system, the EOS Data and Information System (EOSDIS) will collect and store satellite, aircraft, and in situ measurements and their resultant data products, and will distribute the data conveniently. EOSDIS will also provide product generation and science computing facilities to support the development, processing, and validation of standard EOS science data products. The overall architecture of EOSDIS, and how the Distributed Active Archive Centers fit into that structure, are shown. EOSDIS will enable users to query data bases nationally, make use of keywords and other mnemonic identifiers, and see graphic images of subsets of available data prior to ordering full (or selected pieces of) data sets for use in their 'home' environment.

Price, Robert D.↗
NASA NTRS1996

Grant Proposal for the Continuation of the Voyager Interstellar Mission: LECP Investigation

This proposal documents the plans of the Low Energy Charged Particle (LECP) investigation team for participation in NASA's Voyager Interstellar Mission (VIM) as the Voyager 1 and 2 spacecraft explore the outer reaches of the heliosphere and search for the termination shock and the heliopause. The proposal covers the four year period from 1 January 1997 to 31 December 2000. The LECP instruments on Voyager 1 and 2 measure in situ intensities of charged particles with energies from about 30 keV to 100 MeV for ions, and about 20 keV to greater than 10 MeV for electrons. The instruments provide detailed spectral, angular, and compositional information about the particles. Composition is available for greater than 200 keV/nuc using multi-parameter measurements. Angular information is obtained by a mechanically scanned platform that rotates at various commanded rates. Measurements of low energy ion and electron intensities versus time and spatial location within the heliosphere contain an abundance of information regarding various transport and acceleration processes on both local (approx. 1 hr, approx. 0.01 AU) and global (approx. 11 yrs, approx. 100 AU) scales. The LECP instruments provide unique observations of such dynamical processes, and we anticipate that it will return critical information regarding the boundaries of the heliosphere. Several recent and exciting discoveries based on LECP measurements emphasize the important role that low energy charged particle distributions play in physical processes in the interplanetary medium. Yet, at the same time, these discoveries also underscore the fact that our understanding of processes in the outer heliosphere is, in most cases, incomplete, and in others, only rudimentary at best. Among the discoveries referred to above are the following: (1) Shocks: Examination of greater than 30 keV ion intensities have revealed: (a) a total absence of acceleration beyond only -100-200 keV at a strong transient shock in May 1991 at 35 AU, despite an enhanced level of seed particles; (b) a large transient shock in September 1991 of global scale, with intensities of shock-accelerated ions greater than or equal to 30 keV to approx. 30 MeV showing complex, highly energy-dependent spatial evolution, and small-scale (approx. few gyroradii), often anisotropic, micro-structures; (c) recurrent intensity increases in greater than or equal to 30 keV to -few MeV ions, with structures that, in some cases, show no correlation with the associated corotating shock. (2) Superthermal ion pressure: A global merged interaction region with a leading shock, downstream of which the superthermal ion (greater than or equal to 30 keV to approx. 4 MeV) pressure is comparable to that of the thermal plasma, and the total particle pressure yields a plasma beta of order unity. (3) Pickup ions: Measurements of the C/O ratio within transient structures at 35-45 AU showing the first clear evidence that transient shocks can pre-accelerate interstellar pickup ions from approx. 1 keV/nuc to at least 1 MeV/nuc. (4) Seed particles: Injection of ions for acceleration to high energies at the termination shock is unlikely to be a problem, since interplanetary transient and recurrent shocks are continually accelerating ions, of solar wind or interstellar origin, to highly superthermal energies. (5) Precursor electrons: Ambient solar electrons (greater than or equal to few tens of keV) that exist in the outer heliosphere ca form a broad precursor, several days wide, that is upstream of the termination shock and potentially observable a few months prior to the shock crossing. (6) Solar wind velocity at Voyager 1: We can use LECP ion data to obtain the solar wind velocity at Voyager 1, enabling us to provide critical measurement of the plasma flow as we approach and encounter the termination shock and other regions (necessary due to the partial failure of the Voyager 1 PLS experiment). The work of the LECP investigator team during the VIM will include: (1) Continuing operations with regard to the receipt, processing, verification, cataloging, display, and distribution of the data from the LECP instruments on Voyager 1 and 2, (2) Monitoring the health and performance of the LECP instruments, and evaluating and characterizing the response of the LECP instruments to various energetic particle and plasma environments, (3) Participating in, and supporting Voyager Project planning exercises and other coordinated activities relevant to exploration of the outer heliosphere, (4) Developing analysis techniques and operational procedures suitable for searching for and characterizing the boundaries and unique regions of the outher heliosphere, (5) Continuing the preparation of data sets appropriate for submission to the National Space Sciences Data Center (NSSDC) and, where appropriate, the Planetary Data System (PDS), (6) Maintaining direct Web access to online LECP data through the JHU/APL Voyager LECP home page, (7) Performing scientific evaluations of the Voyager 1 and 2 LECP data sets in conjunction with other data sets and other investigators, with particular focus on the outer regions of the heliosphere, and (8) Publishing the results of these evaluations in the scientific literature and presenting the results in scientific conferences.

Krimigis, Stamatios M.↗
NASA NTRS2002

The CCDS Data Compression Recommendations: Development and Status

The Consultative Committee for Space Data Systems (CCSDS) has been engaging in recommending data compression standards for space applications. The first effort focused on a lossless scheme that was adopted in 1997. Since then, space missions benefiting from this recommendation range from deep space probes to near Earth observatories. The cost savings result not only from reduced onboard storage and reduced bandwidth, but also in ground archive of mission data. In many instances, this recommendation also enables more science data to be collected for added scientific value. Since 1998, the compression sub-panel of CCSDS has been investigating lossy image compression schemes and is currently working towards a common solution for a single recommendation. The recommendation will fulfill the requirements for remote sensing conducted on space platforms.

Yeh, Pen-Shu↗
NASA NTRS2003

The Mobile Agents Integrated Field Test: Mars Desert Research Station April 2003

The Mobile Agents model-based, distributed architecture, which integrates diverse components in a system for lunar and planetary surface operations, was extensively tested in a two-week field "technology retreat" at the Mars Society s Desert Research Station (MDRS) during April 2003. More than twenty scientists and engineers from three NASA centers and two universities refined and tested the system through a series of incremental scenarios. Agent software, implemented in runtime Brahms, processed GPS, health data, and voice commands-monitoring, controlling and logging science data throughout simulated EVAs with two geologists. Predefined EVA plans, modified on the fly by voice command, enabled the Mobile Agents system to provide navigation and timing advice. Communications were maintained over five wireless nodes distributed over hills and into canyons for 5 km; data, including photographs and status was transmitted automatically to the desktop at mission control in Houston. This paper describes the system configurations, communication protocols, scenarios, and test results.

Clancey, William J.↗
NASA NTRS2006

Solving Cassini's Data Glitch Problem during Coherency Mode Transition for Titan Radar Observations

We describe the problem of regular small telemetry losses incurred during coherency mode transitions in Cassini's telecommunication. The project did not originally plan any corrective steps for avoiding these data losses, because of 1) the disparity between the small durations of the transitions (1-2 min) and large playback capability losses (15 min) needed for bracketing the transition time spans and 2) the unpredictable content of data downlinking during the transitions. However, as the intense science data return from the tour began, it became apparent that the impact of these small losses can sometimes be significant. We provide two examples of the impact on Radar-dedicated Titan flybys.

telecommunications↗