Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Measuring stellar populations, dust attenuation and ionized gas at kpc scales in 10010 nearby galaxies using the integral field spectroscopy from MaNGA

As one of the three major experiments of the fourth-generation Sloan Digital Sky Survey (SDSS-IV), the Mapping Nearby Galaxies at Apatch Point Observatory (MaNGA) survey has obtained high-quality integral field spectroscopy (IFS) with a resolution of 1–2 kpc for ∼ 10 4 galaxies in the local universe during its six-year operation from July 2014 through August 2020. It is crucial to reliably measure the physical properties of the different components in each spectrum before one can use the data for any scientific study. In the past years we have made lots of efforts to develop a novel technique of full spectral fitting, which estimates a model-independent dust attenuation curve from each spectrum, thus allowing us to break the degeneracy between dust attenuation and stellar population properties when fitting the spectrum with stellar population synthesis models. We have applied our technique to the final data release of MaNGA, and obtained measurements of stellar population properties and emission line parameters, as well as the kinematics and dust attenuation of both stellar and ionized gas components. In this paper we describe our technique and the content and format of our data products. The whole dataset is publicly available in Science Data Bank with the link https://doi.org/10.57760/sciencedb.j00113.00088 .

Physics↗
DOE OSTI2017

Statistical projections for multi-dimensional visual data exploration

When working with large, multidimensional and multivariate data, science users are frequently interested in understanding variation in data, as opposed to the actual data values. Our work focuses on exploring how a simple statistical metric, the Coefficient of Variation (or Cv), can be used in several different ways to facilitate understanding variation in large data. As a statistical measure, it offers a key advantage over more widely accepted measures like standard deviation, namely to its ability to capture local variation properties. As a multidimensional projection operator, Cv is an effective way of reducing data size while preserving the key variational signal. Visualizations produced from Cv that target conveying variation in data are highly informative, especially compared to those produced with more widely known methods. We demonstrate these ideas within the context of a two-part application case study focusing on understanding long-Term trends in the the changes in precipitation and winds in large-scale climate model ensemble output.

Nguyen, H↗
DOE OSTI2020

Interactive Mobility Data Landscape

This is the companion repository to NREL's Interactive Mobility Landscape App (SEE: DOE Code ID 61291. NREL SWR-21-10). The Interactive Mobility Data Landscape is a project intended as a map through the previously uncharted, growing mobility data science field. This attempts to categorize most of the data sources, specifications, and tools in the field of mobility. It has been built by the National Renewable Energy Laboratory's (NREL) Mobility, Behavior, and Advanced Powertrains (MBAP) research group. The software for the interactive landscape is located at https://github.com/NREL/mobility_landscapeapp This repo includes all of the data and images specific to the Interactive Mobility Data Landscape.

Shankari, Kalyanaraman↗
DOE OSTI2024

AMReX and pyAMReX: Looking beyond the exascale computing project

AMReX is a software framework for the development of block-structured mesh applications with adaptive mesh refinement (AMR). AMReX was initially developed and supported by the AMReX Co-Design Center as part of the U.S. DOE Exascale Computing Project (ECP), and is continuing to grow post-ECP. In addition to adding new functionality and performance improvements to the core AMReX framework, we have also developed a Python binding, pyAMReX, that provides a bridge between AMReX-based application codes and the data science ecosystem. pyAMReX provides zero-copy application GPU data access for AI/ML, in situ analysis and application coupling, and enables rapid, massively parallel prototyping. In this paper we review the overall functionality of AMReX and pyAMReX, focusing on new developments, new functionality, and optimizations of key operations. We also summarize capabilities of ECP projects that used AMReX and provide an overview of new, non-ECP applications.

Myers, Andrew↗
DOE OSTI2020

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗
DOE OSTI2021

Safeguards-Informed Hybrid Imagery Dataset [Poster]

Deep Learning computer vision models require many thousands of properly labelled images for training, which is especially challenging for safeguards and nonproliferation, given that safeguards-relevant images are typically rare due to the sensitivity and limited availability of the technologies. Creating relevant images through real-world staging is costly and limiting in scope. Expert-labeling is expensive, time consuming, and error prone. We aim to develop a data set of both realworld and synthetic images that are relevant to the nuclear safeguards domain that can be used to support multiple data science research questions. In the process of developing this data, we aim to develop a novel workflow to validate synthetic images using machine learning explainability methods, testing among multiple computer vision algorithms, and iterative synthetic data rendering. We will deliver one million images – both real-world and synthetically rendered – of two types uranium storage and transportation containers with labelled ground truth and associated adversarial examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Studies in Nuclear and Nucleon Structure, and Neutrino Physics

We have provided training to students in skill sets relevant to job placement in areas of national needs. These trainings are tuned towards placing graduating students in the workforce related to sciences at national laboratories, national security, information systems, and data sciences. The support for undergraduate students will address the academic retention shortfalls by providing opportunities in mentored research experiences.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1973

The Harvard experiment on OSO-6 - Instrumentation, calibration, operation, and description of observations.

The Harvard experiment carried by OSO-6 was an extreme-ultraviolet (EUV) spectrometer-spectroheliometer with a wavelength range of 285 to 1385 A, a spatial and spectral bandwidth of 35 x 35(arc sec) squared and 3 A, respectively. The instrument acquired data that have been deposited with the National Space Science Data Center and World Data Center A at the Goddard Space Flight Center in Greenbelt, Maryland, and are now available in their entirety to the scientific community. Aspects of the experiment that are relevant to potential users of the data are described - namely, instrument configuration and parameters, laboratory and inflight calibrations, as well as operational capabilities and procedures. The observations obtained are reported, and the nature, number, and dates of observation, where relevant, are listed.

Huber, M. C. E.↗
NASA NTRS1987

Ion mass spectrometer experiment for ISIS-2 spacecraft

The International Satellite for Ionospheric Studies (ISIS) program of NASA was the longest duration program in NASA history. A number of satellites were flown under this program, the last being called ISIS-2, which was launched on April 1, 1971 and operated successfully for over 13 years. An experiment called the Ion Mass Spectrometer (IMS) was flown on the ISIS-2 spacecraft. It operated for 10 years providing a large data base of positive ion composition and ion flow velocities along the orbit of the satellite, the latter being circular at 1400 km with a 90 degree inclination. The data were processed and reside in the National Space Sciences Data Center.

Hoffman, John H.↗
NASA NTRS1986

NSSDC activities with 12-inch optical disk drives

The development status of optical-disk data transfer and storage technology at the National Space Science Data Center (NSSDC) is surveyed. The aim of the R&D program is to facilitate the exchange of large volumes of data. Current efforts focus on a 12-inch 1-Gbyte write-once/read-many disk and a disk drive which interfaces with VAX/VMS computer systems. The history of disk development at NSSDC is traced; the results of integration and performance tests are summarized; the operating principles of the 12-inch system are explained and illustrated with diagrams; and the need for greater standardization is indicated.

Lowrey, Barbara E.↗
NASA NTRS1993

EOSDIS - Its role in the EOS program and its importance to the scientific community

In order to manage the global data sets required to understand the earth as a system, the EOS Data and Information System (EOSDIS) will collect and store satellite, aircraft, and in situ measurements and their resultant data products, and will distribute the data conveniently. EOSDIS will also provide product generation and science computing facilities to support the development, processing, and validation of standard EOS science data products. The overall architecture of EOSDIS, and how the Distributed Active Archive Centers fit into that structure, are shown. EOSDIS will enable users to query data bases nationally, make use of keywords and other mnemonic identifiers, and see graphic images of subsets of available data prior to ordering full (or selected pieces of) data sets for use in their 'home' environment.

Price, Robert D.↗
NASA NTRS1996

Grant Proposal for the Continuation of the Voyager Interstellar Mission: LECP Investigation

This proposal documents the plans of the Low Energy Charged Particle (LECP) investigation team for participation in NASA's Voyager Interstellar Mission (VIM) as the Voyager 1 and 2 spacecraft explore the outer reaches of the heliosphere and search for the termination shock and the heliopause. The proposal covers the four year period from 1 January 1997 to 31 December 2000. The LECP instruments on Voyager 1 and 2 measure in situ intensities of charged particles with energies from about 30 keV to 100 MeV for ions, and about 20 keV to greater than 10 MeV for electrons. The instruments provide detailed spectral, angular, and compositional information about the particles. Composition is available for greater than 200 keV/nuc using multi-parameter measurements. Angular information is obtained by a mechanically scanned platform that rotates at various commanded rates. Measurements of low energy ion and electron intensities versus time and spatial location within the heliosphere contain an abundance of information regarding various transport and acceleration processes on both local (approx. 1 hr, approx. 0.01 AU) and global (approx. 11 yrs, approx. 100 AU) scales. The LECP instruments provide unique observations of such dynamical processes, and we anticipate that it will return critical information regarding the boundaries of the heliosphere. Several recent and exciting discoveries based on LECP measurements emphasize the important role that low energy charged particle distributions play in physical processes in the interplanetary medium. Yet, at the same time, these discoveries also underscore the fact that our understanding of processes in the outer heliosphere is, in most cases, incomplete, and in others, only rudimentary at best. Among the discoveries referred to above are the following: (1) Shocks: Examination of greater than 30 keV ion intensities have revealed: (a) a total absence of acceleration beyond only -100-200 keV at a strong transient shock in May 1991 at 35 AU, despite an enhanced level of seed particles; (b) a large transient shock in September 1991 of global scale, with intensities of shock-accelerated ions greater than or equal to 30 keV to approx. 30 MeV showing complex, highly energy-dependent spatial evolution, and small-scale (approx. few gyroradii), often anisotropic, micro-structures; (c) recurrent intensity increases in greater than or equal to 30 keV to -few MeV ions, with structures that, in some cases, show no correlation with the associated corotating shock. (2) Superthermal ion pressure: A global merged interaction region with a leading shock, downstream of which the superthermal ion (greater than or equal to 30 keV to approx. 4 MeV) pressure is comparable to that of the thermal plasma, and the total particle pressure yields a plasma beta of order unity. (3) Pickup ions: Measurements of the C/O ratio within transient structures at 35-45 AU showing the first clear evidence that transient shocks can pre-accelerate interstellar pickup ions from approx. 1 keV/nuc to at least 1 MeV/nuc. (4) Seed particles: Injection of ions for acceleration to high energies at the termination shock is unlikely to be a problem, since interplanetary transient and recurrent shocks are continually accelerating ions, of solar wind or interstellar origin, to highly superthermal energies. (5) Precursor electrons: Ambient solar electrons (greater than or equal to few tens of keV) that exist in the outer heliosphere ca form a broad precursor, several days wide, that is upstream of the termination shock and potentially observable a few months prior to the shock crossing. (6) Solar wind velocity at Voyager 1: We can use LECP ion data to obtain the solar wind velocity at Voyager 1, enabling us to provide critical measurement of the plasma flow as we approach and encounter the termination shock and other regions (necessary due to the partial failure of the Voyager 1 PLS experiment). The work of the LECP investigator team during the VIM will include: (1) Continuing operations with regard to the receipt, processing, verification, cataloging, display, and distribution of the data from the LECP instruments on Voyager 1 and 2, (2) Monitoring the health and performance of the LECP instruments, and evaluating and characterizing the response of the LECP instruments to various energetic particle and plasma environments, (3) Participating in, and supporting Voyager Project planning exercises and other coordinated activities relevant to exploration of the outer heliosphere, (4) Developing analysis techniques and operational procedures suitable for searching for and characterizing the boundaries and unique regions of the outher heliosphere, (5) Continuing the preparation of data sets appropriate for submission to the National Space Sciences Data Center (NSSDC) and, where appropriate, the Planetary Data System (PDS), (6) Maintaining direct Web access to online LECP data through the JHU/APL Voyager LECP home page, (7) Performing scientific evaluations of the Voyager 1 and 2 LECP data sets in conjunction with other data sets and other investigators, with particular focus on the outer regions of the heliosphere, and (8) Publishing the results of these evaluations in the scientific literature and presenting the results in scientific conferences.

Krimigis, Stamatios M.↗
NASA NTRS2002

The CCDS Data Compression Recommendations: Development and Status

The Consultative Committee for Space Data Systems (CCSDS) has been engaging in recommending data compression standards for space applications. The first effort focused on a lossless scheme that was adopted in 1997. Since then, space missions benefiting from this recommendation range from deep space probes to near Earth observatories. The cost savings result not only from reduced onboard storage and reduced bandwidth, but also in ground archive of mission data. In many instances, this recommendation also enables more science data to be collected for added scientific value. Since 1998, the compression sub-panel of CCSDS has been investigating lossy image compression schemes and is currently working towards a common solution for a single recommendation. The recommendation will fulfill the requirements for remote sensing conducted on space platforms.

Yeh, Pen-Shu↗
NASA NTRS2003

The Mobile Agents Integrated Field Test: Mars Desert Research Station April 2003

The Mobile Agents model-based, distributed architecture, which integrates diverse components in a system for lunar and planetary surface operations, was extensively tested in a two-week field "technology retreat" at the Mars Society s Desert Research Station (MDRS) during April 2003. More than twenty scientists and engineers from three NASA centers and two universities refined and tested the system through a series of incremental scenarios. Agent software, implemented in runtime Brahms, processed GPS, health data, and voice commands-monitoring, controlling and logging science data throughout simulated EVAs with two geologists. Predefined EVA plans, modified on the fly by voice command, enabled the Mobile Agents system to provide navigation and timing advice. Communications were maintained over five wireless nodes distributed over hills and into canyons for 5 km; data, including photographs and status was transmitted automatically to the desktop at mission control in Houston. This paper describes the system configurations, communication protocols, scenarios, and test results.

Clancey, William J.↗
NASA NTRS2006

Solving Cassini's Data Glitch Problem during Coherency Mode Transition for Titan Radar Observations

We describe the problem of regular small telemetry losses incurred during coherency mode transitions in Cassini's telecommunication. The project did not originally plan any corrective steps for avoiding these data losses, because of 1) the disparity between the small durations of the transitions (1-2 min) and large playback capability losses (15 min) needed for bracketing the transition time spans and 2) the unpredictable content of data downlinking during the transitions. However, as the intense science data return from the tour began, it became apparent that the impact of these small losses can sometimes be significant. We provide two examples of the impact on Radar-dedicated Titan flybys.

telecommunications↗
NASA NTRS2008

A Look Inside the Juno Mission to Jupiter

Juno, the second mission within the New Frontiers Program, is a Jupiter polar orbiter mission designed to return high-priority science data that spans across multiple divisions within NASA's Science Mission Directorate. Juno's science objectives, coupled with the natural constraints of a cost-capped, PI-led mission and the harsh environment of Jupiter, have led to a very unique mission and spacecraft design.

Jupiter↗
NASA NTRS2012

Content Platforms Meet Data Storage, Retrieval Needs

Earth is under a constant barrage of information from space. Whether from satellites orbiting our planet, spacecraft circling Mars, or probes streaking toward the far reaches of the Solar System, NASA collects massive amounts of data from its spacefaring missions each day. NASA s Earth Observing System (EOS) satellites, for example, provide daily imagery and measurements of Earth s atmosphere, oceans, vegetation, and more. The Earth Observing System Data and Information System (EOSDIS) collects all of that science data and processes, archives, and distributes it to researchers around the globe; EOSDIS recently reached a total archive volume of 4.5 petabytes. Try to store that amount of information in your standard, four-drawer file cabinet, and you would need 90 million to get the job done. To manage the flood of information, NASA has explored technologies to efficiently collect, archive, and provide access to EOS data for scientists today and for years to come. One such technology is now providing similar capabilities to businesses and organizations worldwide.

Source record↗