Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data needs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

The Need for High-Resolution Crustal Magnetic Field Data on Mars

Magnetometer observations from the Mars Global Surveyor spacecraft (MAG/ER on MGS) have confirmed that Mars does not presently have an internally-generated dipole magnetic field, and have also revealed intense remanent magnetism in the Martian crust. The remanent magnetic anomalies, most prevalent in the southern highlands region, are a record of the past history of the internal Mars dipole field. The MAG/ER data constitute a valuable data set for constraining the early thermal evolution of Mars and the history of the planetary magnetic field. However, the data lack the resolution needed to draw definite conclusions regarding the time history of the field. High-resolution magnetometer observations, obtained at low-altitude, are needed to complement and extend the MGS/ER data set and allow a definitive time history of the internal Mars dynamo to be constructed.

Raymond, C. A.↗
DOE OSTI2023

Recent advances in integrated hydrologic models: Integration of new domains

Over the past several decades, hydrologic models have advanced from independent models of the surface and subsurface to integrated models that can capture the terrestrial hydrologic cycle within one framework. In recent years, these coupled frameworks have seen the inclusion of biogeochemical processes, ecohydrology, sedimentation and erosion, cold region hydrology, anthropogenic activities, and atmospheric processes. This expansion is the result of increased computational, data, and modeling capabilities and capacities, as well as improved understanding of the processes that drive these integrated systems. Here, in this study, we review these recent advances to integrate new processes and systems into existing terrestrial hydrologic models and highlight the significant challenges and opportunities that remain. We identify that with so many models currently available and in development, selecting the most appropriate model is difficult, and we suggest a path for new or novice modelers to find the most appropriate code based on their needs. In addition, data required to parameterize and calibrate these models can often constrain their applicability and usefulness. However, advances in environmental sensors and measurement technology, in addition to data assimilation of non-traditional data (e.g. remote sensing, qualitative data) are providing new ways of addressing this issue. As we expand hydrologic models to integrate more processes and systems, our computational demands also increase. Recent and emerging advances in computational platforms, including cloud and quantum computing, in addition to the use of machine learning to capture some processes, will continue to support the use of increasingly larger and more complex, process-based models. Finally, we highlight that it is critical to develop state-of-the-science models that are accessible to all model users, not just those applied for research and development. We encourage continued development of diverse modeling platforms, considering the user needs, data availability, and computational resources.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

The NASA Open Science Data Repository: Biomedical Data, Analysis Tools, and Informatic Collaborations

Increased biomedical risks and challenges associated with deep space missions require knowledge discovery, health countermeasures, and biomedical support capabilities. Maximally open-access and reusable data is needed by developers, scientists, and engineers to develop these systems. The NASA Open Science Data Repository (OSDR) is a maximally open access and FAIR database (ie., findable, accessible, interoperable, and reusable), and meets various scientific, technical, and operational needs. It offers users and submitters the ability to upload, download, search, share, analyze, cite, and visualize data across ‘omics, physiological, phenotypic, payload, hardware, behavioral, bioimaging, video, and environmental monitoring telemetry datasets. OSDR is an expanded database, based upon the successes of NASA GeneLab. OSDR has >460 studies with datasets covering model organisms to non-NASA human astronauts. There are ~12 datasets from the Inspiration 4 (I4) mission, spanning metagenomics, comprehensive metabolic panels, clonal hematopoiesis, spatial transcriptomics, proteomics, and cytokine panels. In the interest of data privacy, two I4 datasets with raw files relating to the epitranscriptome, and a new request feature is live in OSDR (with a backend review process established) developed from industry norms. OSDR is collecting and curating biomedical human data from a new sub-orbital research flight and is open to more space life science/biomedical submissions from the international and commercial sectors. OSDR also recently began a collaboration with the European Space Agency (ESA) to collect and curate >200 terabytes of human and model organism data. The OSDR submission portal is designed to ingest and curate ~25 ‘omics and ~50 physiological-phenotypic-imaging assay data types. Tools available for OSDR users include: 1) an Environmental Data Application to compare radiation, CO2, relative humidity, temperature, and other telemetry across missions and subjects, 2) the RadLab database, a collaboration between NASA, ESA, the German and Italian Space Agencies, and the Bulgarian Academy of Sciences, and 3) a Multi-study visualization tool which enables users to look across and combine ‘omics datasets. There are ~600 volunteer OSDR Analysis Working Group (AWG) members providing feedback on scientific data/metadata standards and collaborating to mine-reuse OSDR in research. OSDR/GeneLab has enabled ~60 publications reusing data as of October 2023.

space biology↗
NASA NTRS1980

NEEDS - Information Adaptive System

The Information Adaptive System (IAS) is an element of the NASA End-to-End Data System (NEEDS) Phase II and is focused toward onboard image processing. The IAS is a data preprocessing system which is closely coupled to the sensor system. Some of the functions planned for the IAS include sensor response nonuniformity correction, geometric correction, data set selection, data formatting, packetization, and adaptive system control. The inclusion of these sensor data preprocessing functions onboard the spacecraft will significantly improve the extraction of information from the sensor data in a timely and cost effective manner, and provide the opportunity to design sensor systems which can be reconfigured in near real-time for optimum performance. The purpose of this paper is to present the preliminary design of the IAS and the plans for its development.

Kelly, W. L.↗
NASA NTRS1998

Enhanced Sea Ice Concentration and Ice Temperature Algorithms for AMSR

Accurate quantification of sea ice concentration and ice temperature from satellite passive microwave data is important because they provide the only long term, spatially detailed and consistent data set needed to study the climatology of the polar regions. Sea ice concentration data are used to derive large-scale daily ice extents that are utilized in trend analysis of the global sea ice cover. They are also used to quantify the amount of open water and thin ice in polynya and divergence regions which together with ice temperatures are in turn needed to estimate vertical heat and salinity fluxes in these regions. Sea ice concentrations have been derived from the NASA Team and Bootstrap algorithms while a separate technique for deriving ice temperature has been reported. An integrated technique that will utilizes most of the channels of AMSR (Advanced Microwave Scanning Radiometer) has been developed. The technique uses data from the 6 GHz and 37 GHz channels at vertical polarization obtain an initial estimate of sea ice concentration and ice temperature. The derived ice temperature is then utilized to estimate the emissivities for the corresponding observations at all the other channels. A procedure for calculating the ice concentration similar to the Bootstrap technique is then used but with variables being emissivities instead of brightness temperatures to minimizes errors associated with spatial changes in ice temperatures within the ice pack. Comparative studies of ice concentration results with those from other algorithms, including the original Bootstrap algorithm and those from high resolution satellite visible and infrared data will be presented. Also, results from a simulation study that demonstrates the effectiveness of the technique in correcting for spatial variations in ice temperatures will be shown. The ice temperature results are likewise compared with satellite infrared and buoy data with the latter adjusted to account for the effects of the snow cover.

Comiso, Josefino C.↗
DOE OSTI2021

Feature Analysis, Tracking, and Data Reduction: An Application to Multiphase Reactor Simulation MFiX-Exa for In-Situ Use Case

As we enter the exascale computing regime, powerful supercomputers continue to produce much higher amounts of data than what can be stored for offline data processing. To utilize such high compute capabilities on these machines, much of the data processing needs to happen in situ, when the full high-resolution data is available at the supercomputer memory. In this article, we discuss our MFiX-Exa simulation, which models multiphase flow by tracking a very large number of particles through the simulation domain. In one of the use cases, the carbon particles interact with air to produce carbon dioxide bubbles from the reactor. These bubbles are of primary interest to the domain experts for these simulations. For this particle-based simulation, we propose a streaming technique that can be deployed in situ to efficiently identify the bubbles, track them over time, and use them to down-sample the data with minimal loss in these features.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1984

Improved resolution rain measurements from spaceborne radar altimeters

Rain measurement of the type described here are considered vital from the standpoint of representing a flag for altimeter data that may be corrupted by rain. It also provides sorely needed rain data over the oceans where little or no such data is available. It is demonstrated that improved resolution measurements of precipitation may be obtained from satellite borne radars with antenna beams having relatively large surface footprints. The method employs deconvolution and Fourier transform procedures, and assumes a knowledge of the antenna beam pattern. As an example, the technique is specifically directed towards the application of future spaceborne radar altimeters which may contain additional range gates to enable the measurement of rain at altitude. It is demonstrated that because of the natural variability of rain in the lateral extent, the standard beam averaging over the footprint could easily produce erroneous interpretations of the intensity of rain and its extent. On the other hand, many of these ambiguities may be removed employing the deconvolution techniques described.

Goldhirsh, J.↗
NASA NTRS1988

Design of Space Station era mass storage systems

The architecture, components, and technical approach for a Space Station era mass storage system prototype are described. The primary data storage needs call for such functions as line outage recording, rate buffering, data archiving, and level zero type processing. The prototype mass storage system hardware will be configurable to support three modes of operation at up to 300 Mbps. The system architecture consists of two distinct components: a configurable high-level mass storage control system and a basic storage kernal.

Horner, Ward P.↗
NASA NTRSDate not supplied

pyQuARC: Preparing for Full Release

Metadata holds the contextual information about data and is the underlying structure for many data search portals. High quality metadata optimizes search results, allowing users to quickly retrieve the data they need. With the abundant volume and diversity of Earth observation datasets, data discovery and metadata quality are critical for end users. The Common Metadata Repository (CMR), for example, currently hosts metadata for over 9,000 Earth observation data products archived across 12 NASA Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the completeness, correctness, and consistency of these metadata records to ensure they are accessible, usable, and discoverable. In 2021, ARC began developing pyQuARC, an open source library for Earth Observation Metadata Quality Assessment to automate this effort. The tool uses ARC’s existing metadata quality framework to provide prioritized recommendations for metadata improvement. During initial testing, pyQuARC automatically identified 58% of metadata findings when compared with a sample of manually reviewed records. Using the results from initial testing, this presentation will focus on recent advancements and improvements of the tool as the ARC team prepares for pyQuARC’s full release. It will also demonstrate pyQuARC's enrichment value, not only for the ARC team, but the broader EOSDIS metadata community as well.

Essence Raphael↗
NASA NTRS2016

Spaceport Command and Control System - Support Software Development

The Information Architecture Support (IAS) Team, the component of the Spaceport Command and Control System (SCCS) that is in charge of all the pre-runtime data, was in need of some report features to be added to their internal web application, Information Architecture (IA). Development of these reports is crucial for the speed and productivity of the development team, as they are needed to quickly and efficiently make specific and complicated data requests against the massive IA database. These reports were being put on the back burner, as other development of IA was prioritized over them, but the need for them resulted in internships being created to fill this need. The creation of these reports required learning Ruby on Rails development, along with related web technologies, and they will continue to serve IAS and other support software teams and their IA data needs.

Information Architecture↗
NASA NTRS2008

James Webb Space Telescope - L2 Communications for Science Data Processing

JWST is the first NASA mission at the second Lagrange point (L2) to identify the need for data rates higher than 10 megabits per second (Mbps). JWST will produce approximately 235 Gigabits of science data every day that will be downlinked to the Deep Space Network (DSN). To get the data rates desired required moving away from X-band frequencies to Ka-band frequencies. To accomplish this transition, the DSN is upgrading its infrastructure. This new range of frequencies are becoming the new standard for high data rate science missions at L2. With the new frequency range, the issues of alternatives antenna deployment, off nominal scenarios, NASA implementation of the Ka-band 26 GHz, and navigation requirements will be discussed in this paper. JWST is also using Consultative Committee for Space Data Systems (CCSDS) standard process for reliable file transfer using CCSDS File Delivery Protocol (CFDP). For JWST the use of the CFDP protocol provides level zero processing at the DSN site. This paper will address NASA implementations of Ground Stations in support of Ka-band 26 GHz and lesson learned from implementing a file base (CFDP) protocol operational system.

Johns, Alan↗
DOE OSTI2025

High-performance data format for scientific data storage and analysis

Here, in this article, we present the High-Performance Output (HiPO) data format developed at Jefferson Laboratory for storing and analyzing data from Nuclear Physics experiments. The format was designed to efficiently store large amounts of experimental data, utilizing modern fast compression algorithms. The purpose of this development was to provide organized data in the output, facilitating access to relevant information within the large data files. The HiPO data format has features that are suited for storing raw detector data, reconstruction data, and the final physics analysis data efficiently, eliminating the need to do data conversions through the lifecycle of experimental data. The HiPO data format is implemented in C++ and JAVA, and provides bindings to FORTRAN, Python, and Julia, providing users with the choice of data analysis frameworks to use. In this paper, we will present the general design and functionalities of the HiPO library and compare the performance of the library with more established data formats used in data analysis in High Energy and Nuclear Physics (such as ROOT and Parquete). In columnar data analysis, HiPO surpasses established data formats in performance and can be effectively applied to data analysis in other scientific fields.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗
DOE OSTI2025

ggtaxplot v 0.0.1

ggtaxplot is an R package designed to process and visualize taxonomic data through a taxonomic river plot. This package is ideal for researchers and data scientists who need to visualize taxonomic data. ggtaxplot function processes data and generates a taxonomic river plot, allowing users to visualize the distribution of taxa across different samples.

Coclet, Clement [Lawrence Berkeley National Labora↗
DOE OSTI2020

Development of Prognostic Models Using Plant Asset Data

The recent growth of machine learning and artificial intelligence technologies provides opportunities for leveraging data-driven algorithms to address the problems of diagnostics and prognostics in the nuclear power industry. The use of machine learning and other statistical methods as prognostic models is of particular interest in the nuclear industry to accurately predict future equipment or plant state given a set of measurements. Such predictive capability will enable predictive assessment of component condition and remaining life and allow for condition-based predictive maintenance. The resulting optimization of maintenance scheduling and reduction in unnecessary maintenance activities will lower overall maintenance costs and improve the economics of nuclear power. This report discusses the various aspects of data processing and model development that are likely to influence the performance of prognostic models. Data from a boiling-water reactor was used to evaluate several prognostic models to identify key considerations for developing such models to predict data-driven plant state and equipment degradation condition. Preliminary results indicate the need for data sets that are relevant to the problem at hand and contain signatures that may be correlated to the prediction problem. Assuming such data exist, development of prognostic models using data-driven methods requires an understanding of the various sources of influence on the prediction accuracy (such as the model architecture, data preprocessing approaches, and potentially external factors influencing the equipment or plant system under assessment). Ongoing research is evaluating these factors in greater detail and examining techniques for calculating prediction uncertainty bounds.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Emulation Modeling for Development of Cyber-Defense Capabilities for Satellite Systems

The objective of this project was to develop a novel capability to generate synthetic data sets for the purpose of training Machine Learning (ML) algorithms for the detection of malicious activities on satellite systems. The approach experimented with was to a) generate sparse data sets using emulation modeling and b) enlarge the sparse data using Generative Adversarial Networks (GANs). We based our emulation modeling on the Open Source NASA Operational Simulator for Small Satellites (NOS3) developed by the Katherine Johnson Independent Verification and Validation (IV&V) program in West Virginia. Significant new capabilities on NOS3 had to be developed for our data set generation needs. To expand these data sets for the purpose of training ML, we experimented with a) Extreme Learning Machines (ELMs) and b) Wasserstein-GANs (WGAN-GP).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

Foundations of Molecular 'Isotomics'

The naturally occurring rare isotopes are versions of common elements, such as hydrogen, carbon and oxygen, that contain a larger than usual number of neutrons in their atomic nuclei and therefore are higher in mass than the common atoms of that element. Isotopes exist for most elements and are found in most natural and synthetic materials, but are uneven in their distribution because chemical and physical processes are isotope-selective (e.g., a chemical reaction may proceed more rapidly for one isotope than for another). For this reason, abundances of isotopes in a material of interest can provide a record, or ‘signature’ of various features of that material’s origin and history. These signatures have been used in the geo, life, chemical and physical sciences in a wide variety of ways over close to 8 decades. However, many such applications struggle to reach unique interpretations of isotopic data because multiple factors combine to control a given sample’s overall isotopic content. That is, the factors controlling isotopic content are too numerous and complex to fully constrain from a simple measurement of a material’s isotope abundances. However, the distribution of isotopes within materials, at molecular scales potentially provides a vastly larger number and diversity of constraints on the chemical and physical processes that comprise a material’s history. The rare isotopes may be concentrated into one atomic position in a molecule relative to another, some proportion of molecules in a sample may contain two or more rare isotopes, and those multiply-isotope-substituted forms of molecules may also have uneven distributions of those isotopes across individual atomic sites. For these reasons, even small, seemingly simple molecules, such as sugars, amino acids or drug compounds, actually exist in a vast number of isotopically unique forms (often millions or more), and each one of those forms is in some sense an independent ‘vote’ on that sample’s history. This project has focused on opening this rich archive of information by enabling the creation of routinely and widely applicable ways of measuring and interpreting isotopic structures of molecules. This work has included the development of core technologies and analytical methods, advancing fundamental understanding of the physical and chemical properties of isotopic versions of molecules, and conducting proof of concept studies of illustrative geochemical, cosmochemical and forensic problems in order to show how these technologies, methods and principles come together to solve problems in new ways. A key to the success of this project was the adaptation of ‘Fourier transform mass spectrometry’ (FTMS) to the task of precisely measuring proportions of the rare, naturally occurring isotopic forms of molecules. FTMS is a highly specialized form of mass spectrometry that traps ions within magnetic or electrostatic cavities and, effectively, ‘listens’ (through registering of subtle electrical signals) to the harmonic signals they make while rapidly orbiting within those cavities. These signals have periods that are a function of their mass and strength (or ‘loudness’) that is proportional to their abundances. Thus, these signals constrain relative amounts of molecules that differ in their mass due to various isotopic substitutions. This technology has been essential to the identification of organic molecules in the life, chemical and environmental sciences for over 4 decades, but generally has lacked the control, stability and precision to meaningfully measure rare isotope forms of molecules. This project’s most fundamental contribution has been to modify FTMS, both in terms of hardware and methods, to enable such measurements. The raw data of molecular isotopic structure is tremendously voluminous and complex, so another important activity of this project has been developing the theoretical and data-science tools needed to interpret the data generated by this new form of isotopic measurement. A particularly challenging part of this task has been predicting molecular isotopic structure, as only through the comparison of measurements with predictions can we make progress on hypothesis driven research questions. We have attacked this this prediction task through a combination of first-principles chemical-physics models of the effects of isotope substitution on molecule properties and data-science models that permit us to generalize that chemical physics to cases that have not yet been studied by detailed chemical physics theory. The proof of concept applications we have pursued over the course of this study include biological reactions of amino acids and other biomolecules, non-biological synthesis of organic molecules in extra-terrestrial settings such as meteorites, petroleum geoscience questions concerning the origin and evolution of natural gas, oil and kerogen compounds, and forensic questions such as the sourcing of chemical weapons. The successes of these applications have laid the groundwork for the next phase of this field’s development, which will include larger scale and more ambitious studies of molecular isotopic structure as a means of diagnosing human diseases, such as cancer, and reconstructing detailed interpretations of the origin and evolution of organic molecules in modern and geological environments.

Cesar, Jaime↗