Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Raw Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Lunar Surface Arrays

During the latter half of the 1980's three concepts for low frequency arrays on the Moon were independently studied for NASA, leading to two workshops in 1990. The main technical challenges were those of deploying the array on the Moon, and of correlating the data on the Moon or returning all the raw data to Earth.

Lunar Moon low frequency arrays↗

Advanced Query and Data Mining Capabilities for MaROS

The Mars Relay Operational Service (MaROS) comprises a number of tools to coordinate, plan, and visualize various aspects of the Mars Relay network. These levels include a Web-based user interface, a back-end "ReSTlet" built in Java, and databases that store the data as it is received from the network. As part of MaROS, the innovators have developed and implemented a feature set that operates on several levels of the software architecture. This new feature is an advanced querying capability through either the Web-based user interface, or through a back-end REST interface to access all of the data gathered from the network. This software is not meant to replace the REST interface, but to augment and expand the range of available data. The current REST interface provides specific data that is used by the MaROS Web application to display and visualize the information; however, the returned information from the REST interface has typically been pre-processed to return only a subset of the entire information within the repository, particularly only the information that is of interest to the GUI (graphical user interface). The new, advanced query and data mining capabilities allow users to retrieve the raw data and/or to perform their own data processing. The query language used to access the repository is a restricted subset of the structured query language (SQL) that can be built safely from the Web user interface, or entered as freeform SQL by a user. The results are returned in a CSV (Comma Separated Values) format for easy exporting to third party tools and applications that can be used for data mining or user-defined visualization and interpretation. This is the first time that a service is capable of providing access to all cross-project relay data from a single Web resource. Because MaROS contains the data for a variety of missions from the Mars network, which span both NASA and ESA, the software also establishes an access control list (ACL) on each data record in the database repository to enforce user access permissions through a multilayered approach.

Wang, Paul↗

SAIL-Net Raw and Post Corrected POPS Data Fall 2021 - Summer 2023

SAIL-Net is a DOE funded project in the East River Watershed near Crested Butte, Colorado with the goal of advancing our understanding of aerosol-cloud interactions in complex, mountainous regions. Through the deployment of a network of six low cost microphysics nodes in Fall 2021 in the same domain at the SAIL campaign, SAIL-Net provides data on aerosol size distributions, cloud condensation nuclei (CCN), and ice nucleation particles (INP). This network enables the investigation of small-scale variations in complex terrain. Two datasets are provided - one containing raw data and the other containing post-corrected data. The raw dataset provides the raw data recorded from the POPS which were deployed at each of the six sites. These data are organized by site and broken down into daily data files. The six site names used here are: “gothic”, “irwin”, “cbtop”, “cbmid”, “pumphouse”, and “snodgrass”. These data are not cleaned or post-corrected, but some flags have been added. The data are reported at 1 second time resolution. The post-corrected dataset provides the post-corrected and cleaned data recorded from the POPS which were deployed at each of the six sites. This data are also organized by site (same as those found in the raw data) and broken down into daily data files. Unlike the raw POPS data, these data have already been cleaned to remove what we believe are bad values. These data should be ready to use with no cleaning. For a full description of the cleaning and post-correction process, see the readme.

54 ENVIRONMENTAL SCIENCES↗

Single-cell chromatin accessibility and cis -regulatory element analyses in plants using the scPlantReg platform

Understanding gene regulation is fundamental to plant improvement, but the lack of plant-specific single-cell assay for transposase-accessible chromatin using sequencing (scATAC-seq) frameworks and cross-species databases has limited insights into cell-type-specific cellular regulation. Here we present ‘scPlantReg’, an integrated framework and database for plant scATAC-seq data. scPlantReg supports end-to-end analyses from raw data processing to biological interpretation and features ‘scATACtor’, a supervised machine-learning approach that outperforms existing tools for cell-type annotation. We applied scPlantReg to pearl millet to characterize cell-type-specific chromatin accessibility and identify validated activating and repressing accessible chromatin regions (ACRs), revealing WRKY transcription factors as potential regulators of xylem development. Furthermore, we reanalysed scATAC-seq datasets from 8 plant species, spanning 11 tissues and multiple developmental stages, enabling cross-species comparisons. Furthermore, these analyses uncovered conserved regulatory programmes, including AP2/EREBP-associated ACRs linked to cell wall development and cell-type-conserved TFs across grasses. Collectively, scPlantReg provides a general framework and resource for comparative regulatory analysis in plants.

Epigenomics↗

The Artificial Scientist: in-Transit Machine Learning of Plasma Simulations

Large-scale simulations or scientific experiments produce petabytes of data per run. This poses massive challenges for I/O and storage when scientific analysis workflows are run manually offline. Unsupervised deep learning-based techniques to extract patterns and non-linear relations from these large amounts of data provide a way to build scientific understanding from raw data, reducing the need for manual pre-selection of analysis steps, but require exascale compute and memory to process the full dataset available. In this paper, we demonstrate a heterogeneous streaming workflow in which plasma simulation data is streamed directly to a Machine Learning (ML) application training a model on the simulation data in-transit, completely circumventing the capacity-constrained filesystem bottleneck. This workflow employs openPMD to provide a high level interface to describe scientific data and also uses ADIOS2, to transfer volumes of data that exceed the capabilities of the filesystem. We employ experience replay to avoid catastrophic forgetting in learning from this non-steady state process in a continual manner and adapt it to improve model convergence while learning in-transit. As a proof-of-concept, we approach the ill-posed inverse problem of predicting particle dynamics from radiation in a particle-incell (PIConGPU) simulation of the Kelvin-Helmholtz instability (KHI). We detail hardware-software co-design challenges as we scale PIConGPU to full Frontier, the Top-1 system as of June 2024 Top500 list.

Kelling, Jeffrey [Helmholtz-Zentrum Dresden Rossen↗

Geothermal Play Fairway Analysis for Low-Temperature Resources in the Denver Basin

This dataset is part of an effort to highlight the advantages of incorporating low-temperature (< 150 C) geothermal resource evaluation into the implementation of combined heat and power (CHP), and geothermal direct use (GDU) technologies (e.g., space heating and/or cooling). For this Denver Basin example, resource favorability maps were created to identify potentially favorable areas for further geothermal exploration and are provided here. Favorability was based on three types of data: (1) geologic, (2) economic, and (3) risk. This raw data is also provided below. Geologic data include bottom-hole temperatures (BHT) from oil and gas wells, water co-production volumes from oil and gas wells, well groundwater levels, hot spring locations, temperatures, and chemistries, faults, and earthquakes. Economic feasibility data include population, thermal energy demand, infrastructure, and roads. Risk data (which includes data on excluded areas) include flood plains, protected lands (e.g. wildlife conservation areas, national parks). The included report describes this project in detail, covering workflows, relevant datasets, Python code, and both common and composite maps used to create low-temperature geothermal resource favorability maps for the Denver Basin, which extends across Colorado, Nebraska, and Wyoming. The figures in this report include: maps of the original datasets; maps of transformed data and derived parameters (such as the geothermal gradient or thermal conductivity); results of uncertainty analyses; results of data completeness (using the GeoRePORT tool); examples of the data combination and processing (using the geoPFA Python library, which is introduced in the attached report); favorability maps for each criteria; and a final combined favorability map. This project is designed to facilitate future deployment of CHP and GDU by providing data, tools, and a workflow applicable to low-temperature geothermal resources in sedimentary basins.

15 GEOTHERMAL ENERGY↗

Preliminary design review package for the solar heating and cooling central data processing system

The Central Data Processing System (CDPS) is designed to transform the raw data collected at remote sites into performance evaluation information for assessing the performance of solar heating and cooling systems. Software requirements for the CDPS are described. The programming standards to be used in development, documentation, and maintenance of the software are discussed along with the CDPS operations approach in support of daily data collection and processing.

Source record↗

The epsilon Geminorum occultation - Evidence for waves or turbulence

Intercomparison of occultation data from various observatories shows poor correlation of the raw data but apparent correlations in the derived temperature profiles, as discussed in a paper by French and Elliott. We point out that the data are at least as consistent with Martian scintillation as they are with a semiglobal wave model.

Hubbard, W. B.↗

New tracking implementation in the Deep Space Network

As part of the Network Simplification Project, the tracking system of the Deep Space Network is being upgraded. This upgrade replaces the discrete logic sequential ranging system with a system that is based on commercial Digital Signal Processor boards. The new implementation allows both sequential and pseudo-noise types of ranging. The other major change is a modernization of the data formatting. Previously, there were several types of interfaces, delivering both intermediate data and processed data (called 'observables'). All of these interfaces were bit-packed blocks, which do not allow for easy expansion, and many of these interfaces required knowledge of the specific hardware implementations. The new interface supports four classes of data: raw (direct from the measuring equipment), derived (the observable data), interferometric (multiple antenna measurements), and filtered (data whose values depend on multiple measurements). All of the measurements are reported at the sky frequency or phase level, so that no knowledge of the actual hardware is required. The data is formatted into Standard Formatted Data Units, as defined by the Consultative Committee for Space Data Systems, so that expansion and cross-center usage is greatly enhanced.

ranging↗

Portable Unit for Metabolic Analysis

The Portable Unit for Metabolic Analysis (PUMA) is an instrument that measures several quantities indicative of human metabolic function. Specifically, this instrument makes time-resolved measurements of temperature, pressure, flow, and the partial pressures of oxygen and carbon dioxide in breath during both inhalation and exhalation. Portable instruments for measuring these quantities have been commercially available, but the response times of those instruments are too long to enable temporal resolution of phenomena on the time scales of human respiration cycles. In contrast, the response time of the PUMA is significantly shorter than characteristic times of human respiration phenomena, making it possible to analyze varying metabolic parameters, not only on sequential breath cycles but also at successive phases of inhalation and exhalation within the same breath cycle. In operation, the PUMA is positioned to sample breath near the subject s mouth. Commercial off-the-shelf sensors are used for three of the measurements: a miniature pressure transducer for pressure, a thermistor for temperature, and an ultrasonic sensor for flow. Sensors developed at Glenn Research Center are used for measuring the partial pressures of oxygen and carbon dioxide: The carbon dioxide sensor exploits the relatively strong absorption of infrared light by carbon dioxide. Light from an infrared source passes through the stream of inhaled or exhaled gas and is focused on an infrared- sensitive photodetector. The oxygen sensor exploits the effect of oxygen in quenching the fluorescence of ruthenium-doped organic molecules in a dye on the tip of an optical fiber. A blue laser diode is used to excite the fluorescence, and the optical fiber carries the fluorescent light to a photodiode, the temporal variation of the output of which bears a known relationship with the rate of quenching of fluorescence and, hence, with the partial pressure of oxygen. The outputs of the sensors are digitized, preprocessed by a small onboard computer, and then sent wirelessly to a desktop computer, where the collected data are analyzed and displayed. In addition to the raw data on temperature, pressure, flow, and mole fractions of oxygen and carbon dioxide, the display can include volumetric oxygen consumption, volumetric carbon dioxide production, respiratory equivalent ratio, and volumetric flow rate of exhaled gas.

Dietrich, Daniel L.↗

Ground-Based Network and Supersite Observations to Complement and Enrich EOS Research

Since 1997 NASA has been successfully launching a series of satellites - the Earth Observing System (EOS) - to intensively study, and gain a better understanding of, the Earth as an integrated system. Space-borne remote sensing observations, however, are often plagued by contamination of surface signatures. Thus, ground-based in-situ and remote-sensing measurements, where signals come directly from atmospheric constituents, the sun, and/or the Earth-atmosphere interactions, provide additional information content for comparisons that confirm quantitatively the usefulness of the integrated surface, aircraft, and satellite datasets. Through numerous participations, particularly but not limited to the EOS remote-sensing/retrieval and validation projects over the years, NASA/GSFC has developed and continuously refined ground-based networks and mobile observatories that proved to be vital in providing high temporal measurements, which complement and enrich the satellite observations. These are: the AERO NET (AErosol RObotic NETwork) a federation of ground-based globally distributed network of spectral sun-sky photometers; the MPLNET (Micro-Pulse Lidar NETwork, a similarly organized network of micro-pulse lidar systems measuring aerosol and cloud vertical structure continuously; and the SMART-COMMIT (Surface-sensing Measurements for Atmospheric Radiative Transfer - Chemical, Optical & Microphysical Measurements of In-situ Troposphere, mobile observatories, a suite of spectral radiometers and in-situ probes acquiring supersite measurements. Most MPLNET sites are collocated with those of AERONET, and both networks always support the deployment of SMART-COMMIT worldwide. These data products follow the data structure of EOS conventions: Level-0, instrument archived raw data; Level-1 (or 1.5), real-time data with no (or limited) quality assurance; Level-2, not real high temporal and spectral resolutions. In this talk, we will present NASA/GSFC groundbased facilities, serving as network or supersite observations, which have been playing key roles in major international research projects over diverse aerosol regimes to complement and enrich the EOS scientific research.

Tsay, Si-Chee↗

Application of Lidar-Radar Combined Data Products during the IMPACTS 2020 Field Campaign

The Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) is a three-year field campaign investigating the formation and lifecycle of banded, precipitation structures within intense wintertime cyclones impacting the highly-populated northeast United States. Unlike previous campaigns in the region, IMPACTS mission scientists have access to and coordinate the NASA ER-2 and P-3 aircraft to collect observations from both a remote sensing and in-situ perspective, respectively. For IMPACTS, the ER-2 aircraft was equipped with lidar (CPL), radar (CRS, HIWRAP, EXRAD), microwave radiometer (CoSMIR, AMPR) instruments, each with their own unique capabilities and limitations. Our on-going work effort aims to develop IMPACTS lidar and radar merged data products, which can be used to supplement the raw data sources, tease out additional aspects of the mechanisms underpinning wintertime cyclones, and enhance our understanding of microphysical properties in sensor overlap regions. Preliminary merged data products combine CPL lidar with any one of the NASA High Altitude Radar (HAR) radar products (CRS, HIWRAP, EXRAD) and represent these data as both normalized values and translated to reflectivity signal (dB). Continuing work will further refine our merged data product algorithm to provide additional information on hydrometeor species identification, ice crystal habit, and ice-water content, which will help IMPACTS achieve its mission goal of improving microphysical properties retrievals from both airborne and spaceborne platforms.

Stephen D. Nicholls↗

Managing the Digital Thread for Structural Applications With Fit for Purpose Materials

With the increased emphasis on reducing the cost and time to market of new materials, the need for analytical tools that enable the virtual design and optimization of materials throughout their processing - internal structure - property - performance envelope, along with the capturing and storing of the associated material and model information across its lifecycle, has become critical. This need is also fueled by the demands for higher efficiency in material testing; consistency, quality and traceability of data; product design; engineering analysis; as well as control of access to proprietary or sensitive information. Consequently, at NASA Glenn Research Center a robust information management system that manages the digital thread across the full material life (i.e., capture, analysis, maintenance, and dissemination of data) cycle directed at the design of ‘fit-for-purpose materials’ is under development. To this end the Application Table has been incorporated within NASA Glenn Research Center’s ICME Information Management framework within the ANSYS Granta MI tool. The Application Table provides a place where material and structural application information/requirements can be linked to marry the “design-the-material” (structural engineering) and the “design-with-material” (material science) paradigms and thereby enable application-driven design and optimization of materials and structures. In additional several associated toolsets, specifically: AIMAOS (Automated Information Management Across Organizations and Scales), Py MILab, and JARIMIS (Just A Rather Intelligent Material Interrogation System) are also under development to assist in the judicious automation of this process. AIMOAS offers users an interactive graphical user interface for connecting material information management systems with both commercial and in-house simulation tools at various length scales to enable such automation in the handoff across scales and maintenance of material digital twins and the digital thread. Py MILab, is an automatic framework for the capture, analysis, maintenance, and storage of material test data. Py MILab uses a modular approach for capturing raw data, analyzing the data, and storing the data in a database, interfaced by neutral file structures, to promote plug-and-play capabilities for various analysis types. Finally, JARIMIS is an expert system that integrates various materials informatics tools (e.g., MicroNet, Surrogate ML models, ANSYS Granta MI, etc.) to enable inverse design of materials and facilitate the application of machine learning (ML) and data science with human in the loop decision making to rapidly discover and optimize new materials.

Digital Transformation↗

Meld: Exploring the Feasibility of a Framework-less Framework

HEP data-processing frameworks are essential ingredients in getting from raw data to physics results. But they are often tricky to use well, and they present a significant learning barrier for the beginning HEP physicist. In addition, existing frameworks typically support rigid, collider-based data models, which do not map well to neutrino-physics experiments like DUNE. Neutrino physicists thus expend significant effort working around framework limitations instead of using a framework that directly supports their needs. Presented here is Meld, a Fermilab R&D project, which intends to address these limitations. By leveraging modern C++ capabilities, state-of-the-art concurrency libraries, and a flexible data model, it is possible for beginning (and seasoned) HEP physicists to execute framework programs easily and efficiently, with minimal coupling to framework-specific constructs. Meld aims to directly support the frameworks needs of neutrino experiments like DUNE as well as the more common collider-based experiments.

Knoepfel, Kyle J.↗

Revised Radiometric Calibration Technique for LANDSAT-4 Thematic Mapper Data by the Canada Centre for Remote Sensing

A technique for the radiometric correction of LANDSAT-4 Thematic Mapper data was proposed by the Canada Center for Remote Sensing. Subsequent detailed observations of raw image data, raw radiometric calibration data and background measurements extracted from the raw data stream on High Density Tape highlighted major shortcomings in the proposed method which if left uncorrected, can cause severe radiometric striping in the output product. Results are presented which correlate measurements of the DC background with variations in both image data background and calibration samples. The effect on both raw data and on data corrected using the earlier proposed technique is explained, and the correction required for these factors as a function of individual scan line number for each detector is described. It is shown how the revised technique can be incorporated into an operational environment.

Murphy, J.↗

GNPS Dashboard: collaborative exploration of mass spectrometry data in the web browser

Access to web-based platforms has enabled scientists to perform research remotely. A critical aspect of mass spectrometry data analysis is the inspection, analysis, and visualization of the raw data to validate data quality and confirm statistical observations. We developed the GNPS Dashboard, a web-based data visualization tool, to facilitate synchronous collaborative inspection, visualization, and analysis of private and public mass spectrometry data remotely.

59 BASIC BIOLOGICAL SCIENCES↗

Towards an optimal inversion method for remote atmospheric sensing

The inference of atmospheric structure from satellite radiometric observations requires an inversion algorithm. A variety of techniques was spawned to meet these demands. One class, the nonlinear inversion methods, copes with the problem of data noise. Unlike linear techniques which require a priori data smoothing, the nonlinear method can be applied directly to raw data. The algorithm discriminates the noise input by resolving the inferences into two types of solution, associating the real roots with atmospheric structure while ascribing the imaginary roots to noise.

King, J. I. F.↗