Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data processing and standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

OPEX propagation measurements and studies

With the launch of the telecommunications Olympus satellite a new area began for the Olympus Propagation Experiments (OPEX) group. The years of preparations are now paying off - the experiments are underway and the co-operative effort is now turning its attention to the processing and analysis of data and to the interpretation of results. The aim here is to give a short review of the accomplishments made since NAPEX 13 and the work planned for the future. When ESA's Olympus was launched in summer of 1989 it carried a payload producing three unmodulated beacons at 12.5, 19.8, and 29.7 GHz. The main purpose of these beacons is to enable scientists to carry out long term slant path propagation experiments at these frequencies. The OPEX group, which was set up under ESA auspices in 1980, had been preparing for this event very carefully. The specifications for the equipment to be used and the elaboration of standard procedures for data processing and analysis have been worked out jointly. Today the OPEX community includes approximately 30 groups of experimenters. Immediately after achieving platform stability at the orbital location at 341 degrees east, ESA performed the In-Orbit Tests. Most measurements were carried out in Belgium using terminals specially developed for this purpose. A summary of the test results is given.

Arbesser-Rastburg, Bertram↗

Take-off Engine Particle Emission Indices for In-Service Aircraft at Los Angeles International Airport

We present ground‐based, advected aircraft engine emissions from flights taking off at Los Angeles International Airport. 275 discrete engine take‐off plumes were observed on 18 and 25 May 2014 at a distance of 400 m downwind of the runway. CO2 measurements are used to convert the aerosol data into plume‐average emissions indices that are suitable for modelling aircraft emissions. Total and non‐volatile particle number EIs are of order 1016‐1017 kg‐1 and 1014‐1016 kg‐1, respectively. Black‐carbon‐equivalent particle mass EIs vary between 175‐941 mg kg‐1 (except for the GE GEnx engines at 46 mg kg‐1). Aircraft tail numbers recorded for each take‐off event are used to incorporate aircraft‐ and engine‐specific parameters into the data set. Data acquisition and processing follow standard methods for quality assurance. A unique aspect of the data set is the mapping of aerosol concentration time series to integrated plume EIs, aircraft and engine specifications, and manufacturer‐reported engine emissions certifications. The integrated data enable future studies seeking to understand and model aircraft emissions and their impact on air quality.

Richard H Moore↗

NANT Site - Lidar / Processed Data Reformatted

This dataset contains standardized data from the PNNL scanning Doppler lidar (S/N 184), consisting of range- and time-resolved measurements of radial velocity, attenuated backscatter, intensity, and spectral width. We note that the beam azimuth angles are NOT referenced to true north.

17 WIND ENERGY↗

Meteorology impact on ATC system design

The impact of meteorology on air traffic control (ATC) system design for designs, and for cost benefit evaluations is discussed. The myriad of choices for implementation is a problem of great magnitude, given the economic climate of today. Cost versus benefit requires greater emphasis. Expanding and improving weather data acquisition, increasing the speed of weather data transmission and automating those actions that lend themselves to standardization for automated data processing are outlined. Three programs are mentioned: (1) automated weather observations, (2) weather radar and improvements to the national airspace system as related to the handling of weather data; and (3) products.

Vandemark, F. E.↗

The Behavior of TCP and Its Extensions in Space

The performance of Transmission Control Protocol (TCP) in space has been examined from the observations of simulation and experimental tests for several years at National Aeronautics and Space Administration (NASA), Department of Defense (DoD) and universities. At New Mexico State University (NMSU), we have been concentrating on studying the performance of two protocol suites: the file transfer protocol (ftp) running over Transmission Control Protocol/Internet Protocol (TCP/IP) stack and the file protocol (fp) running over the Space Communications Protocol Standards (SCPS)-Transport Protocol (TP) developed under the Consultative Committee for Space Data Systems (CCSDS) standards process. SCPS-TP is considered to be TCP's extensions for space communications. This dissertation experimentally studies the behavior of TCP and SCPS-TP by running the protocol suites over both the Space-to-Ground Link Simulator (SGLS) test-bed and realistic satellite link. The study concentrates on comparing protocol behavior by plotting the averaged file transfer times for different experimental configurations and analyzing them using Statistical Analysis System (SAS) based procedures. The effects of different link delays and various Bit-Error-Rates (BERS) on each protocol performance are also studied and linear regression models are built for experiments over SGLS test-bed to reflect the relationships between the file transfer time and various transmission conditions.

Wang, Ruhai↗

Integrated Topographic Corrections Improve Forest Mapping Using Landsat Imagery

In mountainous environments, topography strongly affects the reflectance due to illumination effects and cast shadows, which introduce errors in land cover classifications. However, topographic correction is not routinely implemented in standard data pre-processing chains (e.g., Landsat Analysis Ready Data), and there is a lack of consensus whether topographic correction is necessary, and if so, how to conduct it. Furthermore, methods that correct simultaneously for atmospheric and topographic effects are becoming available, but they have not been compared directly. Our objects were to investigate (1) the effectiveness of two topographic correction approaches that integrate atmospheric and topographic correction, (2) improvements in classification accuracy when analyzing topographically corrected single-date imagery (14 July 2016 and 2 October 2016), versus a full Landsat time series from 2014 to 2016, and 3) improvements in classification accuracy when including additional terrain information (i.e., topographic slope, elevation, and aspect). We developed a physical based model and compared it with an enhanced C-correction, both of which integrate atmospheric and topographic correction. We compared classification accuracies with and without topographic correction using combinations of single-date imagery, image composites and spectral-temporal metrics generated from the full Landsat time series, and additional terrain information in the Caucasus Mountains. We found that both the enhanced C-correction and the physical model performed very well and largely eliminated the correlation (Pearson’s correlation coefficient r ranges from 0.06 to 0.24) between surface reflectance and illumination condition, but the physical model performed best (r ranges from 0.05 to 0.11). Both image composites, and spectral-temporal metrics generated from corrected imagery, resulted in significantly (p ≤ 0.05) higher classification accuracies and better forest classifications, especially for the mixed forests. Adding terrain information reduced classification error significantly, but not as much as topographic correction. In summary, topographic correction remains necessary, even when analyzing a full Landsat time series and including a digital elevation model in the classification. We recommend that topographic correction should be applied when analyzing Landsat satellite imagery in mountainous region for forest cover classification.

Atmospheric correction↗

VA EDH Advanced Software Pipeline Framework Report: Enhancing Automation and Scalability

The VA Environmental Determinants of Health (EDH) Advanced Software Pipeline Framework is designed to enhance the efficiency, scalability, and security of geospatial data processing workflows. This framework integrates modern data orchestration and containerization technologies, including Prefect for workflow automation, Docker for containerization, and PostgreSQL/PostGIS for geospatial data storage and analysis. It ensures standardized, reproducible, and automated data processing, supporting VA objectives related to substance use risk assessment and recovery research. The pipeline addresses key scalability and performance challenges through horizontal and vertical scaling, high-performance computing (HPC) integration, parallel processing, task caching, and dynamic resource allocation. These optimizations improve throughput and reduce latency, allowing the system to efficiently manage large and complex datasets. Additionally, security and compliance measures—such as data encryption (SSL), Role-Based Access Control (RBAC), and adherence to GDPR and HIPAA standards—safeguard sensitive information throughout data transmission and storage. A key implementation of this framework includes the automation of shelter list geolocation workflows, ensuring that up-to-date data is readily available for VA decision-making. Lessons learned from this project include the transition from in-memory processing to incremental storage writes, improving resource management and reliability. Future enhancements aim to expand automation, integrate AI-driven anomaly detection, and incorporate high-performance computing resources. This framework provides a scalable, secure, and adaptable solution for managing geospatial datasets, reinforcing the VA’s ability to support clinical and strategic initiatives through data-driven decision-making.

97 MATHEMATICS AND COMPUTING↗

Tidal Resource Data from Sequim Bay Inlet, WA, August 2020

Data from a Nortek Signature1000 deployed on a lander for 14 days in Aug 2020 in the entrance to Sequim Bay, WA. Raw data were processed using the DOLfYN python package and standardized using the ME Data Pipeline python package, tsdat version 0.2.12. Processed data were partitioned into 24 hour increments and saved in the NETCDF file format.

16 TIDAL AND WAVE POWER↗

Training, Retention, and Transfer of Data Entry Perceptual and Motoric Processes Over Long Retention Intervals

Subjects trained in a standard data entry task, which involved typing numbers (e.g., 5421) using their right hands. At test (6 months post-training), subjects completed the standard task, followed by a left-hand variant (typing with their left hands) that involved the same perceptual, but different motoric, processes as the standard task. At a second test (8 months post-training), subjects completed the standard task, followed by a code variant (translating letters into digits, then typing the digits with their right hands) that involved different perceptual, but the same motoric, processes as the standard task. For each of the three tasks, half the trials were trained numbers (old) and half were new. Repetition priming (faster response times to old than new numbers) was found for each task. Repetition priming for the standard task reflects retention of trained numbers; for the left-hand variant reflects transfer of perceptual processes; and for the code variant reflects transfer of motoric processes. There was thus evidence for both specificity and generalizability of training data entry perceptual and motoric processes over very long retention intervals.

dat↗

Path Forward: Materials Data Modernization for ASME Codes and Standards in the Artificial Intelligence Era

Development of the ASME Materials Properties Database was initiated in the early 2010s to support the ASME Codes and Standards. As information technologies advance at an accelerated pace with the artificial intelligence era on the horizon, the ASME Materials Properties Database must be further modernized from a database to a knowledgebase to ride the wave of digital information revolution and effectively support the ASME Codes and Standards in the new era.This paper is intended to provide an overview of the ASME Materials Properties Database and discuss a roadmap for its future development to facilitate understanding of and participation from different sectors of the Codes and Standards community. It first reviews the basic concepts of data, information, knowledge, database, and database system; as well as the pros and cons in different types of data management, and then discusses the path forward for a desired evolution of the database into a self-explanatory and machine-readable knowledgebase that is consistent with human cognitive processes for the Codes and Standards development and furthermore provides resources for data processing and analysis to reach an eventual goal of streamlining the Codes and Standards development from the initial inquiry, throughout data submission, analysis, …, to Codes and Standards rule establishment for final publication.

Ren, Weiju↗

NASA GeneLab RNA-seq consensus pipeline: Standardized processing of short-read RNA-seq data

With the development of transcriptomic technologies, we are able to quantify precise changes in gene expression profiles from astronauts and other organisms exposed to spaceflight. Members of NASA GeneLab and GeneLab-associated analysis working groups (AWGs) have developed a consensus pipeline for analyzing short-read RNA-sequencing data from spaceflight-associated experiments. The pipeline includes quality control, read trimming, mapping, and gene quantification steps, culminating in the detection of differentially expressed genes. This data analysis pipeline and the results of its execution using data submitted to GeneLab are now all publicly available through the GeneLab database. We present here the full details and rationale for the construction of this pipeline in order to promote transparency, reproducibility, and reusability of pipeline data; to provide a template for data processing of future spaceflight-relevant datasets; and to encourage cross-analysis of data from other databases with the data available in GeneLab.

59 BASIC BIOLOGICAL SCIENCES↗

Path Forward: Materials Data Modernization for ASME Codes and Standards in the Artificial Intelligence Era

Development of the ASME Materials Properties Database was initiated in the early 2010s to support the ASME Codes and Standards. As information technologies advance at an accelerated pace with the artificial intelligence era on the horizon, the ASME Materials Properties Database must be further modernized from a database to a knowledgebase to ride the wave of digital information revolution and effectively support the ASME Codes and Standards in the new era. This paper is intended to provide an overview of the ASME Materials Properties Database and discuss a roadmap for its future development to facilitate understanding of and participation from different sectors of the Codes and Standards community. Further, it first reviews the basic concepts of data, information, knowledge, database, and database system as well as the pros and cons in different types of data management and then discusses the path forward for a desired evolution of the database into a self-explanatory and machine-readable knowledgebase that is consistent with human cognitive processes for the Codes and Standards development and, furthermore, provides resources for data processing and analysis to reach an eventual goal of streamlining the Codes and Standards development from the initial inquiry, throughout data submission, analysis, …, to Codes and Standards rule establishment for final publication.

36 MATERIALS SCIENCE↗

GeneLab: A Systems Biology Platform for Omics Analysis

NASA GeneLab is an open-access repository for omics datasets generated by biological experiments conducted in space or experiments relevant to spaceflight (e.g. simulated cosmic radiation, simulated microgravity, bed rest studies). The GeneLab Data Systems (GLDS) version 4.0 will be available on October 1st 2019, and will provide the latest in terms of professional state-of-the-art bioinformatics platform for the space biology and radiation community to upload their data into an omics data commons, to process their data with vetted standard workflows and to compare to existing analyses. Started in 2015 as a repository designed to archive omics data from space experiments, GeneLab has expanded its scope to all ionizing radiation omics experiments conducted on the ground and has put considerable effort in providing carefully characterized radiation metadata on all dataset. GeneLab is also providing processed data derived from the raw data covering a large spectrum of omics (genome, epigenome, transcriptome, epitranscriptome, proteome, metabolome) to help users explore important questions: 1) Which genes or proteins are expressed differently in space for various living organisms? 2) What specific DNA mutations or epigenetic changes happen in space or after exposure to ionizing radiation? and 3) How does genetics affect these responses? Processed data available on GeneLab are derived by standard data analysis workflows vetted by hundreds of scientists who volunteered to join one of the four GeneLab Analysis Working Groups (Animal AWG, Plant AWG, Microbe AWG, Multi-Omics AWG). In this presentation, we will discuss how to bridge the gap between irradiation studies performed on earth and biological experiments conducted in space since the early 1990's. We will discuss how radiation dosimetry was estimated for datasets derived from samples collected during the Space Shuttle era or on the International Space Station. Finally, we will address future strategies regarding dose monitoring in future missions into space, inter-agency efforts to unify data under one umbrella, and knowledge dissemination across the radiation research community and the space biology community.

open-science↗

NASA GeneLab Space Omics Database: Expanding from Space to Ionizing Radiation Data on the Ground

NASA GeneLab is an open-access repository for omics datasets generated by biological experiments conducted in space or ground experiments relevant to spaceflight (e.g. simulated cosmic radiation, simulated microgravity, bed rest studies). The GeneLab Data Systems (GLDS) version 4.0 will be available on October 1st 2019, and will provide a state-of-the-art bioinformatics platform for the space biology and radiation communities to upload their data into an omics data commons, to process their data with vetted standard workflows and to compare with existing analyses. Started in 2015 as a repository designed to archive omics data from space experiments, GeneLab has expanded its scope to all ionizing radiation omics experiments conducted on the ground and has put considerable effort in providing carefully characterized radiation metadata on all datasets. GeneLab is also providing processed data derived from the raw data covering a large spectrum of omics (genome, epigenome, transcriptome, epitranscriptome, proteome, metabolome) to help users explore important questions: 1) Which genes or proteins are expressed differently in space for various living organisms? 2) What specific DNA mutations or epigenetic changes happen in space or after exposure to ionizing radiation? and 3) How does genetics affect these responses? Processed data available on GeneLab are derived by standard data analysis workflows vetted by hundreds of scientists who volunteered to join one of the four GeneLab Analysis Working Groups (Animal AWG, Plant AWG, Microbe AWG, Multi-Omics AWG). In this presentation, we will discuss how to bridge the gap between irradiation studies performed on earth and biological experiments conducted in space since the early 1990's. We will discuss how radiation dosimetry was estimated for datasets derived from samples collected during the Space Shuttle era on the International Space Station and on other orbiting platforms. Finally, we will address future strategies regarding dose monitoring in future missions into space, inter-agency efforts to unify data under one umbrella, and knowledge dissemination across the radiation research community and the space biology community.

open-science↗

Physics-Informed Gaussian Process Regression for States Estimation and Forecasting in Power Grids

Real-time state estimation and forecasting are critical for the efficient operation of power grids. In this paper, a physics-informed Gaussian process regression (PhI-GPR) method is presented and used for forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system using sparse measurements. In standard data-driven Gaussian process regression (GPR), parameterized models for the prior statistics are fit by maximizing the marginal likelihood of observed data. In the PhI-GPR method, we propose to compute the prior statistics offline by solving stochastic differential equations (SDEs) governing the power grid dynamics. The short-term forecast of a power grid system dominated by wind generation is complicated by the stochastic nature of the wind and the resulting uncertainty in wind mechanical power. Here, we assume that the power grid dynamics are governed by swing equations, with the wind mechanical power fluctuating randomly in time. We solve these equations for the mean and covariances of the power grid states using the Monte Carlo simulation method. We demonstrate that the proposed PhI-GPR method can accurately forecast and estimate observed and unobserved states. For the considered problem, PhI-GPR has computational advantages over the ensemble Kalman filter (EnKF) method: In PhI-GPR, ensembles are computed offline and independently of the data acquisition process, whereas for EnFK, ensembles are computed online with data acquisition, rendering real-time forecast more challenging. We also demonstrate that the PhI-GPR forecast is more accurate than the EnKF forecast when the random mechanical wind power is non-Markovian. In contrast, the two methods produce similar forecasts for the Markovian mechanical wind power. For observed states, we show that PhI-GPR provides a forecast comparable to the standard data-driven GPR; both forecasts are significantly more accurate than the autoregressive integrated moving average (ARIMA) forecast. We also show that the ARIMA forecast is more sensitive to observation frequency and measurement errors than the PhI-GPR forecast.

24 POWER TRANSMISSION AND DISTRIBUTION↗

"XMM/RXTE Observations of GX 339-4"

In March 2003, we performed two simultaneous XMM/RXTE observations of the black hole candidate GX 339-4. Our goal is to compare these data to our prior simultaneous RXTE/ASCA observations (Nowak, Wilms & Dove, 2002). These observations were carried out in timing mode, as opposed to burst mode, and are more complex to analyze than we expected. Specifically, the data suffered from a number of telemetry dropouts (in fact, the standard archive processing failed on these data, and more than a year passed from the time of the observations before the data was delivered to us). Furthermore, the core of the EPIC PSF suffers slightly from pileup and gain shifts. We continue to work on this data, however, and anticipate publishing it within the next academic year. Here we highlight our ongoing work and outline our plans for publication.

Nowak, M. A.↗

Risk of Performance and Behavioral Health Decrements Due to Inadequate Cooperation, Coordination, and Psychosocial Adaptions within a Team

The Risk of Performance and Behavioral Health Decrements Due to Inadequate Cooperation, Coordination, Communication, and Psychosocial Adaptation within a Team (the Team Risk) is primarily performance-focused, with a secondary emphasis on behavioral health outcomes resulting from team performance and interpersonal interactions. Monitoring tools, measures, and countermeasures are aimed at enhancing team processes and team composition configurations to optimize team performance and functioning. Long-duration exploration missions (LDEMs) will include major challenges that could affect team performance, including social isolation, physical confinement, a small and diverse crew, communication delays between crew and ground, limited or no crew rotation or evacuation options, limited or no resupply, and a high-consequence environment. Each of these conditions will affect the crew’s coordination, cooperation, psychological well-being, and performance. Although the International Space Station (ISS) remains important for studies that require spaceflight testing and validation, the current conditions on the ISS do not adequately mimic the exploration environment that is required for National Aeronautics and Space Administration (NASA) teams research, and thus access to terrestrial or ground-based analogs of LDEM conditions is paramount. The emphasis on analogs for research is reflected in this updated evidence review of the Team Risk, and includes data from studies conducted at isolated, confined, extreme (ICE) environments (e.g., Antarctic stations), and from several mission simulation analogs such as the Human Exploration Research Analog (HERA) (HERA Experiment Information Package, 2014), also known as isolated, confined, controlled (ICC) environments. These studies have characterized many team factors regarding LDEMs, and the Team Risk has now matured from risk characterization to focusing more on countermeasure development. Because spaceflight evidence for team-level research is lacking, no reliable data is available to quantify the impact of team-level variables on individual and team-level outcomes during spaceflight missions. Until recently, no systematic attempt had been undertaken to measure the performance effects of team cohesion, team composition, team training, or team-related psychosocial adaptation during spaceflight. The Team Risk is a relatively young research area for NASA, with substantial growth only since the 2000s, and with limited access to spaceflight performance data. As a result, spaceflight evidence is lacking to identify specifically what team composition, level of training, amount of cohesion, or quality of psychosocial adaptation is necessary to reduce the risk of performance errors in space. However, astronaut journals and interviews and reports from spaceflight subject matter experts (SMEs) provide testimonies that team performance during spaceflight is important for mission success and to maintain crew health. Team spaceflight data is now being collected as part of the Spaceflight Standard Measures task (Clement, 2021)—a set of core measurements related to many human spaceflight risks that are collected from astronauts before, during, and after long-duration missions. The team-related standard measures focus on team cohesion, team performance, group living, team climate, and team processes. Collection of standard measures data is ongoing and published data is not yet available. Finally, although spaceflight evidence is lacking, evidence gleaned from ground studies and spaceflight analog studies will help close the gaps outlined in the Team Risk. Ground-based studies provide quantitative evidence for team functioning in ICE environments. Academic research on teams has produced dozens of meta-analyses that can be used to understand the general relationships among team inputs (e.g., team member characteristics and skills, job context), team processes, and emergent states (e.g., coordination, communication, cooperation, cohesion, trust, shared cognition), and team outcomes (e.g., effectiveness, errors, adaptation). Teams are complex, incorporating individual characteristics of team members, but also existing at a level that is greater than the sum of its parts. Therefore, the Team Risk must be integrated with other individual-focused NASA Human Research Program (HRP) risks, including Behavioral Medicine (BMed), Sleep, and Human-Systems Integration Architecture (HSIA), and emerging research indicates more integration may needed between the Team Risk and the physiologically oriented risks. Much of this integration occurs through the Human Systems Risk Board (HSRB). A lack of team functioning may be a stressor in some circumstances, but the team often acts as a countermeasure. For example, support for team leaders and teammates can facilitate individual functioning and encourage psychological and physically healthy behaviors and attitudes. However, more research is needed regarding teams during LDEMs and the remaining gaps in the research are described in the current report.

Lauren Blackwell Landon↗

Enabling modern data discovery for atmospheric measurements

The Atmospheric Radiation Measurement (ARM) user facility is a US Department of Energy Office of Science user facility that is managed and operated through a collaborative effort led by nine US Department of Energy national laboratories. The ARM Data Center, located at Oak Ridge National Laboratory, is responsible for the timely collection, processing, and delivery of data products to the scientific community. The ARM Data Center holds more than 11,000 data products, including metadata collected from field campaigns, instruments, value-added products, and principal investigator–contributed data. These data sets are checked for successful transfer (for most data, this transfer is carried out automatically via the network; however, some of the largest data sets and some of the most remote sites require manual shipping of hard disks) and both the data and metadata are processed to a standard format, which is an ARM-standardized structure, via the Network Common Data Form. The Network Common Data Form is a self-describing binary format with many compatible software tools. Once processed, the data are cataloged, stored in the ARM Data Archive, and made discoverable through association with an array of metadata-characterizing information, such as location and measurement classification. These metadata enable powerful search capabilities through the ARM Data Center Data Discovery interface. This paper discusses the workflow of how the new discovery system has been redesigned from user requirements and how the data are distributed to the scientific community.

54 ENVIRONMENTAL SCIENCES↗