Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

Crossing the Finish Line: Integration of Data-Driven Process Control for Maximization of Energy and Resource Efficiency in Advanced Water Resource Recovery Facilities

Improvements in process monitoring and control at water resource recovery facilities (WRRFs) could result in reductions in electricity consumption, chemical inputs, and greenhouse gas emissions, as well as improved energy recovery. Many current WRRF data collection, monitoring, and control approaches use 20th century process monitoring and control systems, which require large design safety factors to ensure reliability in the absence of more advanced, precise controls. Implementation of more modern data-driven control tools could lead to more efficient operations that provide intrinsic reliability with better overall process performance at full-scale. This presentation provides an overview of a recently initiated project "Crossing the Finish Line: Integration of Data-Driven Process Control for Maximization of Energy and Resource Efficiency in Advanced Water Resource Recovery Facilities" which will (1) develop and demonstrate data-driven process controls at full-scale facilities for five promising WRRF Applications (i.e., process technologies) that provide whole-plant approaches and offer substantial energy and resource recovery benefits, and (2) create a toolbox of new process control approaches and an implementation guide including five examples for application at utilities. The presentation also provides a detailed overview of the research approach and progress being made on one of the five Applications, namely Application 2: Biological Nutrient Removal (BNR): ammonium-based aeration control (ABAC) / ammonia vs. NOx (AvN) + partial denitration with anammox (PdNA), which is being implemented at Hampton Roads Sanitation District. This project is a collaboration of work being conducted by DC Water, Hampton Roads Sanitation District, Metro Water Recovery, University of Michigan, Northwestern University, US Military Academy - West Point, Black & Veatch, and Oak Ridge National Laboratory. Research partner: U.S. Department of Energy.

54 ENVIRONMENTAL SCIENCES↗

NASA’s Human Data Repositories: An In Depth Look at the New Data Request Process

As NASA transitions its focus to travel back to the moon and on to new destinations, the need to ensure the capture, analysis, and application of research and medical data is of greater urgency than at any other previous time. In this era of limited resources and challenging schedules, the Human Research Program (HRP), based at NASA’s Johnson Space Center (JSC), recognizes the need to extract the greatest possible amount of information from the data already captured. To this end, the HRP Chief Scientist Office (CSO), HRP Program Planning and Control (PP&C) Office, and the Space Medicine Operations Division have been working together to make reuse of both research data and medical monitoring data more accessible to the user community through the Life Science Data Archive (LSDA) and the Lifetime Surveillance of Astronaut Health (LSAH) Repositories. The task of both LSDA and LSAH repositories is to acquire, preserve, and distribute retrospective research (LSDA) and medical (LSAH) data and information both within the NASA community and to the science community at large, for knowledge discovery, retrospective analysis, and planning of future research studies. An additional goal is to encourage collaboration with non-NASA institutions also faced with enhancing human performance in extreme environments. In September 2022, the LSDA website and its contents transitioned to a new NASA Life Sciences Portal (https://nlsp.nasa.gov/explore/lsdahome). This site continues to feature publicly releasable information such as non-attributable datasets, experiment descriptions (from Project Mercury to ISS, as well as from multiple flight analog missions), descriptions of medical monitoring data, and LSAH newsletters (1992 - 2022). The website also provides an updated portal to request additional research and medical data not accessible from the public website. This presentation will provide an in-depth look at the new system as it relates to finding and requesting retrospective data. We will also detail processes from making a request to delivering data for different types of data requests (i.e., attributable, or non-attributable). This includes descriptions of various approval boards, what information and actions the requestor is responsible for, and key milestones in making data available for reuse.

D. M. Thomas↗

Processing PCM Data in Real Time

Novel hardware configuration makes it possible for Space Shuttle launch processing system to monitor pulse-code-modulated data in real time. Using two microprogramable "option planes," incoming PCM data are monitored for changes at rate of one frame of data (80 16-bit words) every 10 milliseconds. Real-time PCM processor utilizes CPU in mini-computer and CPU's in two option planes.

Wissink, T. L.↗

Study and Analysis of The Robot-Operated Material Processing Systems (ROMPS)

This is a report presenting the progress of a research grant funded by NASA for work performed during 1 Oct. 1994 - 31 Sep. 1995. The report deals with the development and investigation of potential use of software for data processing for the Robot Operated Material Processing System (ROMPS). It reports on the progress of data processing of calibration samples processed by ROMPS in space and on earth. First data were retrieved using the I/O software and manually processed using MicroSoft Excel. Then the data retrieval and processing process was automated using a program written in C which is able to read the telemetry data and produce plots of time responses of sample temperatures and other desired variables. LabView was also employed to automatically retrieve and process the telemetry data.

Nguyen, Charles C.↗

Reduction and error analysis of the AVE 2 pilot experiment data

The reduction techniques used to process data from the pilot experiment of the second NASA atmospheric variability experiment (AVE IIP), which was conducted during a 24 hour period beginning at 1200 GMT on May 11, 1974, and ending at 1200 GMT on May 12, 1974 are described. Each step of the data handling process is described through the presentation of computer flow charts, programs, equations, and narrative. An error analysis of the final output is presented, and results of the AVE IIP reduction process are compared with results from the National Weather Service. The AVE IIP sounding data contain more detail than National Weather Service data, but the two data sets may be used together without difficulty.

Fuelberg, H. E.↗

Maximum ADPE Approach for a High Rate CCSDS Return Link Processing System

The earth observing system data and operations system (EDOS) multi-mission data processing and distribution system for the earth observing system is considered. The EDOS was based on the Consultative Committee for Space Data Systems (CCSDS) protocols. The development included the challenge of developing and demonstrating a 150 Mbps CCSDS return link processing capability for the support of the first EDOS delivery. The approach used general-purpose automated data processing equipment (ADPE) and minimized the use of customized hardware. The way in which the system was developed is described. The principle design decisions and the performance benchmark results are presented.

Krimchansky, Alexander↗

Multi-crop area estimation and mapping on a microprocessor/mainframe network

The data processing system is outlined for a 1985 test aimed at determining the performance characteristics of area estimation and mapping procedures connected with the California Cooperative Remote Sensing Project. The project is a joint effort of the USDA Statistical Reporting Service-Remote Sensing Branch, the California Department of Water Resources, NASA-Ames Research Center, and the University of California Remote Sensing Research Program. One objective of the program was to study performance when data processing is done on a microprocessor/mainframe network under operational conditions. The 1985 test covered the hardware, software, and network specifications and the integration of these three components. Plans for the year - including planned completion of PEDITOR software, testing of software on MIDAS, and accomplishment of data processing on the MIDAS-VAX-CRAY network - are discussed briefly.

Sheffner, E.↗

Open Source Release of NJOY2016 and NJOY21

NJOY has been the standard for nuclear data processing for many decades. NJOY is a comprehensive computer code used to produce point-wise and multigroup nuclear data application libraries from cross sections and related quantities obtained from evaluated nuclear data in the Evaluated Nuclear Data Format (ENDF). NJOY was first publicly released in 1977 and distributed by what is now the Radiation Safety Information Computational Center (RSICC) at Oak Ridge National Laboratory and the National Energy Software Center (NESC) at Argonne National Laboratory. From that time until the release of NJOY2012, NJOY has been distributed by RSICC and made available to researchers outside the United States by agreements between RSICC and the NEA Databank. NJOY2012 was distributed by the Feynman Center at Los Alamos National Laboratory which did not have agreements with the NEA Databank, thus making it more difficult for non US citizens to obtain copies of NJOY2012. Furthermore, NJOY has had export control restrictions preventing some researchers from obtaining NJOY at all. Two new versions of NJOY have been released, NJOY2016 and NJOY21, in January of 2017. Both NJOY2016 and NJOY21 have been released with no export control restrictions and are distributed with an open-source license. This is a big departure from previous releases and impacts not only who has access to NJOY, but also how updates are made available to users and how collaboration is facilitated among interested developers. In addition to distributing NJOY2016 and NJOY21 with an open-source license, these two new versions provide new capabilities for NJOY which will maintain NJOY as the standard for nuclear data processing into the foreseeable future. We report in this summary about the changes that come with these two new versions of NJOY and how this impacts the users and long-time contributors to NJOY.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Air data measurement using distributed processing and fiber optics data transmission

Distributed processing, fiber optics technology, and redundancy management in the aircraft environment are discussed. The project features the development of an angle-of-attack and sideslip data collection system hich features: (1) two independent microprocessor controlled data collection and calibration units; (2) transmission of data to the control system on a fiber optic data bus; and (3) software implemented error detection and recovery.

Farry, K. A.↗

Poisson Log-Normal Process for Count Data Prediction

Modeling count data is important in physics and other scientific disciplines, where measurements often involve discrete, non-negative quantities such as photon or neutrino detection events. Traditional parametric approaches can be trained to generate integer-count predictions but may struggle with capturing complex, non-linear dependencies often observed in the data. Gaussian process (GP) regression provides a robust non-parametric alternative to modeling continuous data; however, it cannot generate integer outputs. We propose the Poisson Log-Normal (PoLoN) process, a framework that employs GP to model Poisson log-rates. As in GP regression, our approach relies on the correlations between data points captured via GP kernel structure rather than explicit functional parameterizations. We demonstrate that the PoLoN predictive distribution is Poisson-LogNormal and provide an algorithm for optimizing kernel hyperparameters. Furthermore, we adapt the PoLoN approach to the problem of detecting weak localized signals superimposed on a smoothly varying background - a task of considerable interest in many areas of science and engineering. Our framework allows us to predict the strength, location and width of the detected signals. We evaluate PoLoN's performance using both synthetic and real-world datasets, including the open dataset from CERN which was used to detect the Higgs boson at the Large Hadron Collider. Our results indicate that the PoLoN process can be used as a non-parametric alternative for analyzing, predicting, and extracting signals from integer-valued data.

Saha, Anushka [Rutgers U., Piscataway]↗

The use of transputers in processing telemetry data

Parallelism will be an essential ingredient of high performance systems of the future. The Inmos transputer is a high performance single-chip computer whose architecture facilitates the construction of parallel processing systems. Occam is a high level language developed for use with the Inmos transputer. This paper describes a project to evaluate the feasibility of using the transputer to implement real time processing of telemetry data.

Delgado, Hugo M., Jr.↗

Compactly‐Supported Nonstationary Kernels for Computing Exact Gaussian Processes on Big Data

The Gaussian process (GP) is a widely used method for analyzing large-scale data sets, including spatio-temporal measurements of nonlinear processes that are now commonplace in the environmental sciences. Traditional implementations of GPs involve stationary kernels (also termed covariance functions) that limit their flexibility, and exact methods for inference that prevent application to data sets with more than about 10,000 points. Modern approaches to address stationarity assumptions generally fail to accommodate large data sets, while all attempts to address scalability focus on approximating the Gaussian likelihood, which can involve subjectivity and lead to inaccuracies. In this work, we explicitly derive an alternative kernel that can discover and encode both sparsity and nonstationarity. We embed the kernel within a fully Bayesian GP model and leverage high-performance computing resources to enable the analysis of massive data sets. We demonstrate the favorable performance of our novel kernel relative to existing exact and approximate GP methods across a variety of synthetic data examples. Furthermore, we conduct space–time prediction based on more than 1 million measurements of daily maximum temperature and verify that our results outperform state-of-the-art methods in the Earth sciences. More broadly, having access to exact GPs that use ultra-scalable, sparsity-discovering, nonstationary kernels allows GP methods to truly compete with a wide variety of machine learning methods.

Gaussian processes↗

Residual acceleration data on IML-1: Development of a data reduction and dissemination plan

The main thrust of our work in the third year of contract NAG8-759 was the development and analysis of various data processing techniques that may be applicable to residual acceleration data. Our goal is the development of a data processing guide that low gravity principal investigators can use to assess their need for accelerometer data and then formulate an acceleration data analysis strategy. The work focused on the flight of the first International Microgravity Laboratory (IML-1) mission. We are also developing a data base management system to handle large quantities of residual acceleration data. This type of system should be an integral tool in the detailed analysis of accelerometer data. The system will manage a large graphics data base in the support of supervised and unsupervised pattern recognition. The goal of the pattern recognition phase is to identify specific classes of accelerations so that these classes can be easily recognized in any data base. The data base management system is being tested on the Spacelab 3 (SL3) residual acceleration data.

Rogers, Melissa J. B.↗

Applying Service-Oriented Architecture to Archiving Data in Control and Monitoring Systems

Current trends in the architecture of software systems focus our attention on building systems using a set of loosely coupled components, each providing a specific functionality known as service. It is not much different in control and monitoring systems, where a functionally distinct sub-system can be identified and independently designed, implemented, deployed and maintained. One functionality that renders itself perfectly to becoming a service is archiving the history of the system state. The design of such a service and our experience of using it are the topic of this article. The service is built with responsibility segregation in mind, therefore, it provides for reducing data processing on the data viewer side and separation of data access and modification operations. The service architecture and the details concerning its data store design are discussed. An implementation of a service client capable of archiving EPICS process variables (PV) and LabVIEW shared variables is presented. Data access tools, including a browser-based data viewer and a mobile viewer, are also presented.

Nogiec, J. M.↗

A Cloud-Tracking Data Set for the CSAPR2 Adaptive Scanning during TRACER

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) User Facility (Mather and Voyles 2013) deployed the first ARM Mobile Facility (AMF1; Miller et al. 2016) near LaPorte, Texas to support the Tracking Aerosol Convection Interactions Experiment (TRACER) (Jensen et al. 2025) near Houston, Texas. From October 2021 to September 2022, AMF1 was deployed to 29.67° N, 95.06° W near LaPorte, Texas and the 2nd Generation C-band Scanning ARM Precipitation Radar (CSAPR2) was deployed to a supplementary site at 29.53° N, 95.28° W (Figure 1). During an intensive operational period (IOP) from 1 June to 30 September 2022, the CSAPR2 sampled precipitation echoes in an adaptive scanning mode following the Multisensor Agile Adaptive Scanning (MAAS) framework (Kollias et al. 2020). MAAS helped optimize the CSAPR2 scan strategy to perform frequent plan position indicator (PPI) and range height indicator (RHI) scans (Lamer et al. 2023). Details of the CSAPR2 scanning, data processing, and calibration procedures used by the principal investigator (PI), and the PI data files are described by Oue et al. (2023). Details of the CSAPR2 operational performance, ARM data processing and correction procedures, and data quality masks are described by Feng et al. (2024a).

54 ENVIRONMENTAL SCIENCES↗

Multi-frequency multi-polarization processing for spaceborne SAR

The Shuttle Imaging Radar-C (SIR-C) is the third in a series of space shuttle based synthetic aperture radars (SAR) sponsored by the National Aeronautics and Space Administration (NASA). The SIR-C ground data processing system is to process the playbacked SAR signal data into a variety of data products for distribution to the science community. An overview of the end-to-end ground data processing system with emphasis on the unique characteristics involved in the system design is presented. Included in the discussion are science requirements, radar system specifications, input data format specifications, system operations design, data products design, processing algorithm design, hardware architecture design, and software design.

Curlander, John C.↗

Data management in pattern recognition and image processing systems

Data management considerations are important to any system which handles large volumes of data or where the manipulation of data is technically sophisticated. A particular problem is the introduction of image-formatted files into the mainstream of data processing application. This report describes a comprehensive system for the manipulation of image, tabular, and graphical data sets which involve conversions between the various data types. A key characteristic is the use of image processing technology to accomplish data management tasks. Because of this, the term 'image-based information system' has been adopted.

Zobrist, A. L.↗

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗