Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Apparatus and Method for Assessing Vestibulo-Ocular Function

A system for assessing vestibulo-ocular function includes a motion sensor system adapted to be coupled to a user's head; a data processing system configured to communicate with the motion sensor system to receive the head-motion signals; a visual display system configured to communicate with the data processing system to receive image signals from the data processing system; and a gain control device arranged to be operated by the user and to communicate gain adjustment signals to the data processing system.

Shelhamer, Mark J.↗

Monitoring Disasters by Use of Instrumented Robotic Aircraft

Efforts are under way to develop data-acquisition, data-processing, and data-communication systems for monitoring disasters over large geographic areas by use of uninhabited aerial systems (UAS) robotic aircraft that are typically piloted by remote control. As integral parts of advanced, comprehensive disaster- management programs, these systems would provide (1) real-time data that would be used to coordinate responses to current disasters and (2) recorded data that would be used to model disasters for the purpose of mitigating the effects of future disasters and planning responses to them. The basic idea is to equip UAS with sensors (e.g., conventional video cameras and/or multispectral imaging instruments) and to fly them over disaster areas, where they could transmit data by radio to command centers. Transmission could occur along direct line-of-sight paths and/or along over-the-horizon paths by relay via spacecraft in orbit around the Earth. The initial focus is on demonstrating systems for monitoring wildfires; other disasters to which these developments are expected to be applicable include floods, hurricanes, tornadoes, earthquakes, volcanic eruptions, leaks of toxic chemicals, and military attacks. The figure depicts a typical system for monitoring a wildfire. In this case, instruments aboard a UAS would generate calibrated thermal-infrared digital image data of terrain affected by a wildfire. The data would be sent by radio via satellite to a data-archive server and image-processing computers. In the image-processing computers, the data would be rapidly geo-rectified for processing by one or more of a large variety of geographic-information- system (GIS) and/or image-analysis software packages. After processing by this software, the data would be both stored in the archive and distributed through standard Internet connections to a disaster-mitigation center, an investigator, and/or command center at the scene of the fire. Ground assets (in this case, firefighters and/or firefighting equipment) would also be monitored in real time by use of Global Positioning System (GPS) units and radio communication links between the assets and the UAS. In this scenario, the UAS would serve as a data-relay station in the sky, sending packets of information concerning the locations of assets to the image-processing computer, wherein this information would be incorporated into the geo-rectified images and maps. Hence, the images and maps would enable command-center personnel to monitor locations of assets in real time and in relation to locations affected by the disaster. Optionally, in case of a disaster that disrupted communications, the UAS could be used as an airborne communication relay station to partly restore communications to the affected area. A prototype of a system of this type was demonstrated in a project denoted the First Response Experiment (Project FiRE). In this project, a controlled outdoor fire was observed by use of a thermal multispectral scanning imager on a UAS that delivered image data to a ground station via a satellite uplink/ downlink telemetry system. At the ground station, the image data were geo-rectified in nearly real time for distribution via the Internet to firefighting managers. Project FiRE was deemed a success in demonstrating several advances essential to the eventual success of the continuing development effort.

Wegener, Steven S.↗

Atmospheric Radiation Measurement Program Climate Research Facility Operations Quarterly Report. October 1 - December 31, 2010.

Individual raw datastreams from instrumentation at the Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile sites are collected and sent to the Data Management Facility (DMF) at Pacific Northwest National Laboratory (PNNL) for processing in near-real time. Raw and processed data are then sent approximately daily to the ARM Archive, where they are made available to users. For each instrument, we calculate the ratio of the actual number of processed data records received daily at the Archive to the expected number of data records. The results are tabulated by (1) individual datastream, site, and month for the current year and (2) site and fiscal year (FY) dating back to 1998. The U.S. Department of Energy (DOE) requires national user facilities to report time-based operating data. The requirements concern the actual hours of operation (ACTUAL); the estimated maximum operation or uptime goal (OPSMAX), which accounts for planned downtime; and the VARIANCE [1 - (ACTUAL/OPSMAX)], which accounts for unplanned downtime. The OPSMAX time for the first quarter of FY2010 for the Southern Great Plains (SGP) site is 2097.60 hours (0.95 x 2208 hours this quarter). The OPSMAX for the North Slope Alaska (NSA) locale is 1987.20 hours (0.90 x 2208) and for the Tropical Western Pacific (TWP) locale is 1876.80 hours (0.85 x 2208). The first ARM Mobile Facility (AMF1) deployment in Graciosa Island, the Azores, Portugal, continued through this quarter, so the OPSMAX time this quarter is 2097.60 hours (0.95 x 2208). The second ARM Mobile Facility (AMF2) began deployment this quarter to Steamboat Springs, Colorado. The experiment officially began November 15, but most of the instruments were up and running by November 1. Therefore, the OPSMAX time for the AMF2 was 1390.80 hours (.95 x 1464 hours) for November and December (61 days). The differences in OPSMAX performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure OPSMAX for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams that have been received by the Archive. Data not at the Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Therefore, data availability is directly related to individual instrument uptime. Thus, the average percentage of data in the Archive represents the average percentage of the time (24 hours per day, 92 days for this quarter) the instruments were operating this quarter. Summary. Table 1 shows the accumulated maximum operation time (planned uptime), actual hours of operation, and variance (unplanned downtime) for the period October 1-December 31, 2010, for the fixed sites. Because the AMFs operate episodically, the AMF statistics are reported separately and not included in the aggregate average with the fixed sites. This first quarter comprises a total of 2,208 possible hours for the fixed sites and the AMF1 and 1,464 possible hours for the AMF2. The average of the fixed sites exceeded our goal this quarter. The AMF1 has essentially completed its mission and is shutting down to pack up for its next deployment to India. Although all the raw data from the operational instruments are in the Archive for the AMF2, only the processed data are tabulated. Approximately half of the AMF2 instruments have data that was fully processed, resulting in the 46% of all possible data made available to users through the Archive for this first quarter. Typically, raw data is not made available to users unless specifically requested.

54 ENVIRONMENTAL SCIENCES↗

Thirty-Six Combined Years of MODIS Geolocation Trending

Two Moderate Resolution Imaging Spectroradiometer (MODIS) sensors have been in operations for more than 19 and 17 years (thus 36 combined years) as part of NASA's Earth Observing System (EOS) on the Terra platform that was launched in December 1999 and on the Aqua platform that was launched in May 2002, respectively. Accurate geolocation is a critical element needed for accurate retrieval of global biogeophysical parameters. In this paper, we describe the latest trends in the continuously improved MODIS geolocation accuracy in Collection-5 (C5), C6 and C6.1 re-processing and forward-processing data streams. We improved geolocation accuracy in the re-processed data and corrected for geolocation biases found in forward-processed data, including those caused by operations such as the stop-go-stop status of the Advanced Microwave Scanning Radiometer for EOS (AMSR-E) instrument on the Aqua platform. We discuss scan-toscan underlaps near nadir over the equator regions that was discovered in checking the non-underlapping requirement in the Visible Infrared Imaging Radiometer Suite (VIIRS) based on trending parameters from the actual Suomi National Polar-orbiting Partnership (S-NPP) satellite orbit. The underlaps are closely tied to instrument effective focal length that is measured from on-orbit data using a technique we recently developed. We also discuss potential improvements for the upcoming C7 re-processing.

ground control point↗

AmeriFlux BASE data pipeline to support network growth and data sharing

Abstract AmeriFlux is a network of research sites that measure carbon, water, and energy fluxes between ecosystems and the atmosphere using the eddy covariance technique to study a variety of Earth science questions. AmeriFlux’s diversity of ecosystems, instruments, and data-processing routines create challenges for data standardization, quality assurance, and sharing across the network. To address these challenges, the AmeriFlux Management Project (AMP) designed and implemented the BASE data-processing pipeline. The pipeline begins with data uploaded by the site teams, followed by the AMP team’s quality assurance and quality control (QA/QC), ingestion of site metadata, and publication of the BASE data product. The semi-automated pipeline enables us to keep pace with the rapid growth of the network. As of 2022, the AmeriFlux BASE data product contains 3,130 site years of data from 444 sites, with standardized units and variable names of more than 60 common variables, representing the largest long-term data repository for flux-met data in the world. The standardized, quality-ensured data product facilitates multisite comparisons, model evaluations, and data syntheses.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Subtask 1.5 – CO2 Injection Monitoring with an Optimized Scalable, Automated, Semipermanent Seismic Array

The scalable, automated, semipermanent seismic array (SASSA) method is a flexible and relatively cost-effective surface geophysical method for regular time-lapse monitoring of the movement of injected carbon dioxide (CO2) in a reservoir for CO2 enhanced oil recovery (EOR) or geologic CO2 storage operations. It has the advantages of a low-environmental-footprint while monitoring regions of a reservoir from the surface without the need for a regular grid distribution of receivers. Automated data collection is possible. As only time-lapse amplitude changes at the reservoir level due to CO2 movement within the reservoir are monitored, the turnaround time to deliver results from the SASSA method can be short, without the need for long, time-consuming data-processing workflows. As data is collected and processed, incremental information can be provided to the field operator. The Energy & Environmental Research Center (EERC) conducted a SASSA field test from September 2018 to November 2020 in a portion of the Bell Creek Field in Montana, which implemented new CO2 EOR field activities during the study period. Lessons learned from a proof-of-concept study were incorporated to improve the data quality of the SASSA method and demonstrate the viability of the technology. The EERC implemented several enhancements to improve data quality, including 1) an iterative survey design, which allowed placing the receivers in strategic locations where the movement of the CO2 in the reservoir could be tracked with minimum interference by the cultural noise in the study area; 2) the use of powerful seismic sources in the form of surface orbital vibrators, and 3) data acquisition during optimal periods. History-matched reservoir simulation was performed to predict gas saturation and pressure response induced by CO2 injection in the study area. The results were compared with the SASSA-measured responses to CO2 injection as a partial validation technique. A match between the two methods was observed for most of the SASSA points predicted to have intersected a CO2 saturation change. The validated results provide confidence that the SASSA method can be used independently as a CO2 saturation monitoring technique. As data are collected and processed, incremental information can be provided to the field operator. The critical components of the SASSA workflow for a successful application of the method are the following: Iterative survey design with information about CO2 injection activities from the oilfield operator. A detailed CO2 injection plan is the key driver to select the strategic monitoring location of the SASSA sensors. After this information is incorporated in the initial distribution of sources and receivers in the study area, high-resolution satellite images are used to identify ground locations not affected by cultural noise sources, such as power lines, pipelines/flow lines, or roadways. In the next iteration of the survey design, a scouting trip to the study area is needed to understand more details of the noise sources identified in the previous step and the intensity of the field activities that can also generate noise during the monitoring. Integrating the information from the scouting trip into the survey design to select the optimum source and receiver locations is the final step. Noise attenuation. The variety of noise types during seismic monitoring of an oil field is enormous. Tailored noise characterization and processing at a node-by-node level can enhance the performance and sensitivity of the SASSA technique. Future advancements that could improve the efficiency and application of the SASSA technology include: Gaining a better understanding of the noise field produced by the seismic source to aid the choice of receiver location. Surface noise from the source can overwhelm the small signal changes due to CO2 that the SASSA method measures. Improved data-processing workflow to automatically analyze and adapt to dynamic noise conditions associated with industrial settings. This subtask was funded through the EERC–DOE Joint Program on Research and Development for Fossil Energy-Related Resources Cooperative Agreement No. DE- FE0024233.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

EOS ground data systems: A description and interface overview

The Earth Observing System (EOS) is planned as a space-based measurement system, earth-science research program, and data and information system (EOSDIS). It will consist of several high data rate spacecraft with multiple earth sensing instruments which provide investigators with a thorough, longterm view of the earth's environment. Up to seven spacecraft may be supported at once, either in operational, checkout, or testing phases; and the average data rate from the EOS satellites in orbit at any one time is expected to be from 18 to 60 Mbps. Providing the data processing and flight operations support for EOS will be the EOSDIS Core System (ECS). The ECS will command and control the spacecraft; process and store the EOS data; provide access to the data for years; and support researchers. The data processing aspects of the ECS consist of a collection of Distributed Active Archive Centers (DAAC's) which perform the product generation, data archive and distribution, and information management services. Flight operations aspects will be provided by the EOS Operations Center, by instrument control centers, and by widely distributed instrument support terminals. The communications and system management aspects will be provided by the EOSDIS Science Network and the System Management Center. In addition to the EOS satellite data, other data sets from earlier earth science missions are also to be added to designated DAAC's. Other ground data systems which will provide support to EOS for acquiring, transporting, processing, and distributing the transformed spacecraft data are currently being defined or are being upgraded for the EOS era. These systems include the Space Network consisting of the Tracking and Data Relay Satellite System (TDRSS), the TDRSS Ground Terminals, and the Network Control Center as well as the night Dynamics Facility, the EOS Data and Operations System, and EOS Communications. This paper briefly describes data handling by the ECS, the support data systems, their interfaces, and their roles.

Smith, Gene↗

Configuration and Data Management Process and the System Safety Professional

This article presents a discussion of the configuration management (CM) and the Data Management (DM) functions and provides a perspective of the importance of configuration and data management processes to the success of system safety activities. The article addresses the basic requirements of configuration and data management generally based on NASA configuration and data management policies and practices, although the concepts are likely to represent processes of any public or private organization's well-designed configuration and data management program.

Shivers, Charles Herbert↗

Data-driven predictive probability density function control of fiber length stochastic distribution shaping in refining process

Pulp is the most important raw material in paper in paper industries, whose Fiber Length Stochastic Distribution (FLSD) shaping directly determines the energy consumption and paper quality of the subsequent papermaking processes. However, the mean and variance are insufficient to describe the output FLSD shaping, which display non-Gaussian distribution properties. Therefore, the traditional control, method based on the mean and variance of fiber length is difficult to control the FLSD shaping effectively. In this paper, a novel data-driven predictive probability density function (PDF) control method is proposed for output FLSD shaping in refining process. Primarily, in order to improve the approximation accuracy of the PDF employing RBF neural network, the parameters (center value and width) of each RBF basis functions are tuned via utilizing iterative learning control (ILC) law, and the corresponding estimations of weights law can be obtained. Secondly, considering that the conventional linear model of weights vector has drawbacks of low accuracy and weak generalization ability, random vector functional link networks (RVFLNs) based data driven nonlinear modelling method is employed to characterize the prediction model between the input variables and weights vector. Finally, in order to reduce the randomness of the output FLSD, a minimum entropy control method under mean constraint is employed to design the predictive PDF controller for the output FLSD shaping with the help of the established nonlinear stochastic distribution model. Both simulations and experiments are given to illustrate the effectiveness and practicability of the proposed method.

Probability debsity function, Fiber length distrib↗

Near-Real-Time Detection and Monitoring of Dust Events by Satellite (SeaWIFS, MODIS, and TOMS)

Over the last few years satellites have given us increasingly detailed information on the size, location, and duration of dust events around the world. These data not only provide valuable feedback to the modelling community as to the fidelity of their aerosol models but are also finding increasing use in near real-time applications. In particular, the ability to locate and track the development of aerosol dust clouds on a near real-time basis is being used by scientists and government to provide warning of air pollution episodes over major urban area. This ability has also become a crucial component of recent coordinated campaigns to study the characteristics of tropospheric aerosols such as dust and their effect on climate. One such recent campaign was ACE-Asia, which was designed to obtain the comprehensive set of ground, aircraft, and satellite data necessary to provide a detailed understanding of atmospheric aerosol particles over the Asian-Pacific region. As part of ACE-Asia, we developed a near real-time data processing and access system to provide satellite data from the polar-orbiting instruments Earth Probe TOMS (in the form of absorbing aerosol index) and SeaWiFS (in the form of aerosol optical thickness, AOT, and Angstrom exponent). The results were available via web access. The location and movement information provided by these data were used both in support of the day-to-day flight planning of ACE-Asia and as input into aerosol transport models. While near real-time SeaWiFS data processing can be performed using either the normal global data product or data obtained via direct broadcast to receiving stations close to the area of interest, near real-time MODIS processing of data to provide aerosol retrievals is currently only available using its direct broadcast capability. In this paper, we will briefly discuss the algorithms used to generate these data. The retrieved aerosol optical thickness and Angstrom exponent from SeaWiFS will be compared with those obtained from various AERONET sites over the Asian-Pacific region. The TOMS aerosol index will also be compared with AERONET aerosol optical thickness over different aerosol conditions, and comparisons between the MODIS and SeaWiFS data will also be presented. Finally, we will discuss the climate implication of our studies using the combined satellite and AERONET observations.

Hsu, N. Christina↗

Online Monitoring of Radiochemical Processing Streams for the Plutonium-238 Supply Program

Online monitoring with spectrophotometry is being developed to improve the timeliness of analytical measurements for the Plutonium-238 Supply Program at Oak Ridge National Laboratory. A commercially available online monitoring software was used to calculate and view process data in real time to help identify process deviations and optimize system performance. Monitoring detailed process data will improve processing efficiency and help technicians make decisions during hot-cell operations.

Sadergaski, Luke↗

Processed Lab Data for Neural Network-Based Shear Stress Level Prediction

Machine learning can be used to predict fault properties such as shear stress, friction, and time to failure using continuous records of fault zone acoustic emissions. The files are extracted features and labels from lab data (experiment p4679). The features are extracted with a non-overlapping window from the original acoustic data. The first column is the time of the window. The second and third columns are the mean and the variance of the acoustic data in this window, respectively. The 4th-11th column is the the power spectrum density ranging from low to high frequency. And the last column is the corresponding label (shear stress level). The name of the file means which driving velocity the sequence is generated from. Data were generated from laboratory friction experiments conducted with a biaxial shear apparatus. Experiments were conducted in the double direct shear configuration in which two fault zones are sheared between three rigid forcing blocks. Our samples consisted of two 5-mm-thick layers of simulated fault gouge with a nominal contact area of 10 by 10 cm^2. Gouge material consisted of soda-lime glass beads with initial particle size between 105 and 149 micrometers. Prior to shearing, we impose a constant fault normal stress of 2 MPa using a servo-controlled load-feedback mechanism and allow the sample to compact. Once the sample has reached a constant layer thickness, the central block is driven down at constant rate of 10 micrometers per second. In tandem, we collect an AE signal continuously at 4 MHz from a piezoceramic sensor embedded in a steel forcing block about 22 mm from the gouge layer The data from this experiment can be used with the deep learning algorithm to train it for future fault property prediction.

15 GEOTHERMAL ENERGY↗

Expandable and reconfigurable instrument node arrays

An expandable and reconfigurable instrument node includes a feature detection means and a data processing portion in communication with the feature detection means, the data processing portion configured and disposed to process feature information. The instrument node further includes a phase locked loop (PLL) oscillator in communication with the data processing portion, the PLL oscillator configured and disposed to provide PLL information to the processing portion. The instrument node further includes a single tone transceiver and a pulse transceiver in communication with the PLL oscillator, the single tone transceiver configured and disposed to transmit or receive a single tone for phase correction of the PLL oscillator and the pulse transceiver configured and disposed to transmit and receive signals for phase correction of the PLL oscillator. The instrument node further includes a global positioning (GPA) receiver in communication with the processing portion, the GPS receiver configured and disposed to establish a global position of the instrument node.

Hilliard, Lawrence M.↗

Idaho National Laboratory Data Acquisition And Processing System

The INLDAS data acquisition and processing system is designed to develop prototype measurements and real-time processing techniques. The INLDAS hardware and firmware currently consists of National Instruments • NI-DAQmx 14.1 • cDAQ-9184 • 9205 • 9211 INLDAS can perform of standard data acquisition functions as well as novel functions and real-time processing algorithms. There are 3 acquisition modes to choose from: • Continuous mode runs when the user hits start, processing data and logging it to file • SWTrigger mode waits for one or more predefined triggers before acquiring data. It will buffer data as well, so it can record data that happened shortly before the trigger • Wakeup mode waits on predefined timers. When a time goes off, it acquires a preset amount of data There are also 3 Data Processing Modes • Normal mode does no processing besides the rolling average • FFT Mode Performs an FFT on incoming data every time the time window has elapsed • STFFT mode

Smith, JamesA↗

NJOY21: Making NJOY Suitable for the 21. Century - 14409

NJOY has a long history of nuclear data processing. NJOY began as a successor to MINX (Multigroup Interpretation of Nuclear X-Sections), a Los Alamos code and was first publicly released in the summer of 1977. The initial version included modules such as RECONR for resonance reconstruction on a union energy grid, BROADR for Doppler broadening plus a new Multigroup averaging program, GROUPR and an associated output module, DTR. Soon thereafter the HEATR, ERRORR, and THERMR modules were added to NJOY. By the mid 1980's, NJOY had a worldwide user community. The current version of NJOY2012 was released in December 2012. NJOY2012 builds on the success of more than 45 years of nuclear data processing at Los Alamos National Laboratory. NJOY2012 was rewritten using Fortran 90/95, utilizing among other things the concepts of public and private variables, eliminating common blocks in lieu of Fortran modules and taking advantage of allocatable arrays. A new version of NJOY is being developed at Los Alamos National Laboratory; NJOY21: NJOY for the 21. Century. NJOY21 uses modern programming standards of quality, reliability, and maintainability. It is being designed from the ground up to utilize modern methods of interacting with computer codes by providing an interactive and scripting (e.g., Python) interface. This will allow scientists the ability to more easily work with the results of the various steps in the processing of nuclear data. NJOY21 will continue the legacy of NJOY by providing a trusted and verified processing code that is fast, flexible, easy to use and customize and capable of handling both modern and established nuclear data formats. This paper introduces NJOY21 by first relating the history of NJOY; the majority of the paper will discuss NJOY21. NJOY21 will take advantage of the many decades of nuclear data processing experience that is contained in NJOY2012 and previous versions of NJOY and extend the capabilities and convenience of processing nuclear data. We will discuss how NJOY21 will remain backwards compatible with NJOY2012 - i.e., how current NJOY2012 input decks will continue to work with NJOY21. We will also discuss the verification and validation of the NJOY21 code base. Finally we will discuss new features in NJOY21 that do not exist in NJOY2012. These features include changes in how a scientist can interact with NJOY to process and verify and validate nuclear data; and the ability to read and write new nuclear data formats. (authors)

42 ENGINEERING↗

Evaluation of satellite remote sensing and automatic data techniques for characterization of wetlands and coastal marshlands

The author has identified the following significant results. The evaluation was conducted in a humid swamp and marsh area of southern Louisiana. ERTS digital multispectral scanner data was compared with similar data gathered by intermediate altitude aircraft. Automatic data processing was applied to several data sets to produce simulated color infrared images, analysis of single bands, thematic maps, and surface classifications. These products were used to determine the effectiveness of satellites to monitor accretion of land, locate aquatic plants, determine water characteristics, and identify marsh and forest species. The results show that to some extent all of these can be done with satellite data. It is most effective for monitoring accretion and least effective in locating aquatic plants. The data sets used show that the ERTS data is superior in mapping quality and accuracy to the aircraft data. However, in some applications requiring high resolution or maximum use of intermittent clear weather conditions, data gathering by aircraft is preferable. Data processing costs for equivalent areas are about three times greater for aircraft data than ERTS data. This is primarily because of the larger volume of data generated by the high resolution aircraft system.

Cartmill, R. H.↗

Exploring the Performance of Spark for a Scientific Use Case

We present an evaluation of the performance of a Spark implementation of a classification algorithm in the domain of High Energy Physics (HEP). Spark is a general engine for in-memory, large-scale data processing, and is designed for applications where similar repeated analysis is performed on the same large data sets. Classification problems are one of the most common and critical data processing tasks across many domains. Many of these data processing tasks are both computation- and data-intensive, involving complex numerical computations employing extremely large data sets. We evaluated the performance of the Spark implementation on Cori, a NERSC resource, and compared the results to an untuned MPI implementation of the same algorithm. While the Spark implementation scaled well, it is not competitive in speed to our MPI implementation, even when using significantly greater computational resources.

Sehrish, Saba↗