Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data processing automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

ADP Analysis project for the Human Resources Management Division

The ADP (Automated Data Processing) Analysis Project was conducted for the Human Resources Management Division (HRMD) of NASA's Langley Research Center. The three major areas of work in the project were computer support, automated inventory analysis, and an ADP study for the Division. The goal of the computer support work was to determine automation needs of Division personnel and help them solve computing problems. The goal of automated inventory analysis was to find a way to analyze installed software and usage on a Macintosh. Finally, the ADP functional systems study for the Division was designed to assess future HRMD needs concerning ADP organization and activities.

Tureman, Robert L., Jr.↗

EARTHDATA PUB: A Data Publication Workflow Solution for NASA’s EOSDIS

Each NASA Distributed Active Archive Center (DAAC) faces the challenge of dealing with an increasingly diverse number of publishable data products from diverse data producers. Data producers, on the other hand, may experience pain points when interacting with the EOSDIS for the first time or when publishing different data at different DAACs. As a result, there has been a growing need to develop a common software framework that serves as a common interface for data producers, rigorously defines the data publication procedure for DAAC staff, facilitates the management of various data publication processes, and tracks the progress of data publication. This software should also account for the different configurations at different DAACs. Currently, two primary data publication workflow and tracking tools exist in operation at the EOSDIS: Semi-Automated ingest System (SAuS) and Data Publication workflow Portal (DAPPeR). However, neither tool is cloud-ready. Automated data processing could be managed by Cumulus, an EOSDIS cloud-based data ingest, archive and management system. However, Cumulus does not support manual tasks or on-premise implementations. We propose to develop the Earthdata Publication Minimum Viable Product (Earthdata Pub MVP) -- a cloud-hosted solution that works with both cloud and on-premise systems and implements the communications and exchange requirements generated by the Earthdata Pub information architecture team.

Rice, Justin L.↗

Integration of machine learning with neutron scattering for the Hamiltonian tuning of spin ice under pressure

Quantum materials research requires co-design of theory with experiments and involves demanding simulations and the analysis of vast quantities of data, usually including pattern recognition and clustering. Artificial intelligence is a natural route to optimise these processes and bring theory and experiments together. Here, we propose a scheme that integrates machine learning with high-performance simulations and scattering measurements, covering the pipeline of typical neutron experiments. Our approach uses nonlinear autoencoders trained on realistic simulations along with a fast surrogate for the calculation of scattering in the form of a generative model. We demonstrate this approach in a highly frustrated magnet, Dy 2 Ti 2 O 7 , using machine learning predictions to guide the neutron scattering experiment under hydrostatic pressure, extract material parameters and construct a phase diagram. Our scheme provides a comprehensive set of capabilities that allows direct integration of theory along with automated data processing and provides on a rapid timescale direct insight into a challenging condensed matter system.

36 MATERIALS SCIENCE↗

Engine Icing Data - An Analytics Approach

Engine icing researchers at the NASA Glenn Research Center use the Escort data acquisition system in the Propulsion Systems Laboratory (PSL) to generate and collect a tremendous amount of data every day. Currently these researchers spend countless hours processing and formatting their data, selecting important variables, and plotting relationships between variables, all by hand, generally analyzing data in a spreadsheet-style program (such as Microsoft Excel). Though spreadsheet-style analysis is familiar and intuitive to many, processing data in spreadsheets is often unreproducible and small mistakes are easily overlooked. Spreadsheet-style analysis is also time inefficient. The same formatting, processing, and plotting procedure has to be repeated for every dataset, which leads to researchers performing the same tedious data munging process over and over instead of making discoveries within their data. This paper documents a data analysis tool written in Python hosted in a Jupyter notebook that vastly simplifies the analysis process. From the file path of any folder containing time series datasets, this tool batch loads every dataset in the folder, processes the datasets in parallel, and ingests them into a widget where users can search for and interactively plot subsets of columns in a number of ways with a click of a button, easily and intuitively comparing their data and discovering interesting dynamics. Furthermore, comparing variables across data sets and integrating video data (while extremely difficult with spreadsheet-style programs) is quite simplified in this tool. This tool has also gathered interest outside the engine icing branch, and will be used by researchers across NASA Glenn Research Center. This project exemplifies the enormous benefit of automating data processing, analysis, and visualization, and will help researchers move from raw data to insight in a much smaller time frame.

Engine Icing↗

Implementation and extension of the impulse transfer function method for future application to the space shuttle project. Volume 1: Analysis and correlation studies

Computer programming, data processing, and a correlation study that employed data collected in the first phase test were used to demonstrate that standard test procedures and equipment could be used to collect a significant number of transfer functions from tests of the Lunar Module test article LTA-11. The testing consisted of suspending the vehicle from the apex fittings of the outrigger trusses through a set of air springs to simulate the free-free state. Impulsive loadings were delivered, one at a time, at each of the landing gear's attachment points, in three mutually perpendicular directions; thus a total of 36 impulses were applied to the vehicle. Time histories of each pulse were recorded on magnetic tape along with 40 channels of strain gage response and 28 channels of accelerometer response. Since an automated data processing system was not available, oscillograph playbacks were made of all 2400 time histories as a check on the validity of the data taken. In addition, one channel of instrumentation was processed to determine its response to a set of forcing functions from a prior LTA-11 drop test. This prediction was compared with drop test results as a first measure of accuracy.

Mantus, M.↗

A systematic review of machine learning in groundwater monitoring

With increasing concerns about water scarcity, groundwater has become crucial since this resource provides most of the freshwater needs. However, various human and natural activities often contaminate the groundwater, making it unsuitable for use. Over the years, scientists and engineers have used many methods to predict and track groundwater contamination as part of environmental monitoring. Consequently, there is an urgent need for improved methods, particularly in the face of increasing contamination. Machine learning has sometimes been used to monitor groundwater, air quality, and climate. Traditional methods must be improved due to the complexity and large amount of environmental data. This includes using hybrid models that combine traditional and new techniques. Despite the use of machine learning in many scientific areas, there is a lack of comprehensive reviews focusing on its use in environmental monitoring, especially groundwater monitoring. We aim to fill this gap by exploring machine-learning applications in groundwater monitoring. We discuss relevant methods, their limitations, and future potential. We summarize research on automating data processing and model training using groundwater sensor data. Our research underscores the transformative potential of machine learning to revolutionize long-term groundwater monitoring and contamination detection, providing valuable insights for future research and practical applications.

AI/ML↗

First STAX detector installation at the National Institute for Radioelements (IRE)

The Source Term Analysis of Xenon (STAX) project has been installing stack detectors at medical isotope production facilities to measure radioxenon emissions to investigate the effect of radioxenon releases on nuclear explosion monitoring. This paper outlines the installation of the first STAX detection system at the National Institute for Radioelements (IRE) in Fleurus, Belgium which has been operating for over three years and transferring collected data to the STAX repository. Information about the equipment installed, the data flow established, and calculations for determination of radioxenon releases from the facility are presented. Further. data quality was investigated to confirm values reported by STAX automated data processing and in a comparison of collected STAX data with data collected by IRE for regulatory reporting.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Guiding the choice of informatics software and tools for lipidomics research applications

Progress in mass spectrometry lipidomics has led to a rapid proliferation of studies across biology and biomedicine. These generate extremely large raw datasets requiring sophisticated solutions to support automated data processing. To address this, numerous software tools have been developed and tailored for specific tasks. However, for researchers, deciding which approach best suits their application relies on ad hoc testing, which is inefficient and time consuming. Here we first review the data processing pipeline, summarizing the scope of available tools. Next, to support researchers, LIPID MAPS provides an interactive online portal listing open-access tools with a graphical user interface. This guides users towards appropriate solutions within major areas in data processing, including (1) lipid-oriented databases, (2) mass spectrometry data repositories, (3) analysis of targeted lipidomics datasets, (4) lipid identification and (5) quantification from untargeted lipidomics datasets, (6) statistical analysis and visualization, and (7) data integration solutions. Detailed descriptions of functions and requirements are provided to guide customized data analysis workflows.

59 BASIC BIOLOGICAL SCIENCES↗

dbprocessing

dbprocessing is a python framework for automating data processing pipelines. The dbprocessing package uses a configuration file to define the input, intermediate, and output data products for a particular data type as well as the processes that connect those data products. In addition, dbprocessing uses python scripts called inspectors to determine if a particular file matches a configured data product. If a particular data product is found, it is ingested into the dbprocessing database (sqlite3 or postgres) which then triggers all of the chained processes to the final data product. While the framework is written in python, it can run software in any language but may require a “wrapper” to translate the dbprocessing command line arguments to the form expected by the software.

Walker, Andrew↗

NLR OpenPATH™ (National Laboratory of the Rockie's Open Platform for Agile Trip Heuristics [SWR-20-73]

National Laboratory of the Rockies' Open Platform for Agile Trip Heuristics (NLR OpenPATH™) enables people to track their travel modes—by car, bus, bike, walking, etc.—and measure their associated energy use. Formerly known as e-mission, the NLR OpenPATH tool features continuous data collection and analysis via a smart phone app backed by a server and automated data processing. Its open nature enables transparent data collection and analysis while allowing for continuous improvement coupled with accessibility and adaptability by others. NLR OpenPATH empowers communities to collect and understand their own travel data while achieving place-based, locally relevant mobility goals.

Shankari, K.↗

Tools for Visualization and Analysis of Small-Angle Neutron Scattering Data: Descriptions and Examples

A great deal of progress has been made in improving the data reduction experience for the SANS instruments at the SNS and HFIR at ORNL. The existing data reduction toolset, drtsans, makes it possible to integrate data analysis and visualization tools into the data reduction scripts, thereby providing new opportunities for more automated data processing for users of the SNS and HFIR. Here, the first set of tools developed is described with usage examples.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Binary chromatographic data and estimation of adsorbent porosities

Data for the system n-pentane/n-heptane on porous Chromosorb-102 adsorbent were obtained at 150, 175, and 200 C for mixtures containing zero to 100% n-pentane by weight. Prior results showing limitations on superposition of pure component data to predict multicomponent chromatograms were verified. The thermodynamic parameter MR0 was found to be a linear function of sample composition. A nonporous adsorbent failed to separate the system because of large input sample dispersions. A proposed automated data processing scheme involving magnetic tape recording of the detector signals and processing by a minicomputer was rejected because of resolution limitations of the available a/d converters. Preliminary data on porosity and pore size distributions of the adsorbents were obtained.

Meisch, A. J.↗

DBMS UTILIZATION: A Corporate Information System (CIS) development approach

The Corporate Information System (CIS), an integrated information system intended to tie the corporation together as a functioning entity, is described. In addition to being a major upgraded automated data processing system, the CIS is a management philosophy which recognizes data as a valuable corporate resource and which distinguishes between data and selected data, or information. It further recognizes that different users need different kinds of information. Plans for CIS development are discussed. It will offer its users not just after-the-fact data, but timely information in a format that is meaningful and useful to the particular user, so that the information can be applied in planning, controlling, and decision making by all levels of management. In effect, CIS will help the corporation itself to function as a total, integrated system by typing together administrative activities through information exchange. The CIS supports the operational, tactical control, and strategic planning functions of the corporation. Operational functions are the day-to-day processing necessary to support the corporation's work, such as purchasing and payroll.

Rozett, P.↗

The Cyclone meteor radar system for routine wind measurements in the lower thermosphere

A new meteor wind radar system called Cyclone was devised to extend and update the meteor radar network and for unattended operation. The Cyclone meteor radar system obtains information from four directions simultaneously. To automate data processing a special digital device was developed. An algorithm used to determine the Doppler shifts was adopted, which makes it possible to eliminate selectivity with respect to slow velocity meteor drifts. The operation of the Cyclone system is described.

Lysenko, I. A.↗

Electro-optical flight deflection measurement system

This paper describes an electrooptical flight-deflection measurement system (FDMS) developed for use on highly-maneuverable-aircraft-technology (HiMAT) RPV flight research program. The FDMS provides in-flight measurements of the aircraft structural deflections and magnetic-tape recordings for automated data processing. The capabilities and limitations, requirements for installation on an aircraft, analytical considerations, and typical flight data acquired from the HiMAT research program are examined. The flight data indicate that the background light is the major obstacle to acquiring high-quality data and that the relationship between the target displacement and the output of the FDMS is nonlinear; however, the nonlinear effects can be minimized with judicious planning of the installation of the FDMS on the aircraft. Excellent flight deflection data were obtained from both the HiMAT and X-29 A flight research program with very little data lost as a result of encounters with severe background light.

Deangelis, V. Michael↗

Fifth Report of the NASA Advisory Council Task Force on the Shuttle-Mir Rendezvous and Docking Missions

The NASA Advisory Council Task Force on the Shuttle-Mir rendezvous and docking missions examine a number of specific issues related to the Shuttle-Mir program. Three teams composed of Task Force members and technical advisors were formed to address the follow issues: preliminary results from STS-71 and the status of preparations for STS-74; NASA's presence in Russia; and NASA's automated data processing and telecommunications (ADP/T) infrastructure in Russia. The three review team reports have been included in the fifth report of the Task Force.

Source record↗

NASA Information Technology Implementation Plan

NASA's Information Technology (IT) resources and IT support continue to be a growing and integral part of all NASA missions. Furthermore, the growing IT support requirements are becoming more complex and diverse. The following are a few examples of the growing complexity and diversity of NASA's IT environment. NASA is conducting basic IT research in the Intelligent Synthesis Environment (ISE) and Intelligent Systems (IS) Initiatives. IT security, infrastructure protection, and privacy of data are requiring more and more management attention and an increasing share of the NASA IT budget. Outsourcing of IT support is becoming a key element of NASA's IT strategy as exemplified by Outsourcing Desktop Initiative for NASA (ODIN) and the outsourcing of NASA Integrated Services Network (NISN) support. Finally, technology refresh is helping to provide improved support at lower cost. Recently the NASA Automated Data Processing (ADP) Consolidation Center (NACC) upgraded its bipolar technology computer systems with Complementary Metal Oxide Semiconductor (CMOS) technology systems. This NACC upgrade substantially reduced the hardware maintenance and software licensing costs, significantly increased system speed and capacity, and reduced customer processing costs by 11 percent.

Source record↗

Wireless Integrated Microelectronic Vacuum Sensor System

NASA Stennis Space Center's (SSC's) large rocket engine test facility requires the use of liquid propellants, including the use of cryogenic fluids like liquid hydrogen as fuel, and liquid oxygen as an oxidizer (gases which have been liquefied at very low temperatures). These fluids require special handling, storage, and transfer technology. The biggest problem associated with transferring cryogenic liquids is product loss due to heat transfer. Vacuum jacketed piping is specifically designed to maintain high thermal efficiency so that cryogenic liquids can be transferred with minimal heat transfer. A vacuum jacketed pipe is essentially two pipes in one. There is an inner carrier pipe, in which the cryogenic liquid is actually transferred, and an outer jacket pipe that supports and seals the vacuum insulation, forming the "vacuum jacket." The integrity of the vacuum jacketed transmission lines that transfer the cryogenic fluid from delivery barges to the test stand must be maintained prior to and during engine testing. To monitor the vacuum in these vacuum jacketed transmission lines, vacuum gauge readings are used. At SSC, vacuum gauge measurements are done on a manual rotation basis with two technicians, each using a handheld instrument. Manual collection of vacuum data is labor intensive and uses valuable personnel time. Additionally, there are times when personnel cannot collect the data in a timely fashion (i.e., when a leak is detected, measurements must be taken more often). Additionally, distribution of this data to all interested parties can be cumbersome. To simplify the vacuum-gauge data collection process, automate the data collection, and decrease the labor costs associated with acquiring these measurements, an automated system that monitors the existing gauges was developed by Invocon, Inc. For this project, Invocon developed a Wireless Integrated Microelectronic Vacuum Sensor System (WIMVSS) that provides the ability to gather vacuum-gauge measurements automatically and wirelessly, in near-real time - using a low-maintenance, lowpower sensor mesh network. The WIMVSS operates by using a self-configuring mesh network of wireless sensor units. Mesh networking is a type of networking where each sensor or node can capture and disseminate its own data, but also serve as a relay to receive and transmit data from other sensors. Each sensor node can synchronize with adjacent sensors, and propagate data from one sensor to the next, until the destination is reached. In this case, the destination is a Network Interface Unit (NIU). The WIMVSS sensors are mounted on the existing vacuum gauges. Information gathered by the sensors is sent to the NIU. Because of the mesh networking, if a sensor cannot directly send the data to the NIU, it can be propagated through the network of sensors. The NIU requires antenna access to the sensor units, AC power, and an Ethernet connection. The NIU bridges the sensor network to a WIMVSS server via an Ethernet connection. The server is configured with a database, a Web server, and proprietary interface software that makes it possible for the vacuum measurements from vacuum jacketed fluid lines to be saved, retrieved, and then displayed from any Web-enabled PC that has access to the Internet. Authorized users can then simply access the data from any PC with Internet connection. Commands can also be sent directly from the Web interface for control and maintenance of the sensor network. The technology enabled by the WIMVSS decreases labor required for gathering vacuum measurements, increases access to vacuum data by making it available on any computer with access to the Internet, increases the frequency with which data points can be acquired for evaluating the system, and decreases the recurring cost of the sensors by using off-the-shelf components and integrating these with heritage vacuum gauges.

Krug, Eric↗