SEARCH · Engineering Papers

Results for “data processing automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

DOE OSTI2024

High-Throughput Data Processing at FRIB Using ESnet

Real-time or nearly real-time (nearline) data processing methods are critical tools as detector technologies and data acquisition (DAQ) systems allow for higher data rates and volumes. The introduction of the energy sciences network (ESnet), a U.S. Department of Energy (DOE) supported high-speed network for scientific research, creates opportunities to leverage the computing power of DOE facilities like the National Energy Research Scientific Computing Center (NERSC). As a first step toward realizing a DOE Office of Science Integrated Research Infrastructure (IRI) pattern, an automated workflow was developed to remotely process data obtained from a nuclear physics experiment at the Facility for Rare Isotope Beams (FRIB) at NERSC with data transferred between FRIB and NERSC over ESnet. The workflow demonstrated the ability to process one week’s worth of experimental data in approximately 90 min and was used successfully for nearline analysis during a recently completed FRIB experiment. Here, a summary of the workflow development and results of recent demonstrations will be presented.

Data processing↗

DOE OSTI2023

Digital autofocusing of a coded-aperture Laue diffraction microscope

To provide optimal depth resolution with a coded-aperture Laue diffraction microscope, an accurate position of the coded-aperture and its scanning geometry need to be known. However, finding the geometry by trial and error is a time-consuming and often challenging process because of the large number of parameters involved. In this paper, we propose an optimization approach to automate the focusing process after data is collected. Here we demonstrate the robustness and efficiency of the proposed approach with experimental data taken at a synchrotron facility.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Detecting damage in composites using volume decomposition analysis of tomographic data

Detection of damage in a single tow ceramic matrix composite specimen has been achieved using orthogonal decomposition of volumetric tomographic datasets collected at four tensile loads. This decomposition approach has been applied at two different length scales: (i) individual fibres and (ii) bulk volumes containing fibres and matrix material. Volumes were first decomposed to feature vectors, orders of magnitude smaller than the original volume they describe, and then comparisons between datasets at different load levels were made in feature vector space. The results show quantitative measurements of damage location, damage morphology and the relative growth of this damage with increased load when compared with a dataset with less or no damage. No prior knowledge of the dataset or training of algorithms is required for damage to be detected, it is only necessary that at least two datasets are available for comparison, e.g. from in situ or repeated scanning measurements. Results are generated on significantly shorter timescales when compared with previous automated approaches to tomography data processing. This approach has the potential to be applied to damage detection in a range of materials through comparisons of volumetric datasets from a range of measurement or computational techniques.

Middleton, Ceri A.↗

DOE OSTI2025

HydroForecast Long-term: Improving hydropower’s resilience to climate change through accurate climate-scale

With hydrologic patterns and water availability across the globe shifting due to climate change, advancements in hydrologic prediction systems can help significantly reduce the uncertainties that utilities and water supply entities have in their decision making. Understanding and estimating hydrology at the climate scale is critical for managing water resources under changing climate scenarios. This project focuses on integrating state-of-the-art neural network modeling with downscaled climate projections to deliver the reliable water supply projections decades into the future to meet an urgent need from hydropower operators and water utilities. In this Phase 1 DOE SBIR proposal, we developed and validated a theory-guided neural network model, HydroForecast Long-term, for climate-scale hydrology and implemented the model within existing HydroForecast infrastructure. HydroForecast Long-term combines the most accurate streamflow modeling system with a flexible and scalable data architecture to generate water supply projections out to the year 2100. This report illustrates that we have achieved our four objectives: 1) create a prototype of HydroForecast Long-term, building the neural network prediction model, 2) build an automated data input pipeline that processes large amounts of data from the latest global temperature and precipitation climate models; 3) benchmark the accuracy of the hydrologic model over the recent two decades over a large set of diverse basins, and 4) create a set of output visuals and summary metrics informed by customer feedback that connect the data to critical decision points. This work empowers water users to make data-informed decisions supporting a resilient, renewable-powered grid and water system. The results advance the Department of Energy’s mission by addressing critical gaps in water supply planning under climate change.

13 HYDRO ENERGY↗

DOE OSTI2024

HPC-FAIR: A Framework Managing Data and AI Models for Analyzing and Optimizing Scientific Applications

The increasing reliance on machine learning (ML) to analyze and optimize large-scale scientific applications on supercomputers faces a significant bottleneck: the lack of readily available, high-quality training datasets and the difficulty in reusing existing AI models. This project was motivated by the urgent need to address the “FAIR” principles (Findability, Accessibility, Interoperability, Reusability) for both training datasets and AI models in the high-performance computing (HPC) domain. The project developed HPC-FAIR, a high-performance computing data management framework designed to centralize HPC-related datasets and AI models within a unified hub. To ensure interoperability, the framework established a standardized representation and vocabulary (ontology) for both data and models. HPC-FAIR also implemented automated workflows to streamline data processing, model access, and benchmarking. Additionally, the project focused on optimizing data harnessing efficiency through advanced techniques like deep reuse and compression-based analytics.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

A PSCAD Library Component Featuring a Reduced-Order IBR Model for EMT-Based Fault Studies

This paper presents a fully implemented inverter reduce-order-model (ROM) in an EMT simulation (PSCAD) library component for direct user utilization in protection studies. The developed inverter ROM has the following features: Equivalent to a full IBR inverter model with positive- and negative-sequence current formulation and representation A python script is developed to fully automate this process, including training data generation, ROM parameter training, updating parameters, and model verification and validation. With this PSCAD ROM library component, protection engineers can utilize a trustworthy, accurate ROM for protection studies in an easy-to-use and streamlined manner.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Evaluation of a Reduced-Order Model for IBR Fault Response Representation via OEM Blackbox Models

This paper presents a fully implemented inverter reduced-order-model (ROM) in an EMT simulation (PSCAD) library component for direct user utilization in protection studies. The developed inverter ROM has the following features: Equivalent to a full inverter-based resource (IBR) inverter model with positive- and negative-sequence current formulation and representation. A Python script is developed to fully automate this process, including training data generation, ROM parameter training, updating parameters, and model verification and validation. The ROM is validated using both IEEE 2800-compliant and non-compliant OEM modes in a real-world system, building confidence of its usability by protection engineers.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1982

Space Shuttle payloads - An overview

A review is made of historical developments of NASA-launched payloads as a basis for projecting payload operations configured to fit the Shuttle's capabilities, and the impetus for new spacecraft and applications designs is discussed. Payloads have experienced a growth in size and weight, capacity and lifetime, and have increasingly featured more automation, microminiaturized circuitry, and data processing systems. Launches by the DoD and NASA have averaged about 20/yr. Spacecraft specifically configured for Shuttle launch have had to wait due to development schedule delays. Partial compensation has occurred by the use of the MMS, which fits into both the Delta nose cone and the Orbiter bay. The Landsat-4 and SMM are cited as examples. Successful demonstration of in-orbit servicing of satellites is required in order to attract spacecraft designers who will make full use of the Shuttle's capabilities. Finally, increased standardization of spacecraft shape, interfaces, and components is foreseeen.

Edgecombe, D. S.↗

NASA NTRS1994

Development of a prototype real-time automated filter for operational deep space navigation

Operational deep space navigation has been in the past, and is currently, performed using systems whose architecture requires constant human supervision and intervention. A prototype for a system which allows relatively automated processing of radio metric data received in near real-time from NASA's Deep Space Network (DSN) without any redesign of the existing operational data flow has been developed. This system can allow for more rapid response as well as much reduced staffing to support mission navigation operations.

Masters, W. C.↗

NASA NTRS2007

The General Mission Analysis Tool (GMAT) System Test Plan

This document serves as the System Test Approach for the GMAT Project. Preparation for system testing consists of three major stages: 1) The Test Approach sets the scope of system testing, the overall strategy to be adopted, the activities to be completed, the general resources required and the methods and processes to be used to test the release. It also details the activities, dependencies and effort required to conduct the System Test. 2) Test Planning details the activities, dependencies and effort required to conduct the System Test. 3) Test Cases documents the tests to be applied, the data to be processed, the automated testing coverage and the expected results. This document covers the first two of these items, and established the framework used for the GMAT test case development. The test cases themselves exist as separate components, and are managed outside of and concurrently with this System Test Plan.

Conway, Darrel J.↗

NASA NTRSDate not supplied

Automated Detection and Analysis of Resident Space Objects with the 1.3-Meter Eugene Stansbery-Meter Class Autonomous Telescope

Optical telescopes dedicated to the detection of orbital debris employ large-area detectors that generate a large number of images each night. Such surveys require automated data analysis pipelines that process the images and detect moving objects. We present an overview of the data analysis pipeline employed by the 1.3-meter Eugene Stansbery-Meter Class Autonomous Telescope (ES-MCAT) on Ascension Island, operated by NASA’s Orbital Debris Program Office. The pipeline enfolds the astrometric and photometric calibration of the images, star-trail removal, object detection, correlation over multiple sequential image frames, and orbital parameter estimation. The performance of the pipeline was investigated by means of Monte-Carlo simulations in which simulated object tracks were inserted into ES-MCAT images and then processed by the pipeline. This technique allows one to confidently estimate the completeness for the detection of resident space objects as a function of apparent magnitude and angular velocity. This paper discusses these techniques and provides examples using actual data.

Paul Hickson↗

NASA NTRS2023

Automated Detection and Analysis of Resident Space Objects with the 1.3-Meter Eugene Stansbery-Meter Class Autonomous Telescope

Paul Hickson↗

DOE OSTI2024

Detection of Control Injection Attacks using Energy Data Anomalies in CNC Machining

The widespread adoption of networked devices, sophisticated automation, and data-driven processes in the industry - also known as Industry 4.0 - has boosted the quantity and quality of manufacturing products. With these benefits, however, comes a substantial increase in the attack surface of these systems. In addition to affecting the readiness and the quality of critical products, the attacks against manufacturing processes and systems carry the potential to have severe physical consequences, including human injury and death. In this paper we present the results of a remote network-based control injection attack on a CNC mill. Specifically, we focus on the impact of this type of the attack on the movement of CNC mill during operation. Evaluating the physical effect of these attacks on a workpiece, we provide machine agnostic, affordable, and scalable solution for their monitoring. We then demonstrate a simple threshold-based method for the detection of these attacks and evaluate the effectiveness of detection.

Taylor, Curtis↗

DOE OSTI2022

The Lick Observatory Supernova Search follow-up program: photometry data release of 70 SESNe

We present BVRI and unfiltered (Clear) light curves of 70 stripped-envelope supernovae (SESNe), observed between 2003 and 2020, from the Lick Observatory Supernova Search follow-up program. Our SESN sample consists of 19 spectroscopically normal SNe Ib, 2 peculiar SNe Ib, six SNe Ibn, 14 normal SNe Ic, 1 peculiar SN Ic, 10 SNe Ic-BL, 15 SNe IIb, 1 ambiguous SN IIb/Ib/c, and 2 superluminous SNe. Our follow-up photometry has (on a per-SN basis) a mean coverage of 81 photometric points (median of 58 points) and a mean cadence of 3.6 d (median of 1.2 d). From our full sample, a subset of 38 SNe have pre-maximum coverage in at least one passband, allowing for the peak brightness of each SN in this subset to be quantitatively determined. We describe our data collection and processing techniques, with emphasis toward our automated photometry pipeline, from which we derive publicly available data products to enable and encourage further study by the community. Using these data products, we derive host-galaxy extinction values through the empirical colour evolution relationship and, for the first time, produce accurate rise-time measurements for a large sample of SESNe in both optical and infrared passbands. By modelling multiband light curves, we find that SNe Ic tend to have lower ejecta masses and lower ejecta velocities than SNe Ib and IIb, but higher 56Ni masses.

Lick Observatory↗

NASA NTRSDate not supplied

Design for Manufacturing of Structures with Automated Fiber Placement via Integration of Analysis and Process Planning

Under the Design for Manufacturing (DFM) task in the NASA HiCAM program, significant process has been made towards establishing a fully automated optimization process that spans the structural analysis, design, and manufacturing process planning for Automated Fiber Placement (AFP) structures. Previous efforts in this area established the data formats and mapping processes needed to exchange data between disciplines. The software tools used in the framework are HyperX (structural optimization), CAPP (process planning), and VCP (AFP path generation). The work has culminated with automation of data exchanges and an optimization process that drives the three software toward convergence. Within this framework, HyperX is used to generate mass-optimum composite designs which are iterated with VCP and CAPP to improve manufacturability of the designs. As the ply manufacturing process is adjusted by CAPP and VCP, HyperX continually re-assesses the structural integrity of the part and makes adjustments to the laminate as needed. For example, the position of fiber steering and tow overlaps/gaps can necessitate changes to the laminate design. Once the design converges, the end result is a stack of plies that meets both structural and manufacturing requirements. This paper presents the details of the framework and demonstrations the automated process on several parts with significant double-curvature.

HiCAM↗

NASA NTRS2005

3DRT-MPASS

Data from all current JPL missions are stored in files called SPICE kernels. At present, animators who want to use data from these kernels have to either read through the kernels looking for the desired data, or write programs themselves to retrieve information about all the needed objects for their animations. In this project, methods of automating the process of importing the data from the SPICE kernels were researched. In particular, tools were developed for creating basic scenes in Maya, a 3D computer graphics software package, from SPICE kernels.

Lickly, Ben↗

DOE OSTI2022

Digitalization of an experimental electrochemical reactor via the smart manufacturing innovation platform

The exponential increase in data produced over the last two decades has revolutionized the way we collect, store, process, analyze, model, and interpret information to improve profitability. Manufacturing is no exception. How- ever, Smart Manufacturing, the digital practice, organization, workforce, and infrastructure transformation for collection and deployment of data and models at scale and at all levels of manufacturing, is a complex, costly, and labor-intensive journey that is still seeing slow adoption. The Clean Energy Smart Manufacturing Innovation Institute (CESMII), a national Manufacturing USA public-private partnership sponsored by the Department of Energy, is addressing this scaled use of data and modeling in manufacturing. CESMII has focused on how to col- lect and use operating data for numerous applications that improve productivity, precision, and performance of manufacturing operations from factory floor to supply chain using process simulation, predictive analytics, mon- itoring and control, and real-time optimization. Because contextualized data are key, CESMII has developed the Smart Manufacturing Innovation Platform (SMIP) to lower the barriers to the data that are needed to accelerate data-based model building, improve data visualization, and more quickly gain insights. Reusable, standards-based ways of doing data collection, ingestion, and contextualization are particularly important for scaling access and use of data. The SMIP uses a standards-based definition and construct for reusable information models called an SM Profile. When an SM Profile is used in conjunction with the SMIP, the SMIP ensures the availability of contextualized, operational data for model building. The present work demonstrates Smart Manufacturing and the application of the SMIP for building several data-centered models for the operation and control of an ex- perimental electrochemical reactor that reduces carbon dioxide (CO 2 ) gas to valuable liquid and gas chemicals, such as alcohols, olefins, and syngas. We describe how the SMIP plays a central role in more effective model building and we demonstrate how the electochemical reactor can be controlled and optimized for the desired products. Use of the SMIP involves the transmission of real-time sensor measurements to a cloud resource so that the operating data are available to all model building experts. The data collection and transmission process is fully automated to greatly reduce the need for manual manipulation of the data. Data-driven machine learning models are used for advanced real-time state estimation, real-time optimization, and model-based feedback control for the reactor. The application models are implemented as a system to monitor the data flow and control the electrochemical reactor with a single visualization interface. SM Profiles are used to demonstrate reusability of the information models for the reactor and the instrumentation. The application packages, algorithms, and user interfaces developed are cast as Docker images in a library to facilitate reusability of the application models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2001

Improvements in AVHRR Daytime Cloud Detection Over the ARM NSA Site

Clouds play an important role in the radiation budget over Arctic and Antarctic. Because of limited surface observing capabilities, it is necessary to detect clouds over large areas using satellite imagery. At low and mid-latitudes, satellite-observed visible (VIS; 0.65 micrometers) and infrared (IR; 11 micrometers) radiance data are used to derive cloud fraction, temperature, and optical depth. However, the extreme variability in the VIS surface albedo makes the detection of clouds from satellite a difficult process in polar regions. The IR data often show that the surface is nearly the same temperature or even colder than clouds, further complicating cloud detection. Also, the boundary layer can have large areas of haze, thin fog, or diamond dust that are not seen in standard satellite imagery. Other spectral radiances measured by satellite imagers provide additional information that can be used to more accurately discriminate clouds from snow and ice. Most techniques currently use a fixed reflectance or temperature threshold to decide between clouds and clear snow. Using a subjective approach, Minnis et al. (2001) found that the clear snow radiance signatures vary as a function of viewing and illumination conditions as well as snow condition. To routinely process satellite imagery over polar regions with an automated algorithm, it is necessary to account for this angular variability and the change in the background reflectance as snow melts, vegetation grows over land, and melt ponds form on pack ice. This paper documents the initial satellite-based cloud product over the Atmospheric Radiation Measurement (ARM) North Slope of Alaska (NSA) site at Barrow for use by the modeling community. Cloud amount and height are determined subjectively using an adaptation of the methodology of Minnis et al. (2001) and the radiation fields arc determined following the methods of Doelling et al. (2001) as applied to data taken during the Surface Heat and Energy Budget of the Arctic (SHEBA). The procedures and data produced in this empirically based analysis will also facilitate the development of the automated algorithm for future processing of satellite data over the ARM NSA domain. Results are presented for May, June, and July 1998. ARM surface data are use to partially validate the results taken directly over the ARM site.

Chakrapani, V.↗