SEARCH · Engineering Papers

Results for “ME data pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Prioritizing Uncertainties in Hydrogen Contribution to Risk in Post-Crash Outcomes for Rail

This report presents analysis from Sandia National Laboratories predicting contributions to risk associated with the use of hydrogen technology for rail. Event sequence diagrams are used to describe possible accident scenarios and progressions. Initiating event frequencies and branch event probabilities for each scenario are quantified with uncertainty using distributions fit to Federal Railroad Administration and U.S. Department of Transportation Pipeline and Hazardous Materials Safety Administration data on applicable accidents from 2000 to 2020. Uncertainty is propagated through the event sequence diagram to estimate the frequency and conditional probability of accident end states. The analysis identifies four scenarios with significant contributions to risk from hydrogen that are predicted to occur relatively frequently, which may inform priorities for reducing uncertainty. These scenarios are 1) overpressure events resulting from collisions with hydrogen release due to mechanical damage and delayed ignition, 2) jet fire events resulting from collisions with hydrogen release due to mechanical damage and immediate ignition, 3) jet fires resulting from fire or explosion initiating events involving the hydrogen tank and correct operation of the thermally-activated pressure relief device (TPRD) subsequent to the thermal insult, and 4) pressure burst resulting from fire or explosion initiating events involving the hydrogen tank and failure of the TPRD. Delayed and immediate hydrogen ignition probabilities are identified as being highly uncertain and potential candidates for reducing conservatism in the predicted frequencies for these two scenarios.

08 HYDROGEN↗

DOE OSTI2022

Multiphysics Simulation of the NASA SIRIUS-CAL Fuel Experiment in the Transient Test Reactor Using Griffin

After approximately 50 years, NASA is restarting efforts to develop nuclear thermal propulsion (NTP) for interplanetary missions. Building upon nuclear engine tests performed from the late 1950s to the early 1970s, the present research and testing focuses on advanced materials and fabrication methods. A number of transient tests have been performed to evaluate materials performance under high-temperature, high-flux conditions, with several more experiments in the pipeline for future testing. The measured data obtained from those tests are being used to validate the Griffin reactor multiphysics code for this particular type of application. Griffin was developed at Idaho National Laboratory (INL) using the MOOSE framework. This article describes the simulation results of the SIRIUS-CAL calibration experiment in the Transient Reactor Test Facility (TREAT). SIRIUS-CAL was the first transient test conducted on NASA fuels, and although the test was performed with a relatively low core peak power, the test specimen survived a temperature exceeding 900 K. Griffin simulations of the experiment successfully matched the reactor’s power transient after calibrating the initial control rod position to match the initial reactor period. The thermal-hydraulics model largely matches the time-dependent response of a thermocouple located within the experiment specimen to within the uncertainty estimate. However, the uncertainty range is significant and must be reduced in the future.

33 ADVANCED PROPULSION SYSTEMS↗

NASA NTRS1980

Outline of a fast hardware implementation of Winograd's DFT algorithm

The main characteristics of the discrete Fourier transform (DFT) algorithm considered by Winograd (1976) is a significant reduction in the number of multiplications. Its primary disadvantage is a higher structural complexity. It is, therefore, difficult to translate the reduced number of multiplications into faster execution of the DFT by means of a software implementation of the algorithm. For this reason, a hardware implementation is considered in the current study, taking into account a design based on the algorithm prescription discussed by Zohar (1979). The hardware implementation of a FORTRAN subroutine is proposed, giving attention to a pipelining scheme in which 5 consecutive data batches are being operated on simultaneously, each batch undergoing one of 5 processing phases.

Zohar, S.↗

NASA NTRS2004

Searching for Pulsations from CEN X-4

The goal of this proposal is to detect or place sensitive upper limits on pulsations from the quiescent neutron-star X-ray binary Cen X-4. The observations were obtained on 1 March 2003. Unfortunately, due to problems with the standard pipeline processing of this observation, the data were not delivered until more than one year later, on 21 April 2004. No pulsations have yet been found in the data set. However, new optical spectra have been obtained which will lead to better constraints on the orbital period of Cen X-4 and which may enable detection of pulsations.

Kaaret, Philip↗

NASA NTRS2005

The Nature of the Enigmatic 10-Minute Accreting Binary System ES CET

ES Cet is one of the most compact binary systems known with an orbital period of only 10.3 minutes. Our allocated observations with the XMM-Newton X-ray satellite were performed in January and July 2004, with the data being delivered to the PI in August 2004. Preliminary results were presented by the PI in September 2004 and January 2005. We have also secured supporting optical observations of ES Ceti using the Magellan telescopes (November 2004). The team is currently performing a thorough and final analysis of the X-ray, UV and optical data sets with the latest XMM pipeline software and our own analysis packages.

Steeghs, Daniel↗

NASA NTRS2014

The Spitzer Survey of Interstellar Clouds in the Gould Belt. VI. The Auriga-California Molecular Cloud Observed with IRAC and MIPS

We present observations of the Auriga-California Molecular Cloud (AMC) at 3.6, 4.5, 5.8, 8.0, 24, 70 and 160 micrometers observed with the IRAC and MIPS detectors as part of the Spitzer Gould Belt Legacy Survey. The total mapped areas are 2.5 deg(exp 2) with IRAC and 10.47 deg2 with MIPS. This giant molecular cloud is one of two in the nearby Gould Belt of star-forming regions, the other being the Orion A Molecular Cloud (OMC). We compare source counts, colors and magnitudes in our observed region to a subset of the SWIRE data that was processed through our pipeline. Using color-magnitude and color-color diagrams, we find evidence for a substantial population of 166 young stellar objects (YSOs) in the cloud, many of which were previously unknown. Most of this population is concentrated around the LkH(alpha) 101 cluster and the filament extending from it. We present a quantitative description of the degree of clustering and discuss the fraction of YSOs in the region with disks relative to an estimate of the diskless YSO population. Although the AMC is similar in mass, size and distance to the OMC, it is forming about 15 - 20 times fewer stars.

Orion A Molecular Cloud (OMC)↗

NASA NTRS2019

Creating Data-Driven Vector Visualizations of Satellite Orbit Tracks Using NASA GIBS and Worldview

NASA Earth Observing System (EOS) currently operates dozens of remote sensing satellites, many of which can be viewed directly in NASA’s open-source Worldview application. Much of this satellite imagery can be viewed in near-real time as it is processed and served by NASA’s Global Imagery Browse Service (GIBS). To better educate users on the time and location of imagery, GIBS serves orbit track specific layers for each satellite. Worldview has historically served these layers as raster images but recent updates have enabled the application to now serve these layers using vector tiles. With the release of Worldview v3.0, orbit track layers can be displayed using mapbox vector tiles (MVT). This visualization format allows users to not only view and change the color of orbit track layers, as they could do previously with rasters, but also inspect individual vector points and filter layers by specific parameters such as time. The data contained within a MVT is further enhanced in Worldview with the combination of a JSON description file served from GIBS used to describe the MVT data. This presentation will provide an overview of the process of consuming orbit track vector tiles and data files from GIBS using a pipeline to configure, build and ultimately display the orbit tracks in Worldview. Furthermore, the presentation aims to describe how others can leverage our open-source code to display and enhance vector layers in their own applications.

Rice, Zachary↗

DOE OSTI2023

Natural Language Processing for Text Based Event Extraction: Identifying Events of Interest Related to Worldwide State-Sponsored Civil Nuclear Power

Beginning in FY20, SRNL was funded by the National Nuclear Security Administration’s Office of Defense Nuclear Non-Proliferation Research and Development to develop a prototype natural language processing/natural language understating machine learning-based modeling and analysis pipeline to extract and forecast events of interest from massive open data sources. The working hypothesis within the approach is that contextual shifts in key words and phrases act as indicators of events of interest over time. Therefore, by identifying points in time where contextual shifts occur, events of interest can be extracted along with explicit and implicit connections of entities and activities. The development of the preliminary prototype pipeline proved successful, meriting further testing of the pipeline on more broad topical domains and in a worldwide data environment. Therefore, SRNL, in collaboration with the Sanghani Center for Artificial Intelligence and Data Analytics at Virginia Tech, have continued development with a test case of identifying events of interest related to worldwide state-sponsored civil nuclear power in open data sources. In the first year of this follow-on effort, the team has curated domain-specific data corpuses using an automated scheme and applied the modeling and analysis pipeline. This robust, focused, and efficient approach consists of an ensemble of analyses applied to time dependent word embedding models that are trained on the data corpuses. In this report, the team has demonstrated the capability of the existing pipeline (as development has continued in parallel) by exploring several specific case-studies centered around Rosatom’s international activities regarding the planning, construction, operation, and/or shutdown of nuclear reactors. A basic timeline events has been generated by manually cataloging known “milestone” events that have occurred at reactors in Turkey, Finland, Hungary, and Egypt and compared with the output of the modeling pipeline. In this approach, the team has characterized the lead time using the prototype pipeline, as well as the ability to capture relevant information, which proved 100% successful. A deep dive example of the Akkuyu reactor (Turkey) is presented that shows the breadth of information that can be captured using the approach. In this case study, events were extracted pertaining to the planning/construction of Akkuyu including protests from the population, information campaigns in response to the protests, forged regulatory documents and lawsuits, budgetary/shareholder information, geopolitical tensions, and the various construction milestones. This has demonstrated the pipeline’s utility as a research aid or real-time event extraction tool, where summary-level information and detailed text extractions from millions of articles or Tweets across long time periods can be generated with significantly less effort than current techniques.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

PNNL-Predictive-Phenomics/ProteoMeter

ProteoMeter is a Python package that assists in the statistical analysis of global proteomics, protein post-translation modification (PTM), and limited proteolysis (LiP) data. It contains batch correction, normalization, and statistical testing methods, as well as functions that "roll up" peptide-level data to the single-site level. It has a robust user configuration system, allowing it to flexibly integrate different types of experiment designs. For basic usage, a simple configuration file provides the essential functionality. Advanced users have access to the entire statistical pipeline for fine-tuning analyses. Processed data is easily exported to many common spreadsheet and data-frame formats.

Rozum, Jordan [Pacific Northwest National Lab]↗

NASA NTRS2019

A Chromaticity Analysis and PSF Subtraction Techniques for SCExAO/CHARIS Data

We present an analysis of instrument performance using new observations taken with the Coronagraphic High Angular Resolution Imaging Spectrograph (CHARIS) instrument and the Subaru Coronagraphic Extreme Adaptive Optics (SCExAO) system. In a correlation analysis of our data sets (which use the broadband mode covering the J band through the K band in a single spectrum), we find that chromaticity in the SCExAO/CHARIS system is generally worse than temporal stability. We also develop a point-spread function (PSF) subtraction pipeline optimized for the CHARIS broadband mode, including a forward modeling-based exoplanet algorithmic throughput correction scheme. We then present contrast curves using this newly developed pipeline. An analogous subtraction of the same data sets using only the H-band slices yields the same final contrasts as the full JHK sequences; this result is consistent with our chromaticity analysis, illustrating that PSF subtraction using spectral differential imaging (SDI) in this broadband mode is generally not more effective than SDI in the individual J, H, or K bands. In the future, the data processing framework and analysis developed in this paper will be important to consider for additional SCExAO/CHARIS broadband observations and other ExAO instruments which plan to implement a similar integral field spectrograph broadband mode.

Benjamin L. Gerard↗

DOE OSTI2026

Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will produce unprecedented volumes of heterogeneous astronomical data (images, catalogs, and alerts) that challenge traditional analysis pipelines. The LSST Dark Energy Science Collaboration (DESC) aims to derive robust constraints on dark energy and dark matter from these data, requiring methods that are statistically powerful, scalable, and operationally reliable. Artificial intelligence and machine learning (AI/ML) are already embedded across DESC science workflows, from photometric redshifts and transient classification to weak lensing inference and cosmological simulations. Yet their utility for precision cosmology hinges on trustworthy uncertainty quantification, robustness to covariate shift and model misspecification, and reproducible integration within scientific pipelines. This white paper surveys the current landscape of AI/ML across DESC's primary cosmological probes and cross-cutting analyses, revealing that the same core methodologies and fundamental challenges recur across disparate science cases. Since progress on these cross-cutting challenges would benefit multiple probes simultaneously, we identify key methodological research priorities, including Bayesian inference at scale, physics-informed methods, validation frameworks, and active learning for discovery. With an eye on emerging techniques, we also explore the potential of the latest foundation model methodologies and LLM-driven agentic AI systems to reshape DESC workflows, provided their deployment is coupled with rigorous evaluation and governance. Finally, we discuss critical software, computing, data infrastructure, and human capital requirements for the successful deployment of these new methodologies, and consider associated risks and opportunities for broader coordination with external actors.

Aubourg, Eric [APC, Paris] (ORCID:000000025592023X↗

DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗

DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Mulayim, Ozan Baris↗

NASA NTRS2015

Supercomputing in the Age of Discovering Superearths, Earths and Exoplanet Systems

With the Kepler Mission, exoplanet science has entered the era of Big Data and has benefited tremendously from the availability of the NAS (NASA Advanced Supercomputing Division) Pleiades supercomputer. This presentation provides an overview of the history of exoplanet discoveries and highlights the key enabling technologies for Kepler. I provide an overview of the Kepler science pipeline and the algorithms used to analyze the data and detect transiting planets, all of which run routinely on the NAS Pleiades system. The presentation also provides a description of the Blender analysis program used to validate Kepler planet discoveries statistically, and the effort to discover exomoons lurking in Kepler data, both of which also run on Pleiades. Finally, I describe NASA's TESS (Transiting Exoplanet Survey Satellite) Mission, which leverages Kepler heritage to provide a science pipeline similar to that for Kepler and that will also run routinely on the NAS Pleiades supercomputer.

big data↗

NASA NTRS2018

Geonex: A NASA-NOAA Collaboration for Producing Land Surface Products from Geostationary Sensors Using Cloud Computing

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement.Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. We estimate the cost of deploying GEONEX to be $400 - 750 a month for processing data (every 30 minutes) and producing products over the conterminous US. For products such as Fire, latency can be as little as 10 minutes from the time of data acquisition.

Geostationary↗

NASA NTRS2004

Caltrans Keeps the Spitzer Pipelines Moving

The computer pipelines used to process digital infrared astronomical images from NASA's Spitzer Space Telescope require various input calibration-data files for characterizing the attributes and behaviors of the onboard focal-plane-arrays and their detector pixels, such as operability, dark-current offset, linearity, non- uniformity, muxbleed, droop, and point-response functions. The telescope has three very different science instruments, each with three or four spectral-band-pass channels, depending on the instrument. Moreover, each instrument has various operating modes (e-g., full array or sub-array in one case) and parameters (e.g., integration time). Calibration data that depend on these considerations are needed by pipelines for generating both science products (production pipelines) and higher-level calibration products (calibration pipelines). The calibration files are created in various formats either 'off-line' or by the aforementioned calibration pipelines, depending on the above configuration details. Also, the calibration files are generally applicable to a certain time period and therefore must be selected accordingly for a given raw input image to be correctly processed. All of this complexity in selecting and retrieving calibration files for pipeline processing is handled by a procedural software-program called 'caltrans' . This software, which is implemented in C and interacts with an Informix database, was developed at the Spitzer Science Center (SSC) and is now deployed in SSC daily operations. The software is rule-based, very flexible, and, for efficiency, capable of retrieving multiple calibration files with a single software-execution command.

Spitzer↗

DOE OSTI2026

Machine Learning Digital Twin for Lithium Ion Battery State of Health Predictions

A digital twin system has been established to model the long term degradation of the state of health of lithium ion batteries. Two data streams result from the computational model of the system and from the physical experiment measurements. A machine learning pipeline has been developed at the nexus of these data streams. Leveraging the unique data sources in multiple transfer learning approaches has lead to the development of multiple cell specific machine learning digital twins. Our discussion on this first of its kind technology will cover challenges in data ingestion, scalability, architecture and orchestration, and research findings.

25 - ENERGY STORAGE↗

DOE OSTI2022

OpenPATH and Itinerum Integration: A Case Study of Merging Open-Source Projects: Preprint

Throughout the transportation sector, multiple mobility tracking platforms have been developed independently, in parallel, with similar use cases and infrastructure. Maintaining such platforms on an individual level can result in duplicated effort. Innovation within the field could be slowed by the limited resource of people working on extremely similar projects. We provide a case study in how such platforms can be combined with low effort and provide an example in the mobility domain of what the resulting integration points, modules and ownership may look like. OpenPATH (formerly e-mission) and Itinerum are two examples of similar independently developed human mobility tracking platforms that extend beyond standard traffic data collection. Due to the open source nature of the projects, members from both teams decided to merge the functionality, thereby only hosting a single data collection process and limiting maintenance of separate intake platforms. On the front-end, specific questionnaire functionality from Itinerum, mainly the ability to display and return questions and results focused on sociodemographic attributes, was integrated into the OpenPATH user interface. On the back-end, an export pipeline stage was created to transport collected data back to the Itinerum database. Upon completion, the OpenPATH application retained its original functionality while adding the ability to export data for future data sharing and creating an avenue to incorporate Itinerum hosted questions and answers. Itinerum benefits from the rich feature set and infrastructure of OpenPATH without losing needed elements such as the questionnaire component. This case study, within the transportation sector, illustrates the various configurations in which open source software can be developed, maintained and deployed.

ADVANCED PROPULSION SYSTEMS↗