Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Cadmus v1.0

This software package is for distributed computation of persistent (co)homology. It is primarily intended for Topological Data Analysis (TDA) audience and scientists who use TDA methods and apply them to datasets that are too big to handle on a single machine. There are very few codes available for this; Cadmus outperforms DIPHA, if the user is interested in cohomology. The accompanying paper explaining the algorithm was accepted to ALENEX 26.

Nigmetov, Arnur [Lawrence Berkeley National Labora↗
DOE OSTI2025

Computational epidemiological tools for pandemic analysis, understanding, and response

This suite of software tools is being developed to enhance and analyze computational epidemiological models that incorporate realistic disease dynamics and human behavior, with the goal of supporting epidemic and pandemic response. Specifically, the tools enable data analysis, feature extraction, data synthesis, machine learning model development, and prediction of key public health outcomes, such as cases, hospitalizations, deaths, and behavioral responses, for airborne infectious diseases like COVID-19 and influenza.

Butts, David↗
DOE OSTI2021

Analysis of Early Science observations with the CHaracterising ExOPlanets Satellite ( CHEOPS ) using pycheops

ABSTRACT CHEOPS (CHaracterising ExOPlanet Satellite) is an ESA S-class mission that observes bright stars at high cadence from low-Earth orbit. The main aim of the mission is to characterize exoplanets that transit nearby stars using ultrahigh precision photometry. Here, we report the analysis of transits observed by CHEOPS during its Early Science observing programme for four well-known exoplanets: GJ 436 b, HD 106315 b, HD 97658 b, and GJ 1132 b. The analysis is done using pycheops, an open-source software package we have developed to easily and efficiently analyse CHEOPS light-curve data using state-of-the-art techniques that are fully described herein. We show that the precision of the transit parameters measured using CHEOPS is comparable to that from larger space telescopes such as Spitzer Space Telescope and Kepler. We use the updated planet parameters from our analysis to derive new constraints on the internal structure of these four exoplanets.

Maxted, P. F. L. (ORCID:0000000337941317)↗
DOE OSTI2026

An Integrated Framework for Memory-Centric Analysis: From Trace Collection to Co-Design

The memory wall phenomenon—where advances in processor performance significantly outpace those in memory subsystems—poses a fundamental challenge for contemporary computing systems. In memory-bound applications, memory subsystem behavior dominates performance, yet existing analysis approaches present significant limitations: detailed microarchitectural simulators require days to weeks to simulate modest workloads; hardware performance counters provide only aggregate statistics that obscure temporal and spatial access patterns; and scaled simulation approaches face challenges in capturing certain behaviors that emerge at larger scales. These limitations reflect a processor-centric design philosophy increasingly misaligned with memory-bound workloads where detailed understanding of memory access patterns, cache hierarchy interactions, and contention is critical for effective optimization. This paper presents an integrated framework for memory-centric analysis that enables effective hardware-software co-design. We describe practical trace collection techniques, including hardware-assisted processor tracing with minimal overhead and portable software-based instrumentation with statistical sampling. We present multi-perspective analysis methods that examine memory behavior from temporal, sequential, spatial, and relational viewpoints, revealing distinct optimization opportunities invisible in aggregate metrics. We detail an architectural modeling framework that uses sampled traces with temporal interpolation and confidence-based filtering to evaluate cache and memory configurations. Evaluation on representative benchmarks demonstrates that this framework achieves practical accuracy (L2 cache errors of 2.64\%, confidence-filtered L3 errors of 9.92\%, bandwidth errors of 7.33\%) while providing substantial speedup (26.8×) over cycle-accurate simulation, enabling rapid design space exploration. We demonstrate how this integrated framework enables systematic identification of both hardware optimizations (memory controller tuning, bank partitioning, NUMA configuration) and software optimizations (data layout restructuring, prefetching strategies, memory-aware scheduling). Through this comprehensive treatment of the memory-centric analysis pipeline—from trace collection through architectural modeling to co-design application—we provide researchers and practitioners with practical techniques for addressing memory bottlenecks in contemporary computing systems.

Gajaria, Dhruv Mayur↗
DOE OSTI2024

BAD2matrix: Phylogenomic matrix concatenation, indel coding, and more

Common steps in phylogenomic matrix production include biological sequence concatenation, morphological data concatenation, insertion/deletion (indel) coding, gene content (presence/absence) coding, removing uninformative characters for parsimony analysis, recording with reduced amino acid alphabets, and occupancy filtering. Existing software does not accomplish these tasks on a phylogenomic scale using a single program. BAD2matrix is a Python script that performs the above-mentioned steps in phylogenomic matrix construction for DNA or amino acid sequences as well as morphological data. The script works in UNIX-like environments (e.g., LINUX, MacOS, Windows Subsystem for LINUX).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Data acquisition and slow control interface for the Mu2e experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinoless conversion of a muon into an electron in the field of an aluminum nucleus with a sensitivity improvement by a factor of 10000 over existing limits. The Mu2e Trigger and Data Acquisition System (TDAQ) uses otsdaq as the online Data Acquisition System (DAQ) solution. Developed at Fermilab, otsdaq integrates both the artdaq DAQ and the art analysis frameworks for event transfer, filtering, and processing. otsdaq is an online DAQ software suite with a focus on flexibility and scalability and provides a multi-user, web-based, interface accessible through a web browser. The data stream from the detector subsystems is read by a software filter algorithm that selects events which are combined with the data flux coming from a cosmic ray veto system. The Detector Control System (DCS) has been developed using the Experimental Physics and Industrial Control System (EPICS) open source platform for monitoring, controlling, alarming, and archiving. The DCS system has been integrated into otsdaq. A prototype of the TDAQ and the DCS systems has been built at Fermilab's Feynman Computing Center. In this study, we report on the progress of the integration of this prototype in the online otsdaq software.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Dark Energy Survey Year 6 Results: Point-Spread Function Modeling

We present the point-spread function (PSF) modeling for weak lensing shear measurement using the full six years of the Dark Energy Survey (DES Y6) data. We review the PSF estimation procedure using the PIFF (PSFs In the Full FOV) software package and describe the key improvements made to PIFF and modeling diagnostics since the DES year three (Y3) analysis: (i) use of external Gaia and infrared photometry catalogs to ensure higher purity of the stellar sample used for model fitting, (ii) addition of color-dependent PSF modeling, the first for any weak lensing analysis, and (iii) inclusion of model diagnostics inspecting fourth-order moments, which can bias weak lensing measurements to a similar degree as second-order modeling errors. Through a comprehensive set of diagnostic tests, we demonstrate the improved accuracy of the Y6 models evident in significantly smaller systematic errors than those of the Y3 analysis, in which all g band data were excluded due to insufficiently accurate PSF models. For the Y6 weak lensing analysis, we include g band photometry data in addition to the riz bands, providing a fourth band for photometric redshift estimation. Looking forward to the next generation of wide-field surveys, we describe several ongoing improvements to PIFF, which will be the default PSF modeling software for weak lensing analyses for the Vera C. Rubin Observatory’s Legacy Survey of Space and Time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Use of Machine Learning on PMU Data for Transmission System Fault Analysis

Synchrophasor technology has been used for monitoring, control, and protection of bulk power system for over 10 years. Deployment of phasor measurement units (PMUs) in the USA power system has surpassed 3000 units installed in the transmission substations as stand-alone intelligent electronic devices (IEDs) or as a software add-on to other devices such as digital protective relays (DPRs) or digital fault recorders (DFRs). By now, thousands of terabytes of PMU data may have been captured and stored by various transmission system operators (TSOs) and independent system operators (ISOs). This creates an opportunity to deploy advanced machine learning (ML) techniques to detect and classify faults recorded by PMUs automatically to be used by the system operators for rapid, critical decision-making when manual analysis of the past or unfolding events is not feasible. In this paper we offer a brief background on how the automated fault analysis may be done using DPR and/or DFR data, and compare some of the legacy approaches to the new ML approaches in the context of the system-wide PMU recordings. We then offer insights from developing practical ML solutions that have been applied on field recordings captured by close to 450 PMUs from all three US interconnections (Western, Eastern and ERCOT) over two years (2016-2017). We identify and illustrate ML challenges we addressed: inaccurate data, data with scarce and temporally imprecise fault labels, data recorded by PMUs sparsely located at substations resulting in the fault records taken afar from the ends of the faulted lines, data containing only positive sequence values, and data taken at different voltage levels. We then illustrate the ML model results for fault analysis under different application scenarios. The novelty of this study is not only in the design, implementation, and performance analysis of the ML algorithms, but also in the use of advanced fault modelling and simulation approaches to improve the training results when developing supervised ML models for fault detection and classification. Extensive simulations of faults were conducted on a 14-bus power system to create a training dataset with over 1400 accurately labelled faults. This dataset was applied to enhance the accuracy of fault detection and classification of machine learning-based models trained with small number of labelled faults in large datasets recorded in the grid interconnections ranging from 5,000 to 70,000 buses.

Synchrophasors, Machine Learning, Fault Analysis, ↗
DOE OSTI2022

Lithium-Ion Battery Design for Grid-Scale Energy Storage App

A software that delivers parameters from energy storage system (ESS) to container, rack, module and single cell design, as well as data analysis on arbitrage energy and frequency regulation of ESS in different regions, has been developed. The Lithium-ion Battery Design for Grid-scale Energy Storage App V1.0 has the capability to output the system, module and cell design with the energy, power, capacity, group method, cost of single cell, and single cell test protocol which break down from input energy storage system data in different regions. The default chemistry of the battery is LiFePO4 and graphite. The energy density of the graphite/LiFePO 4 pouch cell ranges from 100 Wh/kg to 200 Wh/Kg in the software. Graphite/LiFePO 4 pouch cell (up to 1Ah in lab) manufacturing line is also built and can be used to evaluate the test protocol, moreover, for electrolyte evaluation in other ESMI seedling projects. The software enables rapid prototyping to accelerate energy storage research, development, and manufacturing.

Liu, Dianying↗
DOE OSTI2020

Recent evolutions in the LTDP CDF project

In the latest years, CNAF (the national center of the Italian Institute for Nuclear Physics INFN dedicated to Research and Development on Information and Communication Technologies) has been working on the Long Term Data Preservation (LTDP) project for the CDF experiment, active at Fermilab from 1990 to 2011. The main aims of the project are to protect the most relevant part of the CDF RUN-2 data collected between 2001 and 2011 and already stored on tape at CNAF (4 PB), as well as to ensure the availability and the access to the analysis facility to those data over time. Lately, the CDF database, hosting information about CDF datasets such as their structure, file locations and metadata, has been imported from Fermilab to CNAF. Also, the Sequential Access via Metadata (SAM) station data handling tool for CDF data management, that allows to manage data transfers and to retrieve information from the CDF database, has been properly installed and configured at CNAF. This was a fundamental step in the perspective of a complete decommissioning of CDF services on Fermilab side. An access system has been designed and tested to submit CDF analysis jobs, using CDF software distributed via CERN Virtual Machine File System (CVMFS) and requesting delivery of CDF files stored on CNAF tapes, as well as data present only on Fermilab storage archive. Moreover, the availability and the correctness of all CDF data stored on CNAF tapes has been verified. This paper describes all these recent evolutions in detail, presenting the future plans for the LTDP project at CNAF.

Fornari, Federico↗
DOE OSTI2020

WSF B696R Calcs

This calculation is applied to the accident analysis scenario of a limited combustibles fire breaching eight SWBs in B696R R1010. For a fire in a building with no breaches, there is only a ground release. The source term (ST) of the deflagration is determined by the Waste Storage Facilities Documented Safety Analysis (Ref. 1). The doses from the release are calculated by using MACCS2 (Ref. 2). This software take hourly meteorological data for a year as input. There are 8760 hours in a year. MACCS2 calculates a dose for each of the 8760 hours, taking into account the associated source term from Reference 1, the wind speed, the stability class (i.e., A through F), the directional sector of the wind (with associated distance to the site boundary). For each directional sector (i.e., 1 through 16) a MACCS2 run was performed. From the total collection of MACCS2 output files, Microsoft Excel is used to extract the dose that correspond to the meteorological conditions of each hour in the year. Note: although MACCS2 inputs a single year of meteorological data, five years are used (2010 through 2014) by performing multiple runs. This is discussed in Section 2.2. Conclusions: The final 95th percentile dose at the collocated worker used for accident analysis of a limited combustibles fire breaching eight SWBs in B696R R1010 is 18.4 rem.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Performance Testing of an Integrated Magnetic Power Take-Off

A wave energy converter (WEC) and the power take-off (PTO) generator system can be represented by using a mass-spring-dampener model. By incorporating a negative stiffness spring within the PTO, the overall stiffness of the PTO can be lowered allowing the impedance of the PTO to be more closely matched with the WEC. By designing for impedance matching the WEC can greatly enhance its power generation capability. This project has involved the design, fabrication and testing of a new type of linear-stroke length and rotary stroke length adjustable negative stiffness magnetic springs for use within a wave energy converter (WEC). The magnetic springs were studied by using 3-D finite element analysis with the objective of creating high energy density and a long linear stroke length. After the construction and testing of both a proof-of-principle adjustable linear and rotary magnetic spring prototype the rotary (torsional) magnetic spring was selected for scaling up analysis. The selected scaled-up proof-of-principle magnetic spring had a peak torque of 850 Nm with a ±45 degree stroke length. By translating the inner rotor relative to the outer rotor, the stiffness could be adjusted to be either negative or positive stiffness. During this project a magnetic lead screw was also studied, and it was shown that by combining the magnetic lead screw with a linearly translating magnetic spring a very long rotary stroke length could be attained. However, as the magnetic lead screw increased complexity and reduced overall energy density relative to a rotary (torsional) spring, this design approach was not further pursed. Dynamometer testing of the variable stiffness magnetic springs was first completed by Portland State University and following this the magnetic spring performance was independently verified by Sandia National Laboratory (Sandia). A WEC analysis when using a variable stiffness magnetic spring was completed by using the WecOptTool. WecOptTool is an open-source WEC optimization software developed by Sandia that supports efficient power take-off (PTO) and control optimization. Wave condition data from the Oregon PacWave test-site was used in this study. The analysis showed that a WEC with a tunable stiffness value could consistently achieve about 80% of its maximum theoretical power production. The use of a tunable stiffness WEC, rather than zero-stiffness or a constant stiffness WEC was also shown to lead to a smaller maximum PTO force requirement. The variable stiffness magnetic spring was integrated into an experimental WEC developed by Sandia, called a Wave-Bot. Sandia successfully completed water-tank testing of the Wave-Bot at the Navy’s Carderock, Maryland, wave-basin test site. The wave-basin testing helped to experimentally demonstrate the operating capabilities and increased power generation capability of a WEC containing an integrated variable stiffness magnetic spring. A WEC capacity factor analysis was also completed. The capacity factor was defined as the ratio of annual average WEC generator power to the maximum (RMS) generated power. This capacity factor provided a means of identifying the ratio of potential revenue to cost. It was calculated that if a tunable variable stiffness magnetic spring has RMS constraints it could operate with a capacity factor above 30%. This is comparable to a wind turbine’s capacity factor.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

PlasmoData.jl — A Julia framework for modeling and analyzing complex data as graphs

Datasets encountered in scientific and engineering applications appear in complex formats (e.g., images, multivariate time series, molecules, video, text strings, networks). Graph theory provides a unifying framework to model such datasets and enables the use of powerful tools that can help analyze, visualize, and extract value from data. In this work, we present PlasmoData.jl, an open-source, Julia framework that uses concepts of graph theory to facilitate the modeling and analysis of complex datasets. The core of our framework is a general data modeling abstraction, which we call a DataGraph. We show how the abstraction and software implementation can be used to represent diverse data objects as graphs and to enable the use of tools from topology, graph theory, and machine learning (e.g., graph neural networks) to conduct a variety of tasks. We illustrate the versatility of the framework by using real datasets: (i) an image classification problem using topological data analysis to extract features from the graph model to train machine learning models; (ii) a disease outbreak problem where we model multivariate time series as graphs to detect abnormal events; and (iii) a technology pathway analysis problem where we highlight how we can use graphs to navigate connectivity. Further, our discussion also highlights how PlasmoData.jl leverages native Julia capabilities to enable compact syntax, scalable computations, and interfaces with diverse packages. Overall, we show that the DataGraph abstraction and PlasmoData.jl Julia package are able to model data within graphs and enable useful analysis.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2020

From smart homes to smart laboratories: connected instruments for materials science

The current focus on artificial intelligence and machine learning in the scientific community has the potential to greatly speed up discovery. In this article, we explore what a “smart facility” would mean for materials science. We propose to capture meta-data at every step of an experiment, including materials synthesis, sample production and characterization, simulation, and the analysis software used to extract information. Although most of this information is captured in various institutional systems and staff logbooks, more insight could be obtained by connecting this information through a system that allows automation. AI-enabled processes built on such a system would have the potential of making experiment planning easier and minimize the time between experiment and publication.

Doucet, Mathieu↗
DOE OSTI2025

CRISPR-CARB/nocap

Network Optimization and Causal Analysis of Perturb-seq (NOCAP) is a software package for causal inference of gene regulation networks using data from perturb-seq.

George, August↗
DOE OSTI2026

Multispectral UAV imagery of experimental freshwater wetlands under 5 ppt saltwater intrusion, Louisiana, 2023 and 2024

Multispectral imagery was collected using an unmanned aerial vehicle (UAV) to evaluate how freshwater vegetation responds to short-term simulated saltwater intrusion events. The purpose of this data collection was to understand how plant health changes in response to acute salinity exposure, which is increasingly relevant in coastal wetland ecosystems facing sea level rise and storm surge events, such as in coastal Louisiana. Three experimental saltwater intrusions were conducted at a salinity of approximately 5 parts per thousand (ppt) for durations of 6-days, 10-days, and 17-days. UAV flights occurred both before and after each treatment. The resulting imagery was processed using Pix4DMapper software to georeference the images and generate orthomosaics. The multispectral sensor used in this study captures reflectance in five bands: blue, green, red, red-edge, and near-infrared. The uploaded data consist of georeferenced .tif orthomosaics for each spectral band, which are compatible with GIS software for vegetation analysis. This imagery can be utilized in investigations into vegetation stress, remote sensing of freshwater wetland ecosystems, and modeling of plant response to environmental changes.

EARTH SCIENCE > BIOSPHERE > ECOSYSTEMS↗
DOE OSTI2026

TEMPEST3 surface runoff water chemistry and organic matter composition

Coastal flooding, driven by storm surges and sea level rise, can mobilize organic matter (OM) via runoff, while introducing compositionally distinct OM (e.g., estuarine OM) into the system. To understand event-scale OM dynamics, we monitored source waters and surface runoff during an ecosystem-scale field manipulation experiment, TEMPEST (Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments), in June 2024. The TEMPEST experiment is part of the COMPASS-FME (Coastal Observations, Mechanisms, and Predictions Across Systems and Scales – Field, Measurements, and Experiments) project and designed to investigate biogeochemical and ecological impacts of freshwater and seawater flooding on coastal terrestrial-aquatic interface ecosystems by simulating freshwater and seawater storm events in two 2000m2 coastal upland forest plots (freshwater and brackish seawater plots). The temporal coverage of this dataset is during the TEMPESTⅢ event (June 11-13, 2024). This dataset contains: - Surface runoff discharge measured by flumes - Sensor data (specific conductivity, salinity, dissolved oxygen, and temperature) - Particle size distribution - Total suspended sediment concentrations (TSS), particulate and dissolved organic carbon (POC, DOC) concentrations, total nitrogen and total dissolved nitrogen (TN, TDN) concentrations - Bulk particulate and dissolved OM compositions (stable C and N isotopes of particulates and optical measurements of chromophoric dissolved OM) - High resolution mass spectrometry analysis data - Water isotope data All data files are plain-text CSV (comma-separated value), and no special software is required to read them.

COMPASS-FME↗
DOE OSTI2023

Machine Learning Enabled Sensor Fusion for In-Situ Defect Detection in Laser Powder Bed Fusion

Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. The current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques such as X-Ray Computed Tomography (XCT), which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. RTX Technologies Research Center (RTRC) has licensed ORNL’s Peregrine software package – a printer- and camera-agnostic data analytics tool designed specifically for detecting process anomalies using in situ data collected during powder bed printing. The goal of this project was to feed temporally rich, multi-modal sensor data, including visible light, integrated near infrared (NIR), and spatially mapped co-axial melt pool thermal emission data into Peregrine to enable detection of subsurface flaws. XCT data was used as ground truth training data to allow Peregrine’s deep learning algorithms to recognize anomalies in these complex data streams in both test artifacts and industrially relevant geometries. Completion of this program has seen the successful implementation of multi-modal, multi-layer sensor data footprints for training of machine learning models in Peregrine. Flaws detected in XCT data have been successfully detected directly from this in situ data footprint, and initial analyses of the in situ probability-of-detection has been conducted, showing performance levels commensurate with traditional non-destructive evaluation (NDE) methods. The in situ monitoring methodology was then applied to an industrially relevant component that was using post-build NDE, highlighting the utility of the proposed method for hard-to-inspect AM components. As a direct result of this program, two journal manuscripts [1], [2] have been published in Additive Manufacturing, with additional manuscripts planned following program completion.

36 MATERIALS SCIENCE↗