Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

BUILD: Binary Understanding and Integration Logic for Dependencies (Final Report)

Increasingly diverse mission needs, the emergence of AI and cloud, and increasing hardware diversity are driving HPC software to be more complex. Modern codes are built from hundreds of small, complex components, and much of the software development process involves integrating these components rather than developing new components from scratch. The goal of the BUILD project was to ease the task of software integration for developers across LLNL’s programs. The project focused on (1) modeling software compatibility, (2) modeling ABI compatibility with binary analysis, (3) developing solver techniques to reason about compatibility, and (4) developing AI/ML models to fill gaps in our understanding of software compatibility. The project has developed several key technologies that help developers—by accelerating development workflows, removing the need for rebuilds, and enabling faster, automatic, and less error-prone code sharing. These technologies are used in LLNL codes and will be ready for the new El Capitan Exascale system in Livermore Computing. Many of these technologies have been hardened and integrated with LLNL’s Spack package manager, and they are already in use by production code teams. Results of BUILD have laid the groundwork for future advances in software integration—the ML and binary modification techniques developed in this project still need to be operationalized but have great potential to further speed up software integration.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Transcriptomics Processing Pipelines for Space Biology: An Open Source and Consensus-Driven Approach

Transcriptomics holds significant value in elucidating the relationship between gene expression, experimental factors, biological factors, and various types of omics data. Enhancing our understanding of these connections is paramount for foundational biology, which plays a pivotal role in devising solutions for challenges pertinent to both space travel and terrestrial life. The NASA GeneLab project, part of the Open Science Data Repository (OSDR.nasa.gov), seeks to accelerate space biology research through cataloging and democratizing ‘omics data, including transcriptomics. Since raw omics data are largely inaccessible to non-bioinformaticians, GeneLab works with the scientific community via the Open Science Analysis Working Groups (AWGs) to develop standard processing pipelines to generate and publish processed data. Unlike raw data, processed data have greater immediate value to diverse users with varying technical backgrounds and computational capabilities. Standardizing processing workflows is essential to match the pace of raw data generation, ensure reproducibility, and enable standardized processed data for comparison across datasets. As of June 2023, transcriptomics studies comprise over half of GeneLab datasets hosted on the OSDR, including data from bulk RNA-seq and Affymetrix or Agilent 1-Channel DNA microarray assays. In collaboration with the AWGs, GeneLab developed consensus processing pipelines for these transcriptomics data types that includes quality control, background correction (microarray only), data normalization and quantification, culminating in the detection and annotation of differentially expressed genes. The work presented here describes Nextflow implementations of GeneLab’s consensus transcriptomics pipelines that automates and accelerates processing of these datasets. In addition to the core data processing, these workflows also include raw data staging and a robust verification and validation program to identify errors in real-time, stop additional downstream computation, and preserve computational resources. These workflows are used to generate GeneLab processed data hosted on the OSDR, and are publicly available as open source software for others to use at: https://github.com/nasa/GeneLab_Data_Processing.

Jonathan Oribello↗
DOE OSTI2023

Simulation tools, first results and experimental status of the MURAVES experiment

The MUon RAdiography of VESuvius (MURAVES) project aims at the study of Mt. Vesuvius, an active and hazardous volcano near Naples, Italy, with the use of muons freely and abundantly produced by cosmic rays. In particular, the MURAVES experiment intends to perform muographic imaging of the internal structure of the summit of Mt. Vesuvius. The challenging measurement of the rock density distribution in its summit by muography, in conjunction with data from other geophysical techniques, can help model possible eruption dynamics. The MURAVES apparatus consists of an array of three independent and identical muon trackers, with a total sensitive area of 3 square meters. In each tracker, a sequence of 4 XY tracking planes made of plastic scintillators is complemented by a 60 cm thick lead wall inserted between the two downstream planes to improve rejection of background from low energy muons. The apparatus is currently acquiring data. This paper presents preliminary results from the analysis of the first data samples acquired with trackers pointing towards Mt. Vesuvius, including the first relative measurement of the density projection of two flanks of the volcano at three different altitudes; we also present the workflow of the simulation chain of the MURAVES experiment and its ongoing developments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Julia as a unifying end-to-end workflow language on the Frontier exascale system

We evaluate Julia as a single language and ecosystem paradigm powered by LLVM to develop workflow components for high-performance computing. We run a Gray-Scott, 2-variable diffusion-reaction application using a memory-bound, 7-point stencil kernel on Frontier, the US Department of Energy’s first exascale supercomputer. We evaluate the performance, scaling, and trade-offs of (i) the computational kernel on AMD’s MI250x GPUs, (ii) weak scaling up to 4,096 MPI processes/GPUs or 512 nodes, (iii) parallel I/O writes using the ADIOS2 library bindings, and (iv) Jupyter Notebooks for interactive analysis. Results suggest that although Julia generates a reasonable LLVM-IR, a nearly 50% performance difference exists vs. native AMD HIP stencil codes when running on the GPUs. As expected, we observed near-zero overhead when using MPI and parallel I/O bindings for system-wide installed implementations. Consequently, Julia emerges as a compelling high-performance and high-productivity workflow composition language, as measured on the fastest supercomputer in the world.

Godoy, William↗
NASA NTRS2010

Employing Geodatabases for Planetary Mapping Conduct - Requirements, Concepts and Solutions

Planetary geologic mapping has become complex in terms of merging and co-registering a variety of different datasets for analysis and mapping. But it has also become more convenient when it comes to conducting actual (geoscientific) mapping with the help of desktop Geographic Information Systems (GIS). The complexity and variety of data, however, are major issues that need to be taken care of in order to provide mappers with a consistent and easy-to-use mapping basis. Furthermore, a high degree of functionality and interoperability of various commercial and open-source GIS and remote sensing applications allow mappers to organize map data, map components and attribute data in a more sophisticated and intuitional way when compared to workflows 15 years ago. Integration of mapping results of different groups becomes an awkward task as each mapper follows his/her own style, especially if mapping conduct is not coordinated and organized programmatically. Problems of data homogenization start with various interpretations and implementations of planetary map projections and reference systems which form the core component of any mapping and analysis work. If the data basis is inconsistent, mapping results in terms of objects georeference become hard to integrate. Apart from data organization and referencing issues, which are important on the mapping as well as the data-processing side of every project, the organization of planetary geologic map units and attributes, as well as their representation within a common GIS environment, are key components that need to be taken care of in a consistent and persistent way.

vanGasselt, Stephan↗
DOE OSTI2024

Large-scale atomistic model construction of subbituminous and bituminous coals for solvent extraction simulations with reactive molecular dynamics

Large-scale atomistic models for complex polycyclic aromatic hydrocarbon systems help understand the chemical properties and behaviors of complex feedstocks such as coal or petroleum. However, the development and utilization of large-scale models remain limited due to the difficulty in achieving the varied structural characteristics necessary to capture stochastic nature of these feedstocks. Here we demonstrate a systematic workflow to construct stochastic molecular systems from a broad analytical suite: high-resolution transmission electron microscopy (HRTEM), carbon-13 nuclear magnetic resonance spectroscopy ( 13 C NMR), laser desorption ionization mass spectroscopy (LDI-MS), and elemental analysis. We present a model construction and analysis utility of a new Python-based module. We selected one subbituminous and three high-volatile bituminous coals to construct large-scale models (~40,000 atoms). The constructed models were utilized to examine the affinity for solvent extraction (naphthalene or tetralin) and the effect of structural properties (e.g., aromatic cluster size, functional groups, and cross-linking) in reactive molecular dynamics simulations. Complex chemical reactions were monitored with bond order transitions, intermediates formation, and mass distributions. Reactive molecular dynamics simulations suggest a plausible chemical extraction process and products for the complex fossil feedstocks. The results indicated that radical formations with bond breaking of bridging oxygens and carbons were required at high temperatures to facilitate hydrogeneration and extraction of gas molecules from radical-free molecules. We observed that aliphatic chains of tetralin were easily decomposed and combined with radicals to form small size of molecules with aryl bonding, mainly increasing molecules in the 500–1000 Da, while naphthalene had little impact on chemical extraction process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Accelerating Large-Format Metal Additive Manufacturing: How Controls R&D is Driving Speed, Scale, and Efficiency

This article highlights work at Oak Ridge National Laboratory’s Manufacturing Demonstration Facility to develop closed-loop, feedback control for laser-wire based Directed Energy Deposition, a form of metal Big Area Additive Manufacturing (m-BAAM), a process being developed in partnership with GKN Aerospace specifically for the production of Ti-6Al-4V pre-forms for aerospace components. A large-scale structural demonstrator component is presented as a case-study in which not just control, but the entire 3D printing workflow for m-BAAM is discussed in detail, including design principles for large-format metal AM, toolpath generation, parameter development, process control, and system operation, as well as post-print net-shape geometric analysis and finish machining. In terms of control, a multi-sensor approach has been utilized to measure both layer height and melt pool size, and multiple modes of closed-loop control have been developed to manipulate process parameters (laser power, print speed, deposition rate) to control these variables. Layer height control and melt pool size control have yielded excellent local (intralayer) and global (component-level) geometry control, and the impact of melt pool size control in particular on thermal gradients and material properties is the subject of continuing research. Further, these modes of control have allowed the process to advance to higher deposition rates (exceeding 7.5 lb/hr), larger parts (1-meter scale), shorter build times, and higher overall efficiency. The control modes are examined individually, highlighting their development, demonstration, and lessons learned, and it is shown how they operate concurrently to enable the printing of a large-scale, near net shape Ti-6Al-4V component.

Gibson, Brian↗
NASA NTRSDate not supplied

Evaluating SAR Radiometric Terrain Correction Solutions: Optimal products for applied users

Operational applications of Synthetic Aperture Radar (SAR) are under development around the world, driven by the regularly-acquired, free-and-open source C-band SAR observations provided by ESA’s Sentinel-1 sensor constellation since 2014. Groups like SERVIR, a joint NASA and USAID initiative, are at the forefront of remote sensing applications for societal benefit. A takeaway from SERVIR’s experience is the need for appropriately geocoded and fully calibrated SAR data that is ready to use for a range of ecosystems-related applications. Radiometric Terrain Corrected (RTC) data are key entry-level products for multiple applications that range from ecosystems to hazards. This work fills a gap in current research by evaluating several RTCs produced by open-source software solutions (SNAP-7 and ISCE-2), the gold standard commercial software (GAMMA), a Google Earth Engine (GEE) based workflow, and the uncorrected GRD products currently available in GEE. RTCs were analyzed for geolocation quality, absolute radiometric calibration, and fidelity of the radiometric terrain flattening over ten sites representing varied terrains. In addition, a time series analysis was conducted over two locations. Overall, no significant differences for radiometric calibration were found across RTC products. However, all RTCs performed better than uncorrected GRD products. The main differences between products were found in geolocation quality. These results not only demonstrate the need for the uptake and distribution of RTC products for ecosystems applications, but demonstrate the ability to do so with open source methods, adding value to developing affordable operational applications.

Helen Blue Parache↗
DOE OSTI2021

Exploring Transport Behavior in Hybrid Perovskites Solar Cells via Machine Learning Analysis of Environmental-Dependent Impedance Spectroscopy

Hybrid organic–inorganic perovskites are one of the promising candidates for the next-generation semiconductors due to their superlative optoelectronic properties. However, one of the limiting factors for potential applications is their chemical and structural instability in different environments. Herein, the stability of (FAPbI3)0.85(MAPbBr3)0.15 perovskite solar cell is explored in different atmospheres using impedance spectroscopy. An equivalent circuit model and distribution of relaxation times (DRTs) are used to effectively analyze impedance spectra. DRT is further analyzed via machine learning workflow based on the non-negative matrix factorization of reconstructed relaxation time spectra. This exploration provides the interplay of charge transport dynamics and recombination processes under environment stimuli and illumination. The results reveal that in the dark, oxygen atmosphere induces an increased hole concentration with less ionic character while ionic motion is dominant under ambient air. Under 1 Sun illumination, the environment-dependent impedance responses show a more striking effect compared with dark conditions. In this case, the increased transport resistance observed under oxygen atmosphere in equivalent circuit analysis arises due to interruption of photogenerated hole carriers. The results not only shed light on elucidating transport mechanisms of perovskite solar cells in different environments but also offer an effective interpretation of impedance responses.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Network performance analysis for HPC datacenters (net_perf) v1.0

The software has two main features: (1) identify data movement trends in HPC data centers that use network flow monitoring (2) analyze the performance of individual data flows under the existing data movement management strategy and identify performance bottlenecks that impede timely data availability for science workflows. Its main advantage is that it is tailored for HPC network traffic by considering HPC data movement management intricacies.

Giannakou, Anna↗
DOE OSTI2026

Analytical workflow dependence of experimental observables for uranium chemistries

In this work, we investigated how the sequencing of laboratory analytical methods used for chemical and morphological characterization influences analytical findings for particulate materials relevant to the nuclear fuel cycle, including UO2, U3O8, studtite (UO2O2·4H2O), and β-UO3, in the context of nuclear forensic analysis. Particles of each chemistry obtained from consistent production batches were exposed to Raman spectroscopy and scanning electron microscopy in varying orders to elucidate how the order in which the techniques are applied influences morphological and chemical observations as a function of particle size. The results indicate that particles from all four chemistries exposed to high-resolution electron imaging before Raman spectral analysis demonstrate optical vibrational spectral changes that reduce accurate interpretation of the underlying chemistry via Raman spectral analysis. We hypothesize that these changes are due to the thermal load of the electron beam imparted to the sample being unable to be dissipated by materials with poor thermal conduction properties. Results from this study will aid in determining best practices for forensic analysis procedures to reduce uncertainty in chemical determination of unknown particulate samples.

Manns, Rebecca [University of Nevada, Las Vegas]↗
DOE OSTI2023

Scaling Optimal Allocation of Cloud Resources Using Lagrange Relaxation

The rapid growth of Cloud Computing (CC) has increased the variety of computing resources, storage, and communication services that pose significant new challenges for the efficient use of cloud resources. The cost-efficient allocation of cloud resources has become a decisive premise for the adoption of CC services. The cost-efficient selection and scheduling of these resources to meet the demands of a scientific workflow is a challenging problem that is exacerbated by the inclusion of multiple CC providers. In this paper, we present a novel strategy for the cost-efficient selection of CC resources using Lagrange relaxation. Our approach is based on preselection of resources and demand decomposition to create a series of smaller sub-problems, which allow the estimation of the best cost-structures and selection of CC service providers for a subset of the time period of the planning horizon. Decomposition of the demand is achieved through the boundary analysis of a continuous relaxation of the problem. Using the metrics defined in terms of the cost and time of completion, we demonstrate excellent performance in relation to optimal solutions. Our method reduced the computational time from hours to seconds for a representative 36-month problem and provided high-quality solutions (< 0.05% relative error). Given the importance of selecting resources and scheduling complex scientific workflows, we believe that this novel strategy will be beneficial for many researchers and users of cloud computing resources.

De La Torre, Luis↗
DOE OSTI2026

Optical interference for the guidance of cryogenic focused ion beam milling beyond the axial diffraction limit

Cryogenic focused ion beam (Cryo-FIB) milling has become a standard step in the cryogenic electron tomography (Cryo-ET) workflow and is required to thin cells to electron-semitransparency. However, this destructive process removes the vast majority of the cellular material and raises a critical question: what thin section should be preserved for Cryo-ET analysis? Using a tri-coincident cryogenic FIB-SEM-LM system, we identify an interferometric optical response that can be used for targeting lamella production to fluorescently labeled structures with accuracy beyond the diffraction limit. Here we demonstrate this approach using synthetic samples of fluorescent beads embedded in micron-scale droplets of amorphous ice. We then apply the approach to capture virions inside host cells. Successful targeting is confirmed by Cryo-ET revealing clusters of virions in intracellular vesicles. The method does not require any fluorescent fiducials or axial registration and can be performed on any fluorescently labeled structure that is visible in widefield fluorescence microscopy.

Cryoelectron microscopy↗
DOE OSTI2025

Assessing the Role of Hydrodynamics in Enhancing Height-Above-the-Nearest-Drainage Derived Synthetic Rating Curves: A Comparative Study in the Wu River Basin, Taiwan

The conventional approach to generating synthetic rating curves (SRC) using the Height-Above-the-Nearest-Drainage (HAND) method typically relies on the assumption of uniform flow, such as Manning's equation, to establish stage-discharge ratings. The zero-physics application of the uniform flow equation is insufficient for capturing detailed hydraulic features (e.g., backwater effect) and neglects the hydraulic effects from adjacent channels. This lack of hydrodynamic computation can impact the accuracy and effectiveness of riverine flood risk estimation and management. To reduce this foreseeable error, we introduce the HAND-hd workflow, which integrates sophisticated hydrodynamic computations in the production of HAND-based SRC with hydrodynamic features (SRC hd ). The results indicate that SRC hd demonstrates consistent agreement with both gauge observations and benchmark solutions. Additionally, the comparative analysis suggests that SRC hd provides notable improvements in stage-discharge ratings over conventional HAND-based SRCs, particularly in channels with mild bed gradients, where it reduces water stage prediction errors and percent biases. In steeper channel segments, SRC hd maintains comparable accuracy to conventional methods. The comprehensive evaluation in this study emphasizes the potential discrepancies and inaccuracies associated with the adoption of the uniform flow assumption in the conventional HAND-SRCs and addresses the necessity of including hydrodynamic physics in the application of HAND-based SRC (e.g., inundation map) in channels with mild gradients.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

IDAES-PSE 2.3.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications.. New Features and Models • New diagnostics toolboxes and examples o Tutorial for using the DiagnosticsToolbox o Methods to identify potential evaluation errors in models o SVDToolbox for performing singular value decomposition analysis on models to identify possible degeneracies and poor scaling o DegeneracyHunter for identifying irreducible degenerate sets in models • Model for solid-liquid separation which takes two inputs (solid and liquid streams) and produces three outlets (solids, liquid entrained with solids and pure liquid) • Example of temperature swing adsorption in models_extra Deprecation Warnings • With the update to Pyomo 6.7.0, the plate heat exchanger model has begun failing tests on some CI platforms. If this is not addressed by the February release, this model may be removed due to failing tests. See #1294. Offers to help identify the cause and fix this issue are welcome. Improvements and bug fixes • Fixed oversight which precluded using Mixer and Separator models when inherent reactions were present in property package • Added reporting methods to the MSContactor model • Minor corrections in some examples where values were being fixed outside of declared variable bounds

DiagnosticsToolbox,IDAES,PSE,Process Systems Engin↗
DOE OSTI2026

Accelerating lattice gauge theory studies with Agentic AI

Lattice gauge theory research, with its computationally intensive simulations and complex multi‑stage workflows, is well positioned to benefit from agentic AI systems. We demonstrate how such tools can support key components of lattice gauge theory research, including novel simulation code development using standard LQCD frameworks, HPC job orchestration, simulation data analysis, and expert‑guided tuning of algorithmic parameters such as Hasenbusch mass preconditioning and multigrid solvers. Our results show that agentic AI can reduce manual effort, improve productivity, and accelerate the research cycle while maintaining essential human oversight.

Ayyar, Venkitesh [Fermilab]↗
DOE OSTI2024

Matilda v1.0: An R package for probabilistic climate projections using a reduced complexity climate model

A primary advantage to using reduced complexity climate models (RCMs) has been their ability to quickly conduct probabilistic climate projections, a key component of uncertainty quantification in many impact studies and multisector systems. Providing frameworks for such analyses has been a target of several RCMs used in studies of the future co-evolution of the human and Earth systems. In this paper, we present Matilda, an open-science R software package that facilitates probabilistic climate projection analysis, implemented here using the Hector simple climate model in a seamless and easily applied framework. The primary goal of Matilda is to provide the user with a turn-key method to build parameter sets from literature-based prior distributions, run Hector iteratively to produce perturbed parameter ensembles (PPEs), weight ensembles for realism against observed historical climate data, and compute probabilistic projections for different climate variables. This workflow gives the user the ability to explore viable parameter space and propagate uncertainty to model ensembles with just a few lines of code. The package provides significant freedom to select different scoring criteria and algorithms to weight ensemble members, as well as the flexibility to implement custom criteria. Additionally, the architecture of the package simplifies the process of building and analyzing PPEs without requiring significant programming expertise, to accommodate diverse use cases. We present a case study that provides illustrative results of a probabilistic analysis of mean global surface temperature as an example of the software application.

54 ENVIRONMENTAL SCIENCES↗