Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Workflows”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

2023 Real-time Optimization Workflow Status Update

Nuclear integrated energy systems are composed of a diverse set of energy generation sources and exist in dynamic and competitive electricity markets. With the inclusion of thermal energy storage, nuclear power systems can store heat for future use through various processes, such as water desalination or hydrogen generation. This heat storage can be managed in such a way as to economically optimize its usage. By combining real-time price data from the day-ahead and real-time markets with predictive and intelligent models, the charging and discharging of the thermal energy storage may be determined and optimized. This research details an approach through models and systems for the real-time optimization (RTO) of capacity allocation. Virtual models of the energy system and its physics phenomenon and component interactions provide intelligence to verification and prediction of operations. An optimization framework can use data generated from both a set of physical assets as well as the virtual models to predict future performance and create optimization and control workflows. Data warehouse technologies can be used to combine data across models, optimization workflows, market price data, and sensor data to intuitively store various types of data and provide integrations to physical control systems as well as user visualizations. Put together, these components can create a system for the RTO of nuclear integrated energy systems. Various virtual models and bench-scale physical demonstrations have been successfully performed and verified using this system. Larger scale testbeds that include thermal energy storage systems have been identified as future opportunities. A gap analysis that details the steps necessary to reach a physical demonstration at this scale is provided, along with conclusions on the current effort and future work.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Towards Lightweight Data Integration Using Multi-Workflow Provenance and Data Observability

Modern large-scale scientific discovery requires multidisciplinary collaboration across diverse computing facilities, including High Performance Computing (HPC) machines and the Edge-to-Cloud continuum. Integrated data analysis plays a crucial role in scientific discovery, especially in the current AI era, by enabling Responsible AI development, FAIR, Reproducibility, and User Steering. However, the heterogeneous nature of science poses challenges such as dealing with multiple supporting tools, cross-facility environments, and efficient HPC execution. Building on data observability, adapter system design, and provenance, we propose MIDA: an approach for lightweight runtime Multi-workflow Integrated Data Analysis. MIDA defines data observability strategies and adaptability methods for various parallel systems and machine learning tools. With observability, it intercepts the dataflows in the background without requiring instrumentation while integrating domain, provenance, and telemetry data at runtime into a unified database ready for user steering queries. We conduct experiments showing end-to-end multi-workflow analysis integrating data from Dask and MLFlow in a real distributed deep learning use case for materials science that runs on multiple environments with up to 276 GPUs in parallel. We show near-zero overhead running up to 100,000 tasks on 1,680 CPU cores on the Summit supercomputer.

Santos Souza, Renan↗
DOE OSTI2023

GeoThermalCloud for EGS – An Open-source, User-friendly, Scalable AI Workflow for Modeling Enhanced Geothermal Systems

Enhanced Geothermal Systems (EGS) offer a vast potential to expand the use of geothermal energy. Heat is extracted from this engineered system by injecting relatively cold water into subsurface fractures, which are in contact with hot dry rock, and brought back to surface through production wells. Creating EGS requires improving the natural permeability of hot crystalline rocks. In this short conference paper, we present a reproducible workflow for modeling EGS. Our workflow called the GeoThermalCloud (GTC) for EGS, leverages recent advances in machine learning, deep learning, and high-performance computing. This GTC framework is currently being made open-source, user-friendly, and reproducible through python scripts as well as Google Colab/Jupyter Notebooks. This GTC for EGS modeling scripts are made available at https://github.com/SmartTensors/GeoThermalCloud.jl/tree/master/EGS and will constantly be updated to cater for geothermal community. Current GTC framework provides scripts to train deep learning (DL) models for techno-economics and data worth analysis. The Geothermal Design Tool (https://github.com/GeoDesignTool/GeoDT.git), a fast and simplified multi-physics solver, is used to develop a database for training DL models. This short paper provides details on the scripts to curate, process, and train DL models. The scripts can easily be modified to train on databases generated by other popular open-source simulators such as PFLOTRAN, STOMP, TOUGH, and GEOSX or commercial software such as ResFrac and COMSOL.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

nmrrr : A Reproducible Workflow for Binning and Visualizing NMR Spectra From Environmental Samples

Nuclear magnetic resonance (NMR) spectroscopy is a useful tool for detection and identification of molecular structural information, with increasing applications in environmental sciences. NMR instrument outputs are however heterogeneous and require extensive post-processing, creating barriers to their use and application by non-specialists. Here, we report on a new open-source R package, nmrrr, that processes and visualizes spectral data obtained from one-dimensional solution-state and solid-state NMR experiments; the package also performs relevant calculations commonly applied in natural organic matter communities, such as computing the relative abundance of various functional groups. We document the package's installation, dependencies, and functions; and provide a standard workflow for processing NMR data. This package is currently available on CRAN and GitHub, and community contributions are welcome.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Holistic Approaches to HPC Power and Workflow Management

Constraints on power consumption are having pervasive effects on high-performance computing (HPC) systems, the facilities in which they are housed, and the application codes themselves. Whether these constraints are driven by physical limits on available power within a facility, are due to utility demand response, result from opportunities to reduce utility costs, or are imposed by sponsoring agencies, power management must now be added to the traditional goals of application and algorithm correctness, scalability, and performance. The specifics of these power constraints are likely to vary from site to site, and optimal strategies for managing power will vary. In this paper, we present the results of implementing several strategies for managing HPC system power and quantify the impact of these power reductions on application performance. These can be added to the suite of extant options that can be used to manage power and workflow on HPC systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Portable, heterogeneous ensemble workflows at scale using libEnsemble

libEnsemble is a Python-based toolkit for running dynamic ensembles, developed as part of the DOE Exascale Computing Project. The toolkit utilizes a unique generator–simulator–allocator paradigm, where generators produce input for simulators, simulators evaluate those inputs, and allocators decide whether and when a simulator or generator should be called. The generator steers the ensemble based on simulation results. Generators may, for example, apply methods for numerical optimization, machine learning, or statistical calibration. libEnsemble communicates between a manager and workers. Flexibility is provided through multiple manager–worker communication substrates each of which has different benefits. These include Python’s multiprocessing, mpi4py, and TCP. Multisite ensembles are supported using Balsam or Globus Compute. We overview the unique characteristics of libEnsemble as well as current and potential interoperability with other packages in the workflow ecosystem. We highlight libEnsemble’s dynamic resource features: libEnsemble can detect system resources, such as available nodes, cores, and GPUs, and assign these in a portable way. These features allow users to specify the number of processors and GPUs required for each simulation; and resources will be automatically assigned on a wide range of systems, including Frontier, Aurora, and Perlmutter. Such ensembles can include multiple simulation types, some using GPUs and others using only CPUs, sharing nodes for maximum efficiency. We also describe the benefits of libEnsemble’s generator–simulator coupling, which easily exposes to the user the ability to cancel, and portably kill, running simulations based on models that are updated with intermediate simulation output. We demonstrate libEnsemble’s capabilities, scalability, and scientific impact via a Gaussian process surrogate training problem for the longitudinal density profile at the exit of a plasma accelerator stage. In conclusion, the study uses gpCAM for the surrogate model and employs either Wake-T or WarpX simulations, highlighting efficient use of resources that can easily extend to exascale.

Dynamic ensembles↗
DOE OSTI2019

Input data to electricity_entity_boundaries workflow

The EIA 861 electricity entity information dataset which acts as the input data to the electricity_entity_boundaries workflow (https://github.com/IMMM-SFA/electricity_entity_boundaries).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2002

Automated workflow for engineering services

This paper describes a prototype of an automated workflow system, developed by the Jet Propulsion Laboratory, that provides navigation and telecommunication services.

automated workflow web services database legacy ap↗
DOE OSTI2019

Holistic Approaches to HPC Power & Workflow Management: Preprint

Constraints on power consumption are having pervasive effects on high-performance computing (HPC) systems, the facilities in which they are housed, and the application codes themselves. Whether these constraints are driven by physical limits on available power within a facility, are due to utility demand response, result from opportunities to reduce utility costs, or are imposed by sponsoring agencies, power management must now be added to the traditional goals of application and algorithm correctness, scalability, and performance. The specifics of these power constraints are likely to vary from site to site, and optimal strategies for managing power will vary. In this paper, we present the results of implementing several strategies for managing HPC system power and quantify the impact of these power reductions on application performance. These can be added to the suite of extant options that can be used to manage power and workflow on HPC systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A Processing and Analytics System for Microscopy Data Workflows: The Pycroscopy Ecosystem of Packages

Major advancements in fields as diverse as biology and quantum computing have relied on a multitude of microscopy techniques. Despite the considerable proliferation of these instruments, significant bottlenecks remain in terms of processing, analysis, storage, and retrieval of the acquired datasets. Aside from lack of file standards, individual domain-specific analysis packages are often disjoint from the underlying datasets, and thus keeping track of analysis and processing steps remains tedious for the end-user, hampering reproducibility. Here, in this study, the pycroscopy ecosystem of packages is introduced, an open-source python-based ecosystem underpinned by a common data model. The data model, termed the N-dimensional spectral imaging data format, is realized in pycroscopy's sidpy package. This package is built on top of dask arrays, thus leveraging dask array attributes, but expanding them to accelerate microscopy relevant analysis and visualization. Several examples of the use of the pycroscopy ecosystem to create workflows for data ingestion and analysis of scanning transmission electron microscopy (STEM) and scanning probe microscopy data are shown. Adoption of such standardized routines will be critical to usher in the next generation of autonomous instruments where processing, computation, and meta-data storage will be critical to overall experimental operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

An efficient cre‐based workflow for genomic integration and expression of large biosynthetic pathways in Eubacterium limosum

Abstract Acetogenic Clostridia are obligate anaerobes that have emerged as promising microbes for the renewable production of biochemicals owing to their ability to efficiently metabolize sustainable single‐carbon feedstocks. Additionally, Clostridia are increasingly recognized for their biosynthetic potential, with recent discoveries of diverse secondary metabolites ranging from antibiotics to pigments to modulators of the human gut microbiota. Lack of efficient methods for genomic integration and expression of large heterologous DNA constructs remains a major challenge in studying biosynthesis in Clostridia and using them for metabolic engineering applications. To overcome this problem, we harnessed chassis‐independent recombinase‐assisted genome engineering (CRAGE) to develop a workflow for facile integration of large gene clusters (>10 kb) into the human gut acetogen Eubacterium limosum . We then integrated a non‐ribosomal peptide synthetase gene cluster from the gut anaerobe Clostridium leptum , which previously produced no detectable product in traditional heterologous hosts. Chromosomal expression in E. limosum without further optimization led to production of phevalin at 2.4 mg/L. These results further expand the molecular toolkit for a highly tractable member of the Clostridia, paving the way for sophisticated pathway engineering efforts, and highlighting the potential of E. limosum as a Clostridial chassis for exploration of anaerobic natural product biosynthesis.

Sanford, Patrick A.↗
DOE OSTI2024

A Tip-based Workflow for Sensitive IMAC-based Low Nanogram Level Phosphoproteomics

Analyzing the phosphoproteome at nanoscale poses a significant challenge, mainly due to the substantial sample loss from non-specific surface adsorption during the enrichment of low stoichiometric phosphopeptides. Here, we describe a tandem tip-based phosphoproteomics sample preparation method capable of sequential sample cleanup and enrichment without the need for additional sample transfer, thereby minimizing sample loss. Integration of this method to our recently developed SOP (Surfactant-assisted One-Pot sample preparation) and iBASIL (improved Boosting to Amplify Signal with Isobaric Labeling) approaches creates a streamlined workflow, enabling sensitive, high-throughput nanoscale phosphoproteomics measurements.

Phosphoproteome, Immobilized metal ion affinity ch↗
DOE OSTI2018

Benchtop-compatible sample processing workflow for proteome profiling of < 100 mammalian cells

Extending proteomics to smaller samples can enable the mapping of protein expression across tissues with high spatial resolution and can reveal sub-group heterogeneity. However, despite the continually improving sensitivity of LC-MS instrumentation, in-depth profiling of samples containing low-nanogram amounts of protein has remained challenging due to analyte losses incurred during preparation and analysis. To address this, we recently developed nanodroplet processing in one pot for trace samples (nanoPOTS), a robotic/microfluidic platform that generates ready-to-analyze peptides from cellular material in ~200 nL droplets with greatly reduced sample losses. In combination with ultrasensitive LC-MS, nanoPOTS has enabled >3000 proteins to be confidently identified from as few as 10 cultured human cells and ~700 proteins from single cells. However, the nanoPOTS platform requires a highly skilled operator and a costly in-house-built robotic nanopipetting instrument. In this work, we sought to evaluate the extent to which the benefits of nanodroplet processing could be preserved when upscaling reagent dispensing volumes by a factor of 10 to those addressable by commercial micropipette. We characterized the resulting platform, termed microdroplet processing in one pot for trace samples (µPOTS), for the analysis of as few as ~25 cultured HeLa cells (4 ng total protein) or 50 µm square mouse liver tissue thin sections and found that ~1800 and ~1200 unique proteins were respectively identified with high reproducibility. As such, the reduced equipment requirements should facilitate broad dissemination of nanoproteomics workflows by obviating the need for a capital-intensive custom liquid handling system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

A high-throughput workflow to analyze sequence-conformation relationships and explore hydrophobic patterning in disordered peptoids

Understanding how a macromolecule’s primary sequence governs its conformational landscape is crucial for elucidating its function, yet these design principles are still emerging for macromolecules with intrinsic disorder. Herein, we introduce a high-throughput workflow that implements a practical colorimetric conformational assay, introduces a semi-automated sequencing protocol using matrix-assisted laser desorption/ionization and tandem mass spectrometry (MALDI-MS/MS), and develops a generalizable sequence-structure algorithm. Using a model system of 20mer peptidomimetics containing polar glycine and hydrophobic N-butylglycine residues, we identified nine classifications of conformational disorder and isolated 122 unique sequences across varied compositions and conformations. Conformational distributions of three compositionally identical library sequences were corroborated through atomistic simulations and ion mobility spectrometry coupled with liquid chromatography. A data-driven strategy was developed using existing sequence variables and data-derived “motifs” to inform a machine-learning algorithm toward conformation prediction. Here, this multifaceted approach enhances our understanding of sequence-conformation relationships and offers a powerful tool for accelerating the discovery of materials with conformational control.

data-driven analysis↗
DOE OSTI2022

A workflow for automatic generation and efficient refinement of individual pressure-dependent networks

Manual chemical kinetic model construction often requires modelists to at least implicitly guess all possible decay pathways and their relative fluxes for all important species. We present a workflow and associated tool for automatic generation and re finement of pressure-dependent networks that should enable modelists to efficiently and comprehensively identify decay pathways and estimate respective parameters for chemical species. This tool combines the capabilities of the Reaction Mechanism Generator (RMG) software to generate possible reaction paths, determine thermochemistry, approximate rate coefficients and estimate frequencies with the capabilities of the Arkane software to use quantum chemical parameters to compute thermochemistry and pressure dependent rates. A flux-based algorithm is used to decide which isomers to add to the network. Isomers added to the network are reacted to form other channels. When enough of the flux is accounted for by the isomers and bimolecular product channels, the generation process terminates to yield a comprehensive network. Network sensitivity analysis is applied to the network to identify the most important wells and barriers that can be refined using quantum chemistry calculations. Iterative refinement can then be used to achieve accuracy. The comprehensive network can be easily reduced using energy and flux-based algorithms to the most important channels and isomers in the network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Daylight simulation workflows incorporating measured bidirectional scattering distribution functions

Daylight predictions of architectural spaces depend on good estimates of light transfer through skylights, windows and other fenestration systems. For clear glazing and painted surfaces, parametric transmission and reflection models have proven adequate, but there are many cases where light-scattering, semi-specular shading and daylighting materials defy simple characterization. Something as commonplace as fabric roller shades and venetian blinds may turn daylight prediction into guesswork, and numerous advanced systems on the market tuned specifically to enhance daylight are not sufficiently characterized to distinguish their performance. In this paper, we describe new tools available to handle novel and specialized fabrics, materials, and devices using data-driven modelling of bi-directional scattering distribution functions (BSDFs). These representations are usually tabulated at constant or adjustable angular resolution for efficient point-in-time and annual daylight simulations. We describe a variety of BSDF simulation workflows, including some of the tools and methods that make advanced analysis possible, and highlight some of the current challenges. We conclude with a discussion of future work and how such data might be created and shared worldwide.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Soil porous microstructure control over soil organic matter mobility: A multimethod workflow for understanding chemistry-dependent organic matter binding in soil

Soil organic matter (SOM) has attracted a great deal of interest; particularly for its potential to mitigate human derived CO 2 emissions. Studies have demonstrated that SOM plays a critical role in carbon storage and CO 2 sequestration. However, the sorption properties of SOM, which influence its transport in pore water and stabilization within the soil, remain poorly understood. This study develops a workflow to: (1) examine compound-specific advective and diffusive transport and desorption behaviors, (2) quantify desorption rates through stop-flow and continuous-flow column experiments, and (3) evaluate the impact of soil microporosity on SOM mobility using high-resolution imaging and extractions. Intact core column experiments were conducted on Uncultivated (Natural) and Cultivated soil samples, both were arid soils, collected in Washington State. X-ray computed tomography was employed to measure porosity and pore connectivity, while Fourier-transform ion cyclotron resonance mass spectrometry was used to analyze SOM composition. The findings revealed that cultivation increased total carbon and nitrogen levels due to irrigation and fertilization, enhancing carbon capture potential in arid soils. In contrast, the Natural soil, characterized by higher porosity and connectivity, contained more oxidized carbon. Pore network analysis indicated that soil compaction in the Cultivated soil may lead to longer diffusion pathways, significantly influencing SOM transport and stability.

Hydraulic Properties↗
DOE OSTI2022

A deep redox proteome profiling workflow and its application to skeletal muscle of a Duchenne Muscular Dystrophy model

Perturbation to the redox state accompanies many diseases and its effects are viewed through oxidation of biomolecules, including proteins, lipids, and nucleic acids. The thiol groups of protein cysteine residues undergo an array of redox post-translational modifications (PTMs) that are important for regulation of protein and pathway function. To better understand what proteins are redox regulated following a perturbation, it is important to be able to comprehensively profile protein thiol oxidation at the proteome level. Herein, we report a deep redox proteome profiling workflow and demonstrate its application in measuring the changes in thiol oxidation along with global protein expression in skeletal muscle from mdx mice, a model of Duchenne Muscular Dystrophy (DMD). In depth coverage of the thiol proteome was achieved with >18,000 Cys sites from 5608 proteins in muscle being quantified. Compared to the control group, mdx mice exhibit markedly increased thiol oxidation, where ~2% shift in the median oxidation occupancy was observed. Further, pathway analysis for the redox data revealed that coagulation system and immune-related pathways were among the most susceptible to increased thiol oxidation in mdx mice, whereas protein abundance changes were more enriched in pathways associated with bioenergetics. This study illustrates the importance of deep redox profiling in gaining greater insight into oxidative stress regulation and pathways/processes that are perturbed in an oxidizing environment.

60 APPLIED LIFE SCIENCES↗