Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Machine learning enabling high-throughput and remote operations at large-scale user facilities

Imaging, scattering, and spectroscopy are fundamental in understanding and discovering new functional materials. Contemporary innovations in automation and experimental techniques have led to these measurements being performed much faster and with higher resolution, thus producing vast amounts of data for analysis. These innovations are particularly pronounced at user facilities and synchrotron light sources. Machine learning (ML) methods are regularly developed to process and interpret large datasets in real-time with measurements. However, there remain conceptual barriers to entry for the facility general user community, whom often lack expertise in ML, and technical barriers for deploying ML models. Herein, we demonstrate a variety of archetypal ML models for on-the-fly analysis at multiple beamlines at the National Synchrotron Light Source II (NSLS-II). We describe these examples instructively, with a focus on integrating the models into existing experimental workflows, such that the reader can easily include their own ML techniques into experiments at NSLS-II or facilities with a common infrastructure. The framework presented here shows how with little effort, diverse ML models operate in conjunction with feedback loops via integration into the existing Bluesky Suite for experimental orchestration and data management.

36 MATERIALS SCIENCE↗

Protocols for x-ray transient grating pump/optical probe experiments at x-ray free electron lasers

Abstract Transient grating spectroscopy is a specialized application of the four-wave-mixing methodology and constitutes a versatile technique for investigating the dynamics of vibrational, magnetic and electronic degrees of freedom of matter in a background-free fashion. Recent developments in free-electron laser sources have enabled the extension of this technique into the extreme ultraviolet range. Ongoing efforts to expand transient grating spectroscopy into the x-ray regime promise numerous advantages: (1) substantial penetration depths that allow for probing bulk material properties, (2) element specificity via specific core-excited states, and (3) short wavelengths that allow for excitation gratings with higher momentum transfer and improved spatial resolution. In this study, we comprehensively outline the procedures for conducting x-ray transient grating pump/optical probe experiment. The process encompasses the design and alignment of the experimental setup, as well as the subsequent steps involved in data acquisition and analysis. This paper is intended as a comprehensive guide for researchers interested in implementing x-ray transient grating spectroscopy, providing valuable insights into the intricacies of the experimental workflow required for this novel technique. Furthermore, we discuss the potential for extending this methodology to an x-ray pump/x-ray probe scheme, envisioning a future direction that holds promise for enhancing the capabilities and scope of x-ray transient grating spectroscopy, opening new opportunities for studying ultrafast processes with unprecedented temporal and spatial resolutions.

Optics↗

Baycal

Bayesian Model Calibration (BayCal) toolkit is a software plugin for Risk Analysis Virtual Environment (RAVEN) framework, arming at inversely quantifying the uncertainties associated with simulation model parameters based on available experiment data. BayCal seeks statistical inference of the uncertain input parameters that are consistent with the available measurement data or observed data. The unique feature of BayCal is the capability to be linked with RAVEN to build corresponding calibration workflows for complex multi-physics simulations. In addition to be able to use the machine learning capability of RAVEN to significantly reduce the computational cost of expensive simulation models, another distinctive feature of BayCal is the capability to deal with high-dimensional correlated model outputs, such as time series observations at multiple locations, via principal component analysis (PCA) technique.

Wang, Congjian↗

In-Depth Mass Spectrometry-Based Single-Cell and Nanoscale Proteomics

Leukemic stem cells are highly dynamic and heterogeneous. Analysis of leukemic stem cells at the single cell level should provide a wealth of insights that would not be possible using bulk measurements. Mass spectrometry (MS)-based proteomic workflows can quantify hundreds or thousands of proteins from a biological sample and has proven invaluable for biomedical research, but samples comprising large numbers of cells are typically required due to limited sensitivity. Recent developments in sample processing, chromatographic separations and MS instrumentation are now extending in-depth proteome profiling to single mammalian cells. We describe specific techniques that increase the sensitivity of single-cell proteomics by orders of magnitude, enabling the promise of single cell proteomics to become a reality. We anticipate such techniques could significantly advance our understanding of leukemic stem cells.

Liang, Yiran↗

Workshop Report: 2021 International Symposium of Quantitative Codesign of Supercomputers

This report provides general information about the First International Symposium on the Quantitative Design of Supercomputers (SQCS). This new workshop was held in conjunction with Supercomputing ’21 on November 19, 2021, in St Louis Missouri. The symposium aims at combining two methodologies—collaborative codesign and data-driven analysis—to realize the potential of supercomputing more fully. We refer to the design solutions that rely on intelligence from data-driven insights across applications, systems, system software, workflows, and facilities as quantitative codesign of supercomputers.

Jones, Terry↗

Workshop Report: 2022 International Symposium of Quantitative Codesign of Supercomputers

This report provides general information about the Second International Symposium on the Quantitative Design of Supercomputers (SQCS). This new workshop was held in conjunction with Supercomputing ’22 on November 13, 2022, in Dallas Texas. The symposium aims at combining two methodologies—collaborative codesign and data-driven analysis—to realize the potential of supercomputing more fully. We refer to the design solutions that rely on intelligence from data-driven insights across applications, systems, system software, workflows, and facilities as quantitative codesign of supercomputers.

Jones, Terry↗

Accurate Prediction of Algal Biomass Lipid, Protein, and Carbohydrate Composition with Machine Learning Regression Modelling of Near-IR Spectra

During large scale algal biomass cultivation, it is difficult to reliably control relative composition to target levels. Rapid determination of chemical composition is feasible by using near infrared (NIR) spectral data. We sought to build and improve on reliable high-throughput screening prediction method based on partial least squares regression (PLSR) by the application of artificial neural networks (ANN) and associated optimization strategies. The algal biomass sample set was designed and created in an iterative process of culturing in physiologically diverse conditions at the GAI field site, followed by compositional analyses at NREL. The workflow allowed us to identify gaps in compositional space for informing the subsequent cultivation and sampling efforts and generated a high quality set of 210 unique samples with chemical analysis results, spectral scanning data, and cultivation metadata. We observed a significant improvement in the performance of carbohydrate content predictions using an optimized ANN model compared to PLSR, with > 16% reduction in mean absolute percent error (MAPE) when tested on the same set of reserved data. The optimized ANN models for FAME and protein prediction performed exceptionally well with 5.99% and 5.09% MAPE, respectively. Application of these methods to detection and quantification of minor biomass constituents that are relevant to certain product streams has shown positive preliminary results, opening the possibility for extensions to the outputs of this powerful data type. All models are accompanied by prediction uncertainties and unsupervised spectral outlier detection to alert an operator to unreliable spectral data. These tools can be deployed for rapid determination of algal culture status, and cultivation and biomass quality improvement.

algal biofuels↗

Integrative Modeling and Analysis of Fungal Central Carbon Metabolism

Over a thousand fungal genomes have been sequenced, yet manually curated genome-scale metabolic models (GEMs) are available for only a limited number of species. Moreover, these models have often been developed independently, leading to inconsistencies in namespaces, compartment definitions, and pathway representations that hinder comparative analysis, the systematic reuse of prior curation efforts, and the integration of consolidated metabolic knowledge. Here, we present the Consolidated Fungal Core Metabolism Model (CFCMM), constructed by integrating thirteen published fungal models spanning Ascomycota, Mucoromycota, and both Crabtree-positive and Crabtree-negative yeasts. We harmonized metabolites and reactions into a non-redundant shared ModelSEED ontological space, standardized compartmentalization, and refined gene–protein–reaction (GPR) rules. Using pathway-level visualization and systematic gap detection, we further improved the integrated network through literature-guided curation to correct stoichiometry, stereospecificity, and pathway architecture. Orthologous protein family reconstruction and functional annotation workflows were used to validate and inform GPR associations, with particular emphasis on ambiguous enzyme superfamilies and membrane-associated components. Using the resulting CFCMM, we built high-quality central carbon core models for each fungus and performed flux balance analysis to quantify ATP-yield variation under aerobic and anaerobic conditions, explicitly evaluating scenarios driven by differences in electron transport chain (ETC) composition. Simulations reproduced the expected fermentative yield of approximately 2 mmol ATP per mmol glucose under anaerobic conditions and separated the thirteen fungi into two bioenergetic groups under aerobic respiration based on Complex I status, with predicted yields of approximately 30 versus 22 mmol ATP per mmol glucose. Forcing flux through the alternative oxidase bypass further reduced ATP yields to approximately 12 and 4 mmol ATP per mmol glucose in Complex I-containing and Complex I-lacking fungi, respectively. Collectively, this work provides a manually curated, ModelSEED-consistent, and extensible fungal core metabolic template, deployed in DOE KBase as a resource for automated reconstruction of central carbon core models from any sequenced fungal genome. In addition, the CFCMM provides modular components for developing GEMs with more accurate energy predictions and enables robust comparative analyses of fungal bioenergetics and core metabolic diversity

59 BASIC BIOLOGICAL SCIENCES↗

Toward a Seamless Integration of Computing, Experimental, and Observational Science Facilities: A Blueprint to Accelerate Discovery

The Department of Energy, Office of Science operates world-leading facilities for experimental, observational, and computational science. DOE supercomputing facilities will reach performance at the scale of ExaFLOPs in the coming years, enabling new vistas of scale and precision for large scale simulations and data analysis. Experimental scientific facilities are undergoing similar upgrades that will lead to higher data rates and correspondingly larger computational demands, and will increase the need for near-real-time processing and resilient support for more complex workflows. A transformation of science is underway, with workloads at supercomputing facilities increasingly driven by this explosion of data from instruments and experimental facilities, as well as the accelerating use of Artificial Intelligence (AI) as a tool for scientific discovery. A seamless integration of computing, networking, instruments, and experimental facilities is required to support these emerging workloads and open up a new frontier of U.S. leadership in scientific discovery. We propose to accomplish this by providing frictionless access to the ASCR supercomputing facilities. We describe our vision of combining the power of ASCR supercomputers and networking infrastructure into an integrated scalable fabric, available to end user scientists via interfaces that aim to automate and simplify access to high performance computing systems. This will enable unprecedented computational science capabilities for experimental and observational facilities, and will create new opportunities to combine large simulations and modeling with experimental facility data analysis. This blueprint for creating an integrated network of computational and experimental facilities will provide an enriched discovery environment and open doors for new scientific communities to access the DOE’s world-leading computing and networking capabilities.

97 MATHEMATICS AND COMPUTING↗

Modeling supercritical CO2 injection induced rupture of a minor fault embedded in a poroelastic layered reservoir-caprock system

CO2 injection for geologic carbon sequestration involves hydromechanical processes that lead to changes in fluid pressure and stresses that can activate existing faults. This paper presents a new method and workflow of modeling fault activation considering more complex three-dimensional geometry of natural faults using the TOUGH-FLAC multiphase fluid flow and geomechanical simulator. In this method and workflow, FLAC3D mechanical interfaces and TOUGH3 finite volume elements are discretized using computer aided design and gridding software along with a tailored mesh translation routine. The method and workflow are demonstrated with a model of a curved minor fault embedded in a poro-elastic layered reservoir-caprock system. The model is used for a comprehensive sensitivity analysis of fault responses to fault length, injection mass rate, injection schedule, well-fault distance, and well locations versus fault location. Four metrics (CO2 plume, shear state of fault, pressure and stress path at fault monitoring points) are selected to assess CO2 migration, pressure change, and the reactivation of faults. The results reveal that CO2 can bypass around the tip of the minor impermeable fault, building up pressure and poro-elastic stress on both sides that tends to impede fault rupture. Our study shows the benefit of carefully designing the injection to achieve the targeted final storage volume, starting at a relatively low rate for considerable time, and then ramping up the injection rate to the full rate of injection. The initial low injection has two distinct benefits: (1) it allows for the formation of an extensive CO2 plume with a much higher mobility through a low viscosity that will result in a lower pressure for a given injection rate, and (2) it allows for gradual build-up of horizontal poro-elastic stress within the reservoir that will tend to impede activation of steeply dipping faults. The injection scenario starting at a low injection rate, denoted here as conservative injection, can significantly reduce the risk of fault activation as high fluid mobility and reservoir strengthening poro-elastic stress has been established long before reaching the peak injection rates. Moreover, simultaneous injection in two injection wells on both sides of fault can provide further reservoir strengthening through poro-elastic stress buildup acting on a fault under normal faulting stress regime. The findings presented in the paper can provide practical and effective guidance on long-term, safe, and reliable geological CO2 storage.

Cao, Meng↗

A Fast-Pass, Desorption Electrospray Ionization Mass Spectrometry Strategy for Untargeted Metabolic Phenotyping

Desorption electrospray ionization mass spectrometry imaging (DESI-MSI) provides direct analytical readouts of small molecules that can be used to characterize the metabolic phenotypes of genetically engineered bacteria. In an effort to accelerate the time frame associated with the screening of mutant libraries, we have developed a high-throughput DESI-MSI analytical workflow implementing a single raster line-scan strategy that facilitates the collection of location-resolved molecular information from engineered strains on a subminute time scale. Evaluation of this “Fast-Pass” DESI-MSI phenotyping workflow on analytical standards demonstrated the capability of acquiring full metabolic profiling information with a throughput of ~40 s per sample. This Fast-Pass strategy was implemented in the analysis of genetically edited Escherichia coli strains that have been engineered to produce various free-fatty acids (FFAs) for applications relevant to biofuels. Due to the untargeted nature of DESI-MSI, the investigation of these strains yielded molecular information for both global metabolites and targeted detection of accumulated bioproducts, allowing simultaneous readouts of strain-specific chemical profiles and comparative measurements of FFA production levels.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Broadening a SARS-CoV-1–neutralizing antibody for potent SARS-CoV-2 neutralization through directed evolution

The emergence of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) underscores the need for strategies to rapidly develop neutralizing monoclonal antibodies that can function as prophylactic and therapeutic agents and to help guide vaccine design. Here, we demonstrate that engineering approaches can be used to refocus an existing antibody that neutralizes one virus but not a related virus. Through a rapid affinity maturation strategy, we engineered CR3022, a SARS-CoV-1–neutralizing antibody, to bind to the receptor binding domain of SARS-CoV-2 with >1000-fold increased affinity. The engineered CR3022 neutralized SARS-CoV-2 and provided prophylactic protection from viral challenge in a small animal model of SARS-CoV-2 infection. Deep sequencing throughout the engineering process paired with crystallographic analysis of engineered CR3022 elucidated the molecular mechanisms by which the antibody can accommodate sequence differences in the epitopes between SARS-CoV-1 and SARS-CoV-2. This workflow provides a blueprint for the rapid broadening of neutralization of an antibody from one virus to closely related but resistant viruses.

Biochemistry & Molecular Biology↗

Dataset for 'Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning', Water 2022

This data package presents forcing data, model code, and model output for classical machine learning models that predict monthly stream water temperature as presented in the manuscript ‘Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning’, Water (Weierbach et al., 2022). Specifically, for input forcing datasets we include two files each generated using the BASIN-3D data integration tool (Varadharajan et al., 2022) for stations in the Pacific Northwest and Mid Atlantic Hydrologic regions. Model code (written in python with the use of jupyter notebooks) includes codes for data preprocessing, training Multiple Linear Regression, Support Vector Regression, and Extreme Gradient Boosted Tree models, and additional notebooks for analysis of model output. We include specific model output files which represent modeling configurations presented in the manuscript also presented in an hdf5 format. Together, these data make up the workflow for predictions across three scenarios (single station, regional, and predictions in unmonitored basins) presented in the manuscript and allow for reproducibility of modeling procedures.

54 ENVIRONMENTAL SCIENCES↗

Comparisons of Nodal diffusion and whole-core transport methods for multiple cycles of a small Light water reacto

As part of a cooperative research and development agreement between the US department of Energy's Oak Ridge National Laboratory and Holtec International subsidiary SMR LLC, core simulator models of the SMR-160, a light water-cooled and -moderated, natural circulation, small modular reactor, were developed and compared. The model results indicate pin-by-pin power histories, critical boron concentration, and other key performance indicators useful for developing multi-cycle core loading patterns. One model uses industry standard nodal methods with a simple thermal-hydraulics solution, and the other uses an advanced deterministic neutronics solver with a coupled subchannel calculation. The goals of the comparison are to provide the reactor designer with a detailed and coupled core physics reference solution, inform the reactor designer of nodal model best practices based on the code-to-code comparison, and set up a workflow for performing subsequent detailed core simulator calculations. The results of this work will be used in the development of coupled neutronic, thermal hydraulic, and fuel performance models for advanced analysis of the SMR-160. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Quantitative 14 N NMR with Monte Carlo Uncertainty Analysis of Nitrate/Nitrite in Alkaline Nuclear Waste

While monitoring of nitrate and nitrite concentrations is important for managing corrosion in nuclear waste systems, existing analytical methods are hindered by turbidity, spectral interference, and delays from sample handling. Here, we demonstrate quantitative 14 N nuclear magnetic resonance (qNMR) spectroscopy as a direct, matrix-tolerant approach for nitrate and nitrite detection at natural abundance. Monte Carlo resampling was integrated into the workflow to quantify random error, establish precision–time tradeoffs, and separate noise-limited uncertainty from systematic bias arising from shimming, transmitter offset, or excitation pulse conditions. Quantification of nitrate and nitrite were validated in controlled alkaline matrix challenges and in 18-component Hanford-type simulants. These results establish 14 N qNMR as a practical, uncertainty-bounded tool for monitoring redox-active nitrogen species in chemically complex environments and provide a generalizable framework for quantitative analysis of quadrupolar nuclei.

Graham, Trent R. [Pacific Northwest National Labor↗

A workflow for segmenting soil and plant X-ray computed tomography images with deep learning in Google’s Colaboratory

X-ray micro-computed tomography (X-ray μCT) has enabled the characterization of the properties and processes that take place in plants and soils at the micron scale. Despite the widespread use of this advanced technique, major limitations in both hardware and software limit the speed and accuracy of image processing and data analysis. Recent advances in machine learning, specifically the application of convolutional neural networks to image analysis, have enabled rapid and accurate segmentation of image data. Yet, challenges remain in applying convolutional neural networks to the analysis of environmentally and agriculturally relevant images. Specifically, there is a disconnect between the computer scientists and engineers, who build these AI/ML tools, and the potential end users in agricultural research, who may be unsure of how to apply these tools in their work. Additionally, the computing resources required for training and applying deep learning models are unique, more common to computer gaming systems or graphics design work, than to traditional computational systems. To navigate these challenges, we developed a modular workflow for applying convolutional neural networks to X-ray μCT images, using low-cost resources in Google’s Colaboratory web application. Here we present the results of the workflow, illustrating how parameters can be optimized to achieve best results using example scans from walnut leaves, almond flower buds, and a soil aggregate. We expect that this framework will accelerate the adoption and use of emerging deep learning techniques within the plant and soil sciences.

59 BASIC BIOLOGICAL SCIENCES↗

Integrated Research Infrastructure Architecture Blueprint Activity (Final Report 2023)

The complexity of scientific pursuits is increasing rapidly with aspects that require dynamic integration of experiment, observation, theory, modeling, simulation, visualization, machine learning (ML), artificial intelligence (AI), and analysis. Research projects across the Department of Energy (DOE) are increasingly data and compute intensive. Innovative research teams are accelerating the pace of discovery by using high-performance computational and data tools in their research workflows and leveraging multiple research infrastructures. Additionally, several recent high-level U.S. government reports underscore the necessity of a new advanced computing ecosystem for international competitiveness and national security. International competitors are moving forward with major research infrastructure integration efforts that seek to capture a competitive advantage in the global innovation race. Owing to its unparalleled constellation of world-class experimental and observational facilities and high-performance and extreme-scale computational, data, and networking infrastructure, DOE is positioned to be a global leader in this new era of integrated science. However, this new integration paradigm will demand continuing evolution to ensure the U.S. remains a global leader in research and innovation. The DOE Office of Science (SC) has seized on the strategic importance of integration and has adopted a vision for Integrated Research Infrastructure (IRI): To empower researchers to meld DOE’s world-class research tools, infrastructure, and user facilities seamlessly and securely in novel ways to radically accelerate discovery and innovation. To respond to the evolving computational requirements of research and the competitive international innovation landscape, experimental facilities could be connected with high performance computing resources for near real-time analysis, and resources should be provided for merging enormous and diverse data for AI/ML techniques and analysis.

97 MATHEMATICS AND COMPUTING↗

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗