Automation and Collaboration in Complex Epidemiological Workflows with OSPREY
GSA and data assimilation with ANL's new workflow engine
Ozik, Jonathan [Argonne National Laboratory]↗
SEARCH · Engineering Papers
Results for “data engineering”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
MCNPy
SAND2026-20425O MCNPy runs and analyzes simulations from MCNP, a software that models radiation transport of neutrons and gamma rays. MCNPy uses Python to start MCNP, retrieve event data files, and convert them into graph structures for detailed analysis. It offers visualization tools, including 2D views of particle histories, making complex simulation data easier to interpret for researchers and engineers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.
Nowack, Aaron [Sandia National Lab. (SNL-CA), Live↗
Computational study on the impact of gasoline-ethanol blending on autoignition and soot/NO x emissions under low-load gasoline compression ignition conditions
Here, in the present work, computational fluid dynamics (CFD) simulations of a single-cylinder gasoline compression ignition (GCI) engine are performed to investigate the impact of gasoline-ethanol blending on autoignition, nitrogen oxide (NO x ), and soot emissions under low-load conditions. In order to represent the test gasoline (RD5-87), a four-component toluene primary reference fuel (TPRF)+ethanol (ETPRF) surrogate (with 10% ethanol by volume; E10) is employed. A three-dimensional (3D) engine CFD model employing finite-rate chemistry with a skeletal kinetic mechanism (including NO x sub-mechanism), adaptive mesh refinement (AMR), and hybrid method of moments (HMOM) is adopted to capture the in-cylinder combustion phenomena and soot/NO x emissions. The engine CFD model is validated against experimental data for three gasoline-ethanol blends: E10, E30 and E100, with varying ethanol content by volume. Model validation is carried out for a broad range of start-of-injection (SOI) timings (−21, −27, −36, and −45 crank angle degrees (°CA) after top-dead-center (aTDC)) with respect to in-cylinder pressure, heat release rate, combustion phasing, NO x and soot emissions. For relatively later injection timings (−21 and −27 °CA aTDC), E30 yields higher amount of soot than E10; while the trend reverses for early injection cases (−36 and −45 °CA aTDC ). On the other hand, E100 yields the lowest amount of soot among all fuels irrespective of SOI timing. Further, E10 shows a non-monotonic trend in soot emissions with SOI timing: SOI-36>SOI-45>SOI-21>SOI-27, while soot emissions from E30 exhibit monotonic decrease with advancing SOI timing. NO x emissions from various fuels follow a trend of E10>E30>E100. On the other hand, NO x emissions increase as SOI timing is advanced for all fuels, with an anomaly for E10 and E100 where NO x decreases when SOI is advanced beyond −36 °CA aTDC. Detailed analysis of the numerical results is performed to investigate the soot/NO x emission trends and elucidate the impact of chemical composition and physical properties on autoignition and emissions characteristics.
Computational fluid dynamics↗
NEON AOP foliar trait maps, maps of model uncertainty estimates, and conifer map, East River, CO 2018
This data package contains mapped trait estimates and their uncertainties, and conifer map, for the National Ecological Observatory Network's Airborne Observation Platform survey data acquired over the Upper East River, Colorado in 2018. For full details, please see associated reference. in brief, trait models were developed independently for needle and non-needle leaf species using partial least squares regression (PLSR) using ground data from additional datasets: doi:10.15485/1618130, doi:10.15485/1618132, and doi:10.15485/1631278, merged with extracted spectral data from doi:10.15485/1618131. We separated vegetated pixels into needle and non-needle classes in order to generate a classification map based on the spectral differences between these leaf types (conifer.tif). We trained a deep learning model with custom architecture, detailed in Chadwick et al. In Press. The model performed with 0.998 true positive rate and 0.982 true negative rate, with ‘positives’ being non-needle identification. We then utilized PLSR to generate models of foliar traits for each leaf type. So that we could also map uncertainty in these predictions, we generated ten different models for needle and non-needle leaf species using different testing holdout sets of discrete sites. Each of these models was developed with a 100-fold cross validation procedure that utilized a 70% training set and 30% validation set with each fold, and then assessed based on the 10% of testing sites that were not included in that model’s development. The mean predicted value across the 10 models is used for the trait estimate in each pixel across the study area. The models are applied according to the leaf type designation in the conifer.tif map. The errors are the standard deviation across the 10 different models developed, with high error suggesting instability in model prediction and areas where values may not be reliable for ecological inference. These maps are only applied to areas with a NDVI > 0.5 to exclude non-vegetated areas. Shade masks could be applied to these data (doi:10.15485/1618131), but have not been for this data package. These data are also available on Google Earth Engine: https://code.earthengine.google.com/?asset=users/kdc/ER_NEON
54 ENVIRONMENTAL SCIENCES↗
MyCrunchGPT: A LLM Assisted Framework for Scientific Machine Learning
Scientific machine learning (SciML) has advanced recently across many different areas in computational science and engineering. Here, the objective is to integrate data and physics seamlessly without the need of employing elaborate and computationally taxing data assimilation schemes. However, preprocessing, problem formulation, code generation, postprocessing, and analysis are still time- consuming and may prevent SciML from wide applicability in industrial applications and in digital twin frameworks. Here, we integrate the various stages of SciML under the umbrella of ChatGPT, to formulate MyCrunchGPT, which plays the role of a conductor orchestrating the entire workflow of SciML based on simple prompts by the user. Specifically, we present two examples that demonstrate the potential use of MyCrunchGPT in optimizing airfoils in aerodynamics, and in obtaining flow fields in various geometries in interactive mode, with emphasis on the validation stage. To demonstrate the flow of the MyCrunchGPT, and create an infrastructure that can facilitate a broader vision, we built a web app based guided user interface, that includes options for a comprehensive summary report. The overall objective is to extend MyCrunchGPT to handle diverse problems in computational mechanics, design, optimization and controls, and general scientific computing tasks involved in SciML, hence using it as a research assistant tool but also as an educational tool. While here the examples focus on fluid mechanics, future versions will target solid mechanics and materials science, geophysics, systems biology, and bioinformatics.
97 MATHEMATICS AND COMPUTING↗
SNL will be able to provide well-calibrated models to weapons systems analysts by integrating an engine for constitutive model calibration with the GRANTA materials database
Researchers at Sandia National Laboratories have integrated the GRANTA materials database with the MatCal calibration engine to calibrate material models from characterization data. GRANTA is gaining acceptance across the NNSA Tri-lab complex and is being populated with weapons-specific test data by Sandia experimentalists. To use that data to create material models for use by weapons systems analysts, MatCal has been enabled import calibration data and test conditions from GRANTA to quickly and reproducibly produce a calibrated set of parameters for a given constitutive model. The team is currently working to store the parameters characterizing material behavior in GRANTA to make them accessible by all weapons analysts.
36 MATERIALS SCIENCE↗
LSST Undergraduate Internships at Fermilab
The LSST Data Science for Undergraduate summer internship program focuses on data-driven astronomy for undergraduates at Fermilab’s Cosmic Physics Center. The internship activities focus on the development and implementation of data-driven investigatory techniques that will aid in LSST science, as well as prepare the undergraduates for future work in LSST. In particular, the internship activities include a number of opportunities for undergraduates to learn other skills critical for working on LSST --- data science research techniques, software development and engineering, science communication training.
79 ASTRONOMY AND ASTROPHYSICS↗
Translator Plan: A Coordinated Vision for Fiscal Years 2023-2025
Translators serve a unique role in the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) user facility, offering scientific input through various leadership and service roles. The Translators direct the creation of value-added products (VAPs) and analysis tools that make ARM measurements more accessible to the scientific community. Translators also serve as liaisons between users and the ARM infrastructure, collecting information about priorities and communicating ARM data and services. A key group focus is supporting the DOE Atmospheric System Research (ASR) program scientists and ASR’s efforts towards a process-level understanding of cloud-aerosol interactions, and in reducing uncertainty in global climate model projections. The ARM Translator Group (Table 1) consists of the five Translators, a representative of software development, and one from the Data Quality Office (DQO). Additionally, the ARM Engineering and Process Manager participates in this group and provides input and direction from ARM and its programmatic priorities.
54 ENVIRONMENTAL SCIENCES↗
Smart Contract Architectures and Templates for Blockchain-based Energy Markets (V.1.0)
Within the field of Transactive Energy Systems (TES), there is an active need for tools that can support and accelerate the development of these new grid solutions. Among the many tools available, blockchain stands out as a viable instrument that can help researchers develop decentralized, autonomous, and tamper-resistant grid applications. In this work, we explore the use of smart contracts (SCs), a subset of blockchain technology, and analyze their applicability to facilitating the implementation of TES solutions. In particular, we focus on presenting areas of opportunity and potential drawbacks, along with use cases that can benefit from this technology building upon previous research developed by Pacific Northwest National Laboratory and other research organizations. This work builds upon the fundamentals of TES and smart contract technology to develop a series of software templates that can be used by industry to build TES-oriented grid solutions. These templates are intended to be platform agnostic and take into consideration the unique properties of SCs and distributed ledger storage mechanisms to ensure actual code implementations remain aware of the limitations of the technology. The proposed templates have the potential to enable software architects to mix and match components to satisfy their application requirements, thereby reducing the number of resources required to implement blockchain-based solutions. These templates are divided into two main components—data and behavioral models. The data models are intended to help software engineers represent the underlying grid objects along with their properties in a ledger-based storage system. The behavioral models are used to describe the processes and actions that actors within a system must perform to achieve a given outcome such as registering an asset, placing a bid, and performing bid clearances. These two components are documented in a Unified Modeling Language (UML) format and are intended for use in SC-based implementations, with special behavioral considerations to account for the asynchronous properties of the underlying ledger and the typical execution model of smart contracts. Finally, future research ideas and potential extensions to this work are discussed. In particular, known limitations and potential improvements of the developed product are identified and expected to be addressed in future revisions of the template model.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Uncertainty Quantification for Component Modeling Using the Discrete-Direct Approach
Threaded fastener behavior can be an important aspect of complex component and system behavior, but there is no one-size-fits-all finite element analysis technique. Proper modeling of threaded fastener joints requires careful consideration of many details, from test setup and data acquisition to constitutive modeling and uncertainty quantification approaches. This report details analysis of a “mini-radax” bolted-joint exemplar where a Discrete-Direct uncertainty quantification approach is employed to evaluate margin of the component. The mini-radax geometry is tested to failure on a drop table, and single-coupon tests of individual fasteners serve as foundational data for the analysis. Analysis predictions complement the test data well and provide additional context for engineering decision-making.
42 ENGINEERING↗
Graph-Based Modeling for the Detection and Tracking of Sarin-Surrogate-Induced Neurotoxicity Using a Human-Relevant, In-Vitro Brain Model
Organophosphorus (OP) nerve agents are a chemical threat to the United States, to the civilian population (e.g., pesticides) and historically weaponized (e.g., sarin) as chemical warfare agents. The unprecedented, accelerated process from “bench-to-bedside” during the SARSCov2 pandemic has made it clear that technology and tools need to be readily available for immediate response. Advances in human organ tissue mimetic systems are a promising technology to evaluate the human-relevant response in vitro for basic and applied research and drug screening. In particular, current brain microphysiological systems (MPS) have the capability to monitor and detect changes in engineered human neural circuit activity. However, current data analytics approaches for these systems lack the granularity to functionally detect and distinguish the different mechanisms that occur in the brain following neurotoxicity, injury, and disease. The goal of this project was to advance the computational analytical capabilities of the brain MPS to detect functional changes in neural circuit structure at different stages of Sarin surrogate-induced neurotoxicity. We developed graph-based models to (1) identify the composition of the neural circuit structure; (2) detect and monitor how this structure changes following sarin-induced neurotoxicity; and (3) evaluate the analytical pipeline using known/promising oxime reactivators. Through experiments on the bMPS where in vitro neuronal cultures were exposed to a sarin surrogate, we demonstrated the capabilities of our computational pipeline to identify different responses in the functional networks of brain cells exposed to low and high concentrations of the nerve agent. We identified a biphasic response of human neural network activity following exposure to a sarin-surrogate that had not been reported in the literature before. The graph-based models and software developed in this project can be used for future studies that leverage the brain MPS technology, such as treatment efficacy assessment.
59 BASIC BIOLOGICAL SCIENCES↗
Bridging Cloud and Edge Computing at NREL Using CONNECT: Cloud Optimized Networking for Next-Gen Edge Computing Technologies [Slides]
CONNECT is an innovative on-premise hardware and software solution that integrates edge and cloud computing infrastructure at NREL. Built on the AWS Greengrass middleware and leveraging the MQTT protocol, CONNECT enables real-time data streaming from IoT devices and gateways to both cloud and local services, empowering researchers to rapidly capture, analyze, and act upon edge-generated data while leveraging cloud capabilities. The platform addresses research infrastructure challenges by providing a pre-approved platform which is already configured with the correct networking and cybersecurity baselines thus eliminating procurement delays and enabling on-demand availability. CONNECT's hybrid architecture efficiently manages burstable workloads, allowing research teams to dynamically scale computational capacity, handle peak data loads, and reduce operational bottlenecks. Advanced capabilities include built-in GPU support for executing machine learning models which enables low-latency inference at the edge from models trained in the cloud. This architecture supports real-time analytics and filtering, providing a mechanism to allow only transmitting and processing high-value data. Cloud-based configuration management permits engineers to manage on-premise systems remotely, optimizing operational efficiency. By bridging edge and cloud computing, CONNECT provides NREL researchers with a flexible, scalable platform that accelerates scientific discovery while maintaining robust security and performance standards.
97 MATHEMATICS AND COMPUTING↗
Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems
Physics-informed machine learning (PIML) is a set of methods and tools that systematically integrate machine learning (ML) algorithms with physical constraints and abstract mathematical models developed in scientific and engineering domains. As opposed to purely data-driven methods, {PIML} models can be trained from additional information obtained by enforcing physical laws such as energy and mass conservation. More broadly, {PIML} models can include abstract properties and conditions such as stability, convexity, or invariance. The basic premise of {PIML} is that the integration of ML and physics can yield more effective, physically consistent, and data-efficient models. This paper aims to provide a tutorial-like overview of the recent advances in {PIML} for dynamical system modeling and control. Specifically, the paper covers an overview of the theory, fundamental concepts and methods, tools, and applications on topics of: 1) physics-informed learning for system identification; 2) physics-informed learning for control; 3) analysis and verification of {PIML} models; and 4) physics-informed digital twins. The paper is concluded with a perspective on open challenges and future research opportunities.
Nghiem, Truong↗
FALCON: Framework for Anomaly Detection in Industrial Control Systems
Industrial Control Systems (ICS) are used to control physical processes in critical infrastructure. These systems are used in a wide variety of operations such as water treatment, power generation and distribution, and manufacturing. While the safety and security of these systems are of serious concern, recent reports have shown an increase in targeted attacks aimed at manipulating physical processes to cause catastrophic consequences. This trend emphasizes the need for algorithms and tools that provide resilient and smart attack detection mechanisms to protect ICS. In this paper, we propose an anomaly detection framework for ICS based on a deep neural network. The proposed methodology uses dilated convolution and long short-term memory (LSTM) layers to learn temporal as well as long term dependencies within sensor and actuator data in an ICS. The sensor/actuator data are passed through a unique feature engineering pipeline where wavelet transformation is applied to the sensor signals to extract features that are fed into the model. Additionally, this paper explores four variations of supervised deep learning models, as well as an unsupervised support vector machine (SVM) model for this problem. The proposed framework is validated on Secure Water Treatment testbed results. This framework detects more attacks in a shorter period of time than previously published methods.
97 - MATHEMATICS AND COMPUTING↗
Carbon Mitigation Potential of Heat Pump Integrated with Thermal Storage for Grid-Interactive Residential Buildings
Residential buildings’ heating and cooling loads are associated with significant carbon emissions and peak electricity demand. Phase change material (PCM) based thermal energy storage (TES) can be used for space heating and cooling by embedding into the heat pump equipment. Past work on TES integrated with heat pumps (HP) has demonstrated significant load shifting and economic benefits. However, the potential for TES to reduce carbon emissions has not been widely explored. This study evaluates carbon mitigation potential of an ice-based TES coupled to HP (HP-TES) based on a simple rule-based control strategy accounting for electric grid emissions data. A vapor compression HP model using Engineering Equation Solver (EES). The modeled HP-TES system for single-family residential building demonstrates decreased carbon emissions with reduced peak utility cost.
Sultan, Sara↗
Resilience Metrics for Solar Photovoltaics
This workshop presentation proposes the development of solar photovoltaic (PV) system resilience metrics and a methodology and framework for evaluation of PV resilience metrics. PV resilience metrics are needed to establish a consistent basis for reporting, evaluation, and data collection by industry, evaluate performance of PV systems that have been subject to natural hazards, correlating resilience to system attributes, and predicting resilience for any PV system. PV resilience metrics can guide improved system design, standards, and insurance coverage. Establishing consistent metrics can foster data collection on impacts of natural hazards on PV systems.
14 SOLAR ENERGY↗
AutoCheck: Automatically Identifying Variables for Checkpointing by Data Dependency Analysis
Checkpoint/Restart (C/R) has been widely deployed in numerous HPC systems, Clouds, and industrial data centers, which are typically operated by system engineers. Nevertheless, there is no existing approach that helps system engineers without domain expertise and domain scientists without system fault tolerance knowledge identify those critical variables accounted for correct application execution restoration in a failure for C/R. To address this problem, we propose an analytical model and a tool (AutoCheck) that can automatically identify critical variables to checkpoint for C/R. AutoCheck relies on first, analytically tracking and optimizing data dependency between variables and other application execution state, and second, a set of heuristics that identify critical variables for checkpointing from the refined data dependency graph (DDG). AutoCheck allows programmers to pinpoint critical variables to checkpoint quickly within a few minutes. We evaluate AutoCheck on 13 representative HPC benchmarks, demonstrating that AutoCheck can efficiently identify correct critical variables to checkpoint.
HPC↗
MARVEL Reactor Digital Engineering Developments
The MARVEL reactor project has served to introduce a new generation of engineers to the processes required to transform a reactor design from simply an idea on paper into what will be an approved, constructed, and operational nuclear power system. Much as there have been advances in materials, analysis, and evaluation methodologies over the 50 years since the last reactor was built at INL, so too has the technology for managing the engineering process itself advanced. Digital Engineering tools and methods provide improved coordination between previously siloed engineering disciplines, reduced burdens of non-value-added data transcription processes and bring forward insights and improvements that might otherwise fall later in the design stage, where changes are much more costly. While the tools and techniques to support the full digital engineering vision are not yet complete, the MARVEL design processes provide valuable demonstrations and validations of key aspects and illuminate further areas for implementation by subsequent projects.
21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗