Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Big data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Obtaining and Managing Answer Quality for Online Data-Intensive Services

Online data-intensive (OLDI) services use anytime algorithms to compute over large amounts of data and respond quickly. Interactive response times are a priority, so OLDI services parallelize query execution across distributed software components and return best effort answers based on the data so far processed. Omitted data from slow components could lead to better answers, but tracing online how much better the answers could be is difficult. Here, we introduce Ubora, a design method to measure the effect of slow-running components on the quality of answers. Ubora randomly samples online queries and executes them a second time. The first online execution omits data from slow components and provides interactive answers. The second execution uses mature results from intermediate components completed after the online execution finishes. Ubora uses memoization to speed up mature executions by replaying network messages exchanged between components. Our systems-level implementation works for a wide range of services, including Hadoop/Yarn, Apache Lucene, the EasyRec Recommendation Engine, and the OpenEphyra question-answering system. Ubora computes answer quality with more mature executions per second than competing approaches that do not use memoization. With Ubora, we illustrate that answer quality is effective at guiding online admission control. While achieving the same answer quality on high-priority queries, our adaptive controller had 55% higher peak throughput on low-priority queries than a competing controller guided by the rate of timeouts.

answer quality↗
DOE OSTI2020

Software-Defined Network for End-to-end Networked Science at the Exascale

Domain science applications and workflow processes are currently forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with the network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. The work we presen here is motivated by a vision for a new smart network and smart application ecosystem that will provide a more deterministic and interactive environment for domain science workflows. The Software-Defined Network for End-to-end Networked Science at Exascale (SENSE) system includes a model-based architecture, implementation, and deployment which enables automated end-to-end network service instantiation across administrative domains. An intent based interface allows applications to express their high-level service requirements, an intelligent orchestrator and resource control systems allow for custom tailoring of scalability and real-time responsiveness based on individual application and infrastructure operator requirements. This allows the science applications to manage the network as a first-class schedulable resource as is the current practice for instruments, compute, and storage systems. Deployment and experiments on production networks and testbeds have validated SENSE functions and performance. Emulation based testing verified the scalability needed to support research and education infrastructures. Key contributions of this work include an architecture definition, reference implementation, and deployment. This provides the basis for further innovation of smart network services to accelerate scientific discovery in the era of big data, cloud computing, machine learning and artificial intelligence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Applications and Techniques for Fast Machine Learning in Science

In this community review report, we discuss applications and techniques for fast machine learning (ML) in science—the concept of integrating powerful ML methods into the real-time experimental data processing loop to accelerate scientific discovery. The material for the report builds on two workshops held by the Fast ML for Science community and covers three main areas: applications for fast ML across a number of scientific domains; techniques for training and implementing performant and resource-efficient ML algorithms; and computing architectures, platforms, and technologies for deploying these algorithms. We also present overlapping challenges across the multiple scientific domains where common solutions can be found. This community report is intended to give plenty of examples and inspiration for scientific discovery through integrated and accelerated ML solutions. This is followed by a high-level overview and organization of technical advances, including an abundance of pointers to source material, which can enable these breakthroughs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Development of Explainable, Knowledge-Guided AI Models to Enhance the E3SM Land Model Development and Uncertainty Quantification

Focal Area(s): (2)Predictive modeling using AI techniques and AI-derived model components; use of AI and other tools to design a prediction system comprising of a hierarchy of models. (3) Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge- guided AI. Science Challenge: The Energy Exascale Earth System Model (E3SM) is a fully coupled, state-of-the-science Earth system model that uses code optimized for DOE's advanced computers to address the most critical scientific questions facing our nation and society (Golaz et al., 2019). The E3SM Land model (ELM) is designed to understand how the changes in terrestrial land surfaces will interact with other Earth system components and has been used to understand hydrologic cycles, biogeophysics, and ecosystem dynamics. In spite of great successes, the ELM has several known issues that restrain rapid improvements. For example, the ELM uses equilibrium models to simulate dynamic land-climate interactions and it requires long model spin-up time to identify suitable initial conditions for transient simulations. The ELM lacks built-in uncertainty mechanisms that can improve the robustness of model predictions. The ELM is a holistic, deterministic model system with a rigid design, and in many situations, it is hard to modify the ELM system to incorporate new theory/hypothesis and new data across scales to address emerging science problems (such as predicting the impacts of water cycle extremes). In addition, The ELM is technically optimized for traditional CPU-centric computers and it cannot fully utilize the current and incoming leadership computers for model simulations and uncertainty quantification (UQ). The success of artificial intelligence (AI) has inspired scientists to use AI models to discover intrinsic features from simulation data (Chattopadhyay et al., 2020) and observational data (Reichstein et al., 2019) to gain further process understanding of Earth science problems. However, autonomous AI model training through deep learning usually requires a huge amount of annotated data. To overcome the limitations from the data and computing resources, knowledge-guided AI models are necessary where human-knowledge is ingested in model construction (Banino et al., 2018) and training process (Silver et al., 2016) for efficient learning. Herein, we present a new way that leverages the process understanding from the ELM to guide AI model development for the ELM enhancement and UQ. We hope this study can inspire further Earth and environmental system model developments and transformations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Impact of extraneous mispositioned events on motion-corrected brain SPECT images of freely moving animals

Purpose: Single photon emission computed tomography (SPECT) brain imaging of freely moving small animals would allow a wide range of important neurological processes and behaviors to be studied, which are normally inhibited by anesthetic drugs or precluded due to the animal being restrained. While rigid body motion of the head can be tracked and accounted for in the reconstruction, activity in the torso may confound brain measurements, especially since motion of the torso is more complex (i.e., nonrigid) and not well correlated with that of the head. The authors investigated the impact of mispositioned events and attenuation due to the torso on the accuracy of motion corrected brain images of freely moving mice. Methods: Monte Carlo simulations of a realistic voxelized mouse phantom and a dual compartment phantom were performed. Each phantom comprised a target and an extraneous compartment which were able to move independently of each other. Motion correction was performed based on the known motion of the target compartment only. Two SPECT camera geometries were investigated: a rotating single head detector and a stationary full ring detector. The effects of motion, detector geometry, and energy of the emitted photons (hence, attenuation) on bias and noise in reconstructed brain regions were evaluated. Results: The authors observed two main sources of bias: (a) motion-related inconsistencies in the projection data and (b) the mismatch between attenuation and emission. Both effects are caused by the assumption that the orientation of the torso is difficult to track and model, and therefore cannot be conveniently corrected for. The motion induced bias in some regions was up to 12% when no attenuation effects were considered, while it reached 40% when also combined with attenuation related inconsistencies. The detector geometry (i.e., rotating vs full ring) has a big impact on the accuracy of the reconstructed images, with the full ring detector being more advantageous. Conclusions: Motion-induced inconsistencies in the projection data and attenuation/emission mismatch are the two main causes of bias in reconstructed brain images when there is complex motion. It appears that these two factors have a synergistic effect on the qualitative and quantitative accuracy of the reconstructed images.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Pass-efficient methods for compression of high-dimensional turbulent flow data

The future of high-performance computing, specifically on future Exascale computers, will presumably see memory capacity and bandwidth fail to keep pace with data generated, for instance, from massively parallel partial differential equation (PDE) systems. Current strategies proposed to address this bottleneck entail the omission of large fractions of data, as well as the incorporation of in situ compression algorithms to avoid overuse of memory. To ensure that post-processing operations are successful, this must be done in a way that a sufficiently accurate representation of the solution is stored. Moreover, in situations where the input/output system becomes a bottleneck in analysis, visualization, etc., or the execution of the PDE solver is expensive, the number of passes made over the data must be minimized. In the interest of addressing this problem, this work focuses on the utility of pass-efficient, parallelizable, low-rank, matrix decomposition methods in compressing high-dimensional simulation data from turbulent flows. Additionally, a particular emphasis is placed on using coarse representation of the data – compatible with the PDE discretization grid – to accelerate the construction of the low-rank factorization. This includes the presentation of a novel single-pass matrix decomposition algorithm for computing the so-called interpolative decomposition. The methods are described extensively and numerical experiments on two turbulent channel flow data are performed. In the first (unladen) channel flow case, compression factors exceeding 400 are achieved while maintaining accuracy with respect to first- and second-order flow statistics. In the particle-laden case, compression factors of 100 are achieved and the compressed data is used to recover particle velocities. These results show that these compression methods can enable efficient computation of various quantities of interest in both the carrier and disperse phases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2014

A Framework for Lattice QCD Calculations on GPUs

Efficient calculation of the greatest common divisor (GCD) for big integers each whose number of bits is greater than or equal to 1024 has drawn a considerable amount of attention because it can be used to detect a weakness of the RSA security infrastructure. This paper presents a parallel binary GCD algorithm and its implementation for big integers on the Intel Xeon Phi coprocessor. This algorithm is capable of computing GCDs efficiently on many pairs of big integers in parallel by utilizing all cores on a Xeon Phi coprocessor as well as taking advantage of all vector processing units of the coprocessor to speed up critical integer operations within the algorithm. Using 240 threads on a Xeon Phi coprocessor to carry out GCD calculations for a large amount of 2048-bit integers, the implementation achieves the speedup of 30 times over a sequential binary GCD algorithm implementation on a single CPU core, and it delivers twice amount of performance in comparison to the same sequential binary GCD implementation running on 240 threads of the Xeon Phi.

Winter, F. T.↗
DOE OSTI2024

Improving the Concrete Crack Detection Process via a Hybrid Visual Transformer Algorithm

Inspections of concrete bridges across the United States represent a significant commitment of resources, given their biannual mandate for many structures. With a notable number of aging bridges, there is an imperative need to enhance the efficiency of these inspections. This study harnessed the power of computer vision to streamline the inspection process. Our experiment examined the efficacy of a state-of-the-art Visual Transformer (ViT) model combined with distinct image enhancement detector algorithms. We benchmarked against a deep learning Convolutional Neural Network (CNN) model. These models were applied to over 20,000 high-quality images from the Concrete Images for Classification dataset. Traditional crack detection methods often fall short due to their heavy reliance on time and resources. This research pioneers bridge inspection by integrating ViT with diverse image enhancement detectors, significantly improving concrete crack detection accuracy. Notably, a custom-built CNN achieves over 99% accuracy with substantially lower training time than ViT, making it an efficient solution for enhancing safety and resource conservation in infrastructure management. These advancements enhance safety by enabling reliable detection and timely maintenance, but they also align with Industry 4.0 objectives, automating manual inspections, reducing costs, and advancing technological integration in public infrastructure management.

42 ENGINEERING↗
DOE OSTI2026

Causality-respecting adaptive refinement for PINNs: enabling precise interface evolution in phase field modeling

Physics-informed neural networks (PINNs) have emerged as a powerful tool for solving physical systems described by partial differential equations (PDEs). However, their accuracy in dynamical systems, particularly those involving sharp moving boundaries with complex initial morphologies, remains a challenge. Here, this study introduces an approach combining residual-based adaptive refinement (RBAR) with causality-informed training to enhance the performance of PINNs in solving spatio-temporal PDEs. Our method employs a three-step iterative process: initial causality-based training, RBAR-guided domain refinement, and subsequent causality training on the refined mesh. Applied to the Allen-Cahn equation, a widely-used model in phase field simulations, our approach demonstrates significant improvements in solution accuracy and computational efficiency over traditional PINNs. Notably, we observe an ‘overshoot and relocate’ phenomenon in dynamic cases with complex morphologies, showcasing the method’s adaptive error correction capabilities. This synergistic interaction between RBAR and causality training enables accurate capture of interface evolution, even in challenging scenarios where traditional PINNs fail. Our framework not only resolves the limitations of uniform refinement strategies but also provides a generalizable methodology for solving a broad range of spatio-temporal PDEs. The enhanced performance of the RBAR–causality combined framework demonstrates its strong potential for advancing PINN-based modeling of physical systems characterized by complex, evolving interfaces.

Allen-Cahn equations↗
DOE OSTI2012

Tension in the void: cosmic rulers strain inhomogeneous cosmologies

New constraints on inhomogeneous Lemaitre-Tolman-Bondi (LTB) models alternative to Dark Energy are presented, focusing on adiabatic profiles with space-independent Big Bang and baryon fraction. The Baryon Acoustic Oscillation (BAO) scale at early times is computed in terms of the asymptotic value and then projected to different redshifts by following the geodesics of the background metric. Additionally, a model-independent method to constraint the local expansion rate using a prior on supernovae luminosity is presented. Cosmologies described by an adiabatic GBH matter profile with Ω{sub out} = 1 and Ω{sub out} ≤ 1 are investigated using a Markov Chain Monte Carlo analysis including the latest BAO data from the WiggleZ collaboration and the local expansion rate from the Hubble Space Telescope, together with Union2 type Ia supernovae data and the position and height of the Cosmic Microwave Background acoustic peaks. The addition of BAO data at higher redshifts increases considerably their constraining power and represents a new drawback for this type of models, yielding a value of the local density parameter Ω{sub in}∼>0.2 which is 3σ apart from the value Ω{sub in}∼<0.15 found using supernovae. The situation does not improve if the asymptotic flatness assumption is dropped, and a Bayesian analysis shows that constrained GBH models are ruled out at high confidence. We emphasize that these are purely geometric probes, that only recently have become sufficiently constraining to independently rule out the whole class of adiabatic LTB models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Tikiri—Towards a lightweight blockchain for IoT

Internet of Things (IoT) platforms have been deployed in several domains to enhance efficiency of business process and improve productivity. Most IoT platforms comprise of heterogeneous software and hardware components which can potentially introduce security and privacy challenges. Blockchain technology has been proposed as one of the solutions to realize IoT security by leveraging the (a) Immutable ledger, (b) Decentralized architecture and (c) Strong cryptography primitives. However, integrating blockchain platforms with IoT based applications presents several challenges due to lack of (a) acceptable performance on resource-constrained devices, (b) high transaction throughput, (c) keyword-based search and retrieve, (d) transaction back pressure operations, and (e) real-time response. In this paper, we propose a lightweight blockchain platform, “Tikiri”, for resource-constrained IoT devices. Tikiri uses Apache Kafka for the consensus and proposes new blockchain architecture to handle real-time transaction execution on the blockchain. Tikiri is characterized by functional programming and actor-based smart contract platform that realizes concurrent execution of transactions in the blockchain. Tikiri realizes a lightweight and scalable blockchain that can provides performance on the resource-constrained IoT devices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Comprehensive Land Use and Environmental Stewardship

Comprehensive Land Use and Environmental Stewardship (CLUES) Report serves as a summary document of the land use and environmental stewardship activities occurring on the Idaho National Laboratory (INL) Site (Desert) and the Research and Education Campus (REC) within Idaho Falls. Land and facility use planning and decisions at the INL Site are guided by a comprehensive planning process in accordance with the United States (U.S.) Department of Energy (DOE) Order 430.1C, “Real Property Asset Management,” which states "Establish a data-driven, risk-informed, performance-based approach to the life-cycle management of real property assets that aligns the real property portfolio with DOE mission needs; acquire, manage, positively account for, and dispose of real property assets in a safe, secure, cost-effective, and sustainable manner; and ensure the real property portfolio is appropriately sized, aligned, and in the proper condition to support efficient mission execution." Land use planning, like Campus Master Planning and 5-Year Facility Planning, provides a means for better, more sustainable use of the INL Site in a coordinated effort to ensure current and future mission needs are met, including acquisition, recapitalization, maintenance, disposition, real property utilization and long-term stewardship. This document and all functions of INL are guided by the DOE Vision for INL and the INL Mission and builds on the baseline established in the FY 2015 CLUES Report. However, it delivers a revised structure with focus on new resource management zones, which provide organization of key management considerations and access restrictions to optimize land use and environmental stewardship. A new set of thematic Guiding Principles presented in this report provide the intent and sustainable management direction to protect the INL Site natural environment. They demonstrate that the mission and vision of DOE and INL can be realized with inclusion of first of a kind technology, private sector development, and globally recognized testing and demonstration. This CLUES Report encourages comprehensive management decision-making with additional resource discussions for sustainability, the built environment, and the ecological landscape at the INL Site. Enhanced resource considerations and trends emphasize the importance of air, land use, environmental, subsurface, and cultural resources. The INL Site supports exceptional and interdependent resources. A diversity of bat species are accommodated by culturally significant caves distributed around the Site. Big game species like elk, deer, and moose seek vegetation communities which are protected by long-term stewardship and monitoring programs.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

System Engineers and Decisions: It?s All about Knowledge

In order to guarantee that a system meets adequate levels of reliability and availability, system performances are continuously monitored and analyzed thanks to the technological advancements driving the Industry 4.0 revolution. An Industry 4.0 approach is typically based on advanced statistical, big data mining, machine learning, and internet-of-things methods designed to detect anomalies in the behavior of system, detect the most likely failure modes, and provide indications to system engineers on when maintenance activities should be performed before system performance are deemed unacceptable (which can be generated by diagnostic and prognostic methods). However, these analyses, which are designed to automatize and increase the efficacy of the system maintenance program, require large amount of data which can come in various forms: numeric, textual, images, sounds etc. Such data constitutes the historic knowledge benchmark to track system performances and support system engineer decisions. Here we claim that data is not sufficient to support this kind of analyses when applied to systems characterized by complex architectures and behaviors. Robust system engineer decisions require the ability to understand the system operational context that lies behind the observed data elements. In this respect, system models are in fact necessary to “put data in context” and capture relationships between data elements. Industry 4.0 methods require in fact contextual knowledge as a basis upon which hypotheses can be generated and assumptions tested. In our view, for complex systems, model-based system engineering (MBSE) models can afford this contextual knowledge, as they are typically used to describe systems architecture and dynamic behaviors. System knowledge is here intended as the blending of collected data and system architecture which takes the form of a “knowledge graph”. A knowledge graph is a database which consists of a large set of nodes (in our case an entity can be either a data or an MBSE element) which are linked to each other. The types of nodes and links follow a pre-defined topology, sometimes also refers as an ontology, that is designed to fit the actual decisions that needs to be performed. We show here how a knowledge graph can be defined to support system engineer maintenance decisions and how the same graph can be built based on system MBSE models and pre-processed data from numeric (through anomaly detections and diagnostic methods) and textual elements (through technical language processing TLP).

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2012

A phantom for testing of 4D-CT for radiotherapy of small lesions

Purpose: The use of time-resolved four-dimensional computed tomography (4D-CT) in radiotherapy requires strict quality assurance to ensure the accuracy of motion management protocols. The aim of this work was to design and test a phantom capable of large amplitude motion for use in 4D-CT, with particular interest in small lesions typical for stereotactic body radiotherapy. Methods: The phantom of 'see-saw' design is light weight, capable of including various sample materials and compatible with several surrogate marker signal acquisition systems. It is constructed of polymethylmethacrylate (Perspex) and its movement is controlled via a dc motor and drive wheel. It was tested using two CT scanners with different 4D acquisition methods: the Philips Brilliance Big Bore CT (helical scan, pressure belt) and a General Electric Discovery STE PET/CT (axial scan, infrared marker). Amplitudes ranging from 1.5 to 6.0 cm and frequencies of up to 40 cycles per minute were used to study the effect of motion on image quality. Maximum intensity projections (MIPs), as well as average intensity projections (AIPs) of moving objects were investigated and their quality dependence on the number of phase reconstruction bins assessed. Results: CT number discrepancies between moving and stationary objects were found to have no systematic dependence on amplitude, frequency, or specific interphase variability. MIP-delineated amplitudes of motion were found to match physical phantom amplitudes to within 2 mm for all motion scenarios tested. Objects undergoing large amplitude motions (>3.0 cm) were shown to cause artefacts in MIP and AIP projections when ten phase bins were assigned. This problem can be mitigated by increasing the number of phase bins in a 4D-CT scan. Conclusions: The phantom was found to be a suitable tool for evaluating the image quality of 4D-CT motion management technology, as well as providing a quality assurance tool for intercenter/intervendor testing of commercial 4D-CT systems. When imaging objects with large amplitudes, the completeness criterion described here indicates the number of phase bins required to prevent missing data in MIPs and AIPs. This is most relevant for small lesions undergoing large motions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2014

Multi-wavelength high-resolution observations of a small-scale emerging magnetic flux event and the chromospheric and coronal response

State-of-the-art solar instrumentation is now revealing magnetic activity of the Sun with unprecedented temporal and spatial resolutions. Observations with the 1.6 m aperture New Solar Telescope (NST) of the Big Bear Solar Observatory are making next steps in our understanding of the solar surface structure. Granular-scale magnetic flux emergence and the response of the solar atmosphere are among the key research topics of high-resolution solar physics. As part of a joint observing program with NASA's Interface Region Imaging Spectrograph (IRIS) mission on 2013 August 7, the NST observed active region NOAA 11,810 in the photospheric TiO 7057 Å band with a resolution of pixel size of 0.''034 and chromospheric He I 10830 Å and Hα 6563 Å wavelengths. Complementary data are provided by the Solar Dynamics Observatory (SDO) and Hinode space-based telescopes. The region displayed a group of solar pores, in the vicinity of which we detect a small-scale buoyant horizontal magnetic flux tube causing granular alignments and interacting with the preexisting ambient field in the upper atmospheric layers. Following the expansion of distorted granules at the emergence site, we observed a sudden appearance of an extended surge in the He I 10830 Å data (bandpass of 0.05 Å). The IRIS transition region imaging caught ejection of a hot plasma jet associated with the He I surge. The SDO/HMI data used to study the evolution of the magnetic and Doppler velocity fields reveal emerging magnetic loop-like structures. Hinode/Ca II H and IRIS filtergrams detail the connectivities of the newly emerged magnetic field in the lower solar chromosphere. From these data, we find that the orientation of the emerging magnetic field lines from a twisted flux tube formed an angle of ∼45° with the overlying ambient field. Nevertheless, the interaction of emerging magnetic field lines with the pre-existing overlying field generates high-temperature emission regions and boosts the surge/jet production. The localized heating is detected before and after the first signs of the surge/jet ejection. We compare the results with previous observations and theoretical models and propose a scenario for the activation of plasma jet/surges and confined heating triggered by buoyant magnetic flux tubes rising up into a magnetized upper environment. Such process may play a significant role in the mass and energy flow from the interior to the corona.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Investigating resource-efficient neutron/gamma classification ML models targeting eFPGAs

There has been considerable interest and resulting progress in implementing machine learning (ML) models in hardware over the last several years from the particle and nuclear physics communities. A big driver has been the release of the Python package, hls4ml, which has enabled porting models specified and trained using Python ML libraries to register transfer level (RTL) code. So far, the primary end targets have been commercial field-programmable gate arrays (FPGAs) or synthesized custom blocks on application specific integrated circuits (ASICs). However, recent developments in open-source embedded FPGA (eFPGA) frameworks now provide an alternate, more flexible pathway for implementing ML models in hardware. These customized eFPGA fabrics can be integrated as part of an overall chip design. In general, the decision between a fully custom, eFPGA, or commercial FPGA ML implementation will depend on the details of the end-use application. In this work, we explored the parameter space for eFPGA implementations of fully-connected neural network (fcNN) and boosted decision tree (BDT) models using the task of neutron/gamma classification with a specific focus on resource efficiency. We used data collected using an AmBe sealed source incident on Stilbene, which was optically coupled to an OnSemi J-series silicon photomultiplier (SiPM) to generate training and test data for this study. We investigated relevant input features and the effects of bit-resolution and sampling rate as well as trade-offs in hyperparameters for both ML architectures while tracking total resource usage. The performance metric used to track model performance was the calculated neutron efficiency at a gamma leakage of 10 -3 . The results of the study will be used to aid the specification of an eFPGA fabric, which will be integrated as part of a test chip.

47 OTHER INSTRUMENTATION↗
DOE OSTI2015

SU-E-J-128: Two-Stage Atlas Selection in Multi-Atlas-Based Image Segmentation

Purpose: In the new era of big data, multi-atlas-based image segmentation is challenged by heterogeneous atlas quality and high computation burden from extensive atlas collection, demanding efficient identification of the most relevant atlases. This study aims to develop a two-stage atlas selection scheme to achieve computational economy with performance guarantee. Methods: We develop a low-cost fusion set selection scheme by introducing a preliminary selection to trim full atlas collection into an augmented subset, alleviating the need for extensive full-fledged registrations. More specifically, fusion set selection is performed in two successive steps: preliminary selection and refinement. An augmented subset is first roughly selected from the whole atlas collection with a simple registration scheme and the corresponding preliminary relevance metric; the augmented subset is further refined into the desired fusion set size, using full-fledged registration and the associated relevance metric. The main novelty of this work is the introduction of an inference model to relate the preliminary and refined relevance metrics, based on which the augmented subset size is rigorously derived to ensure the desired atlases survive the preliminary selection with high probability. Results: The performance and complexity of the proposed two-stage atlas selection method were assessed using a collection of 30 prostate MR images. It achieved comparable segmentation accuracy as the conventional one-stage method with full-fledged registration, but significantly reduced computation time to 1/3 (from 30.82 to 11.04 min per segmentation). Compared with alternative one-stage cost-saving approach, the proposed scheme yielded superior performance with mean and medium DSC of (0.83, 0.85) compared to (0.74, 0.78). Conclusion: This work has developed a model-guided two-stage atlas selection scheme to achieve significant cost reduction while guaranteeing high segmentation accuracy. The benefit in both complexity and performance is expected to be most pronounced with large-scale heterogeneous data.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

iDDS: intelligent distributed dispatch and scheduling for workflow orchestration

The intelligent distributed dispatch and scheduling (iDDS) service is a versatile workflow orchestration system designed for large-scale, distributed scientific computing. iDDS extends traditional workload and data management by integrating data-aware execution, conditional logic, and programmable workflows, enabling automation of complex and dynamic processing pipelines. Originally developed for the ATLAS experiment at the large hadron collider, iDDS has evolved into an experiment-agnostic platform that supports both template-driven workflows and a Function-as-a-Task model for Python-based orchestration. This paper presents the architecture and core components of iDDS, highlighting its scalability, modular message-driven design, and integration with systems such as PanDA and Rucio. We demonstrate its versatility through real-world use cases: fine-grained tape resource optimization for ATLAS, orchestration of large Directed Acyclic Graph (DAG) workflows for the Rubin Observatory, distributed hyperparameter optimization for machine learning applications, active learning for physics analyses, and AI-assisted detector design at the electron–ion collider. By unifying workload scheduling, data movement, and adaptive decision-making, iDDS reduces operational overhead and enables reproducible, high-throughput workflows across heterogeneous infrastructures. We conclude with current challenges and future directions, including interactive, cloud-native, and serverless workflow support.

97 MATHEMATICS AND COMPUTING↗