Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complex computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Machine Learning-enabled Scalable Performance Prediction of Scientific Codes

Hardware architectures become increasingly complex as the compute capabilities grow to exascale. Here, we present the Analytical Memory Model with Pipelines (AMMP) of the Performance Prediction Toolkit (PPT). PPT-AMMP takes high-level source code and hardware architecture parameters as input and predicts runtime of that code on the target hardware platform, which is defined in the input parameters. PPT-AMMP transforms the code to an (architecture-independent) intermediate representation, then (i) analyzes the basic block structure of the code, (ii) processes architecture-independent virtual memory access patterns that it uses to build memory reuse distance distribution models for each basic block, and (iii) runs detailed basic-block level simulations to determine hardware pipeline usage. PPT-AMMP uses machine learning and regression techniques to build the prediction models based on small instances of the input code, then integrates into a higher-order discrete-event simulation model of PPT running on Simian PDES engine. We validate PPT-AMMP on four standard computational physics benchmarks and present a use case of hardware parameter sensitivity analysis to identify bottleneck hardware resources on different code inputs. We further extend PPT-AMMP to predict the performance of a scientific application code, namely, the radiation transport mini-app SNAP. To this end, we analyze multi-variate regression models that accurately predict the reuse profiles and the basic block counts. We validate predicted SNAP runtimes against actual measured times.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

RingX: Scalable Parallel Attention for Long-Context Learning on HPC

The attention mechanism has become foundational for remarkable AI breakthroughs since the introduction of the Transformer, driving the demand for increasingly longer context to power frontier models such as large-scale reasoning language models and high-resolution image/video generators. However, its quadratic computational and memory complexities present substantial challenges. Current state-of-the-art parallel attention methods, such as ring attention, are widely adopted for long-context training but utilize a point-to-point communication strategy that fails to fully exploit the capabilities of modern HPC network architectures. In this work, we propose ringX, a scalable family of parallel attention methods optimized explicitly for HPC systems. By enhancing workload partitioning, refining communication patterns, and improving load balancing, ringX achieves up to 3.4 × speedup compared to conventional ring attention on the Frontier supercomputer. Optimized for both bi-directional and causal attention mechanisms, ringX demonstrates its effectiveness through training benchmarks of a Vision Transformer (ViT) on a climate dataset and a Generative Pre-Trained Transformer (GPT) model, Llama3 8B. Our method attains an end-to-end training speedup of approximately 1.5 × in both scenarios. To our knowledge, the achieved 38% model FLOPs utilization (MFU) for training Llama3 8B with a 1M-token sequence length on 4,096 GPUs represents one of the highest training efficiencies reported for long-context learning on HPC systems. Our code implementation is available at https://github.com/jqyin/ringX-attention.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2024

Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models

Purpose To calibrate Cancer Intervention and Surveillance Modeling Network (CISNET)'s SimCRC, MISCAN-Colon, and CRC-SPIN simulation models of the natural history colorectal cancer (CRC) with an emulator-based Bayesian algorithm and internally validate the model-predicted outcomes to calibration targets.Methods We used Latin hypercube sampling to sample up to 50,000 parameter sets for each CISNET-CRC model and generated the corresponding outputs. We trained multilayer perceptron artificial neural networks (ANNs) as emulators using the input and output samples for each CISNET-CRC model. We selected ANN structures with corresponding hyperparameters (i.e., number of hidden layers, nodes, activation functions, epochs, and optimizer) that minimize the predicted mean square error on the validation sample. We implemented the ANN emulators in a probabilistic programming language and calibrated the input parameters with Hamiltonian Monte Carlo-based algorithms to obtain the joint posterior distributions of the CISNET-CRC models' parameters. We internally validated each calibrated emulator by comparing the model-predicted posterior outputs against the calibration targets.Results The optimal ANN for SimCRC had 4 hidden layers and 360 hidden nodes, MISCAN-Colon had 4 hidden layers and 114 hidden nodes, and CRC-SPIN had 1 hidden layer and 140 hidden nodes. The total time for training and calibrating the emulators was 7.3, 4.0, and 0.66 h for SimCRC, MISCAN-Colon, and CRC-SPIN, respectively. The mean of the model-predicted outputs fell within the 95% confidence intervals of the calibration targets in 98 of 110 for SimCRC, 65 of 93 for MISCAN, and 31 of 41 targets for CRC-SPIN.Conclusions Using ANN emulators is a practical solution to reduce the computational burden and complexity for Bayesian calibration of individual-level simulation models used for policy analysis, such as the CISNET CRC models. In this work, we present a step-by-step guide to constructing emulators for calibrating 3 realistic CRC individual-level models using a Bayesian approach.

artificial neural networks↗
DOE OSTI2021

Facilitating better and faster simulations of aerosol-cloud interactions in Earth system models

Focal Area(s): 1. Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising a hierarchy of models. 2. Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI. Science Challenge: One major challenge that Earth system models (ESMs) face in providing credible prediction of the Earth system and its water cycle characteristics (e.g., mean state, variability, and extreme events) is to accurately simulate aerosol-cloud interactions (ACI). The physical, chemical, and dynamical processes affecting ACI are extremely complex and they range from nanoscale to planetary scale. In each model development cycle, scientists spend significant efforts investigating model deficiencies and uncertainties associated with aerosols (e.g., emissions, chemical processes, aerosol microphysics, and transport) and clouds (e.g., macrophysics, microphysics, turbulence, and large-scale circulation) in order to develop improved treatments. However, despite decades of active research, ACI is still a major source of uncertainty in climate projections, even though great progress has been made. Specific scientific challenges include: (i) Parameterizations are developed based on limited data; (ii) The complexity of a parameterization required for accurate predictions is not understood; (iii) Incomplete and unknown physics leads to errors in the fully coupled Earth system; and (iv) Complex physics is computationally too expensive to employ in ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

High-Accuracy Module Emulators from Physically-Constrained AI Algorithms

Focal Area(s): How do we use AI tools to integrate observations, simulated data and physical and chemical fundamentals (Focal Area 3) into model components (Focal Area 2) that have high accuracy and stability and low computational burden to improve Earth System Predictability? Science Challenge: Earth system modeling of the hydrological cycle involves compute-intensive modules representing complex chemical and physical process. Recently, AI tools that are far less compute intensive have been developed that emulate these modules, but many of these efforts are not yet sufficiently accurate or even stable. We know a lot about the physics and chemistry of earth system processes. The Science Challenge is developing AI tools that not only incorporate observations and simulated data, but also incorporate the physics and chemistry of the process, while still maintaining the compute efficiency.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

MCNP6.3 Unstructured Mesh Verification: GodivR and CANDU Models

A geometric cell of the Monte Carlo N-Particle (MCNP)1 transport code is traditionally created by using Boolean operators on defined surfaces. This constructive solid geometry (CSG) capability has been available in the MCNP code since its beginning. However, a CSG model approach is limited when it comes to constructing a representative geometry for a complex model in its ability to capture a correct model representation. Starting with the version 6.0, the MCNP code has the ability of embedding an unstructured mesh (UM) model into a CSG cell to create a hybrid geometry [1]. The MCNP UM feature provides the flexibility of defining very complex geometries because computer aided design (CAD) and mesh generation software packages can be utilized to construct UM models for MCNP simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Modeling Workloads of a Linear Electromagnetic Code for Load Balancing Matrix Assembly

This report presents our work to model the workloads of a linear electromagnetic application based on the method of moments in the frequency domain to effectively load balance the matrix assembly. This application is particularly challenging to load balance due to its lack of persistent iterative behavior, its operation under tight memory constraint (where the matrix may fill 80% of memory on each node), and the algorithmic complexity of the computational method. This report describes the first step in our work to apply an inspector-executor approach for load balancing workloads where key parameters are exposed during the inspector phase and a pre-trained model is applied to predict relative task weights for the load balancer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Wilkins: HPC in situ workflows made easy

In situ approaches can accelerate the pace of scientific discoveries by allowing scientists to perform data analysis at simulation time. Current in situ workflow systems, however, face challenges in handling the growing complexity and diverse computational requirements of scientific tasks. In this work, we present Wilkins, an in situ workflow system that is designed for ease-of-use while providing scalable and efficient execution of workflow tasks. Wilkins provides a flexible workflow description interface, employs a high-performance data transport layer based on HDF5, and supports tasks with disparate data rates by providing a flow control mechanism. Wilkins seamlessly couples scientific tasks that already use HDF5, without requiring task code modifications. We demonstrate the above features using both synthetic benchmarks and two science use cases in materials science and cosmology.

HPC↗
DOE OSTI2023

JOBRUNNER

SF-23-071 Jobrunner is a command line tool to manage and deploy computing jobs, organize complex workloads, and enforce a directory based hierarchy to enable reuse of files and bash scripts within a project. Organization details of a directory tree are encoded in Jobfiles which serve as an index of files/scripts, and indicate their purpose when deploying or setting up a job. It is a flexible tool that allows users to design 16 their own directory structure, perserve their design, and maintain 17 consistency with increase in complexity of the project.

DHRUV, AKASH VIJAYKUMAR↗
DOE OSTI2024

MSD CoP Webinar: Applied Science for Decision-Making at the Water-Energy Nexus

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Abstract: The energy transition is a game-changer across multiple sectors, requiring researchers and practitioners to re-evaluate the evolving connections between climate, water, and power systems, as well as the associated co-management of resources and decision-making. In anticipation of new technologies, policies, business models, and other solutions, applied science for decision-making at the climate-water-energy nexus is needed to support transitions with the expected climate resilience, maintained and enhanced energy security, thriving economies, and equity considerations. Through panelists' applied research and operational experience, the webinar will provide lesson-learnt in how to increase the readiness of water-energy research and become actionable in the context of energy transitions. A number of themes will be discussed, including the connection between growing computational resources and complexity of models, and the implications on the intended users, the actual actionable products, the availability of data for validation of the models, uncertainty characterization and decision-making under uncertainty, and the communication of the novelty to decision-makers and the public. Presenters : David McCollum (Oak Ridge National Laboratory; Co-Chair), and Gokul Iyer (Pacific Northwest National Laboratory; Co-Chair), Curt Jawdy (Tennessee Valley Authority), Nathalie Voisin (Pacific Northwest National Laboratory), and Andrew D. Jones (Lawrence Berkeley National Laboratory) Moderator: Pat M. Reed (MSD CoP Facilitation Team) This webinar was held on: April 30, 2024 from 1-2 PM ET

Energy↗
NASA NTRS1972

Chemical kinetics computer program for static and flow reactions

General chemical kinetics computer program for complex gas mixtures has been developed. Program can be used for any homogeneous reaction in either one dimensional flow or static system. It is flexible, accurate, and easy to use. It can be used for any chemical system for which species thermodynamic data and reaction rate constant data are known.

Bittker, D. A.↗
NASA NTRS1972

Techniques for generating highly reliable redundant systems.

A simple heuristic algorithm for designing highly reliable modularly redundant computer systems under complexity constraints is presented. The technique, which produces near optimal solutions, is intuitively appealing and easy to apply. The algorithms performance is shown to compare very well with the optimal solution obtained via a computerized model for dynamic programming.

White, J. B.↗
NASA NTRS1977

Symbolic calculations in a finite dynamic element analysis

A second order problem is outlined for which MACSYMA was used only for checking purpose. A fourth order problem is briefly described for which a symbolic system is necessary. At the end, some sample output is displayed to indicate the complexity of the computational problem.

Gupta, K. K.↗
NASA NTRS1977

Axially grooved heat pipe study

A technology evaluation study on axially grooved heat pipes is presented. The state-of-the-art is reviewed and present and future requirements are identified. Analytical models, the Groove Analysis Program (GAP) and a closed form solution, were developed to facilitate parametric performance evaluations. GAP provides a numerical solution of the differential equations which govern the hydrodynamic flow. The model accounts for liquid recession, liquid/vapor shear interaction, puddle flow as well as laminar and turbulent vapor flow conditions. The closed form solution was developed to reduce computation time and complexity in parametric evaluations. It is applicable to laminar and ideal charge conditions, liquid/vapor shear interaction, and an empirical liquid flow factor which accounts for groove geometry and liquid recession effects. The validity of the closed form solution is verified by comparison with GAP predictions and measured data.

Source record↗
NASA NTRS1979

Advanced vehicle separation apparatus

A method of obtaining test data from two independent models or bodies in a conventional wind tunnel is described. The system makes efficient use of wind tunnel test time with computer control performing complex coordinate transformations necessary for model positioning. The apparatus is designed to be used in any of the three Unitary Wind Tunnels at NASA-Ames Research Center. Mechanical design details and a brief description of the control system for the separation apparatus are presented.

Ospring, M. J.↗
NASA NTRS1980

Perturbation-magnitude control for difference-quotient estimation of derivatives

A process for adjusting perturbation magnitude for accurate difference-quotient estimation of derivatives is described. The process is intended to be carried out sequentially, alternating with iterations of a parameter-optimization algorithm. A more complex and computationally-expensive scheme for occasional auxiliary use is also described.

Kelley, H. J.↗
NASA NTRS1984

Managing geometric information with a data base management system

The strategies for managing computer based geometry are described. The computer model of geometry is the basis for communication, manipulation, and analysis of shape information. The research on integrated programs for aerospace-vehicle design (IPAD) focuses on the use of data base management system (DBMS) technology to manage engineering/manufacturing data. The objectives of IPAD is to develop a computer based engineering complex which automates the storage, management, protection, and retrieval of engineering data. In particular, this facility must manage geometry information as well as associated data. The approach taken on the IPAD project to achieve this objective is discussed. Geometry management in current systems and the approach taken in the early IPAD prototypes are examined.

Dube, R. P.↗
NASA NTRS1983

Accuracy of approximations to the Navier-Stokes equations

The systems of truncated differential equations that have been proposed to reduce the complexity and large computational costs of solutions to the full Navier-Stokes equations are considered. These systems are computationally efficient and capture all the physically relevant behavior. The systems follow a certain hierarchy: (1) the classical boundary-layer equations with specified edge properties (usually the streamwise pressure distribution); (2) the coupled boundary-layer/inviscid equations; (3) the so-called thin-layer equations that discard streamwise diffusion; and (4) the Navier-Stokes equations. Consideration is given to each of these approximations applied to an incompressible, laminar-separating flow at low and moderate Reynolds numbers. It is pointed out that for any flow or region of flow for which viscous-inviscid interaction effects are small, classical boundary-layer equations will provide a satisfactory description of the viscous flow at a fraction of the computational cost of any higher approximations.

Murphy, J. D.↗