Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Large scale”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Design and implementation of I/O performance prediction scheme on HPC systems through large-scale log analysis

Abstract Large-scale high performance computing (HPC) systems typically consist of many thousands of CPUs and storage units used by hundreds to thousands of users simultaneously. Applications from large numbers of users have diverse characteristics, such as varying computation, communication, memory, and I/O intensity. A good understanding of the performance characteristics of each user application is important for job scheduling and resource provisioning. Among these performance characteristics, I/O performance is becoming increasingly important as data sizes rapidly increase and large-scale applications, such as simulation and model training, are widely adopted. However, predicting I/O performance is difficult because I/O systems are shared among all users and involve many layers of software and hardware stack, including the application, network interconnect, operating system, file system, and storage devices. Furthermore, updates to these layers and changes in system management policy can significantly alter the I/O behavior of applications and the entire system. To improve the prediction of the I/O performance on HPC systems, we propose integrating information from several different system logs and developing a regression-based approach to predict the I/O performance. Our proposed scheme can dynamically select the most relevant features from the log entries using various feature selection algorithms and scoring functions, and can automatically select the regression algorithm with the best accuracy for the prediction task. The evaluation results show that our proposed scheme can predict the write performance with up to 90% prediction accuracy and the read performance with up to 99% prediction accuracy using the real logs from the Cori supercomputer system at NERSC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

CGSim: A Simulation Framework for Large Scale Distributed Computing Environment

Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new algorithms, and optimizing resource allocation strategies. However, existing simulators suffer from limited scalability, hardwired algorithms, lack of real-time monitoring, and inability to generate datasets suitable for modern machine learning approaches. We present CGSim, a simulation framework for large-scale distributed computing environments that addresses these limitations. Built upon the validated SimGrid simulation framework, CGSim provides high-level abstractions for modeling heterogeneous grid environments while maintaining accuracy and scalability. Key features include a modular plugin mechanism for testing custom workflow scheduling and data movement policies, interactive real-time visualization dashboards, and automatic generation of event-level datasets suitable for AI-assisted performance modeling. We demonstrate CGSim’s capabilities through a comprehensive evaluation using production ATLAS PanDA workloads, showing significant calibration accuracy improvements across WLCG computing sites. Scalability experiments show near-linear scaling for multi-site simulations, with distributed workloads achieving 6 × better performance compared to single-site execution. The framework enables researchers to simulate WLCG-scale infrastructures with hundreds of sites and thousands of concurrent jobs within practical time budget constraints on commodity hardware.

Vatsavai, Sairam Sri [Brookhaven National Laborato↗
NASA NTRS2004

High Speed Networking and Large-scale Simulation in Geodynamics

Large-scale numerical simulation has been one of the most important approaches for understanding global geodynamical processes. In this approach, peta-scale floating point operations (pflops) are often required to carry out a single physically-meaningful numerical experiment. For example, to model convective flow in the Earth's core and generation of the geomagnetic field (geodynamo), simulation for one magnetic free-decay time (approximately 15000 years) with a modest resolution of 150 in three spatial dimensions would require approximately 0.2 pflops. If such a numerical model is used to predict geomagnetic secular variation over decades and longer, with e.g. an ensemble Kalman filter assimilation approach, approximately 30 (and perhaps more) independent simulations of similar scales would be needed for one data assimilation analysis. Obviously, such a simulation would require an enormous computing resource that exceeds the capacity of a single facility currently available at our disposal. One solution is to utilize a very fast network (e.g. 10Gb optical networks) and available middleware (e.g. Globus Toolkit) to allocate available but often heterogeneous resources for such large-scale computing efforts. At NASA GSFC, we are experimenting with such an approach by networking several clusters for geomagnetic data assimilation research. We shall present our initial testing results in the meeting.

Kuang, Weijia↗
NASA NTRS1972

Stability of large-scale systems under structural perturbations.

A large-scale system is considered as a system constituted of subsystems which may be connected or disconnected from each other during operation. A new concept of connective stability is introduced by which a large-scale system is regarded as stable if it remains stable (in the sense of Lyapunov) under structural perturbations produced by the on-off participation of the subsystems. Algebraic conditions are developed that guarantee exponential connective stability of large-scale systems which may be composed of linear and nonlinear time-varying subsystems coupled by linear or nonlinear connections.

Siljak, D. D.↗
NASA NTRS1977

Large-scale V/STOL testing

Several facets of large-scale testing of V/STOL aircraft configurations are discussed with particular emphasis on test experience in the Ames 40- by 80-Foot Wind Tunnel. Examples of powered-lift test programs are presented in order to illustrate tradeoffs confronting the planner of V/STOL test programs. Large-scale V/STOL wind-tunnel testing can sometimes compete with small-scale testing in the effort required (overall test time) and program costs because of the possibility of conducting a number of different tests with a single large-scale model where several small-scale models would be required. The benefits of both high- or full-scale Reynolds numbers, more detailed configuration simulation, and number and type of onboard measurements are studied.

Koenig, D. G.↗
DOE OSTI2023

Solar@Scale: A Local Government Guidebook for Improving Large-Scale Solar Development Outcomes (Third Edition)

The purpose of the Solar@Scale guidebook is to help local government practitioners—including planners, economic development professionals, local government managers, and elected and appointed officials—make decisions that improve large-scale solar development outcomes. Given the variation between state and regional contexts and priorities in the United States, the guidebook avoids a “one-size-fits-all” approach. Rather, users will need to apply the guidebook’s key points to the social, political, environmental, and economic situations in their community or the communities they serve. This guidebook contains eight related, but semi-independent, modules and each concludes with key takeaways and a list of references and links to supplemental resources.

14 SOLAR ENERGY↗
DOE OSTI2021

An Implementation of Replica Exchange with Dynamical Scaling for Efficient Large-Scale Simulations

An implementation of the replica exchange with dynamical scaling (REDS) method in the commonly used molecular dynamics program GROMACS is presented. REDS is a replica exchange method that requires fewer replicas than conventional replica exchange while still providing data over a range of temperatures and can be used in either constant volume or constant pressure ensembles. Details for running REDS simulations are given, and an application to the human islet amyloid polypeptide (hIAPP) 11-25 fragment shows that the model efficiently samples conformational space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Impacts of Small-Scale Heterogeneity on Large-Scale Subsurface Flow

Discussion of NETL's CT scanning and core characterization capabilities, followed by a rapid review of several recent publications that utilize these capabilities to answer reservoir questions at the micro scale with relevance to field scale operations.

core characterization↗
NASA NTRS2014

Inlet Turbulence and Length Scale Measurements in a Large Scale Transonic Turbine Cascade

Constant temperature hotwire anemometry data were acquired to determine the inlet turbulence conditions of a transonic turbine blade linear cascade. Flow conditions and angles were investigated that corresponded to the take-off and cruise conditions of the Variable Speed Power Turbine (VSPT) project and to an Energy Efficient Engine (EEE) scaled rotor blade tip section. Mean and turbulent flowfield measurements including intensity, length scale, turbulence decay, and power spectra were determined for high and low turbulence intensity flows at various Reynolds numbers and spanwise locations. The experimental data will be useful for establishing the inlet boundary conditions needed to validate turbulence models in CFD codes.

hotwire↗
NASA NTRS2021

Large-scale space use of large juvenile and adult smalltooth sawfish Pristis pectinata: implications for management

The smalltooth sawfish Pristis pectinata is an endangered species endemic to the Atlantic Ocean. The only known viable populations occur in the USA along both coasts of Florida and in the western Bahamas. Little is known about habitat use and movement ecology of large juvenile and adult smalltooth sawfish. Although Critical Habitat — a management designation in the USA — has been identified for small juveniles, it has yet to be identified for these life stages. Between May 2016 and April 2019, we used passive acoustic telemetry and 3 large data sharing networks of receivers to track movements of 43 large juvenile and adult smalltooth sawfish. During this study, 24 females and 19 males were implanted with transmitters with estimated 4 or 10 yr battery lives. These tagged individuals were detected off the southeastern USA on 461 receivers ranging from off the coast of Brunswick, Georgia, to the lower Florida Keys, and along the Gulf coast to Apalachee Bay, Florida. Seasonal migrations were undertaken by 58% (43% mature; 57% immature) of the tagged individuals, with the remainder being apparent residents of their tagging locations. Tagged sawfish from both size classes and of both sexes migrated, which indicates that neither sex nor length is a predictor of whether a sawfish will migrate or not. Although both coasts of Florida were used for migration, most individuals consistently used the same coast when they migrated. The areas surrounding Boca Grande, Cape Canaveral, and the lower Florida Keys were heavily visited sites that could be further evaluated as potential Critical Habitat for these life stages. Understanding the movement patterns of this Critically Endangered species is essential for creating policies to protect areas important for promoting growth of the population.

Pristis pectinata Habitat use · Acoustic monitorin↗
NASA NTRS1987

Survey on large scale system control methods

The problem inherent to large scale systems such as power network, communication network and economic or ecological systems were studied. The increase in size and flexibility of future spacecraft has put those dynamical systems into the category of large scale systems, and tools specific to the class of large systems are being sought to design control systems that can guarantee more stability and better performance. Among several survey papers, reference was found to a thorough investigation on decentralized control methods. Especially helpful was the classification made of the different existing approaches to deal with large scale systems. A very similar classification is used, even though the papers surveyed are somehow different from the ones reviewed in other papers. Special attention is brought to the applicability of the existing methods to controlling large mechanical systems like large space structures. Some recent developments are added to this survey.

Mercadal, Mathieu↗
NASA NTRS1984

Time scales for the decay of induced large-scale magnetic fields in the Venus ionosphere

Observations made with the aid of a magnetometer on the Pioneer Venus Orbiter have shown large-scale horizontal magnetic fields in the dayside ionosphere of Venus. According to Cloutier and Daniell (1981), the observed magnetic structures may be quasi-steady features produced by an ionospheric current system driven by solar wind interaction. Russell et al. (1983) have suggested that the altitude profiles of the horizontal field on different orbits exhibit a pattern which can be interpreted as phases in the temporal evolution of an initial state in which the ionosphere was permeated with magnetosheath-like fields. The present investigation is concerned with the argument in favor of a temporal versus spatial explanation for some of the observed field structure. A calculation indicates that the diffusion time for ionospheric fields is long enough to justify attributing the observed fields to the 'memory' of the Venus ionosphere in certain regions.

Luhmann, J. G.↗
NASA NTRS1991

The new discussion of a neutrino mass and issues in the formation of large-scale structure

It is argued that the discrepancy between the large-scale structure predicted by cosmological models with neutrino mass (hot dark matter) do not differ drastically from the observed structure. Evidence from the correlation amplitude, nonlinearity and the onset of galaxy formation, large-scale streaming velocities, and the topology of large-scale structure is considered. Hot dark matter models seem to be as accurate predictors of the large-scale structure as are cold dark matter models.

Melott, Adrian L.↗
DOE OSTI2022

Mechanism for sequestering magnetic energy at large scales in shear-flow turbulence

Straining of magnetic fields by large-scale shear flow, which is generally assumed to lead to intensification and generation of small scales, is reexamined in light of the persistent observation of large-scale magnetic fields in astrophysics. It is shown that, in magnetohydrodynamic turbulence, unstable shear flows have the unexpected effect of sequestering magnetic energy at large scales due to counteracting straining motion of nonlinearly excited large-scale stable eigenmodes. This effect is quantified via dissipation rates, energy transfer rates, and visualizations of magnetic field evolution by artificially removing the stable modes. In conclusion, these analyses show that predictions based upon physics of the linear instability alone miss substantial dynamics, including those of magnetic fluctuations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1981

Large-scale anisotropy of the cosmic microwave background radiation

Inhomogeneities in the large-scale distribution of matter inevitably lead to the generation of large-scale anisotropy in the cosmic background radiation. The dipole, quadrupole, and higher order fluctuations expected in an Einstein-de Sitter cosmological model have been computed. The dipole and quadrupole anisotropies are comparable to the measured values, and impose important constraints on the allowable spectrum of large-scale matter density fluctuations. A significant dipole anisotropy is generated by the matter distribution on scales greater than approximately 100 Mpc. The large-scale anisotropy is insensitive to the ionization history of the universe since decoupling, and cannot easily be reconciled with a galaxy formation theory that is based on primordial adiabatic density fluctuations.

Silk, J.↗
NASA NTRS1990

On the large-scale structures formed by wakes of open cosmic strings

Large-scale structures of the universe have been variously described as sheetlike, filamentary, cellular, bubbles or spongelike. Recently cosmic strings became one of viable candidates for a galaxy formation scenario, and some of the large-scale structures seem to be simply explained by the open cosmic strings. According to this scenario, sheets are wakes which are traces of moving open cosmic strings where dark matter and baryonic matter have accumulated. Filaments are intersections of such wakes and high density regions are places where three wakes intersect almost orthogonally. The wakes formed at t sub eq become the largest surface density among all wakes, where t sub eq is the epoch when matter density equals to radiation density. If we assume that there is one open cosmic string per each horizon, then it can be explained that the typical distances among wakes, filaments and clusters are also approx. 10(exp 2) Mpc. This model does not exclude a much more large scale structure. Open cosmic string may move even now and accumulate cold dark matter after its traces. However, the surface density is much smaller than the ones formed at t sub eq. From this model, it is expected that the typical high density region will have extended features such as six filaments and three sheets and be surrounded by eight empty regions (voids). Here, the authors are mainly concerned with such structures and have made numerical simulations for the formation of such large scale structures.

Hara, Tetsuya↗
DOE OSTI2022

Scalable Predictive Control and Optimization for Grid Integration of Large-Scale Distributed Energy Resources

Integrating a large number of distributed energy resources (DERs) into the power grid needs a scalable power balancing method. We formulate the power balancing problem as a look-ahead optimization problem to be solved sequentially by a power distribution system aggregator based on a model predictive control (MPC) framework. Solving large-scale look-ahead control problems requires proper configuration of the control steps. In this paper, to solve large-scale control problems, we propose a variable time granularity where control time steps nearby the current control step have finer resolutions. The aggregator objective includes maximization of power production revenue and minimization of power purchasing expense, renewable power curtailment, and mileage costs for energy storage and electric vehicle (EV) charging stations while satisfying system capacity and operational constraints. The control problem is formulated as a mixed-integer linear program (MILP) and solved using the XpressMP solver. We perform simulations considering a copper plate representation of a large distribution network consisting of 2507 devices (control-lable DERs), including curtailable photovoltaics (PVs), energy storage batteries, EV charging stations, and buildings with heating, ventilation, and air conditioning units (HVACs). We show the effectiveness of the proposed approach in managing DERs interactively for maximum energy trading profit and local supply-demand power balancing. Finally, we demonstrate that the proposed method outperforms other benchmark controllers regarding computation time without compromising operational performance.

DER↗