SEARCH · Engineering Papers

Results for “large scale analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

NASA NTRS1994

Rapid solution of large-scale systems of equations

The analysis and design of complex aerospace structures requires the rapid solution of large systems of linear and nonlinear equations, eigenvalue extraction for buckling, vibration and flutter modes, structural optimization and design sensitivity calculation. Computers with multiple processors and vector capabilities can offer substantial computational advantages over traditional scalar computer for these analyses. These computers fall into two categories: shared memory computers and distributed memory computers. This presentation covers general-purpose, highly efficient algorithms for generation/assembly or element matrices, solution of systems of linear and nonlinear equations, eigenvalue and design sensitivity analysis and optimization. All algorithms are coded in FORTRAN for shared memory computers and many are adapted to distributed memory computers. The capability and numerical performance of these algorithms will be addressed.

Storaasli, Olaf O.↗

DOE OSTI2023

Scalable Graph Analytics and HPC Operational Enhancement: Parallel Computing and ML/DL Innovations

Parallel computing plays a pivotal role in the efficient processing of large-scale graphs. Complex network analysis stands as a capti- vating research frontier, holding promise across diverse scientific domains such as sociology, biology, online media, and recommenda- tion systems. In this era, Machine Learning (ML) and Deep Learning (DL) have emerged as indispensable tools, underpinning remarkable technological achievements. Within this dynamic landscape, my research revolves around advancing parallel algorithms tailored for large-scale graph operations. To achieve this, I harness the power of cutting-edge technologies including OpenMP, MPI, HIP, and CUDA, on the High-Performance Computing (HPC) platforms to unlock optimal performance. I also apply ML/DL techniques to HPC operational data, to streamline the monitoring and maintenance of supercomputers, alleviating the complexities associated with their upkeep and enhancing user support. My research echoes the syn- ergy between parallel computing, large-scale graph analysis, and ML/DL, improving computational efficiency and user experience.

Sattar, Naw Safrin↗

NASA NTRS1994

Large-scale variations in ozone from the first two years of UARS MLS data

Two years of stratospheric measurements of ozone from the Upper Atmosphere Research Satellite (UARS) Microwave Limb Sounder (MLS) are examined in order to characterize large horizontal scale wave variations. The use of Fourier analysis allows the detection of variations from daily through seasonal and interannual timescales. High-latitude winter variations at 10 hPa often have very large amplitudes, but smaller midlatitude variations are more ubiquitous. Some variations have the characteristics of locally generated instabilities. Correlations of wave features with changes in the zonal-mean ozone at 10 hPa suggest the presence of significant horizontal motions during strong wintertime polar warming events. Such correlations are not evident at other levels. Spectral analysis of the large-scale variations show most waves to be slowly propagating. In contrast to some past observations, equatorial regions are shown to lack large amplitude wave events.

Elson, Lee S.↗

DOE OSTI2022

Toward higher-radix switches with co-packaged optics for improved network locality in data center and HPC networks [Invited]

In this work, we study the network locality improvements that can be achieved by using co-packaged optics in data center and high-performance computing (HPC) networks. The increased escape bandwidth offered by co-packaged optics can enable switches with speeds of 51.2 Tb/s and beyond. From a network architecture perspective, the key advantages of introducing co-packaged optics at the switch points include the implementation of large-scale topologies of >12,000 end points with 4× higher bisection bandwidth and the reduction of the required number of switches by >40% compared with state-of-the-art approaches. From a network operation perspective, improved network locality and faster operation can be achieved since the higher-radix switches can mitigate the impact of network contention. Placing applications under fewer leaf switches reduces the number of packets that cross the spine switches in a leaf-spine topology. The proposed scheme is evaluated via discrete-event simulations: we initially evaluate the network locality properties of the system by using virtual-machine traces from a production data center, and we subsequently quantify the performance improvements by simulating an all-to-all pattern for a variety of message sizes over a number of nodes. The results suggest that co-packaged optics form a promising solution for keeping up with bandwidth scaling in future networks. The virtual-machine analysis shows that large-scale applications can be placed under up to 50% fewer first-level switches, while the network analysis shows speedups of up to 7.1, which translates to execution time reductions of up to 26% and 42.7% for applications with communication ratios of 0.3 and 0.5, respectively.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

A Framework for International Collaboration on ITER Using Large-Scale Data Transfer to Enable Near-Real-Time Analysis

The global nature of the ITER project along with its projected ~ petabyte per day data generation presents a unique challenge, but also an opportunity for the fusion community to rethink, optimize, and enhance our scientific discovery process. Recognizing this, collaborative research with computational scientists was undertaken over the past several years to create a framework for large-scale data movement across wide-area networks (WANs), to enable global near-real time analysis of fusion data. This would broaden the available computational resources for analysis/simulation, and increase the number of researchers actively participating in experiments. An official demonstration of this framework for fast, large data transfer and real-time analysis was carried out between the KSTAR tokamak in Daejeon, Korea and PPPL in Princeton, USA. Streaming large data transfer, with near real-time movie creation and analysis of the KSTAR Electron Cyclotron Emission imaging (ECEI) data, was performed using the I/O framework ADIOS, and comparisons made at PPPL with simulation results from the XGC1 code. These demonstrations were made possible utilizing an optimized network configuration at PPPL, which achieved over 8.8 Gbps (88% utilization) in throughput tests from NFRI to PPPL. This demonstration showed the feasibility for large-scale data analysis of KSTAR data, and provides a nascent framework to enable use of globally distributed computational and personnel resources in pursuit of scientific knowledge from the ITER experiment.

43 PARTICLE ACCELERATORS↗

NASA NTRS1981

Spectral analysis and diagnosis of nonlinear interactions of large-scale moving waves at 200 mb in the GLAS General Circulation Model

The space-time Fourier spectral analysis and the equations of kinetic energy and momentum transport in the wavenumber-frequency domain proposed by Kao (1968) and modified by Kao and Lee (1977) using Tukey's (1967) numerical spectral analysis are employed to analyze the 200 mb wind fields of a four-month climate experiment of the GLAS atmospheric circulation model. This climate run covers the period from Jan. 1 to Apr. 30, 1975. The current study analyzes a 90-day (Jan. 15-Apr. 14, 1975) wind field of this climate run. A comparison is conducted between the current study and observations reported by Kao and Lee. It is found that the 200 mb latitudinal distributions of model mean zonal wind, zonal and meridional kinetic energy and momentum transport of eddies agree fairly well with the observations.

Chen, T.-C.↗

DOE OSTI2021

FasTensor (FT) v0.0.1

The FasTensor implements the native array data programming mode namely SLOPE for modern data analysis tasks. It is designed to work in parallel on supercomputer and can handle terabyte data analysis tasks. It is thousand times faster than other data analysis systems such as Apache Spark and 38% faster than TensorFlow in dealing with large scale scientific data analysis. It has wide applications in image data analysis and mesh data analysis tasks in physical simulations and other fields.

Wu, Kesheng↗

NASA NTRS2012

Improved Cloud and Snow Screening in MAIAC Aerosol Retrievals Using Spectral and Spatial Analysis

An improved cloud/snow screening technique in the Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm is described. It is implemented as part of MAIAC aerosol retrievals based on analysis of spectral residuals and spatial variability. Comparisons with AERONET aerosol observations and a large-scale MODIS data analysis show strong suppression of aerosol optical thickness outliers due to unresolved clouds and snow. At the same time, the developed filter does not reduce the aerosol retrieval capability at high 1 km resolution in strongly inhomogeneous environments, such as near centers of the active fires. Despite significant improvement, the optical depth outliers in high spatial resolution data are and will remain the problem to be addressed by the application-dependent specialized filtering techniques.

Lyapustin, A.↗

NASA NTRS1986

Influence of large-scale motion on turbulent transport for confined coaxial jets. Volume 1: Analytical analysis of the experimental data using conditional sampling

The existence of large scale coherent structures in turbulent shear flows has been well documented. Discrepancies between experimental and computational data suggest a necessity to understand the roles they play in mass and momentum transport. Using conditional sampling and averaging on coincident two component velocity and concentration velocity experimental data for swirling and nonswirling coaxial jets, triggers for identifying the structures were examined. Concentration fluctuation was found to be an adequate trigger or indicator for the concentration-velocity data, but no suitable detector was located for the two component velocity data. The large scale structures are found in the region where the largest discrepancies exist between model and experiment. The traditional gradient transport model does not fit in this region as a result of these structures. The large scale motion was found to be responsible for a large percentage downstream at approximately the mean velocity of the overall flow in the axial direction. The radial mean velocity of the structures was found to be substantially greater than that of the overall flow.

Brondum, D. C.↗

DOE OSTI2020

Characterization and identification of HPC applications at leadership computing facility

High Performance Computing (HPC) is an important method for scientific discovery via large-scale simulation, data analysis, or artificial intelligence. Leadership-class supercomputers are expensive, but essential to run large HPC applications. The Petascale era of supercomputers began in 2008, with the first machines achieving performance in excess of one petaflops, and with the advent of new supercomputers in 2021 (e.g., Aurora, Frontier), the Exascale era will soon begin. However, the high theoretical computing capability (i.e., peak FLOPS) of a machine is not the only meaningful target when designing a supercomputer, as the resources demand of applications varies. A deep understanding of the characterization of applications that run on a leadership supercomputer is one of the most important ways for planning its design, development and operation. In order to improve our understanding of HPC applications, user demands and resource usage characteristics, we perform correlative analysis of various logs for different subsystems of a leadership supercomputer. This analysis reveals surprising, sometimes counter-intuitive patterns, which, in some cases, conflicts with existing assumptions, and have important implications for future system designs as well as supercomputer operations. For example, our analysis shows that while the applications spend significant time on MPI, most applications spend very little time on file I/O. Combined analysis of hardware event logs and task failure logs show that the probability of a hardware FATAL event causing task failure is low. Combined analysis of control system logs and file I/O logs reveals that pure POSIX I/O is used more widely than higher level parallel I/O. Based on holistic insights of the application gained through combined and co-analysis of multiple logs from different perspectives and general intuition, we engineer features to "fingerprint" HPC applications. We use t-SNE (a machine learning technique for dimensionality reduction) to validate the explainability of our features and finally train machine learning models to identify HPC applications or group those with similar characteristic. To the best of our knowledge, this is the first work that combines logs on file I/O, computing, and inter-node communication for insightful analysis of HPC applications in production.

Liu, Zhengchun↗

DOE OSTI2021

Reactor Pressure Vessel Fracture Mechanics Development and Concrete Application Testing for Grizzly

The Grizzly code is being developed to address degradation issues in nuclear reactor structures and components. For light-water reactors, Grizzly currently has capabilities to simulate degradation processes and their effects on structural integrity in two key areas: reactor pressure vessels (RPVs) and reinforced concrete structures. This report documents improvements made to Grizzly’s ability to address both of these structural systems. For RPVs, the reduced-order models (ROMs) used in fracture mechanics calculations have been expanded to allow their application over a broader range of the parameter space than was permitted by the previous models. The ROMs currently used in Grizzly for the evaluation of flaws that are fully embedded within the RPV (as opposed to surface-breaking flaws) are based on a model that is known to be conservative, indicating higher stress intensity factors than would be obtained from direct simulations. A more accurate model that eliminates these excess conservatisms has been recently included in the American Society of Mechanical Engineers Boiler and Pressure Vessel Code but was not applicable for flaws near the RPV surface, which is where the most critical flaws are usually located. That model has recently been extended for increased applicability in this near-surface region. The ROMs for embedded flaws in the Grizzly code have been expanded to include these recent extensions, which permit their use in a much broader set of cases than previously possible. Direct 3D simulations have been used to check these ROMs and have shown good agreement in most cases, although there are still some cases that need further investigation. There are considerable benefits to using these these more accurate and less conservative ROMs for embedded flaws. On a benchmark probabilistic fracture mechanics problem tested here, the conditional probability of fracture initiation computed for a population of flaws in a single plate in an RPV decreased by over a factor of 3. To address aging in reinforced concrete structures, a capability to simulate multiple degradation mechanisms, including alkali-silica reaction and radiation-induced volumetric expansion has been developed in Grizzly over the past several years. This had previously been demonstrated on laboratory-scale specimens but not on full-scale nuclear concrete structures with reinforcement. To demonstrate the applicability of Grizzly to the analysis of large-scale structures of interest, a full 3D model of a representative reinforced concrete structure, including a complex arrangement of reinforcing bars, was developed and demonstrated in Grizzly.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS1993

Space station static and dynamic analyses using parallel methods

Algorithms for high-performance parallel computers are applied to perform static analyses of large-scale Space Station finite-element models (FEMs). Several parallel-vector algorithms under development at NASA Langley are assessed. Sparse matrix solvers were found to be more efficient than banded symmetric or iterative solvers for the static analysis of large-scale applications. In addition, new sparse and 'out-of-core' solvers were found superior to substructure (superelement) techniques which require significant additional cost and time to perform static condensation during global FEM matrix generation as well as the subsequent recovery and expansion. A method to extend the fast parallel static solution techniques to reduce the computation time for dynamic analysis is also described. The resulting static and dynamic algorithms offer design economy for preliminary multidisciplinary design optimization and FEM validation against test modes. The algorithms are being optimized for parallel computers to solve one-million degrees-of-freedom (DOF) FEMs. The high-performance computers at NASA afforded effective software development, testing, efficient and accurate solution with timely system response and graphical interpretation of results rarely found in industry. Based on the author's experience, similar cooperation between industry and government should be encouraged for similar large-scale projects in the future.

Gupta, V.↗

NASA NTRS1999

Global-Scale Hydrology: Simple Characterization of Complex Simulation

Atmospheric general circulation models (AGCMS) are unique and valuable tools for the analysis of large-scale hydrology. AGCM simulations of climate provide tremendous amounts of hydrological data with a spatial and temporal coverage unmatched by observation systems. To the extent that the AGCM behaves realistically, these data can shed light on the nature of the real world's hydrological cycle. In the first part of the seminar, I will describe the hydrological cycle in a typical AGCM, with some emphasis on the validation of simulated precipitation against observations. The second part of the seminar will focus on a key goal in large-scale hydrology studies, namely the identification of simple, overarching controls on hydrological behavior hidden amidst the tremendous amounts of data produced by the highly complex AGCM parameterizations. In particular, I will show that a simple 50-year-old climatological relation (and a recent extension we made to it) successfully predicts, to first order, both the annual mean and the interannual variability of simulated evaporation and runoff fluxes. The seminar will conclude with an example of a practical application of global hydrology studies. The accurate prediction of weather statistics several months in advance would have tremendous societal benefits, and conventional wisdom today points at the use of coupled ocean-atmosphere-land models for such seasonal-to-interannual prediction. Understanding the hydrological cycle in AGCMs is critical to establishing the potential for such prediction. Our own studies show, among other things, that soil moisture retention can lead to significant precipitation predictability in many midlatitude and tropical regions.

Koster, Randal D.↗

NASA NTRS1974

Data processing of Martian topographic information obtained from ground-based radar and spectroscopy and from Mariners 6 and 7. Martian topography elevations: Data processing

Papers are presented which were published as a result of a project involving the preparation of a topographical elevation contour map of Mars from all data sources available through 1969, as well as the observation of Mars by spectroscopic methods in 1971 to provide additional pressure data for topographic information. Topics of the papers include: the analysis of large-scale Martian topography variations - data preparation from earth based radar, earth based CO2 spectroscopy, and Mariners 6 and 7 CO2 spectroscopy; the analysis of water content in observed Martian white clouds; and Martian, lunar, and terrestrial crusts - a three-dimensional exercise in comparative geophysics.

Anderson, K. A.↗

NASA NTRS2018

Test and Analysis of a Buckling-Critical Large-Scale Sandwich Composite Cylinder

Structural stability is an important design consideration for launch-vehicle shell structures and it is well known that the buckling response of such shell structures can be very sensitive to small geometric imperfections. As part of an effort to develop new buckling design guidelines for sandwich composite cylindrical shells, an 8-ft-diameter honeycomb-core sandwich composite cylinder was tested under pure axial compression to failure. The results from this test are compared with finite-element-analysis predictions and overall agreement was very good. In particular, the predicted buckling load was within 1% of the test and the character of the response matched well. However, it was found that the agreement could be improved by including composite material nonlinearity in the analysis, and that the predicted buckling initiation site was sensitive to the addition of small bending loads to the primary axial load in analyses.

Schultz, Marc R.↗

DOE OSTI2024

Analysis and Mitigation of Cascading Outages Using an Interaction Graph Addressing Transient Stability

Cascading outages of power systems pose great threats to system security and reliability, potentially leading to large-scale blackouts. For analysis and mitigation of cascading outages, this paper proposes a transient stability-incorporated interaction graph. This graph statistically quantifies the interactions among line outages and instabilities of generators, which can model propagation paths and patterns of cascading outages. Compared with an interaction graph that only models line outages, this new interaction graph provides important insights on how transient instability occurs along with cascading outages. It also offers more effective strategies for mitigating outage propagation. The proposed interaction graph can be constructed from datasets of historical or simulated cascading events. It is demonstrated on an NPCC 140-bus system with mitigation strategies.

Guo, Zhenping↗

DOE OSTI2021

The persistence of large scale structures. Part I. Primordial non-Gaussianity

Abstract We develop an analysis pipeline for characterizing the topology of large scale structure and extracting cosmological constraints based on persistent homology . Persistent homology is a technique from topological data analysis that quantifies the multiscale topology of a data set, in our context unifying the contributions of clusters, filament loops, and cosmic voids to cosmological constraints. We describe how this method captures the imprint of primordial local non-Gaussianity on the late-time distribution of dark matter halos, using a set of N-body simulations as a proxy for real data analysis. For our best single statistic, running the pipeline on several cubic volumes of size 40 (Gpc/h) 3 , we detect f NL loc =10 at 97.5% confidence on ~ 85% of the volumes. Additionally wetest our ability to resolve degeneracies betweenthe topological signature of f NL loc and variation of σ 8 and argue that correctly identifying nonzero f NL loc in this case is possible via an optimal template method. Our method relies on information living at $\mathcal{O}$(10) Mpc/h, a complementary scale with respect to commonly used methods such as the scale-dependent bias in the halo/galaxy power spectrum. Therefore, while still requiring a large volume, our method does not require sampling long-wavelength modes to constrain primordial non-Gaussianity. Moreover, our statistics are interpretable: we are able to reproduce previous results in certain limits and we make new predictions for unexplored observables, such as filament loops formed by dark matter halos in a simulation box.

Astronomy & Astrophysics↗

NASA NTRS1990

Analysis of faults detected in a large-scale multi-version software development experiment

In a multiversion software experiment, twenty programs were built to the same specification of an inertial navigation problem. The programs were then subjected to a three-phase testing and debugging process: an acceptance test, a certification test, and an operational test. Less than 20 percent of the faults discovered during the certification and operational testing were nonunique, i.e., the same or very similar faults would be found in more than one program. However, some of these common faults spanned as many as half of the versions. Faults discovered during the certification testing were due to specification errors and ambiguities, inadequate programmer background knowledge, insufficient programming experience, incomplete analysis, and insufficient acceptance testing. Faults discovered during the operational testing were of a more subtle nature, and were mostly due to various programmer knowledge defects and incomplete analysis errors. Techniques that might have prevented the observed faults are discussed.

Vouk, Mladen A.↗