Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large scale network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Demystifying the Resilience of Large Language Models: An End-to-End Perspective

Deep neural networks are known to be resilient to random bit-wise faults in their parameters. However, this resilience has primarily been established through evaluations of classification models. The extent to which this claim holds for large-language models remains underexplored. In this work, we conduct an extensive measurement study on the impact of random bitwise faults in commercial-scale language models. We perform an in-depth analysis of the resulting generation outputs. We first expose that these language models are not truly resilient to random bit-flips. While aggregate metrics such as accuracy may suggest resilience, an in-depth inspection of the generated outputs shows significant degradation in text quality. Our analysis also shows that tasks requiring more complex reasoning suffer more from performance and quality degradation. Moreover, we extend our analysis to models with augmented reasoning capabilities, such as Chain-of-Thought or Mixture of Experts architectures, and characterize their failure scenarios under random bit-flips.

Sun, Yu↗
DOE OSTI2022

Variational encoder geostatistical analysis (VEGAS) with an application to large scale riverine bathymetry

Estimation of riverbed profiles, also known as bathymetry, plays a vital role in many applications, such as safe and efficient inland navigation, prediction of bank erosion, land subsidence, and flood risk management. The high cost and complex logistics of direct bathymetry surveys, i.e, depth imaging, have encouraged the use of indirect measurements such as surface flow velocities. However, estimating high-resolution bathymetry from indirect measurements is an inverse problem that can be computationally challenging. Here, we propose a reduced-order model (ROM) based approach that utilizes a variational autoencoder (VAE), a type of deep neural network with a narrow layer in the middle, to compress bathymetry and flow velocity information and accelerate bathymetry inverse problems from flow velocity measurements. In our application, the shallow-water equations (SWE) with appropriate boundary conditions (BCs), e.g., the discharge and/or the free surface elevation, constitute the forward problem, to predict flow velocity. Then, ROMs of the SWEs are constructed on a nonlinear manifold of low dimensionality through a variational encoder and the bathymetry inversion problem is derived on the low-dimensional latent space in a Hierarchical Bayesian setting. Further, the reformulation allows variational inference with a small number (e.g., $\mathscr{O}$ (100) of ROM runs and efficient uncertainty quantification. We have tested our inversion approach on a one-mile reach of the Savannah River, GA, USA. Once the neural network is trained (offline stage), the proposed technique can perform the inversion operation orders of magnitude faster than traditional inversion methods that are commonly based on linear projections, such as principal component analysis (PCA), or the principal component geostatistical approach (PCGA). Furthermore, tests show that the algorithm can estimate the bathymetry with good accuracy even with sparse flow velocity measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Physics-guided dual implicit neural representations for source separation

Significant challenges exist in efficient data analysis of most advanced experimental and observational techniques because the collected signals often include unwanted contributions, such as background and signal distortions, that can obscure the physically relevant information of interest. To address this, we have developed a self-supervised machine-learning approach for source separation using a dual implicit neural representation framework that jointly trains two neural networks: one for approximating distortions of the physical signal of interest and the other for learning the effective background contribution. Our method learns directly from the raw data by minimizing a reconstruction-based loss function without requiring labeled data or pre-defined dictionaries. We demonstrate the effectiveness of our framework by considering a challenging case study involving large-scale simulated, as well as experimental, momentum-energy-dependent inelastic neutron scattering data in a four-dimensional parameter space, characterized by heterogeneous background contributions and unknown distortions to the target signal. The method is found to successfully separate physically meaningful signals from a complex or structured background even when the signal characteristics vary across all four dimensions of the parameter space. An analytical approach that informs the choice of the regularization parameter is presented. Our method offers a versatile framework for addressing source separation problems across diverse domains, ranging from superimposed signals in astronomical measurements to structural features in biomedical image reconstructions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Grassland ecosystem type drives AM fungal diversity and functional guild distribution in North American grasslands

Nutrient exchange forms the basis of the ancient symbiotic relationship that occurs between most land plants and arbuscular mycorrhizal (AM) fungi. Plants provide carbon (C) to AM fungi and fungi provide the plant with nutrients such as nitrogen (N) and phosphorous (P). Nutrient addition can alter this symbiotic coupling in key ways, such as reducing AM fungal root colonization and changing the AM fungal community composition. However, environmental parameters that differentiate ecosystems and drive plant distribution patterns (e.g., pH, moisture), are also known to impact AM fungal communities. Identifying the relative contribution of environmental factors impacting AM fungal distribution patterns is important for predicting biogeochemical cycling patterns and plant-microbe relationships across ecosystems. Here, to evaluate the relative impacts of local environmental conditions and long-term nutrient addition on AM fungal abundance and composition across grasslands, we studied experimental plots amended for 10 years with N, P, or N and P fertilizer in different grassland ecosystem types, including tallgrass prairie, montane, shortgrass prairie, and desert grasslands. Contrary to our hypothesis, we found ecosystem type, not nutrient treatment, was the main driver of AM fungal root colonization, diversity, and community composition, even when accounting for site-specific nutrient limitations. We identified several important environmental drivers of grassland ecosystem AM fungal distribution patterns, including aridity, mean annual temperature, root moisture, and soil pH. This work provides empirical evidence for niche partitioning strategies of AM fungal functional guilds and emphasizes the importance of long-term, large scale research projects to provide ecologically relevant context to nutrient addition studies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

RingX: Scalable Parallel Attention for Long-Context Learning on HPC

The attention mechanism has become foundational for remarkable AI breakthroughs since the introduction of the Transformer, driving the demand for increasingly longer context to power frontier models such as large-scale reasoning language models and high-resolution image/video generators. However, its quadratic computational and memory complexities present substantial challenges. Current state-of-the-art parallel attention methods, such as ring attention, are widely adopted for long-context training but utilize a point-to-point communication strategy that fails to fully exploit the capabilities of modern HPC network architectures. In this work, we propose ringX, a scalable family of parallel attention methods optimized explicitly for HPC systems. By enhancing workload partitioning, refining communication patterns, and improving load balancing, ringX achieves up to 3.4 × speedup compared to conventional ring attention on the Frontier supercomputer. Optimized for both bi-directional and causal attention mechanisms, ringX demonstrates its effectiveness through training benchmarks of a Vision Transformer (ViT) on a climate dataset and a Generative Pre-Trained Transformer (GPT) model, Llama3 8B. Our method attains an end-to-end training speedup of approximately 1.5 × in both scenarios. To our knowledge, the achieved 38% model FLOPs utilization (MFU) for training Llama3 8B with a 1M-token sequence length on 4,096 GPUs represents one of the highest training efficiencies reported for long-context learning on HPC systems. Our code implementation is available at https://github.com/jqyin/ringX-attention.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2020

Predicting Compliance in an Epidemiological Model: Constructs from Psychological Theory and Research

Vaccination and the alternative behavior, vaccine refusal, are a classic example of manifesting behaviors driven by social norms and norm violations. Establishing how norms emerge, and under what circumstances people choose to violate them are key issues to understand in modeling epidemics. Interactions between individuals can lead to large-scale patterning of behavior (emergent phenomena). As norm violations are revealed through human behavior, drawing on psychological theory and principles to predict those violations is a viable approach for more human-constrained epidemiological models. As an example of the implications at scale, vaccine refusal is correlated with the spread of mis/disinformation about vaccine side-effects. Considering the complexities of network dynamics, the downstream effects means that if even a small group within a population are persuaded against vaccination, there is a reservoir from which disease and disease outbreaks can propagate. This work will attempt to identify those psychological indicators, to define circumstances that predict health behaviors, and identify potentially modifiable antecedents of health behavior, and factors that influence changes toward health protective behaviors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Multi-Fidelity Stochastic Economic Dispatch for Operating Low Carbon Power Grids

Grid operators can address the inherently stochastic nature of renewables by solving a two-stage stochastic programming model that minimizes the cost of dispatch decisions while accounting for the complex grid dynamics. It is common to use a sample average approximation to estimate the expectation of the second stage costs in this model. However, the large sample count needed for numerical accuracy makes effective modeling large-scale electric grids computationally intractable. We introduce a control variate multi-fidelity estimator for the second-stage recourse that enables high quality dispatch decisions in real-time with a reduced computational burden. We obtain a hierarchy of model fidelities by linearizing the AC power flow system representation to DC power flow, and by relaxing transmission and voltage network constraints. We evaluate the performance of our proposed method on a synthetic grid with 73 buses against a deterministic baseline with persistence forecast and a high-fidelity reference. Our analysis shows a computational speed-up of 7.62x with a minimal loss in accuracy. The multi-fidelity method is well suited to fidelity combinations that use a simplified network topology in their lower fidelity model and is an attractive option for applications where accurate grid modeling needed on a limited computational budget.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

The LSST AGN Data Challenge: Selection Methods

Abstract Development of the Rubin Observatory Legacy Survey of Space and Time (LSST) includes a series of Data Challenges (DCs) arranged by various LSST Scientific Collaborations that are taking place during the project's preoperational phase. The AGN Science Collaboration Data Challenge (AGNSC-DC) is a partial prototype of the expected LSST data on active galactic nuclei (AGNs), aimed at validating machine learning approaches for AGN selection and characterization in large surveys like LSST. The AGNSC-DC took place in 2021, focusing on accuracy, robustness, and scalability. The training and the blinded data sets were constructed to mimic the future LSST release catalogs using the data from the Sloan Digital Sky Survey Stripe 82 region and the XMM-Newton Large Scale Structure Survey region. Data features were divided into astrometry, photometry, color, morphology, redshift, and class label with the addition of variability features and images. We present the results of four submitted solutions to DCs using both classical and machine learning methods. We systematically test the performance of supervised models (support vector machine, random forest, extreme gradient boosting, artificial neural network, convolutional neural network) and unsupervised ones (deep embedding clustering) when applied to the problem of classifying/clustering sources as stars, galaxies, or AGNs. We obtained classification accuracy of 97.5% for supervised models and clustering accuracy of 96.0% for unsupervised ones and 95.0% with a classic approach for a blinded data set. We find that variability features significantly improve the accuracy of the trained models, and correlation analysis among different bands enables a fast and inexpensive first-order selection of quasar candidates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1998

Mesoscale to Synoptic Scale Cloud Variability

The atmospheric circulation and its interaction with the oceanic circulation involve non-linear and non-local exchanges of energy and water over a very large range of space and time scales. These exchanges are revealed, in part, by the related variations of clouds, which occur on a similar range of scales as the atmospheric motions that produce them. Collection of comprehensive measurements of the properties of the atmosphere, clouds and surface allows for diagnosis of some of these exchanges. The use of a multi-satellite-network approach by the International Satellite Cloud Climatology Project (ISCCP) comes closest to providing complete coverage of the relevant range space and time scales over which the clouds, atmosphere and ocean vary. A nearly 15-yr dataset is now available that covers the range from 3 hr and 30 km to decade and planetary. This paper considers three topics: (1) cloud variations at the smallest scales and how they may influence radiation-cloud interactions, and (2) cloud variations at "moderate" scales and how they may cause natural climate variability, and (3) cloud variations at the largest scales and how they affect the climate. The emphasis in this discussion is on the more mature subject of cloud-radiation interactions. There is now a need to begin similar detailed diagnostic studies of water exchange processes.

Rossow, William B.↗
NASA NTRS2019

Global and Regional Trends of Atmospheric Sulfur

The profound changes in global SO[subscript 2] emissions over the last decades have affected atmospheric composition on a regional and global scale with large impact on air quality, atmospheric deposition and the radiative forcing of sulfate aerosols. Reproduction of historical atmospheric pollution levels based on global aerosol models and emission changes is crucial to prove that such models are able to predict future scenarios. Here, we analyze consistency of trends in observations of sulfur components in air and precipitation from major regional networks and estimates from six different global aerosol models from 1990 until 2015. There are large interregional differences in the sulfur trends consistently captured by the models and observations, especially for North America and europe. europe had the largest reductions in sulfur emissions in the first part of the period while the highest reduction came later in North America and east Asia. the uncertainties in both the emissions and the representativity of the observations are larger in Asia. However, emissions from East Asia clearly increased from 2000 to 2005 followed by a decrease, while in India a steady increase over the whole period has been observed and modelled. the agreement between a bottom-up approach, which uses emissions and process-based chemical transport models, with independent observations gives an improved confidence in the understanding of the atmospheric sulfur budget.

Aas, Wenche↗
NASA NTRS2025

Photophoretic Propulsion Enabling Mesosphere Exploration NIAC Phase I Final Report

This Phase I report presents a comprehensive study on photophoretic flyers—innovative, ultralight, solar-powered vehicles that harness photophoretic forces generated via Knudsen pumping to achieve sustained flight in the mesosphere (50–80 km altitude). By integrating advanced materials such as nanocardboard— characterized by its extremely low areal density (~1 g/m²) and high bending stiffness—with ultrathin light-absorbing coatings, the project converts incident solar radiation directly into a directed thrust. Extensive experimental investigations, coupled with high-fidelity computational fluid dynamics (CFD) simulations using ANSYS Fluent, validate the concept across various three-dimensional geometries, including spherical, conical, and rocket-shaped configurations. These simulations bridge the gap between free-molecular and continuum flow regimes, demonstrating that optimized designs can generate lift forces sufficient to support kilogram-scale payloads even in low-pressure environments. At the heart of this innovation is the use of Knudsen pumping, where temperature gradients across porous surfaces induce directional gas flow, creating a modest overpressure that provides lift. The report introduces an analytical framework that interpolates between the well-known low-Reynolds number drag regime and the high-Reynolds number momentum theory. This model accurately predicts lift based on design parameters such as microchannel dimensions, porous wall geometry, areal density, and nozzle exit area. For instance, simulations indicate that 10-meter-scale structures with carefully engineered porous walls can achieve the necessary pressure differential to support scientifically significant payloads (~1 kg). The study also explores a hybrid propulsion approach that combines solar buoyancy with photophoretic lift. Initially, solar heating creates a buoyant force that elevates the flyer to mesospheric altitudes. Once in the optimal pressure range, the photophoretic mechanism—powered by Knudsen pumping—takes over as the primary source of lift, ensuring stable, long-duration flight. This dual-mode operation not only facilitates the deployment of photophoretic flyers but also broadens the potential applications for mesospheric exploration. In addition to propulsion, the report investigates the integration of photophoretic thrusters for trajectory control of existing research balloons in the upper stratosphere. By dynamically adjusting the nozzle orientation and controlling the flow-through velocity, these thrusters provide precise maneuverability, enabling the flyers to counteract atmospheric disturbances and adjust their flight paths in real time. For example, a photophoretic thruster approximately 7.5 by 7.5 meters in size could be unfolded below a payload gondola of a 60 million-cubic-foot zero-pressure balloon. Such a thruster can provide horizontal speed control of approximately 1 m/s using only sunlight and no moving parts (except those needed to track the Sun and control the jet direction). Importantly, photophoretic thrusters operate more efficiently at higher altitudes, which is complementary to known trajectory control techniques, such as propellers and tethered wings, which are more effective at lower altitudes. Finally, the report identifies three scientific research thrusts where mesospheric aircraft technology can have a profound impact: atmospheric tides, characterization of gravity waves, and investigation of mesospheric instabilities. Overall, the findings of this Phase I project represent a significant advancement in photophoretic propulsion technology. By demonstrating that large-scale, ultralight structures can be powered solely by solar radiation—via carefully engineered Knudsen pumping—this work lays a robust foundation for scalable, near-space flight architectures. Future refinements in material fabrication, structural optimization, and integrated trajectory control are expected to further enhance performance, paving the way for operational demonstrations that could revolutionize atmospheric science, remote sensing, and communication networks.

Knudsen Pump↗
DOE OSTI2021

Learning-Based Real-Time Event Identification Using Rich Real PMU Data

A large-scale deployment of phasor measurement units (PMUs) that reveal the inherent physical laws of power systems from a data perspective enables an enhanced awareness of power system operation. However, the high-granularity and non-stationary nature of PMU data and imperfect data quality could bring great technical challenges for real-time system event identification. To address these challenges, this paper proposes a two-stage learning-based framework. In the first stage, a Markov transition field (MTF) algorithm is exploited to extract the latent data features by encoding temporal dependency and transition statistics of PMU data in graphs. Then, a spatial pyramid pooling (SPP)-aided convolutional neural network (CNN) is established to efficiently and accurately identify power events. The proposed method fully builds on and is also tested on a large real-world dataset from several tens of PMU sources (and the corresponding event logs), located across the U.S., with a time span of two consecutive years. We report the numerical results validate that our method has high identification accuracy while showing good robustness against poor data quality.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Generating multi-scale Li-ion battery cathode particles with radial grain architectures using stereological generative adversarial networks

Abstract Understanding structure-property relationships of Li-ion battery cathodes is crucial for optimizing rate-performance and cycle-life resilience. However, correlating the morphology of cathode particles, such as in LiNi0.8Mn0.1Co0.1O2 (NMC811), and their inner grain architecture with electrode performance is challenging, particularly, due to the significant length-scale difference between grain and particle sizes. Experimentally, it is not feasible to image such a high number of particles with full granular detail. A second challenge is that sufficiently high-resolution 3D imaging techniques remain expensive and are sparsely available at research institutions. Here, we present a stereological generative adversarial network-based model fitting approach to tackle this, that generates representative 3D information from 2D data, enabling characterization of materials in 3D using cost-effective 2D data. Once calibrated, this multi-scale model can rapidly generate virtual cathode particles that are statistically similar to experimental data, and thus is suitable for virtual characterization and materials testing through numerical simulations. A large dataset of simulated particles with inner grain architecture has been made publicly available.

25 ENERGY STORAGE↗
DOE OSTI2020

FPDeep: Scalable Acceleration of CNN Training on Deeply-Pipelined FPGA Clusters

In this paper, we propose a framework called FPDeep, which uses a hybrid of model and layer paral- lelism to configure distributed reconfigurable clusters to train DNNs. This approach has numerous benefits. First, the design does not suffer from batch size growth. Second, novel workload and weight partitioning leads to balanced loads of both among nodes. And third, the entire system is fine-grained pipeline. This leads to high parallelism and utilization and also minimizes the time features need to be cached while waiting for back-propagation.

Wang, Tianqi↗
DOE OSTI2020

Advances in High-Power Wireless Charging Systems: Overview and Design Considerations

Wireless charging systems are foreseen as an effective solution to improve the convenience and safety of conventional conductive chargers. As this technology has matured, recent broad applications of wireless chargers to electrified transportation have indicated a trend toward higher power, power density, modularity, and scalability of designs. In this article, commercial systems and laboratory prototypes are reviewed, focusing mostly on the advances in high-power wireless charging systems. The recent endeavors in magnetic pad designs, compensation networks, power electronics converters, control strategies, and communication protocols are illustrated. Both stationary and dynamic (in-motion) wireless charging systems are discussed, and critical differences in their designs and applications are emphasized. On that basis, the comparisons among different solutions and design considerations are summarized to present the essential elements and technology roadmap that will be necessary to support large-scale deployment of high-power wireless charging systems. The review is concluded with the discussion of several fundamental challenges and prospects of high-power wireless power transfer (WPT) systems. Foreseen challenges include utilization of advanced materials, electric and electromagnetic field measurement and mitigation, customization, communications, power metering, and cybersecurity.

25 ENERGY STORAGE↗
DOE OSTI2020

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗
DOE OSTI2025

High-frequency Data Integration for Landscape Model Calibration of Carbon Fluxes Across Diverse Tidal Marshes

Terrestrial Aquatic Interfaces (TAIs), and tidal wetlands in particular, store large amounts of carbon yet are not well represented in Earth System Models (ESMs). Predictions of carbon cycling and greenhouse gas (GHG) emissions in tidal wetlands are highly uncertain. Eddy covariance (EC) towers provide ecosystem-scale GHG flux data at a temporal resolution (every 30min) that is helpful for parameterizing and improving mechanistic realism in ESMs. We propose to use a network of eddy covariance towers and standardized ancillary data streams, along with mesocosm experiments and statistical analyses, across diverse tidal wetlands of North America to develop and improve biogeochemical modeling at the TAI. Our overarching objective is to improve understanding and process-based modeling of gross primary productivity (GPP) and CH4 emission responses, both non-linear and asynchronous, to stressors including plant inundation, disturbance, salinity and nitrogen loading.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1986

Optical fiber characteristics and standards; Proceedings of the Meeting, Cannes, France, November 25-27, 1985

Papers are presented on outside vapor deposition, the plasma activated CVD process for large scale production of telecommunication fibers, axial lateral plasma deposition technology from plastic clad silica, coatings for optical fibers, primary coating characterization, and radiation-induced time dependent attenuation in a fiber. Topics discussed include fibers with high tensile strength, the characteristics and specifications of airborne fiber optic components, the baseband frequency response of multimode fibers, and fibers for local and broadband networks. Consideration is given to industrial measurements for single mode and multimode fibers, the characterization of source power distribution in a multimode fiber by a splice offset technique, the measurement of chromatic dispersion in a single mode optical, and the effect of temperature on the refracted near-field optical fiber profiling technique.

Bouillie, Remy↗