Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “unprecedented”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Tournament-Based Pretraining to Accelerate Federated Learning

Advances in hardware, proliferation of compute at the edge, and data creation at unprecedented scales have made federated learning (FL) necessary for the next leap forward in pervasive machine learning. For privacy and network reasons, large volumes of data remain stranded on endpoints located in geographically austere (or at least austere network-wise) locations. However, challenges exist to the effective use of these data. To solve the system and functional level challenges, we present an three novel variants of a serverless federated learning framework. We also present tournament-based pretraining, which we demonstrate significantly improves model performance in some experiments. Overall, these extensions to FL and our novel training method enable greater focus on science rather than ML development.

Baughman, Matt↗

Quantifying Uncertainty in HPC Job Queue Time Predictions

High Performance Computing (HPC) has developed at an unprecedented pace in recent decades. This growth has demanded corresponding development in the area of HPC Operational Data Analytics (ODA), which encompasses a wide range of data analysis techniques, ML/AI efforts, tools, and visualizations. Published studies in ODA offer a variety of practical ways to inform HPC users, administrators, procurement managers, and other stakeholders. Uncertainty analysis, however, is rare in the related published literature. For instance, we identify only 1 out of 14 existing studies focused on job queue time prediction that investigates the uncertainty aspect of their proposed predictions. We recognize the utmost importance uncertainty quantification can have in such predictive analytics solutions, with consequences in how users interpret information they receive, and attempt to bridge this gap. With the goal of improving access to such insights, we develop a process for determining upper and lower bounds of the predicted queue times of a regression model at a specified confidence level. Our current research is focused on the uncertainty in predicting job queue times, yet our approach may be employed in predicting other metrics.

HPC↗

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗

Simulating many-engine spacecraft: Exceeding 1 quadrillion degrees of freedom via information geometric regularization

We present an optimized implementation of the recently proposed information geometric regularization (IGR) for unprecedented scale simulation of compressible fluid flows applied to multi-engine spacecraft boosters. We improve upon state-of-the-art computational fluid dynamics (CFD) techniques in terms of computational cost, memory footprint, and energy-to-solution metrics. Unified memory on coupled CPU–GPU or APU platforms increases problem size with negligible overhead. Mixed half/single-precision storage and computation are used on well-conditioned numerics. We simulate flow at 200 trillion grid points and 1 quadrillion degrees of freedom, exceeding the current record by a factor of 20. A factor of 4 wall-time speedup is achieved over optimized baselines. Ideal weak scaling is observed on OLCF Frontier, LLNL El Capitan, and CSCS Alps using the full systems. Strong scaling is near ideal at extreme conditions, including 80% efficiency on CSCS Alps with an 8 node baseline and stretching to the full system.

Wilfong, Benjamin [Georgia Institute of Technology↗

Advancing Quantum Many-Body GW Calculations on Exascale Supercomputing Platforms

Advanced ab initio materials simulations face growing challenges as increasing systems and phenomena complexity requires higher accuracy, driving up computational demands. Quantum many-body GW methods are state-of-the-art for treating electronic excited states and couplings but often hindered due to the costly numerical complexity. Here, we present innovative implementations of advanced GW methods within the BerkeleyGW package, enabling large-scale simulations on Frontier and Aurora exascale platforms. Our approach demonstrates exceptional versatility for complex heterogeneous systems with up to 17,574 atoms, along with achieving true performance portability across GPU architectures. We demonstrate excellent strong and weak scaling to thousands of nodes, reaching double-precision core-kernel performance of 1.069 ExaFLOP/s on Frontier (9,408 nodes) and 707.52 PetaFLOP/s on Aurora (9,600 nodes), corresponding to 59.45% and 48.79% of peak, respectively. Our work demonstrates a breakthrough in utilizing exascale computing for quantum materials simulations, delivering unprecedented predictive capabilities for rational designs of future quantum technologies.

Zhang, Benran [University of Southern California, ↗

QProR: An Efficient Framework for Quantity-of-Interest Based Progressive Retrieval with Guaranteed Error Control

Scientific applications generate an unprecedented volume of data, overwhelming the network and file systems’ bandwidth and posing challenges for efficient and scalable data retrieval and analysis. Progressive data compression offers a promising solution by enabling on-demand retrieval at reduced size. However, existing progressive methods either fail to bound the errors in essential quantities of interest (QoIs) derived from raw data or suffer from suboptimal retrieval efficiency. In this work, we propose QProR, an efficient QoI-based progressive framework that optimizes progressive retrieval for target QoIs. Our key contributions include: (1) a systematic framework that integrates error-controlled lossy compressors with bitplane encoding while decoupling the two processes for high flexibility and adaptability; (2) a novel weighted bitplane encoding method which incorperates QoI knowledge into data refactoring to enhance retrieval efficiency; (3) an optimized retrieval strategy that accounts for the varying impacts of different variables on multivariate QoIs; (4) comprehensive evaluations using six real-world datasets from multiple scientific applications and thorough comparisons against state of the arts. Experimental results demonstrate that QProR achieves up to 80.38% reduction in the retrieval size under the same requested QoI error tolerance, when compared with the best-performing existing methods. When transferring 384 GB of scientific data to remote sites, QProR delivers up to 1.68 × speedup in the end-to-end data transfer performance.

Li, Wenbo [University of Kentucky]↗

Evolutionary History of Plant Metabolism

Tremendous chemical diversity is the hallmark of plants and is supported by highly complex biochemical machinery. Plant metabolic enzymes originated and were transferred from eukaryotic and prokaryotic ancestors and further diversified by the unprecedented rates of gene duplication and functionalization experienced in land plants. Unlike microbes, which have frequent horizontal gene transfer events and multiple inputs of energy and organic carbon, land plants predominantly rely on organic carbon generated from CO 2 and have experienced very few, if any, gene transfers during their recent evolutionary history. As such, plant metabolic networks have evolved in a stepwise manner and on existing networks under various evolutionary constraints. This review aims to take a broader view of plant metabolic evolution and lay a framework to further explore evolutionary mechanisms of the complex metabolic network. Understanding the underlying metabolic and genetic constraints is also an empirical prerequisite for rational engineering and redesigning of plant metabolic pathways.

Plant Sciences↗

Photometric Redshifts for Next-Generation Surveys

Photometric redshifts are essential in studies of both galaxy evolution and cosmology, as they enable analyses of objects too numerous or faint for spectroscopy. The Rubin Observatory, Euclid, and Roman Space Telescope will soon provide a new generation of imaging surveys with unprecedented area coverage, wavelength range, and depth. To take full advantage of these data sets, further progress in photometric redshift methods is needed. In this review, we focus on the greatest common challenges and prospects for improvement in applications of photometric redshifts to the next generation of surveys: ∙ Gains in performance (i.e., the precision of redshift estimates for individual galaxies) could greatly enhance studies of galaxy evolution and some probes of cosmology. ∙ Improvements in characterization (i.e., the accurate recovery of redshift distributions of galaxies in the presence of uncertainty on individual redshifts) are urgently needed for cosmological measurements with next-generation surveys. To achieve both of these goals, improvements in the scope and treatment of the samples of spectroscopic redshifts that make high-fidelity photometric redshifts possible will also be needed. For the full potential of the next generation of surveys to be reached, the characterization of redshift distributions must improve by roughly an order of magnitude compared with the current state of the art, requiring progress on a wide variety of fronts. We conclude by presenting a speculative evaluation of how photometric redshift methods and the collection of the necessary spectroscopic samples may improve by the time near-future surveys are completed.

Astronomy & Astrophysics↗

Control of Low-Inertia Power Systems

Electric power systems are undergoing an unprecedented transition from fossil fuel–based power plants to low-inertia systems that rely predominantly on power electronics and renewable energy resources. This article reviews the resulting control challenges and modeling fallacies, at both the device and system level, and focuses on novel aspects or classical concepts that need to be revised in light of the transition to low-inertia systems. To this end, we survey the literature on modeling of low-inertia systems, review research on the control of grid-connected power converters, and discuss the frequency dynamics of low-inertia systems. Moreover, we discuss system-level services from a control perspective. Overall, we conclude that the system-theoretic mindset is essential to bridge different research communities and understand the complex interactions of power electronics, electric machines, and their controls in large-scale low-inertia power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Plant Cell Identity in the Era of Single-Cell Transcriptomics

High-throughput single-cell transcriptomic approaches have revolutionized our view of gene expression at the level of individual cells, providing new insights into their heterogeneity, identities, and functions. Recently, technical challenges to the application of single-cell transcriptomics to plants have been overcome, and many plant organs and tissues have now been subjected to analyses at single-cell resolution. In this review, we describe these studies and their impact on our understanding of the diversity, differentiation, and activities of plant cells. We particularly highlight their impact on plant cell identity, including unprecedented views of cell transitions and definitions of rare and novel cell types. Lastly, we also point out current challenges and future opportunities for the application and analyses of single-cell transcriptomics in plants.

59 BASIC BIOLOGICAL SCIENCES↗

Mechanical Properties of Metal Nanolaminates

This article reviews recent basic research on two categories of metal-based nanolaminates: those composed of metal/metal constituents and those composed of metal/ceramic constituents. We focus primarily on studies that aim to understand—via experiments, modeling, or both—the biphase interface structure and its role in changing the mechanisms that govern strength and deformability at a fundamental level. We anticipate that, by providing a broad perspective on the latest advances in nanolaminates, this review will aid design of new metallic materials with unprecedented combinations of mechanical and physical properties.

Materials Science↗

Polarization and Vorticity in the Quark–Gluon Plasma

The quark–gluon plasma (QGP) produced by collisions between ultrarelativistic heavy nuclei is well described in the language of hydrodynamics. Noncentral collisions are characterized by very large angular momentum, which in a fluid system manifests as flow vorticity. This rotational structure can lead to a spin polarization of the hadrons that eventually emerge from the plasma, and thus these collisions provide experimental access to flow substructure at unprecedented detail. Recently, the first observations of Λ hyperon polarization along the direction of collisional angular momentum were reported. These measurements are in broad agreement with hydrodynamic and transport-based calculations and reveal that the QGP is the most vortical fluid ever observed. However, there remain important tensions between theory and observation that might be fundamental in nature. In the relatively mature field of heavy-ion physics, the discovery of global hyperon polarization and 3D simulations of the collision have opened an entirely new direction of research. We discuss the current status of this rapidly developing area and directions for future research.

heavy-ion collisions↗

Rare and Experimentally Challenging Supersymmetry Signatures

Supersymmetry has long played a central role in the search for physics beyond the Standard Model at colliders, providing a comprehensive and internally consistent framework for generating well-motivated experimental signatures. For more than 15 years of Large Hadron Collider (LHC) operation, the CMS and ATLAS Collaborations have achieved remarkable sensitivity to a wide range of supersymmetric signatures. Despite this unprecedented reach, no conclusive evidence for supersymmetry has emerged. If supersymmetry is nature's solution to outstanding questions in particle physics, it is necessarily challenging to find. In this article, we review supersymmetric signatures that are particularly rare or otherwise challenging, with a focus on searches at the LHC. We highlight experimental challenges related to detector constraints and analysis difficulties, in addition to model challenges in the interpretation and optimization of searches. Here, we also identify regions of signature space that remain comparatively unconstrained and therefore represent promising targets for future exploration.

Large Hadron Collider↗

Covariant Density Functional Theory in Nuclear Physics and Astrophysics

How does subatomic matter organize itself? Neutron stars are cosmic laboratories uniquely poised to answer this fundamental question that lies at the heart of nuclear science. Newly commissioned rare isotope facilities, telescopes operating across the entire electromagnetic spectrum, and ever more sensitive gravitational wave detectors will probe the properties of neutron-rich matter with unprecedented precision over an enormous range of densities. A coordinated effort between observation, experiment, and theoretical research is of paramount importance for realizing the full potential of these investments. Theoretical nuclear physics provides valuable insights into the properties of neutron-rich matter in regimes that are not presently accessible to experiment or observation. In particular, nuclear density functional theory is likely the only tractable framework that can bridge the entire nuclear landscape by connecting finite nuclei to neutron stars. This compelling connection is the main scope of the present review.

79 ASTRONOMY AND ASTROPHYSICS↗

Bimolecular Chemistry in the Ultracold Regime

Advances in atomic, molecular, and optical physics techniques allowed the cooling of simple molecules down to the ultracold regime ([Formula: see text]1 mK) and opened opportunities to study chemical reactions with unprecedented levels of control. This review covers recent developments in studying bimolecular chemistry at ultralow temperatures. We begin with a brief overview of methods for producing, manipulating, and detecting ultracold molecules. We then survey experimental works that exploit the controllability of ultracold molecules to probe and modify their long-range interactions. Further combining the use of physical chemistry techniques such as mass spectrometry and ion imaging significantly improved the detection of ultracold reactions and enabled explorations of their dynamics in the short range. We discuss a series of studies on the reaction KRb + KRb → K 2 + Rb 2 initiated below 1 μK, including the direct observation of a long-lived complex, the demonstration of product rotational state control via conserved nuclear spins, and a test of the statistical model using the complete quantum state distribution of the products.

Chemistry↗

Porting a 3D seismic modeling code (SW4) to CORAL machines

Seismic waves fourth order (SW4) solves the seismic wave equations on Cartesian and curvilinear grids using large compute clusters with O (100,000) cores. In this article we discuss the porting of SW4 to run on the CORAL architecture using the RAJA performance portability abstraction layer. The performances of key kernels using RAJA and CUDA are compared to estimate the performance penalty of using the portability abstraction layer. Code changes required for efficiency on GPUs and minimizing time spent in Message Passing Interface (MPI) are discussed. This article describes a path for efficiently porting large code bases to GPU-based machines while avoiding the pitfalls of a new architecture in the early stages of its deployment. Current bottlenecks in the code are discussed along with possible architectural or software mitigations. SW4 runs 28× faster on one 4-GPU CORAL node than on a CTS-1 node (Dual Intel Xeon E5-2695 v4). SW4 is now in routine use on problems of unprecedented resolution (203 billion grid points) and scale on 1,200 nodes of Summit.

97 MATHEMATICS AND COMPUTING↗

bnl/pub-Maffettone_2020_08

The application of the XCA package as first demonstrated in aXiv:2008.00283. ABSTRACT: The discovery of new structural and functional materials is driven by phase identification, often using X-ray diffraction (XRD). Automation has accelerated the rate of XRD measurements, greatly outpacing XRD analysis techniques that remain manual, time consuming, error prone, and impossible to scale. With the advent of autonomous robotic scientists or self-driving labs, contemporary techniques prohibit the integration of XRD. Here, we describe a computer program for the autonomous characterization of XRD data, driven by artificial intelligence (AI), for the discovery of new materials. Starting from structural databases, we train an ensemble model using a physically accurate synthetic dataset, which output probabilistic classifications --- rather than absolutes --- to overcome the overconfidence in traditional neural networks. This AI agent behaves as a companion to the researcher, improving accuracy and offering unprecedented time savings, and is demonstrated on a diverse set of organic and inorganic materials challenges. This innovation is directly applicable to inverse design approaches, robotic discovery systems, and can be immediately considered for other forms of characterization such as spectroscopy and the pair distribution function.

Maffettone, PhillipM [Brookhaven National Lab. (BN↗

Explainable Neural Architecture Search (XNAS)

Code for the paper Learning Interpretable Models Through Multi-Objective Neural Architecture Search by Zachariah Carmichael, Tim Moon, and Sam Ade Jacobs. Monumental advances in deep learning have led to unprecedented achievements across a multitude of domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial. Research has been introduced to automate the design of neural network architectures through neural architecture search (NAS). Recent progress has made these methods more pragmatic by exploiting distributed computation and novel optimization algorithms. However, there is little work in optimizing architectures for interpretability. To this end, we propose a multiobjective distributed NAS framework that optimizes for both task performance and introspection. We leverage the non-dominated sorting genetic algorithm (NSGA-II) and explainable AI (XAI) techniques to reward architectures that can be better comprehended by humans. The framework is evaluated on several image classification datasets. We demonstrate that jointly optimizing for introspection ability and task error leads to more disentangled architectures that perform within tolerable error.

Carmichael, ZachariahJ↗