Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data locality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Advances in Kriging-Based Autonomous X-Ray Scattering Experiments

Autonomous experimentation is an emerging paradigm for scientific discovery, wherein measurement instruments are augmented with decision-making algorithms, allowing them to autonomously explore parameter spaces of interest. We have recently demonstrated a generalized approach to autonomous experimental control, based on generating a surrogate model to interpolate experimental data, and a corresponding uncertainty model, which are computed using a Gaussian process regression known as ordinary Kriging (OK). We demonstrated the successful application of this method to exploring materials science problems using x-ray scattering measurements at a synchrotron beamline. Here, we report several improvements to this methodology that overcome limitations of traditional Kriging methods. The variogram underlying OK is global and thus insensitive to local data variation. We augment the Kriging variance with model-based measures, for instance providing local sensitivity by including the gradient of the surrogate model. As with most statistical regression methods, OK minimizes the number of measurements required to achieve a particular model quality. However, in practice this may not be the most stringent experimental constraint; e.g. the goal may instead be to minimize experiment duration or material usage. We define an adaptive cost function, allowing the autonomous method to balance information gain against measured experimental cost. We provide synthetic and experimental demonstrations, validating that this improved algorithm yields more efficient autonomous data collection.

36 MATERIALS SCIENCE↗

Graph theory data for topological quantum chemistry

Topological phases of noninteracting particles are distinguished by the global properties of their band structure and eigenfunctions in momentum space. On the other hand, group theory as conventionally applied to solid-state physics focuses only on properties that are local (at high-symmetry points, lines, and planes) in the Brillouin zone. To bridge this gap, we have previously [Bradlyn et al., Nature (London) 547, 298 (2017)] mapped the problem of constructing global band structures out of local data to a graph construction problem. In this paper, we provide the explicit data and formulate the necessary algorithms to produce all topologically distinct graphs. Furthermore, we show how to apply these algorithms to certain “elementary” band structures highlighted in the aforementioned reference, and thus we identified and tabulated all orbital types and lattices that can give rise to topologically disconnected band structures. Finally, we show how to use the newly developed bandrep program on the Bilbao Crystallographic Server to access the results of our computation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Efficient Hierarchical State Vector Simulation of Quantum Circuits via Acyclic Graph Partitioning

Early but promising results in quantum computing have been enabled by the concurrent development of quantum algorithms, devices, and materials. Classical simulation of quantum programs has enabled the design and analysis of algorithms and implementation strategies targeting current and anticipated quantum device architectures. In this paper, we present a graph-based approach to achieve efficient quantum circuit simulation. Our approach involves partitioning the graph representation of a given quantum circuit into sub-graphs/circuits that exhibit better data locality. Simulation of each sub-circuit is organized hierarchically, with the iterative construction and simulation of smaller state vectors, improving overall performance. Also, this partitioning reduces the number of passes through data, improving the total computation time. We present three partitioning strategies and observe that acyclic graph partitioning typically results in the best time-to-solution. In contrast, other strategies reduce the partitioning time at the expense of potentially increased simulation times. Experimental evaluation demonstrates the effectiveness of our approach.

Fang, Bo↗

Performance Debugging and Tuning of Flash-X with Data Analysis Tools

State-of-the-art multiphysics simulations running on large scale leadership computing platforms have many variables contributing to their performance and scaling behavior. We recently encountered an interesting performance anomaly in Flash-X, a multiphysics multicomponent simulation software, when characterizing its performance behavior on several large-scale HPC platforms. The anomaly was tracked down to the interaction between the use of dynamic allocation of scratch data and data locality in the cache hierarchy. In this paper we present the details of unexpected performance variability of Flash-X, its extensive analysis using the performance measurement tool TAU to collect the data and Python data analysis libraries to explore the data, and our insights from this experience. In this process, we discovered and removed or mitigated two additional performance limiting bottlenecks for performance tuning.

Huck, Kevin↗

Climate data for bioclimate research of Amazon Basin central region near the city of Manaus

The current research/data set deals with environmental data related to the region around the city of Manaus, Brazil, located in the Amazon Basin central region. The research problem encompasses the answers to the questions: 'What correlations can arise from the data of climate and fauna in the Amazon Basin?" "How useful is the data from instrumented stations related to that area, related to the fauna and climatic conditions?" To answer these questions, an initial data set was generated, taking into account the main pollutants with sources from NASA satellites, the Amazon Tall Tower Observatory (ATTO) experiment, and the GOAmazon project, from 2014 to 2015, along with other local data, such as the position of thermal electric power stations. It has been worth noting the data available was not coherent among the sources, due to different measuring time intervals, heights, and geographical locations. Equally important, for future bioclimatic research, a grid space of 5-km interval and a 30-minute time period was considered within the data set, covering a surface area within the boundaries of Latitude 2.00 S to 4.25 S and Longitude 59.00 to 61.25 W. The data from NASA satellites, ATTO, and GOAmazon do not have this kind of detailed grid and time mesh. To carry on, the machine learning (ML) Random Forest (RF) algorithm was selected and used, among other ML algorithms, to fill in the data into this new grid. The features considered were: data from NASA satellites and from the two projects above, covering the pollutants: ozone, NOx, particulates with diameter down to 10 nanometers, isoprene, CO, and acetonitrile. Moreover, distances and bearings to Manaus and 11 thermal power stations nearby, night and day time periods, dry and wet seasons, were also considered to compose the features. The interpolation produced by the Random Forest algorithm aimed at the pollutants: acetonitrile, ozone, NOx, Particulate N, isoprene, and CO, which are related to bioclimatic research commonly. In total, a data set was created with 51,148,800 rows, with 44 columns, 38 for the features and 6 for the targets.

54 ENVIRONMENTAL SCIENCES↗

Advances in Geophysical Monitoring Methods To Support Groundwater Remedies

Monitoring plays an important role in supporting remedial investigations and selection of remedies for groundwater contamination and for assessing performance during implementation of remedies. When a groundwater plume is near the interface between groundwater and surface water, the dynamics of groundwater flow at this interface needs to be considered in the design and implementation of a remedy. For this and other aquifer situations, groundwater flow dynamics may be difficult to evaluate through groundwater head measurements due to a sparse monitoring-well network, a relatively flat hydraulic gradient, or the presence of induced gradients from pumping operations or groundwater mounds. Geophysical approaches, coupled with other targeted measurements or the use of an ionic tracer, provide temporal data that can quantify groundwater flow dynamics. Recent developments include a flux-monitoring tool that measures fluid conductivity, bulk conductivity, and temperature at the interface between groundwater and surface water. Joint interpretation of these local data with temporal two- or three-dimensional geophysical data improves quantification of groundwater and mass flux at a targeted location. In addition, geophysical design improvements that enable the use of numerical simulations to evaluate implementation configurations and expected data resolution for geophysical methods identify threshold conditions for successful monitoring and identify the most cost-effective configurations to meet monitoring objectives.

Strickland, Christopher E.↗

Advances in Geophysical Monitoring Methods to Support Groundwater Remedies - 19096

Monitoring plays an important role in supporting remedial investigations and selection of remedies for groundwater contamination and for assessing performance during implementation of remedies. When a groundwater plume is near the interface between groundwater and surface water, the dynamics of groundwater flow at this interface needs to be considered in the design and implementation of a remedy. For this and other aquifer situations, groundwater flow dynamics may be difficult to evaluate through groundwater head measurements due to a sparse monitoring-well network, a relatively flat hydraulic gradient, or the presence of induced gradients from pumping operations or groundwater mounds. Geophysical approaches, coupled with other targeted measurements or the use of an ionic tracer, provide temporal data that can quantify groundwater flow dynamics. Recent developments include a flux-monitoring tool that measures fluid conductivity, bulk conductivity, and temperature at the interface between groundwater and surface water. Joint interpretation of these local data with temporal two- or three-dimensional geophysical data improves quantification of groundwater and mass flux at a targeted location. In addition, geophysical design improvements that enable the use of numerical simulations to evaluate implementation configurations and expected data resolution for geophysical methods identify threshold conditions for successful monitoring and identify the most cost-effective configurations to meet monitoring objectives. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Impacts of Local Convective Processes on Rain on the Caribbean Island of Puerto Rico

Abstract This study aims to determine the impacts of tropical island processes on local convective storms. An analysis of rain events on the island of Puerto Rico between 1 June 2015 and 31 July 2016 showed that local island‐enhanced western storms accounted for 89 of 322 storms. This period is of particular importance for the Caribbean as 2015 was one of the driest years on record. While large‐scale influences such as the El Niño–Southern Oscillation, the North Atlantic Oscillation, African easterly waves, and Saharan dust transport modulate moisture conditions in the region, correlations between precipitation and El Niño–Southern Oscillation (−0.14), North Atlantic Oscillation (−0.42), and Saharan dust (0.1) for 1980–2016 ranged from weak to moderate. Local data for the island of Puerto Rico from weather stations, the Convection, Aerosol, and Synoptic‐Effects in the Tropics field campaign, and the North American Mesoscale model support the initiation or enhancement of convective rain events due to local island processes. In particular, analysis of surface wind speed/direction, convective available potential energy, lifted index, and the bulk Richardson number substantiate local instability due to surface heating, orographic uplift, and sea breeze trade‐wind convergence. These convective forcings along with available precipitable water in excess of 50 mm ultimately led to intense storms despite severe rainfall‐mitigating dust episodes for which aerosol optical thickness exceeded 0.4. These results may have major implications for considering the impacts of local air‐sea‐land interactions on rainfall over other tropical islands.

Hosannah, N.↗

Toward Electrochemical Studies on the Nanometer and Atomic Scales: Progress, Challenges, and Opportunities

Electrochemical reactions and ionic transport underpin the operation of a broad range of devices and applications, from energy storage and conversion to information technologies, as well as biochemical processes, artificial muscles, and soft actuators. Understanding the mechanisms governing function of these applications requires probing local electrochemical phenomena on the relevant time and length scales. Here, we discuss the challenges and opportunities for extending electrochemical characterization probes to the nanometer and ultimately atomic scales, including challenges in down-scaling classical methods, the emergence of novel probes enabled by nanotechnology and based on emergent physics and chemistry of nanoscale systems, and the integration of local data into macroscopic models. Scanning probe microscopy (SPM) methods based on strain detection, potential detection, and hysteretic current measurements are discussed. We further compare SPM to electron beam probes and discuss the applicability of electron beam methods to probe local electrochemical behavior on the mesoscopic and atomic levels. Similar to a SPM tip, the electron beam can be used both for observing behavior and as an active electrode to induce reactions. We briefly discuss new challenges and opportunities for conducting fundamental scientific studies, matter patterning, and atomic manipulation arising in this context.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Even Higher-Level Synthesis: An Exploration of AI Hardware Accelerators using HLS4ML

With the rise of artificial intelligence, the popularization of deep learning, and a constantly evolving industry, the demand for flexible and efficient tools has never been greater. As algorithms grow more complex, their runtime and energy consumption increase exponentially. Customized hardware accelerators, long used for specific mathematical operations, remain essential for managing modern applications' computational and power demands. Hardware accelerators can speed up complex computations by orders of magnitude, but their manual design and verification processes are often challenging and time-consuming. High-Level Synthesis (HLS) provides a solution by transforming high-level algorithm descriptions, typically written in C++ or SystemC, into synthesizable RTL suitable for hardware implementation. This approach reduces development time for RTL engineers while offering flexibility beyond what traditional handwritten RTL can provide. We extended this capability to the machine-learning domain with the open-source framework hls4ml, which allows neural networks trained in Python frameworks like Tensorflow or PyTorch to be synthesized into efficient hardware representations for the traditional FPGA and ASIC flows. This breakthrough addresses the growing need for reduced design turnaround and easy verification of ML hardware accelerators with low latency and power efficiency constraints. During this tutorial, we will demonstrate how Python complements HLS by simplifying the ML design process, bridging the gap between software and hardware development. Attendees will explore how we translate neural networks modeled in Python into fixed-point C++ models suitable for HLS workflows. We will dive into strategies like Value-Range Analysis and Quantization-Aware Training, which optimize these designs for deployment and evaluate their accuracy, power consumption, and energy efficiency. To exemplify these concepts, experts from Fermilab will share their experiences applying this technology to high-energy physics experiments, where real-time, low-latency processing is critical. Over the years, Fermilab engineers have demonstrated how deep neural networks, optimized for hardware using hls4ml, can meet the stringent requirements of trigger systems at the CERN Large Hadron Collider. These systems rely on rapid decision-making to process immense data volumes while retaining only the most relevant events for further analysis. The application of hls4ml has also been extended to innovative technologies like smart pixel arrays. These smart pixels integrate ML inference capabilities directly into sensor devices, enabling localized data processing at the pixel level. This approach drastically reduces the need to transmit raw data to external processing units, significantly decreasing power consumption and latency. By embedding neural networks within the pixel architecture, the smart pixels can identify and prioritize relevant data in real time, providing a highly efficient solution for edge computing in scenarios such as particle detectors and imaging systems. Fermilab's work highlights the potential of hardware-accelerated ML in scenarios where both speed and power efficiency are mission-critical. Through this tutorial, attendees will gain valuable insights into the challenges and solutions of deploying ML in hardware. Understanding how HLS and hls4ml streamline the development of neural network-based hardware accelerators is fundamental for the industry's future. Participants will learn how these technologies are shaping the future of AI and scientific computing.

Di Guglielmo, Giuseppe [Fermilab]↗

Securely Aggregated Coded Matrix Inversion

Coded computing is a method for mitigating straggling workers in a centralized computing network, by using erasure-coding techniques. Federated learning is a decentralized model for training data distributed across client devices. In this work we propose approximating the inverse of an aggregated data matrix, where the data is generated by clients; similar to the federated learning paradigm, while also being resilient to stragglers. To do so, we propose a coded computing method based on gradient coding. We modify this method so that the coordinator does not access the local data at any point; while the clients access the aggregated matrix in order to complete their tasks. Here, the network we consider is not centrally administrated, and the communications which take place are secure against potential eavesdroppers.

97 MATHEMATICS AND COMPUTING↗

SpF: Enabling Petascale Performance for Pseudospectral Dynamo Models

Pseudospectral (PS) methods possess a number of characteristics (e.g., efficiency, accuracy, natural boundary conditions) that are extremely desirable for dynamo models. Unfortunately, dynamo models based upon PS methods face a number of daunting challenges, which include exposing additional parallelism, leveraging hardware accelerators, exploiting hybrid parallelism, and improving the scalability of global memory transposes. Although these issues are a concern for most models, solutions for PS methods tend to require far more pervasive changes to underlying data and control structures. Further, improvements in performance in one model are difficult to transfer to other models, resulting in significant duplication of effort across the research community.We have developed an extensible software framework for pseudospectral methods called SpF that is intended to enable extreme scalability and optimal performance. High-level abstractions provided by SpF unburden applications of the responsibility of managing domain decomposition and load balance while reducing the changes in code required to adapt to new computing architectures. The key design concept in SpF is that each phase of the numerical calculation is partitioned into disjoint numerical kernels that can be performed entirely in-processor. The granularity of domain-decomposition provided by SpF is only constrained by the data-locality requirements of these kernels. SpF builds on top of optimized vendor libraries for common numerical operations such as transforms, matrix solvers, etc., but can also be configured to use open source alternatives for portability. SpF includes several alternative schemes for global data redistribution and is expected to serve as an ideal testbed for further research into optimal approaches for different network architectures.In this presentation, we will describe the basic architecture of SpF as well as preliminary performance data and experience with adapting legacy dynamo codes. We will conclude with a discussion of planned extensions to SpF that will provide pseudospectral applications with additional flexibility with regard to time integration, linear solvers, and discretization in the radial direction.

Pseudospectral (PS)↗

Using Virtual Observatory Services in Sky View

For over a decade Skyview has provided astronomers and the public with easy access to survey and imaging data from all wavelength regimes. SkyView has pioneered many of the concepts that underlie the Virtual Observatory. Recently SkyView has been released as a distributable package which uses VO protocols to access image and catalog services. This chapter describes how to use the Skyview as a local service and how to customize it to access additional VO services and local data.

McGlynn, Thomas A.↗

Improved representation of agricultural land use and crop management for large-scale hydrological impact simulation in Africa using SWAT+

To date, most regional and global hydrological models either ignore the representation of cropland or consider crop cultivation in a simplistic way or in abstract terms without any management practices. Yet, the water balance of cultivated areas is strongly influenced by applied management practices (e.g. planting, irrigation, fertilization, and harvesting). The SWAT+ (Soil and Water Assessment Tool) model represents agricultural land by default in a generic way, where the start of the cropping season is driven by accumulated heat units. However, this approach does not work for tropical and subtropical regions such as sub-Saharan Africa, where crop growth dynamics are mainly controlled by rainfall rather than temperature. In this study, we present an approach on how to incorporate crop phenology using decision tables and global datasets of rainfed and irrigated croplands with the associated cropping calendar and fertilizer applications in a regional SWAT+ model for northeastern Africa. We evaluate the influence of the crop phenology representation on simulations of leaf area index (LAI) and evapotranspiration (ET) using LAI remote sensing data from Copernicus Global Land Service (CGLS) and WaPOR (Water Productivity through Open access of Remotely sensed derived data) ET data, respectively. Results show that a representation of crop phenology using global datasets leads to improved temporal patterns of LAI and ET simulations, especially for regions with a single cropping cycle. However, for regions with multiple cropping seasons, global phenology datasets need to be complemented with local data or remote sensing data to capture additional cropping seasons. In addition, the improvement of the cropping season also helps to improve soil erosion estimates, as the timing of crop cover controls erosion rates in the model. With more realistic growing seasons, soil erosion is largely reduced for most agricultural hydrologic response units (HRUs), which can be considered as a move towards substantial improvements over previous estimates. We conclude that regional and global hydrological models can benefit from improved representations of crop phenology and the associated management practices. Future work regarding the incorporation of multiple cropping seasons in global phenology data is needed to better represent cropping cycles in areas where they occur using regional to global hydrological models.

crop phenology↗

Rock Valley Dense Gravity Acquisition

Characterizing the shallow structure of the Rock Valley region of the Nevada National Security Site is a critical component of the Rock Valley Direct Comparison project. Geophysical data of the region is needed for operational decisions, to constrain geologic models used for simulation, and to facilitate the analysis of future explosive source data. Local measurements of gravity are a key piece of geophysical information that helps to resolve the underlying geologic composition, fault structure, and density characteristics, yet, in the Rock Valley region these measurements are sparse on the scale of the testbed. In this report, we present the details of a recent gravity data acquisition survey designed to collect a dense dataset in the region of interest that complements the existing gravity work but greatly enhances our resolution. This dataset will be integrated with a complementary Los Alamos National Laboratory gravity collection and combined with the existing seismic data in a joint inversion. These measurements were conducted over two weeks with a portable gravimeter and high-resolution GPS and include repeat measurements at a USGS base station as well as reoccupation of gravity sites in the regional dataset. This collection of over 100 new dense gravity measurements will facilitate refinement of the existing Geologic Framework Model and directly complement newly acquired dense seismic data, ultimately improving the project’s ability to investigate the direct comparison of shallow earthquake and explosive sources.

58 GEOSCIENCES↗

Near-optimal routing of noisy quantum states

Placement, routing, and scheduling are essential tasks for near-optimal performance of programs for noisy quantum processors. Reliable execution of an arbitrary quantum circuit on current devices requires routing methods that overcome connectivity limitations while meeting data locality requirements. However, current devices also express highly variable noise levels in both the quantum gates and quantum registers. This requires any routing algorithm to be adaptive to both the circuit and the operating conditions. We demonstrate near-optimal routing methods of noisy quantum states that minimize the overall error of data movement while also limiting the computational complexity of routing decisions. We evaluate our methods against the noise characteristics of a 20-qubit superconducting quantum processor.

Sadlier III, Ronald↗

Towards Sheaf Theoretic Analyses for Delay Tolerant Networking

The goal of Delay Tolerant Networking (DTN) is to take a collection of heterogeneous, disparate connections between satellites, space assets, ground stations, and ground infrastructure and bring it together into a cohesive, functioning overlay network. Depending on the systems being considered, one can find links with a one-way light time exceeding minutes (and hours),periodic links which can sometimes be predicted by orbital mechanics, and restrictions based on the variety of capabilities built into these systems. These characteristics preclude traditional network models and routing techniques and have classically led to either rigid routing tables or purely probabilistic models. As the deeper underlying structures remain unknown, development of more DTN-optimized algorithms has lacked the necessary foundation. In a continuation of previous work, the goal of this paper is to identify and study these fundamental structures that exist in delay tolerant networks (DTN), with a focus on space networks. The current routing methodology has been to use contact graph routing (CGR) algorithms. CGR models a series of known contacts as a static graph. For CGR to work, this graph must be globally consistent and must have an accurate picture of the network. Because this is a globally controlled structure, there is little room for flexibility in the event of changes to the network which would naturally occur as the network grows. As a response to the desire for flexibility as the network changes, we introduced the mathematical structure known as sheaves to DTNs last year. The tag-line for sheaves is that they are a mathematically precise way of gluing local data together into unique global data. Thus, sheaves lend extra power to traditional models(and routing algorithms) by taking additional information and merging it, in as consistent a manner as possible, with the representation itself. The clearest example of how Earth-bound networks exhibit behavior that is “sheafy” is link state routers, which build a local-to-global picture of their network by gluing local information together into a global network, exactly as a sheaf would do. For routing within delay tolerant networks to truly exploit this structure, a deeper structure than a graph is required. In this paper, we develop sheaves that can work over directed graphs such as temporal flow networks, we construct a sheaf representation for Dijkstra’s algorithm, and we outline a construction for routing sheaves capable of modeling multicast scenarios. Finally, there is a section of future work suggesting follow-on research.

Robert Short↗

Annular Flow Simulation Supported by Iterative In-Memory Mesh Adaptation

Various flow regimes exist in a boiling water reactor (BWR) as the steam quality increases in the uprising coolant flow, from bubbly flow, slug/churn flow, to annular flow. The annular flow is characterized by the presence of a fast-moving gas core and the surrounding liquid film flowing on the conduit wall. Additionally, entrained droplets can be observed in the gas core with ingested bubbles in the liquid film. The dynamics occurring on the wavy interface between the liquid film and gas core plays a crucial role in affecting the heat transfer rate and pressure drop within the BWR core. However, a fundamental understanding of annular flow is still lacking, partly due to the difficulty in obtaining detailed local data in annular flow experiments. In the current study, a novel simulation framework is developed for the annular flow by coupling a computational fluid dynamics flow solver with state-of-the-art meshing software. The gas-liquid interface is tracked with the level set method. Based on the computed flow solutions, the computational mesh is dynamically adapted in memory to meet the local mesh resolution requirement. This iterative simulation-adaptation framework can ensure the fine mesh resolution across the interface, which not only helps mitigate the mass conservation degradation known to level set methods but also improves the representation of dramatic interface topological changes such as wave breaking and droplet entrainment. The present investigation will shed light onto the complex interfacial processes involved in annular flow and generate much needed simulation data for annular flow modeling.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗