Data Centers in the Commercial Sector
This fact sheet summarizes some of the key needs, barriers, and opportunities related to data center management and operations in the Commercial Sector.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This fact sheet summarizes some of the key needs, barriers, and opportunities related to data center management and operations in the Commercial Sector.
One of the major scientific goals of the Deep Underground Neutrino Experiment (DUNE) is to detect and measure the neutrino flux originating from galactic core-collapse supernovae. These neutrinos provide an opportunity to study the end of life evolution of massive stars, and reveal information about the structure of core-collapse that is not visible in observations of the electromagnetic spectrum. Because of the rarity of these events, it is crucial that DUNE is able to detect supernova neutrino interactions when they occur. However, this will require sifting through a large quantity of data, motivating the development of a trigger algorithm to identify significant events and discard irrelevant data. Machine learning provides a potential approach to building this trigger. This project generates ADC and ground truth images of simulated neutrino interactions in a LArTPC detector to be used for machine learning, and uses them to train a sparse Convolutional Neural Network (C NN). The performance of this model when applied to the task of pixel classification based on interaction type is examined. This project found that the sparse CNN approach has the potential to have high accuracy in pixel classification, meaning it may be highly relevant to the development of a supernova neutrino trigger for the DUNE far detector.
As large language models scale to trillions of parameters, their computational and memory requirements present critical challenges for efficient training and deployment. While Mixture of Experts (MoE) architectures enable efficient scaling through sparse parameter activation, and state-space models like Mamba offer linear-time complexity, principled methods for combining these paradigms remain undeveloped. We introduce HARMONY (Hybrid Architecture Research for Mamba, Optimized with Neural efficiencY), a multi-objective evolutionary neural architecture search framework for discovering efficient hybrid language models that integrate Transformer attention mechanisms, Mixture-of-Experts routing, and Mamba state-space components. Through large-scale distributed search using 16,384 MI250X GPUs on the Frontier supercomputer, HARMONY explores a comprehensive design space encompassing six attention variants (MHA, MQA, GQA, MLA, SWA, and Mamba-2), variable MoE configurations with both routed and shared experts, and extensive Mamba hyperparameters. Our framework discovers heterogeneous architectures that balance training performance with computational efficiency through multi-objective optimization incorporating latency penalties and fitness-based selection. Analysis of discovered architectures reveals that optimal hybrid designs favor heterogeneous component mixing rather than homogeneous patterns, with Mamba-2 and Multi-Head Latent Attention (MLA) emerging as preferred mechanisms. Discovered architectures demonstrate superior training efficiency: our best configuration achieves a final perplexity of 1.0874 with 2.38B parameters while processing 4,320 tokens/second, outperforming significantly larger manually designed models. Full-scale evaluation shows HARMONY's top architectures achieve better loss trajectories than equivalently-sized models using state-of-the-art configurations including Mixtral, Jamba, and Samba. Additionally, we demonstrate 91% weak scaling efficiency when training discovered 36B-parameter models across 1,024 GPUs. HARMONY is released as an open framework with comprehensive tools for building and training hybrid models using expert-data-pipeline parallelism, democratizing access to automated architecture design for next-generation language models.
Scalable and actionable performance measures for traffic signal systems provide opportunities for practitioners to measure and improve the transportation network. Historically, traffic signal improvements have relied on scheduled signal retiming based on limited data collection, or on the public to call and alert engineers of an issue. This inefficient method of improving signal timing led to the creation of automated traffic signal performance measures (ATSPMs). These metrics rely on expensive infrastructure, including detection and communications, which has produced barriers for numerous agencies to fully adopt. Recently, third-party data providers have begun to release vehicle trajectory data, which allows for enhanced signal metrics with no investment in physical equipment. The purpose of this study is to demonstrate the use of these data and summarize the scalability of the created metrics. This work builds on previous efforts to quantify signal performance on nine intersections in Michigan, U.S. Ten signalized corridors in Columbus, Ohio, were chosen to scale a performance assessment using crowdsourced trajectory data. A total of 136 intersections were assessed in 2-h intervals using data from all weekdays in 2017. High-level corridor summary metrics including average percent of vehicles stopping (18%–32%), average delay (9.4–20.5 s), and level of travel time reliability (1.23–2.73) were calculated for each corridor direction. Intersection-level metrics were also introduced, which can be used by practitioners to identify problems, improve signal timings, and prioritize future infrastructure investments.
Deciding on a suitable algorithm for energy demand prediction in a building is non-trivial and depends on the availability of data. In this paper we compare four machine learning models, commonly found in the literature, in terms of their generalization performance and in terms of how using different sets of input features affects accuracy. This is tested on a data set where consumption patterns differ significantly between training and evaluation because of the Covid-19 pandemic. We provide a hands-on guide and supply a Python framework for building operators to adapt and use in their applications.
Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.
Experimental results are often plotted as 2-dimensional graphical plots (aka graphs) in scientific domains depicting dependent versus independent variables to aid visual analysis of processes. Repeatedly performing laboratory experiments consumes significant time and resources, motivating the need for computational estimation. The goals are to estimate the graph obtained in an experiment given its input conditions, and to estimate the conditions that would lead to a desired graph. Existing estimation approaches often do not meet accuracy and efficiency needs of targeted applications. We develop a computational estimation approach called AutoDomainMine that integrates clustering and classification over complex scientific data in a framework so as to automate classical learning methods of scientists. Knowledge discovered thereby from a database of existing experiments serves as the basis for estimation. Challenges include preserving domain semantics in clustering, finding matching strategies in classification, striking a good balance between elaboration and conciseness while displaying estimation results based on needs of targeted users, and deriving objective measures to capture subjective user interests. These and other challenges are addressed in this work. The AutoDomainMine approach is used to build a computational estimation system, rigorously evaluated with real data in Materials Science. Our evaluation confirms that AutoDomainMine provides desired accuracy and efficiency in computational estimation. It is extendable to other science and engineering domains as proved by adaptation of its sub-processes within fields such as Bioinformatics and Nanotechnology.
Computer simulations, especially of complex phenomena, can be expensive, requiring high-performance computing resources. Often, to understand a phenomenon, multiple simulations are run, each with a different set of simulation input parameters. These data are then used to create an interpolant, or surrogate, relating the simulation outputs to the corresponding inputs. When the inputs and outputs are scalars, a simple machine learning model can suffice. However, when the simulation outputs are vector valued, available at locations in two or three spatial dimensions, often with a temporal component, creating a surrogate is more challenging. In this report, we use a two-dimensional problem of a jet interacting with high explosives to understand how we can build high-quality surrogates. The characteristics of our data set are unique - the vector-valued outputs from each simulation are available at over two million spatial locations; each simulation is run for a relatively small number of time steps; the size of the computational domain varies with each simulation; and resource constraints limit the number of simulations we can run. We show how we analyze these extremely large data-sets, set the parameters for the algorithms used in the analysis, and use simple ways to improve the accuracy of the spatio-temporal surrogates without substantially increasing the number of simulations required.
In this study, we delineate key weather and demographic predictors of override behavior in residential buildings during connected thermostats demand response events. Anticipating and reducing overrides is critical to demand flexibility (DF) program success. We use high- dimensional fixed effects linear regression techniques on a large ecobee dataset for about 5,000 enrolled households in the United States. We identify critical weather (indoor and outdoor temperature), building (housing type), and occupant (previous DF overrides and previous DF event exposure) factors influencing the override patterns of customers during thermostat demand response. We also differentiate DF events by season to understand the different indoor and outdoor conditions that might influence seasonal override rates. We found significant differences in override rates between building types, with single-family semi-detached homes generally having the highest overrides. Having a history of overrides was additionally a critical factor in predicting occupant response to future DF events. Understanding these override differences is necessary for rural electric cooperatives and emerging DF programs without access to large DR historical data. Overall, we provide critical information on technical and local demographic characteristics that may be correlated to building type to influence strategies to reduce overrides and improve the adoption of DF technologies.
Here, we have explored data-driven methods for material microstructure quantification that improve sensitivity to microstructural changes compared to traditional approaches. The methods integrate multiple microstructural properties, including grain morphology, crystallographic orientation, and material phase information. The simpler method employs maps of the Euclidean distance transformation metric to evaluate the morphology of grain boundary networks. The more intensive approach employs generalized spherical harmonic mapping for crystallographic orientations, per-pixel phase information, and a variational auto-encoder for dimensionality reduction and results in a multidimensional clustering of by microstructure similarity. Applied to an experimental dataset of additively manufactured steel, both methods detected slight variations in samples produced under nominally identical processing conditions. Both methods were able to distinguish between samples from multiple (nominally identical) builds, while the generalized spherical harmonics-based method could additionally cluster data samples rotated at two orientations on the build plate. The improved sensitivity of the methods, demonstrated through comparison with traditional microstructure characterization techniques, offers advantages for microstructure quantification and comparisons in advanced manufacturing applications.
Three essential capabilities for using exascale computing resources on next generation power grid applications are: generating large renewable energy datasets, modeling damage and operations during and after extreme events, and employing multi-stage optimization for infrastructure planning. Powerscenarios, developed as part of the ExaSGD project, addresses these capabilities by enabling users to build synthetic wind farms for large test systems using numerical weather prediction-based data sources. We share examples of using Powerscenarios to build out wind farms on the ACTIVSg2000 test system, to enable simulated operations and emergency asset allocation during a hurricane strike, and to compute multi-stage infrastructure buildouts.
Occupants are active participants in their built environment, affecting its performance while simultaneously being affected by its design and indoor environmental conditions. With recent advances in computer modeling, simulation tools, and analysis techniques, topics such as human-building interactions and occupant behavior have gained significant interest in the literature given their premise of improving building design processes and operating strategies. In practice, the focus of occupant-centric literature has been mostly geared towards the latter (i.e., operation), leaving the implications on building design practices underexplored. This paper fills the gap by providing a critical review of existing studies applying computer-based modeling and simulation to guide occupant-centric building design. The reviewed papers are organized along four main themes, namely occupant-centric: (i) metrics of building performance, (ii) modeling and simulation approaches, (iii) design methods and applications, and (iv) supporting practices and mechanisms. Important barriers are identified for a more effective application of occupant-centric building design practices, including the limited consideration of metrics beyond energy efficiency (e.g., occupant well-being and space planning), the limited implementation and validation of the proposed methods, and the lack of integration of occupant behavior modeling in existing building performance simulation tools. Finally, future research directions are discussed, covering large-scale international data collection efforts to move from generic assumptions about occupant behavior to specific/localized knowledge, improved metrics of measuring building performance, and improved industry practices, such as building codes, to promote an occupant-in-the-loop approach to the building design process.
This work describes the initial development of dynamic system models of the cryogenic moderator system (CMS) of the Spallation Neutron Source (SNS) at ORNL as a part of the ORNL LDRD funded project Building TRANSFORM to Accelerate Digital Twin Applications for Nuclear Systems, LOIS 10563. The goal of the work is to start the dynamic system modeling effort with the end goal of using them for real-time applications as digital twins. The CMS is a cryogenic liquid hydrogen flow loop that provides moderation of the neutrons that are generated by the SNS. For optimal neutron production, the CMS needs to maintain a steady and controlled density of cryogenic hydrogen in the moderator section thus requiring precise temperature and pressure control. Due to the varied time scales and system characteristics, control of the system is complex, and diagnostics are also difficult. Difficulty in accessing the flow loop during operations, limited instrumentation and unknown design details of the equipment combine to make the case for having sophisticated digital twin models of the system. Operationally the CMS also provides a strong use case for digital twins due to the constant need of optimization and for troubleshooting/diagnostics. The large amount of data collected which are freely available for using in building the model and verifying and validating the model also makes it a great candidate for a proof-of-concept for digital twins. The project extends ORNL's capacity of development and implementation of the open-source dynamic system modeling tool TRANSFORM for engineering design and digital twin/real-time applications. Specific system configuration data for the CMS have been gathered and an initial dynamic model was created in the TRANSFORM library using Dymola as the solution platform. Models of increasing complexity are created to demonstrate the need for a multi-layered approach in digital twin modeling depending on the scale and phenomena being focused on. The dynamic modeling is shown to bring the dynamic operational aspects to the design process for systems as well as serve as a digital twin to the hardware and allow for models to be tuned and compared against real time operational data. These aims should help to push forward strategic goals of application of digital twins and increase the impact of ORNL systems modeling capabilities with TRANSFORM/Modelica for various advanced energy systems.
In preparation for the NISAR launch and data collection in 2024, the NISAR Project Science Team is building workflows for each Science Team discipline (Ecosystems, Cryosphere, and Solid Earth). This abstract focuses on the Ecosystem disciplines and the development of on-demand cloud-processing workflows for wetlands inundation, forest biomass, agricultural active crop area, and forest disturbance. The workflow simulates NISAR data using UAVSAR or ALOS-2 Single Look Complex data, which are processed to Level 2 geocoded polarimetric covariance matrix products using InSAR Scientific Computing Environment 3.0 software and to Level 3 science products using the Algorithm Theoretical Basis Documents. In this presentation, we describe these workflows and efforts to improve efficiency and data accessibility by using a cloud processing system. We present preliminary sample products from each Ecosystem discipline: inundation, forest biomass, crop area, and forest disturbance.
This study investigates the recovery of building-level footfall from the COVID-19 pandemic using privacy-preserving mobile devices-based footfall data within 60 downtown areas in the USA and Canada. Using clustering, we identify five distinct building typologies based on their characteristics, including rent, quality and recovery rates. The results reveal significant variation of recovery rates by building features. We find negative relationships with footfall recovery for both the percentage of office and remote work tenants and building quality. In contrast, buildings with traditional work tenants and retail functions achieve higher recovery rates. We also test the ‘flight to quality’ hypothesis via on our typology results. High-quality office buildings (Class A+) continue to have high rents but experience low physical footfall recovery, which suggests that this class is not as resilient as portrayed. The findings thus suggest the importance of considering both economic and footfall resilience in evaluating the performance of office buildings.
The HL-LHC run is anticipated to start at the end of this decade and will pose a significant challenge for the scale of the HEP software and computing infrastructure. The mission of the U.S. CMS Software & Computing Operations Program is to develop and operate the software and computing resources necessary to process CMS data expeditiously and to enable U.S. physicists to fully participate in the physics of CMS. We have developed a strategic plan to prioritize R&D efforts to reach this goal for the HL-LHC. This plan includes four grand challenges: modernizing physics software and improving algorithms, building infrastructure for exabyte-scale datasets, transforming the scientific data analysis process and transitioning from R&D to operations. We are involved in a variety of R&D projects that fall within these grand challenges. In this talk, we will introduce our four grand challenges and outline the R&D program of the U.S. CMS Software & Computing Operations Program.
Robust hardware and controls are necessary to ensure results match their intent before they can be used broadly. However, this often requires multiple field experiments in a variety of climate zones. In the field, it is more difficult to obtain information on other important factors, such as thermal, grid, and occupant interaction. Gaps also exist in understanding the performance degradation and life cycle of thermal energy systems as they relate to buildings. There is a lack of robust, high-quality performance data for projects at scale; this data can be expensive to produce and often remain proprietary.
We introduce pulse-echo ultrasound as a method for characterizing the impact of powder bed fusion parameters on the properties of additively manufactured stainless-steel components, their material anisotropy, and location-dependent heterogeneity. Our results indicate that accurate characterization requires careful selection of ultrasonic propagation paths, which must consider the direction of additive layering, variations in processing parameters, and the component's geometry. We employed two distinct methods to estimate material properties from ultrasonic data: One assumes isotropy, while the other accounts for anisotropic interactions during the propagation of elastic waves. When applied to samples fabricated with laser energy densities ranging from 24 to 42 J/mm³ , these methods revealed transverse isotropy and weak anisotropy (quantified by small Thomsen parameters, ε = 0.0651 and γ = 0.0092) and less than a ∼6 % change in acoustic impedance. The assumption of isotropy, in this case, leads to small errors (less than 4 % or 1 % for Young's modulus in the build or transverse directions) when estimating orthotropic material properties using ultrasonic data measured along just two orthogonal directions, one of which must align with the build direction. By comparing ultrasonic measurements — which aggregate the spatial variability in material properties along the length of elastic wave propagation into a single value — with localized measurements obtained from surface nanoindentation, we uncovered and spatially profiled significant differences between the surface and interior properties. Specifically, the surface Young's modulus decreased from approximately 210 GPa to 180 GPa within a depth of about 3 mm. We attribute this surface-localized heterogeneity in PBF-fabricated components to distinct thermal histories experienced by the surface and interior regions. Collectively, the results of this study establish a framework for the ultrasonic characterization of material heterogeneity and anisotropy in material properties and demonstrate its application in additively manufactured metal components.