Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “building benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Predicting Cost/Performance Trade-Offs for Whitney: A Commodity Computing Cluster

Recent advances in low-end processor and network technology have made it possible to build a "supercomputer" out of commodity components. We develop simple models of the NAS Parallel Benchmarks version 2 (NPB 2) to explore the cost/performance trade-offs involved in building a balanced parallel computer supporting a scientific workload. We develop closed form expressions detailing the number and size of messages sent by each benchmark. Coupling these with measured single processor performance, network latency, and network bandwidth, our models predict benchmark performance to within 30%. A comparison based on total system cost reveals that current commodity technology (200 MHz Pentium Pros with 100baseT Ethernet) is well balanced for the NPBs up to a total system cost of around $1,000,000.

Becker, Jeffrey C.↗

Microgravity Vibration Control and Civil Applications

Controlling vibration of structures is essential for both space structures as well as terrestrial structures. Due to the ambient acceleration levels anticipated for the International Space Station, active vibration isolation is required to provide a quiescent acceleration environment for many science experiments. An overview is given of systems developed and flight tested in orbit for microgravity vibration isolation. Technology developed for vibration control of flexible space structures may also be applied to control of terrestrial structures such as buildings and bridges subject to wind loading or earthquake excitation. Recent developments in modern robust control for flexible space structures are shown to provide good structural vibration control while maintaining robustness to model uncertainties. Results of a mixed H-2/H-infinity control design are provided for a benchmark problem in structural control for earthquake resistant buildings.

Whorton, Mark Stephen↗

Direct Observations of Solute Dispersion in Rocks With Distinct Degree of Sub‐Micron Porosity

Abstract The transport of chemical species in rocks is affected by their structural heterogeneity to yield a wide spectrum of local solute concentrations. To quantify such imperfect mixing, advanced methodologies are needed that augment the traditional breakthrough curve analysis by probing solute concentration within the fluids locally. Here, we demonstrate the application of asynchronous, multimodality imaging by X‐ray computed tomography (XCT) and positron emission tomography (PET) to the study of passive tracer experiments in laboratory rock cores. The four‐dimensional concentration maps measured by PET reveal specific signatures of the transport process, which we have quantified using fundamental measures of mixing and spreading. We observe that the extent of solute spreading correlate strongly with the strength of subcore‐scale porosity heterogeneity measured by XCT, while dilution is enhanced in rocks containing substantial sub‐micron porosity. We observe that the analysis of different metrics is necessary, as they can differ in their sensitivity to the strength and forms of heterogeneity. The multimodality imaging approach is uniquely suited to probe the fundamental difference between spreading and mixing in heterogeneous media. We propose that when multi‐dimensional data is available, mixing and spreading can be independently quantified using the same metric. We also demonstrate that one‐dimensional transport models have limited predictive ability toward the internal evolution of the solute concentration, when the model is solely calibrated against the effluent breakthrough curves. The data set generated in this study can be used to build realistic digital rock models and to benchmark transport simulations that account deterministically for rock property heterogeneity.

Kurotori, Takeshi [Department of Chemical Engineer↗

I/O performance studies of analysis workloads on production and dedicated resources at CERN

The recent evolutions of the analysis frameworks and physics data formats of the LHC experiments provide the opportunity of using central analysis facilities with a strong focus on interactivity and short turnaround times, to complement the more common distributed analysis on the Grid. In order to plan for such facilities, it is essential to know in detail the performance of the combination of a given analysis framework, of a specific analysis and of the installed computing and storage resources. This contribution describes performance studies performed at CERN, using the EOS disk-based storage, either directly or through an XCache instance, from both batch resources and highperformance compute nodes which could be used to build an analysis facility. A variety of benchmarks, both synthetic and based on real-world physics analyses and their corresponding input datasets, are utilized. In particular, the RNTuple format from the ROOT project is put to the test and compared to the latest version of the TTree format, and the impact of caches is assessed. In addition, we assessed the difference in performance between the use of storage system specific protocols, like XRootd, and FUSE. The results of this study are intended to be a valuable input in the design of analysis facilities, at CERN and elsewhere.

Sciabà, Andrea↗

Toward Consistent High-Fidelity Quantum Learning on Unstable Devices via Efficient In-Situ Calibration

In the near-term noisy intermediate-scale quantum (NISQ) era, high noise will significantly reduce the fidelity of quantum computing. What's worse, recent works reveal that the noise on quantum devices is not stable, that is, the noise is dynamically changing over time. This leads to an imminent challenging problem: At run-time, is there a way to efficiently achieve a consistent high-fidelity quantum system on unstable devices? To study this problem, we take quantum learning (a.k.a., variational quantum algorithm) as a vehicle, which has a wide range of applications, such as combinatorial optimization and machine learning. A straightforward approach is to optimize a variational quantum circuit (VQC) with a parameter-shift approach on the target quantum device before using it; however, the optimization has an extremely high time cost, which is not practical at run-time. To address the pressing issue, in this paper, we proposed a novel quantum pulse-based noise adaptation framework, namely QuPAD. In the proposed framework, first, we identify that the CNOT gate is the fidelity bottleneck of the conventional VQC, and we employ a more robust parameterized multi-qubit gate (i.e., Rzx gate) to replace CNOT gate. Second, by benchmarking Rzx gate with different parameters, we build a fitting function for each coupling qubit pair, such that the deviation between the theoretic output of Rzx gate and its on-device output under a given pulse amplitude and duration can be efficiently predicted. On top of this, an evolutionary algorithm is devised to identify the pulse amplitude and duration of each Rzx gate (i.e., calibration) and find the quantum circuits with high fidelity. Experiments show that the runtime on quantum devices of QuPAD with 8–10 qubits is less than 15 minutes, which is up to 270 x faster than the parameter-shift approach. In addition, compared to the vanilla VQC as a baseline, QuPAD can achieve 59.33% accuracy gain on a classification task, and average 66.34% closer to ground state energy for molecular simulation.

Hu, Zhirui↗

Space Networking Implementation for Lunar Operations

The High-Rate Delay Tolerant Networking (HDTN) project at NASA has developed a performance optimized and open-source Delay Tolerant Networking (DTN) implementation. The primary goal is to create a scalable networking solution to increase the scientific data return rate of space missions. To reach this goal, HDTN must span multiple edge cases in space networking by including tools and configurations to accommodate a wide range of space systems. Typically, HDTN evaluations are conducted on a laboratory emulation test bed, made up of hardware accelerated x86 based systems capable of data rates over 10 Gbps. HDTN must have an effective implementation process on a wide range of systems to increase the sustainability of the design. One important implementation option is with low-level embedded systems which could be used on small robotic missions. This paper details the implementation process, benchmark testing, and performance results of HDTN in multiple configurations on Raspberry Pi 4 devices. By implementing HDTN on a Raspberry Pi 4, a process for building HDTN onto ARM processors was developed and utilized to conduct benchmark tests in multiple network configurations, achieving a data rate performance exceeding 600 Mbps. Based on these results, HDTN proved to run on small ARM based systems with slight modifications to the build procedure. These results were then extended to evaluating an implementation of the HDTN software parsed across several Raspberry Pi 4 nodes. To test this capability, HDTN was configured in a simplified cut-through setup and distributed among multiple Raspberry Pi 4 processors. This distributed architecture was benchmark tested in a similar fashion to the testing of a singular HDTN implementation. The results from the benchmark testing are used to examine how these implementation options and capabilities can expand the use cases for DTN, and particularly with small robotic missions.

Space Networking↗

BrickQA: Bridging the Semantic Gap in Building Operations with Dynamic Graph Exploration

While standardized ontologies like the Brick schema address data heterogeneity in Building Automation Systems (BAS), accessing this semantic data remains a challenge as domain experts often lack the expertise to formulate complex SPARQL queries. To bridge this gap, we present BrickQA, a Large Language Model (LLM)-based framework that translates natural language into executable SPARQL queries through structured query decomposition, dynamic schema exploration, and inline validation. BrickQA utilizes an iterative reasoning agent to actively navigate graph topology through dynamic exploration actions without requiring exhaustive context injection or model fine-tuning. This approach effectively mitigates hallucinations, particularly in large-scale building knowledge graphs. Empirical evaluation on BuildingQA, a standardized benchmark, demonstrates that BrickQA significantly outperforms ReAct baselines, delivering a 0.291–0.355 absolute F1 improvement while achieving 3 × –12.7 × higher token cost-efficiency. Beyond these metrics, the framework maintains structural fidelity across heterogeneous buildings and remains resilient to ambiguous queries without requiring site-specific fine-tuning. Furthermore, a case study on operational analytics validates the framework’s capability to handle temporal and aggregation constraints, effectively transforming abstract semantic models into actionable facility management insights.1

Ko, Yun-Dam↗

Simulating energy performance of buildings: a study using eQUEST and Energy Star ® portfolio manager

Commercial buildings consume significant energy in the United States and exhibit high potential for energy use reduction through retrofits. Benchmarking and energy simulation are well established tools in the industry to identify potential improvements and measure performance. Analysis to identify most sensitive retrofit parameters to energy performance can optimize investment and available energy savings. Presented study demonstrates methodology using a static model to determine sensitivity of building design and retrofit parameters with respect to energy performance. Calibrated simulation energy models (eQUEST) of two distribution centers (A, B) are presented. A fractional factorial analysis is conducted on retrofit parameters of efficiency measures targeting the highest energy consumers, and the results are benchmarked using Energy Star® Portfolio Manager. A custom Microsoft Excel® based simulation model is created to simulate occupancy levels, lighting, plug loads, and other equipment used in various spaces throughout the day. For Building A, efficient lighting was the most influential parameter for energy savings, carbon savings and benchmarking score; whereas, for Building B, HVAC efficiency was most influential for energy and demand controlled ventilation and economizers was most influential for benchmarking score. While retrofit projects can save energy and carbon emissions, variation in source-site ratios and state grid emissions, benchmarking scores may not always reflect equivalent improvement. State grid emissions factors, natural gas composition are difficult to model and hence not considered in this study. In conclusion, the synergistic analysis presented, emphasizes the importance of benchmarking and efficiency retrofits in promoting sustainable building practices to reduce energy consumption.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Whole-building life-cycle analysis with a new GREET® tool: Embodied greenhouse gas emissions and payback period of a LEED-Certified library

Embodied greenhouse gas (GHG) emissions of building components and buildings operations need to be quantified to holistically address building sustainability. To evaluate embodied GHG emissions of buildings and to provide insights on building materials and building design decisions toward decarbonization, we have recently created a building life-cycle assessment (LCA) module in the widely used Greenhouse gases, Regulated Emissions, and Energy use in Technologies (GREET (R)) LCA model. We applied the GREET building LCA module to examine embodied GHG impacts and the payback period of a LEED (Leadership in Energy and Environmental Design) certified public library in Chicago, USA. We developed localized, detailed life-cycle inventories to address individual building materials used in the library. We expanded the LCA system boundary to include the mechanical, electrical, and plumbing system, as well as refrigerant impacts, which are often ignored in previous studies. Results show that the total embodied GHG emissions are approximately 817 metric tons, or approximately 538 kg/m 2 . Sensitivity analysis highlights the positive role of increasing the use of recycled materials for reducing embodied GHG emissions. Sensitivity analysis on embodied GHG emissions payback periods shows the need to benchmark the embodied and operational carbon performance of buildings for comparison to alternative building designs and sustainability practices. Furthermore, this analysis demonstrates that building LCA models, such as the GREET building LCA module, which addresses embodied and operational GHG emission impacts of whole buildings holistically, could empower building architects, technology developers, manufacturers, and general contractors to address embodied and operational impacts holistically for building sustainability.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Case Study: NREL Campus Chilled Water Storage Potential: Benchmark Datasets Development and Applications, Task 4 - Use Case Demonstration

The Benchmark Datasets Development and Applications project is a three-year collaboration between the National Renewable Energy Laboratory (NREL), Oak Ridge National Laboratory, Pacific Northwest National Laboratory, and Lawrence Berkeley National Laboratory. The project seeks to collect and curate high-resolution, well-calibrated time series of building operational and indoor/outdoor environmental data, which are crucial to understanding and optimizing building energy efficiency performance and demand flexibility capabilities as well as benchmarking energy algorithms. Project outcomes include approximately twelve high-fidelity building datasets, enhanced data representation tools, and four case studies to illustrate example applications. The goal of these case studies is to define and execute analyses that demonstrate how one or more datasets collected through this project can address a data gap or challenge historically faced by building stakeholders. This technical paper summarizes the findings of one of these case studies, in which we studied the operational efficiencies of the central cooling system at NREL. We looked at three years of data from the three chillers in the Field Test Laboratory Building (FTLB), from 2019 to 2021, to compare equipment operation and demand throughout the time period. Our analysis indicates that all three chillers are operating at or below the optimal loading conditions for most of the operation time, and thus there was no efficiency drop due to loading of the chillers at full capacity. Our recommendation is that no chiller capacity increase is needed; instead, the central plant could benefit from adopting advanced control logics for optimal sequencing of chillers during part load operations. Analysis of adding chilled water thermal storage to the central plant indicated 34% savings in demand cost and 24.5% savings in total cost (energy consumption and demand charge cost). The payback period is estimated to be 11-22 years with an assumed TES cost of $\$$100-$200 per ton. This case study shows how a selected dataset is used to solve a practical building problem - learning the operational status of its components, analyzing the effectiveness of a proposed new technique, and aiding decision-making for the building operations and maintenance team.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Open Data and Deep Semantic Segmentation for Automated Extraction of Building Footprints

Advances in machine learning and computer vision, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics, cost-effectively, and at scale. These characteristics are relevant to a variety of urban and energy applications, yet are time consuming and costly to acquire with today’s manual methods. Several recent research studies have shown that in comparison to more traditional methods that are based on features engineering approach, an end-to-end learning approach based on deep learning algorithms significantly improved the accuracy of automatic building footprint extraction from remote sensing images. However, these studies used limited benchmark datasets that have been carefully curated and labeled. How the accuracy of these deep learning-based approach holds when using less curated training data has not received enough attention. The aim of this work is to leverage the openly available data to automatically generate a larger training dataset with more variability in term of regions and type of cities, which can be used to build more accurate deep learning models. In contrast to most benchmark datasets, the gathered data have not been manually curated. Thus, the training dataset is not perfectly clean in terms of remote sensing images exactly matching the ground truth building’s foot-print. A workflow that includes data pre-processing, deep learning semantic segmentation modeling, and results post-processing is introduced and applied to a dataset that include remote sensing images from 15 cities and five counties from various region of the USA, which include 8,607,677 buildings. The accuracy of the proposed approach was measured on an out of sample testing dataset corresponding to 364,000 buildings from three USA cities. The results favorably compared to those obtained from Microsoft’s recently released US building footprint dataset.

97 MATHEMATICS AND COMPUTING↗

An MLCommons Scientific Benchmarks Ontology

Scientific machine learning research spans diverse domains and data modalities, yet existing benchmark efforts remain siloed and lack standardization. This makes novel and transformative applications of machine learning to critical scientific use-cases more fragmented and less clear in pathways to impact. This paper introduces an ontology for scientific benchmarking developed through a unified, community-driven effort that extends the MLCommons ecosystem to cover physics, chemistry, materials science, biology, climate science, and more. Building on prior initiatives such as XAI-BENCH, FastML Science Benchmarks, PDEBench, and the SciMLBench framework, our effort consolidates a large set of disparate benchmarks and frameworks into a single taxonomy of scientific, application, and system-level benchmarks. New benchmarks can be added through an open submission workflow coordinated by the MLCommons Science Working Group and evaluated against a six-category rating rubric that promotes and identifies high-quality benchmarks, enabling stakeholders to select benchmarks that meet their specific needs. The architecture is extensible, supporting future scientific and AI/ML motifs, and we discuss methods for identifying emerging computing patterns for unique scientific workloads. The MLCommons Science Benchmarks Ontology provides a standardized, scalable foundation for reproducible, cross-domain benchmarking in scientific machine learning. A companion webpage for this work has also been developed as the effort evolves: https://mlcommons-science.github.io/benchmark/

Hawks, Ben [Fermilab] (ORCID:0000000157000288)↗

Build Orientation Dependent Microstructure in Polymer Laser Sintering: Relationship to Part Performance and Evolution with Aging

Laser sintering (LS) is widely used to produce functional polymeric parts; however, the resulting parts are often limited by their porous structure, and performance of the part may be strongly anisotropic. Relating the structural features of parts to build process conditions or powder feedstock has been explored previously. In contrast, little is known regarding how the unique internal structures of LS parts evolve and relate to their performance later in their life cycle, for example, after use in a real-world operating environment. In this study, a tightly controlled LS build process and measurement campaign by standard X-ray computed tomography (XCT), supported by high-resolution synchrotron XCT, was used to benchmark the internal microstructure (e.g. porosity) as a function of four different build orientations in printed polyamide-12 (PA-12) parts. The initial performance of the parts after printing was characterized by tensile testing and dynamic mechanical analysis (DMA). Arrays of PA-12 parts in different build orientations were exposed to steam (under pressure) and air across multiple temperature and time points for the purposes of accelerated aging through oxidative and hydrolytic breakdown. Exposing parts to steam dramatically altered the internal microstructure and functional properties such as the glass transition temperature, tensile properties, and damping behavior. Notably, post-aging XCT revealed large microstructural changes after only 40 h of steam treatment relative to the as-printed specimens. Furthermore, pore reorganization and changes in crystallinity occurred regardless of whether the steam temperature was aggressive enough to induce a significant loss in mechanical properties. The build orientation dependence on the aging rate was minimal with the relative trend in performance persisting across most metrics among the different orientations even after aging.

36 MATERIALS SCIENCE↗

Feasibility and performance of the staged Z-pinch: A one-dimensional study with FLASH and MACH2

Z-pinch platforms constitute a promising pathway to fusion energy research. Here, we present a one-dimensional numerical study of the staged Z-pinch (SZP) concept using the FLASH and MACH2 codes. We discuss the verification of the codes using two analytical benchmarks that include Z-pinch-relevant physics, building confidence on the codes' ability to model such experiments. Then, FLASH is used to simulate two different SZP configurations: a xenon gas-puff liner (SZP1*) and a silver solid liner (SZP2). The SZP2 results are compared against previously published MACH2 results, and a new code-to-code comparison on SZP1* is presented. Using an ideal equation of state and analytical transport coefficients, FLASH yields a fuel convergence ratio (CR) of approximately 39 and a mass-averaged fuel ion temperature slightly below 1 keV for the SZP2 scheme, significantly lower than the full-physics MACH2 prediction. For the new SZP1* configuration, full-physics FLASH simulations furnish large and inherently unstable CRs (>300) but achieve fuel ion temperatures of many kilo-electron volts. While MACH2 also predicts high temperatures, the fuel stagnates at a smaller CR. The integrated code-to-code comparison reveals how magnetic insulation, heat conduction, and radiation transport affect platform performance and the feasibility of the SZP concept.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Transforming Windows from Energy Liabilities to Zero-Energy Assets: Next-Generation Solutions for Buildings

Windows have traditionally contributed to a building's HVAC load, but they can also become a source of net energy gain or even operate as zero-energy components. For heating applications, highly insulating windows can harness more solar heat than the energy lost through them, transforming windows from energy liabilities to assets. Dynamic glazings provide further benefits by regulating solar heat gain, reducing cooling loads in summer and heating demands in winter. This simulation study focuses on developing the next generation of zero-energy windows (ZEW) for residential new construction. Through annual energy simulations across climate zones 1-8, ZEW performance benchmarks were established based on current code-level buildings, and we've identified the regions where meeting ZEW standards are most achievable. This work evaluates both static and dynamic window technologies, assessing their effects on annual energy use and cost. Key findings demonstrate that ZEW performance is achievable across diverse climate zones, with specific regional requirements. Most climate zones from 3-8 can achieve ZEW with specific configurations, while some warm climates (1-2) appear challenging for ZEW implementation. Climate zones 4-6 consistently allow for zero energy window implementation, offering multiple pathways through either static or dynamic window technologies. Colder climate zones (7-8) ZEW products allow for higher SHGC values while requiring low U-values.

Yu, Lili↗

Decarbonizing or illusion? How carbon emissions of commercial building operations change worldwide

To lead the low-carbon transition in global buildings, this study is the first to use the generalized Divisia index method (GDIM) to identify the factors driving carbon emissions and assess the decarbonization performance in commercial building operations (CBOs) of sixteen countries during 2000–2019. Results show that (1) while the global carbon emissions from CBOs have increased at a modest rate of 0.9%/yr, this trend runs counter to the declining emissions in the U.S. (-1.1%/yr) and the significant growth in China (14.4%/yr), which can be attributed to the impact of economy-related factors. (2) The U.S. and China, as the largest emitters, contributed 66.8% of the samples’ decarbonization of CBOs (919.1 million tons of carbon dioxide). (3) Most countries’ CBOs had a decarbonization efficiency level of less than 10%, except for Spain (27.8%). Spain excelled in both areas of per capita and per floor area with an average efficiency of nearly 30%. Moreover, ridge regression successfully confirms the stability of GDIM results and it should be noted GDIM has limitations in characterizing the end-use activity. Overall, this study tracks the historical decarbonization of global CBOs and offers benchmarks for different emitters to forecast the dynamic of building emissions along with economic booms.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Nonlinear dimension reduction for surrogate modeling using gradient information

We introduce a method for the nonlinear dimension reduction of a high-dimensional function $u:{\mathbb{R}}^d\rightarrow{\mathbb{R}}$, $d\gg 1$. Our objective is to identify a nonlinear feature map $g:{\mathbb{R}}^d\rightarrow{\mathbb{R}}^m$, with a prescribed intermediate dimension $m\ll d$, so that $u$ can be well approximated by $f\circ g$ for some profile function $f:{\mathbb{R}}^m\rightarrow{\mathbb{R}}$. We propose to build the feature map by aligning the Jacobian $\nabla g$ with the gradient $\nabla u$, and we theoretically analyze the properties of the resulting $g$. Once $g$ is built, we construct $f$ by solving a gradient-enhanced least squares problem. Our practical algorithm uses a sample $\{{\textbf{x}}^{(i)},u({\textbf{x}}^{(i)}),\nabla u({\textbf{x}}^{(i)})\}_{i=1}^N$ and builds both $g$ and $f$ on adaptive downward-closed polynomial spaces, using cross validation to avoid overfitting. We numerically evaluate the performance of our algorithm across different benchmarks, and explore the impact of the intermediate dimension $m$. We show that building a nonlinear feature map $g$ can permit more accurate approximation of $u$ than a linear $g$, for the same input data set.

97 MATHEMATICS AND COMPUTING↗

GrAMME: Semisupervised Learning Using Multilayered Graph Attention Models

Modern data analysis pipelines are becoming increasingly complex due to the presence of multiview information sources. While graphs are effective in modeling complex relationships, in many scenarios, a single graph is rarely sufficient to succinctly represent all interactions, and hence, multilayered graphs have become popular. Though this leads to richer representations, extending solutions from the single-graph case is not straightforward. Consequently, there is a strong need for novel solutions to solve classical problems, such as node classification, in the multilayered case. In this article, we consider the problem of semisupervised learning with multilayered graphs. Though deep network embeddings, e.g., DeepWalk, are widely adopted for community discovery, we argue that feature learning with random node attributes, using graph neural networks, can be more effective. To this end, we propose to use attention models for effective feature learning and develop two novel architectures, GrAMME-SG and GrAMME-Fusion, that exploit the interlayer dependences for building multilayered graph embeddings. Using empirical studies on several benchmark data sets, we evaluate the proposed approaches and demonstrate significant performance improvements in comparison with the state-of-the-art network embedding strategies. The results also show that using simple random features is an effective choice, even in cases where explicit node attributes are not available.

97 MATHEMATICS AND COMPUTING↗