Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Measurements over distributed high performance computing and storage systems

Requirements are carefully described in descriptions of systems to be acquired but often there is no requirement to provide measurements and performance monitoring to ensure that requirements are met over the long term after acceptance. A set of measurements for various UNIX-based systems will be available at the 1992 Goddard Conference on Mass Storage Systems and Technologies. The authors invite others to contribute to the set of measurements. The framework for presenting the measurements of supercomputers, workstations, file servers, mass storage systems, and the networks that interconnect them are given. Production control and database systems are also included. Though other applications and third party software systems are not addressed, it is important to measure them as well. The capability to integrate measurements from all these components from different vendors, and from the third party software systems was recognized and there are efforts to standardize a framework to do this. The measurement activity falls into the domain of management standards. Standards work is ongoing for Open Systems Interconnection (OSI) systems management; AT&T, Digital, and Hewlett-Packard are developing management systems based on this architecture even though it is not finished. Another effort is in the UNIX International Performance Management Working Group. In addition, there are the Open Systems Foundation's Distributed Management Environment and the Object Management Group. A paper comparing the OSI systems management model and the Object Management Group model has been written. The IBM world has had a capability for measurement for various IBM systems since the 1970's and different vendors were able to develop tools for analyzing and viewing these measurements. Since IBM was the only vendor, the user groups were able to lobby IBM for the kinds of measurements needed. In the UNIX world of multiple vendors, a common set of measurements will not be as easy to get.

Williams, Elizabeth↗
DOE OSTI2026

Applying Particle Swarm Optimization and Extended Kalman Filtering to Model Kaplan Generation Dynamics for Hydropower Systems

Variable renewable generation is increasing the need for hydropower plants to provide fast and flexible grid support, which places new demands on plant-level dynamic models used for monitoring, control, and operational decision-making. This need is especially important for hydroelectric systems, where turbine and generator dynamics are strongly coupled, nonlinear, and time-varying, making accurate real-time representation difficult. To address this problem, this paper develops a digital twin (DT) framework for a synchronous generator–Kaplan turbine system using an explicit separation of slow turbine dynamics and fast generator dynamics. The turbine subsystem is represented by a six-coefficient model, whose parameters are identified offline using particle swarm optimization, while the generator subsystem is updated online through an extended Kalman filter for real-time state and parameter estimation. These models are integrated within a closed-loop simulation that includes a proportional–integral–derivative–double-derivative governor and excitation system, allowing the DT to track plant behavior under realistic operating conditions. Unlike prior studies that treat turbine and generator modeling separately or rely mainly on simulated inputs, the proposed framework is validated using real operational data from a hydropower plant. Results show that the DT reproduces terminal voltage, active power, and reactive power with a normalized root mean square error of approximately 5%. This hybrid offline–online formulation constitutes the main contribution of the work, providing an adaptive and practically deployable DT for hydropower systems with direct relevance to control improvement, performance monitoring, and grid-support applications under high renewable penetration.

13 HYDRO ENERGY↗
DOE OSTI2019

Real-time data processing in the ALICE High Level Trigger at the LHC

At the Large Hadron Collider at CERN in Geneva, Switzerland, atomic nuclei are collided at ultra-relativistic energies. Many final-state particles are produced in each collision and their properties are measured by the ALICE detector. The detector signals induced by the produced particles are digitized leading to data rates that are in excess of 48 GB/s. The ALICE High Level Trigger (HLT) system pioneered the use of FPGA- and GPU-based algorithms to reconstruct charged-particle trajectories and reduce the data size in real time. The results of the reconstruction of the collision events, available online, are used for high level data quality and detector-performance monitoring and real-time time-dependent detector calibration. The online data compression techniques developed and used in the ALICE HLT have more than quadrupled the amount of data that can be stored for offline event processing.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Charged particle reconstruction in CLAS12 using Machine Learning

In this work, we present studies of track parameter reconstruction from raw information in CLAS12 detector's Drift Chambers, using Machine Learning (ML). We study the resolution of tracks reconstructed with different types of ML models/algorithms, including Multi-Layer Perceptron (MLP), Extremely Randomized Trees (ERT) and Gradient Boosting Trees (GBT) using simulated data. We find that the resulting ML model is capable of reconstructing track parameters (particle momentum, and polar and azimuthal angles) with accuracy similar to Hit Based (HB) tracking code, but $150$ times faster. Moreover, physics reactions can be identified using the particles reconstructed by the neural network in real-time (with a rate of about $34~kHz$) during experimental data collection. The developed model can be used in numerous applications, such as triggering specific physics reactions in real-time, detector performance monitoring, and real-time detector calibration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Embedded Sensors in Additively Manufactured Silicon Carbide

Silicon carbide (SiC) components are being considered for a wide range of nuclear applications due to their high-temperature strength retention, low neutron absorption, chemical inertness, and dimensional stability under neutron irradiation. However, machining and joining of SiC components have traditionally limited its application to relatively simple geometries. Recent work has demonstrated additive manufacturing of complex, high-purity, crystalline SiC components using a combination of binder jet printing and densification via chemical vapor infiltration (CVI). The process lends itself to embedding of fuel, absorbers, moderators, and sensors at strategic locations within a component. The latter could allow for enhanced in situ performance monitoring of limiting fuel temperatures, self-shielded neutron flux, and potentially spatially distributed strain within complex SiC components if sensors can be successfully embedded during CVI. This work describes (1) methods for embedding sensors; (2) thermodynamic analyses and material compatibility testing for identifying sensors capable of surviving high temperatures and exposure to hydrogen and hydrogen chloride during CVI; and (3) nuclear applications for embedded sensors, including potential failure modes during fabrication and during reactor operation. Molybdenum-sheathed thermocouples were successfully embedded in a complex SiC component, whereas niobium-sheathed high-temperature irradiation-resistant thermocouples started to drift as soon as the reactant gases were introduced and ultimately failed during CVI due to severe constrained expansion, potentially resulting from niobium hydride formation in the low-temperature region of the CVI system. Optical fibers were successfully embedded in SiC, but further work is needed to protect the fragile fiber leads after their protective coatings are removed during CVI.

thermocouples↗
DOE OSTI2020

Metagenome-Guided Proteomic Quantification of Reductive Dehalogenases in the Dehalococcoides mccartyi -Containing Consortium SDC-9

At groundwater sites contaminated with chlorinated ethenes, fermentable substrates are often added to promote reductive dehalogenation by indigenous or augmented microorganisms. Contemporary bioremediation performance monitoring relies on nucleic acid biomarkers of key organohalide-respiring bacteria, such as Dehalococcoides mccartyi (Dhc). In this work, metagenome sequencing of the commercial, Dhc-containing consortium, SDC-9, identified 12 reductive dehalogenase (RDase) genes, including pceA (two copies), vcrA, and tceA, and allowed for specific detection and quantification of RDase peptides using liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS). Shotgun (i.e., untargeted) proteomics applied to the SDC-9 consortium grown with tetrachloroethene (PCE) and lactate identified 143 RDase peptides, and 36 distinct peptides that covered greater than 99% of the protein-coding sequences of the PceA, TceA, and VcrA RDases. Quantification of RDase peptides using multiple reaction monitoring (MRM) assays with 13 C-/ 15 N-labeled peptides determined 1.8 × 10 3 TceA and 1.2 × 10 2 VcrA RDase molecules per Dhc cell. Ultimately, the MRM mass spectrometry approach allowed for sensitive detection and accurate quantification of relevant Dhc RDases and has potential utility in bioremediation monitoring regimes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Counterintuitive Compatibilization of Poly(-Valerolactone) and Poly(L-Lactic Acid) by Statistical Copolymers toward Compostable and Recyclable Packaging

Poly(δ-valerolactone) (PVL) and poly(l-lactic acid) (PLLA) are bioderivable, compostable, and chemically recyclable plastics with synergistic properties for addressing plastic waste accumulation in receiving environments. Though recyclable-by-design polymers often fall short of competing with incumbent materials, blending affords a means to leverage individual component strengths toward ideal tunable properties. Polymer blends are often immiscible, but a range of methodologies are available to promote mixing. Here, we report on the compatibilization of 9 immiscible PVL and PLLA blends with three different compatibilization agents: thermoplastic starch, synthesized PVL-co-PLLA statistical copolymers (SCPs), and synthesized PVL-b-PLLA block-type copolymers. Resulting degrees of compatibilization are observed through scanning electron microscopy, corroborated by thermal and mechanical analyses monitoring performance as a function of microdomain size. Small-angle and wide-angle X-ray scattering experiments are conducted to observe the influence of compatibilizers on individual crystalline phases to further elucidate material behavior. Molecular dynamics simulations provide key insights into the interfacial interactions between homopolymers and compatibilizers. Finally, a suite of end-of-life avenues is established by biodegradation in industrial composting conditions, chemical recycling by deconstruction to hydroxymethyl esters, and direct chemical depolymerization to lactone precursors in mixed feed. Overall, we highlight several promising blends and the counterintuitive SCP compatibilization phenomenon toward high-performance, sustainable materials.

Compatibilization, copolymer compatibilizer, bio-b↗
DOE OSTI2018

High-performance and scalable on-chip digital Fourier transform spectroscopy

Abstract On-chip spectrometers have the potential to offer dramatic size, weight, and power advantages over conventional benchtop instruments for many applications such as spectroscopic sensing, optical network performance monitoring, hyperspectral imaging, and radio-frequency spectrum analysis. Existing on-chip spectrometer designs, however, are limited in spectral channel count and signal-to-noise ratio. Here we demonstrate a transformative on-chip digital Fourier transform spectrometer that acquires high-resolution spectra via time-domain modulation of a reconfigurable Mach-Zehnder interferometer. The device, fabricated and packaged using industry-standard silicon photonics technology, claims the multiplex advantage to dramatically boost the signal-to-noise ratio and unprecedented scalability capable of addressing exponentially increasing numbers of spectral channels. We further explore and implement machine learning regularization techniques to spectrum reconstruction. Using an ‘elastic-D 1 ’ regularized regression method that we develop, we achieved significant noise suppression for both broad (>600 GHz) and narrow (<25 GHz) spectral features, as well as spectral resolution enhancement beyond the classical Rayleigh criterion.

47 OTHER INSTRUMENTATION↗
DOE OSTI2017

CMS readiness for multi-core workload scheduling

In the present run of the LHC, CMS data reconstruction and simulation algorithms benefit greatly from being executed as multiple threads running on several processor cores. The complexity of the Run 2 events requires parallelization of the code to reduce the memory-per- core footprint constraining serial execution programs, thus optimizing the exploitation of present multi-core processor architectures. The allocation of computing resources for multi-core tasks, however, becomes a complex problem in itself. The CMS workload submission infrastructure employs multi-slot partitionable pilots, built on HTCondor and GlideinWMS native features, to enable scheduling of single and multi-core jobs simultaneously. This provides a solution for the scheduling problem in a uniform way across grid sites running a diversity of gateways to compute resources and batch system technologies. This paper presents this strategy and the tools on which it has been implemented. The experience of managing multi-core resources at the Tier-0 and Tier-1 sites during 2015, along with the deployment phase to Tier-2 sites during early 2016 is reported. The process of performance monitoring and optimization to achieve efficient and flexible use of the resources is also described.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Interstate-24 MOTION: Closing the Loop on Smart Mobility

We introduce the I-24 Mobility Technology Interstate Observation Network (MOTION), a transportation cyber-physical systems testbed under development in Tennessee. It consists of a six-mile freeway segment instrumented with 400 4K resolution cameras, processed by a real-time compute system to enable continuous performance monitoring of freeway traffic. The testbed is being developed to support next generation connected and autonomous vehicle technologies and advanced traffic management. When complete, the testbed will be the longest continuously observed freeway segment in the world. This article introduces the testbed, discusses the core design choices, and outlines the preliminary work conducted to support the design.

Gloudemans, Derek↗
DOE OSTI2018

Coupling Exascale Multiphysics Applications: Methods and Lessons Learned

With the growing computational complexity of science and the complexity of new and emerging hardware, it is time to re-evaluate the traditional monolithic design of computational codes. One new paradigm is constructing larger scientific computational experiments from the coupling of multiple individual scientific applications, each targeting their own physics, characteristic lengths, and/or scales. We present a framework constructed by leveraging capabilities such as in-memory communications, workflow scheduling on HPC resources, and continuous performance monitoring. This code coupling capability is demonstrated by a fusion science scenario, where differences between the plasma at the edges and at the core of a device have different physical descriptions. This infrastructure not only enables the coupling of the physics components, but it also connects in situ or online analysis, compression, and visualization that accelerate the time between a run and the analysis of the science content. Results from runs on Titan and Cori are presented as a demonstration.

Choi, Jong Youl↗
DOE OSTI2024

Data-driven Modeling for Grid Edge IBRs: A Digital Twin Perspective of User-Defined Models

Recent events in Odessa have brought attention to the challenges associated with the interaction between Inverter- Based Resources (IBRs) and the transmission and distribution system. The NERC event diagnosis report has highlighted sev- eral issues, emphasizing the need for continuous performance monitoring of these IBRs by system operators. Key areas of concern include the mismatch of control and protection perfor- mance of IBRs between the original equipment manufacturer (OEM)-provided models and field measurements. The inability to replicate the realistic response can result in incorrect reliability and resilience studies. In this paper, we developed an approach on how to emulate the behavior of an IBR using measurement data obtained for system operators to utilize in real-time and long- term planning. Two experiments are conducted in the phasor domain and electromagnetic transients (EMT) domain to emulate the behavior for grid forming and grid following inverters under various operating conditions and the effectiveness of the proposed model is demonstrated in terms of accuracy and ease of utilizing user-defined models (UDMs)

Mahapatra, Kaveri [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2018

Automatic Detection of Clear-Sky Periods Using Ground and Satellite Based Solar Resource Data

Solar resource availability and variability are important aspects of monitoring performance of photovoltaic installations. For example, recent degradation studies have highlighted the importance of considering cloud cover when calculation degradation rates. With this in mind, we present a method for optimizing clear sky detection algorithms given only modeled clear sky irradiance and ground-measured irradiance values. This method is tested on global horizontal irradiance (GHI) data from ground collectors at six sites across the US and was trained against clear sky classifications determined from satellite data. Thirty models were optimized on each individual site at GHI data frequencies of 1, 5, 10, 15, and 30 minutes. The models had an average F 0.5 score of 0.945 +/- .021 on a holdout test set. In comparison, the un-optimized clear sky detection algorithm produced F 0.5 score that averaged to 0.707 +/- 0.187.

14 SOLAR ENERGY↗
DOE OSTI2024

Transmission Data-Driven User-Defined Model for Inverter-based and Conventional Power Plants

Recent events in Odessa [1], [2] have shed light on the complexities of integrating large Inverter-Based Resource (IBR) plants with the transmission system, prompting NERC to stress continuous performance monitoring by transmission operators. Challenges such as plant control updates, IBR model revisions, Phase-locked loop loss of synchronism, and protection events have been identified, underscoring the need for enhanced monitoring protocols by regulatory bodies. The recent FERC 901 order underscores the importance of accurate data exchange regarding IBRs for reliability studies. However, limited access to IBR plant-related data hampers effective decision-making for transmission operators (TOP). This paper proposes a method for constructing data-driven User-Defined dynamic Models (UDM) for power plants for validating multiple-event data using field measurements from interconnection bus locations. The problem is formulated as a power plant model identification problem and a multi-task learning approach under partial input observability assumptions is proposed in this work. This approach aims to predict aggregated responses of conventional and IBR power plants during various dynamic physical events which is useful for planning studies under diverse disturbance conditions. Ultimately, this methodology emphasizes the importance of plant visibility to operators in addressing power system challenges, facilitating improved planning and operational studies.

Mahapatra, Kaveri [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2020

Dynamic Undervolting to Improve Energy Efficiency on Multicore X86 CPUs

Chip manufacturers introduce redundancy at various levels of CPU design to guarantee correct operation, even for worst-case combinations of non-idealities in process variation and system operating conditions. This redundancy is implemented partly in the form of voltage margins. However, for a wide range of real-world execution scenarios these margins are excessive and merely translate to increased power consumption, hindering the effort towards higher-energy efficiency in both HPC and general purpose computing. Our study on the x86-64 Haswell and Skylake multicore microarchitectures reveals-wide voltage margins, which vary across different microarchitectures, different chip parts of the same microarchitecture, and across different workloads. We find that it is necessary to quantify-voltage margins using multi-threaded and multi-instance workloads, as characterization with single-threaded and single-instance workloads that do not stress the CPU to its full capacity typically identifies overly optimistic margins that lead to errors when applied in realistic program execution scenarios. In addition, we introduce, deploy and evaluate a run-time governor that dynamically reduces the supply voltage of modern multicore x86-64 CPUs. Our governor employs a model that takes as input a set of performance metrics which are directly measurable via performance monitoring counters and have high predictive value for the minimum tolerable supply voltage (V min ), to predict and apply the appropriate reduction for the workload at hand. Compared with the conventional DVFS governor, our approach in this study achieves up to 42 percent energy savings for the Skylake family and 34 percent for the Haswell family for complex, real-world applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

CAN-D: A Modular Four-Step Pipeline for Comprehensively Decoding Controller Area Network Data

Controller area networks (CANs) are a broadcast protocol for real-time communication of critical vehicle subsystems. Original equipment manufacturers of passenger vehicles hold secret their mappings of CAN data to vehicle signals, and these definitions vary according to make, model, and year. Without these mappings, the wealth of real-time vehicle information hidden in the CAN packets is uninterpretable, severely impeding vehicle-related research, including CAN cybersecurity and privacy studies, aftermarket tuning, efficiency and performance monitoring, and fault diagnosis to name a few. Guided by the four-part CAN signal definition, we present CAN-D (CAN-Decoder), a modular, four-step pipeline for identifying each signal's boundaries (start bit and length), endianness (byte ordering), signedness (bit-to-integer encoding), and by leveraging diagnostic standards, augmenting a subset of the extracted signals with meaningful, physical interpretation. En route to CAN-D, we provide a comprehensive review of the CAN signal reverse engineering research. All previous methods ignore endianness and signedness, rendering them incapable of decoding many standard CAN signal definitions. Incorporating endianness grows the search space from 128 to 4.72E21 signal tokenizations and introduces a web of changing dependencies. In response, we formulate, formally analyze, and provide an efficient solution to an optimization problem, allowing identification of the optimal set of signal boundaries and byte orderings. In addition, we provide two novel, state-of-the-art signal boundary classifiers—both of which are superior to previous approaches in precision and recall in three different test scenarios—and the first signedness classification algorithm, which exhibits a $>$ 97% F-score. Altogether, CAN-D is the only solution with the potential to extract any CAN signal that is also the state of the art. In evaluation on 10 vehicles of different makes, CAN-D's average $\ell ^1$ error is five times better (81% less) than all previous methods and exhibits lower average error, even when considering only signals that meet prior methods’ assumptions. Finally, CAN-D is implemented in lightweight hardware, allowing for an on-board diagnostic (OBD-II) plugin for real-time in-vehicle CAN decoding.

42 ENGINEERING↗
DOE OSTI2021

AUTOPERF

AutoPerf is a collection of modules for low-overhead performance monitoring on HPC systems, the modules collect monitoring data such as MPI data, network counter data etc. Autoperf modules interoperate with the Open source Darshan software (xgitlab.cels.anl.gov/darshan/) as submodules and leverages the Darshan's log recording and analysis framework.

CHUNDURI, DEVISUDHEER KUMAR↗
DOE OSTI2018

Coupled Approximation of U.S. Driving Speed and Volume Statistics using Spatial Conflation and Temporal Disaggregation

The advent of mobile devices with embedded global positioning systems has allowed commercial providers of real-time traffic data to develop highly accurate estimates of network-level vehicle speeds. Traffic speed data have far outpaced the availability and accuracy of real-time traffic volume information. Limited to a relatively small number of permanent and temporary traffic counters in any city, traffic volumes typically only cover a handful of roadways, with inconsistent temporal resolution. This work addressed this data gap by coupling a commercial data set of typical traffic speeds (by roadway and time of week) from TomTom to the U.S. Federal Highway Administration's Highway Performance Monitoring System database of annual average daily traffic (AADT) counts by roadway. This work is technically novel in its solution for establishing a national crosswalk between independent network geometries using spatial conflation and big data techniques. The resulting product is a national data set providing traffic speed and volume estimates under typical conditions for all U.S. roadways with AADT values.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗