Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Trace”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Exceptional Electrical Detection of Trace NO 2 via Mixed Metal MOF-on-MOF Film-Based Sensors

The tunability of metal–organic frameworks (MOFs) makes them exceptional materials for the development of highly selective, low-power sensors for toxic gas detection. Herein, we demonstrate enhanced detection of NO 2 gas by a MOF-based electrical impedance sensor made using a unique mixed metal MOF-on-MOF synthesis. For this work, a combined experimental and computational study was performed using the exemplar Ni x Mg 1–x -MOF-74 to understand the fundamental structure–property relationships behind metal mixing and MOF film synthesis methods on sensor performance. Density functional theory results indicated that the presence of Ni in Mg-MOF-74 increased framework stability and increased the electron density of states at lower energies near the HOMO, as well as enhanced the NO 2 –Mg adsorption interaction. Impedance data of the Ni x Mg 1–x -MOF-74 films with larger Ni contents showed greater impedance change after exposure to 1 ppm of NO 2 gas. Furthermore, when synthesized through either a drop-cast or direct solvothermal film growth approach, the monometallic Ni-based sensors had the best performance. However, the mixed metal Ni x Mg 1–x -MOF-74 sensors synthesized through a MOF-on-MOF approach resulted in the highest impedance change, outperforming all monometallic Ni-based sensors. In particular, the mixed metal Ni-on-Mg-MOF-74 film was the best-performing sensor with an impedance change of 309 upon trace NO 2 exposure. Change in impedance response after NO 2 exposure was improved by 52% compared to the best monometallic Ni-on-Ni-MOF-74 sensor. Structural analysis of the Ni-on-Mg film showed that the first Mg-MOF-74 layer acts as a structural template controlling the structural features of the final film after metal exchange with Ni. This led to improved film quality, evidenced by the greater crystallinity and larger MOF grain sizes, and resulted in enhanced sensor performance which was not achievable through other metal mixing methods. Altogether, this study identifies structure–property relationships and synthetic templating methods that inform MOF-based sensor design, allowing for improved detection of toxic compounds.

36 MATERIALS SCIENCE↗

Exploratory Studies of Mechanical Properties, Residual Stress, and Grain Evolution at the Local Regions near Pores in Additively Manufactured Metals

Directed energy deposition (DED) is gaining widespread acceptance in various industrial applications since its unique manufacturing features allow the DED to print metallic parts with very complex geometries. However, DED inevitably generates a lot of internal pores which can limit the widespread applications of the DED technique. The current studies on DED porosity are mostly focused on analyzing pores’ bulk-scale influences on mechanical properties and performances. Since DED pores have a micro-scale existence, with dimensions ranging from a few microns to several hundred microns, it is fundamental to explore the pores’ influences on the micro-scale, including local mechanical properties, residual stress, and grains near pores. However, this important research direction has been neglected. The objective of this work is to fill the above gap in DED porosity research and acquire a fundamental understanding of the role of porosity on a microscopic scale. The authors used nanoindentation approaches to investigate internal pores’ effects on mechanical properties and residual stress in local regions surrounding the pores. In addition, the grains near pores were observed through EBSD, and simulated with the Kinetic Monte Carlo model. The research findings can be provided for DED researchers and industrial practitioners as technical guidance. Most importantly, the research results can work as a good reference for tracing the source of bulk-scale mechanical performances and properties of DED parts with internal pores.

36 MATERIALS SCIENCE↗

Simulation of Radio Frequency Power Received by a UAV Along Its Flight Path

A ray-tracing electromagnetic simulation using ALTAIR WinProp software was performed to calculate the 2.4 GHz power received by a UAV in flight, both from the intended controller transmitter and from a fictitious interference source of equal power located near the ground. The signal-to-interference ratio was then calculated. For the chosen example, the received power from the controller varied from -88.3 to -70.1 dBm, while the signal-to-interference ratio varied from -10.9 to +11.4 db. This work was done in support of the System-Wide Safety Project Technical Challenge 2 - Emerging Operations at NASA Langley, which is studying methods to avoid interference of UAV control and data relay signals.

Electromagnetic Simulation↗

Thermal Analysis of a Solid Particle Light-Trapping Planar Cavity Receiver Using Computational Fluid Dynamics

Concentrated solar power (CSP) is one of the most effective ways of harnessing solar power to create efficient, durable, and resilient energy systems. This study entails thermal modeling and analysis of a novel central tower receiver configuration. This receiver uses solid particles as the heat transfer fluid (HTF), a promising option for third-generation CSP systems. The configuration considered here is the light-trapping planar cavity receiver (LTPCR) introduced by the National Renewable Energy Laboratory. While heat transfer studies of various LTPCR subsystems have been done, system-level thermal analysis of the LTPCR receiver has not been attempted. This study also presents important sensitivity analyses of the operating parameters of the CSP system, which can help guide the design of future central tower receivers. This study employs Ansys Fluent as a computational fluid dynamics (CFD) tool to model fluid dynamics and heat transfer in the receiver, intending to quantify its thermal performance. The model seamlessly integrates Monte Carlo ray tracing data, which generates absorbed solar flux profiles from the heliostat field design, with the heat transfer characteristics of the fluidized particle bed. This unified model is designed to accurately predict the thermal behavior of the LTPCR. Analysis of preliminary results reveals that the primary loss mechanisms are radiative and natural convective losses, in that order. Based on observations from a baseline case, several strategies are suggested and numerically tested. These solutions include selective cooling of high-temperature regions and manipulation of particle bed parameters. Selective cooling of high-temperature regions reduced the peak temperature by 151 degrees C and decreased thermal losses by 0.9%. Improving the particle-wall heat transfer coefficient (P-W HTC) of the particle bed decreased the thermal losses by 1.7% and decreased the peak temperatures by 57 degrees C. Decreasing the particle inlet temperature (PIT) also reduced thermal losses by 3.5% and decreased peak temperatures by 29 degrees C. Compounding these strategies improved the thermal losses of the receiver from 13.5% in the baseline case to 7.5%. Additionally, the study explores the variation in thermal performance across different locations of the receiver, where a variation of thermal losses from 12.9% to 17.3% is found. This allows a comprehensive evaluation of potential improvements in efficiency and temperature management.

computational fluid dynamics↗

The Pasamonte unequilibrated eucrite: Pyroxene REE systematic and major-, minor-, and trace-element zoning

We are evaluating the trace-element concentrations in the pyroxenes of Pasamonte. Pasamonte is a characteristic member of the main group eucrites, and has recently been redescribed as a polymict eucrite. Our Pasamonte sample contained eucritic clasts with textures ranging from subophitic to moderately coarse-grained. This study concentrates on pyroxenes from an unequilibrated, coarse-grained eucrite clast. Major-, minor-, and trace-element analyses were measured for zoned pyroxenes in the eucritic clast of Pasamonte. The major- and minor-element zoning traverses were measured using the JEOL 733 electron probe with an Oxford-Link imaging/analysis system. Complemenatry trace elements were then measured for the core and rim of each of the grains by SIMS. The trace elements analyzed consisted of eight REE, Sr, Y, and Zr. These analyses were performed on a Cameca 4f ion probe. The results of the CI chondrite normalized (average CI trace-element analyses for several grains and the major- and minor-element zoning patterns from a single pyroxene grain are given. The Eu abundance in the cores of the pyroxenes represents the detection limit and therefore the (-Eu) anomaly is a minimum. Major- and minor-element patterns are typical for igneous zoning. Pyroxene cores are Mg enriched, whereas the rims are enriched in Fe and Ca. Also, Ti and Mn are found to increase, while Cr and Al generally decrease in core-to-rim traverses. The cores of the pyroxenes are more depleted in the Rare Earth Elements (REE) than the rims. Using the minor- and trace-element concentrations of bulk Pasamonte and the minor- and trace-element concentrations from the cores of the pyroxenes in Pasamonte measured in this study, we calculated partition coefficients between pyroxene and melt. This calculation assumes that bulk Pasamonte is representative of a melt composition.

Pun, A.↗

Constructing Space-Time Views from Fixed Size Statistical Data: Getting the Best of Both Worlds

Many performance monitoring tools are currently available to the super-computing community. The performance data gathered and analyzed by these tools fall under two categories: statistics and event traces. Statistical data is much more compact but lacks the probative power event traces offer. Event traces, on the other hand, can easily fill up the entire file system during execution such that the instrumented execution may have to be terminated half way through. In this paper, we propose an innovative methodology for performance data gathering and representation that offers a middle ground. The user can trade-off tracing overhead, trace data size vs. data quality incrementally. In other words, the user will be able to limit the amount of trace collected and, at the same time, carry out some of the analysis event traces offer using spacetime views for the entire execution. Two basic ideas are employed: the use of averages to replace recording data for each instance and "formulae" to represent sequences associated with communication and control flow. With the help of a few simple examples, we illustrate the use of these techniques in performance tuning and compare the quality of the traces we collected vs. event traces. We found that the trace files thus obtained are, in deed, small, bounded and predictable before program execution and that the quality of the space time views generated from these statistical data are excellent. Furthermore, experimental results showed that the formulae proposed were able to capture 100% of all the sequences associated with 11 of the 15 applications tested. The performance of the formulae can be incrementally improved by allocating more memory at run-time to learn longer sequences.

Schmidt, Melisa↗

Aircraft measurements of trace gases and particles near the tropopause

Research activities which were performed using atmospheric constituent data obtained by the NASA Global Atmospheric Sampling Program are described. The characteristics of the particle size spectrum in various meteorological settings from a special collection of GASP data are surveyed. The relationship between humidity and cloud particles is analyzed. Climatological and case studies of tropical ozone distributions measured on a large number of flights are reported. Particle counter calibrations are discussed as well as the comparison of GASP particle data in the upper troposphere with other measurements at lower altitudes over the Pacific Ocean.

Falconer, P.↗

Constructing Space-Time Views from Fixed Size Statistical Data: Getting the Best of both Worlds

Many performance monitoring tools are currently available to the super-computing community. The performance data gathered and analyzed by these tools fall under two categories: statistics and event traces. Statistical data is much more compact but lacks the probative power event traces offer. Event traces, on the other hand, can easily fill up the entire file system during execution such that the instrumented execution may have to be terminated half way through. In this paper, we propose an innovative methodology for performance data gathering and representation that offers a middle ground. The user can trade-off tracing overhead, trace data size vs. data quality incrementally. In other words, the user will be able to limit the amount of trace collected and, at the same time, carry out some of the analysis event traces offer using space-time views for the entire execution. Two basic ideas arc employed: the use of averages to replace recording data for each instance and formulae to represent sequences associated with communication and control flow. With the help of a few simple examples, we illustrate the use of these techniques in performance tuning and compare the quality of the traces we collected vs. event traces. We found that the trace files thus obtained are, in deed, small, bounded and predictable before program execution and that the quality of the space time views generated from these statistical data are excellent. Furthermore, experimental results showed that the formulae proposed were able to capture 100% of all the sequences associated with 11 of the 15 applications tested. The performance of the formulae can be incrementally improved by allocating more memory at run-time to learn longer sequences.

Schmidt, Melisa↗

Analysis of dislocation configurations in SiC crystals through X-ray topography aided by ray tracing simulations

Silicon carbide as a wide bandgap semiconductor is of great research interest for its widespread deployment in a range of electronic and optoelectronic devices, particularly in power electronics. However, defects in silicon carbide crystals are still major concerns that is hampering the development of high-performance devices. X-ray topography, particularly using the synchrotron beam has been instrumental in characterizing and analyzing defect configurations in silicon carbide crystals to optimize crystal growth as well as understand the effect of defects on device performance. Here, in recent years, the use of ray-tracing simulation technique based on the orientation contrast mechanism to simulate contrast of defects observed on actual X-ray topographs has proven to be an effective approach to investigate the nature of crystallographic defects in various semiconductors. This review discusses the principle of ray-tracing simulation and its application and modifications to incorporate the effects of surface relaxation and photoelectric absorption to better simulate different dislocations observed in 4H–SiC as well as 6H–SiC crystals of various orientations. The adaptation to weak beam topography and plane wave topography is also discussed. The application of ray-tracing simulation in dislocation characterization of silicon carbide of different polytypes is systematically reviewed including different types of dislocations observed in both off-axis wafers and axial-sliced samples through synchrotron X-ray topography under various beam conditions, recording geometries and reflections. The result of ray-tracing simulation is further utilized in other studies including the investigation of effective penetration depth of all types of dislocations lying on the basal plane on grazing-incidence X-ray topography.

Engineering↗

Hybrid Solar System (Final Scientific/Technical Report)

GTI Energy (GTI) teamed with the University of California at Merced (UCM) to scaleup the hybrid solar system (HSS) technology for demonstrating its performance at the US Gypsum (USG) plant in Plaster City, California. The technology integrates two-stage concentrating solar collector with matching particle thermal transport and storage (TSS) system to deliver cost-effective, and on-demand distributed high temperature industrial process heat up to 600°C with solar thermal, in this case to a gypsum kettle, to reduce its fuel use and carbon footprint. Current solar technologies, which reach these temperatures, are not distributable (towers) or cost-effective (dish). The research team developed a conceptual system design for host site retrofit, including preliminary heat balance, process flow diagram, particle to process heat exchanger and equipment placements at the site. Subsequently, parallel efforts were carried out at UCM to design, build and test a 12 m long commercial scale prototype concentrating thermal-only collector system and at GTI to design, build and test a matching 650°C capable particle TTS system. The nominal 50 kWth collector consists of a parabolic trough and three 4 m long two-stage receivers in series. Prior to on-sun testing, a 4 m long receiver was fabricated and successfully tested at 650 °C in a laboratory setting for 100 hrs of continuous operation showing less than 15% radiation loss. A 7 m wide x 17 m long parabolic trough was then installed at UCM for on-sun testing of the 12 m long receiver, and concurrently several 4 m long receivers were built. The optics of the parabolic trough were calibrated, and on-sun test were carried out on 12 m long receivers. During tests, the intense solar radiation (53x) caused the absorber tubes in the receivers to bend, reducing the overall optical efficiency. To address the bending issue, a self-consistent algorithm that includes ray tracing, thermal and deformation models was developed to perform thermal stress analysis on absorbers for parabolic solar collectors. Results obtained with this algorithm showed a dramatic rise in deformation as absorber tube length increases. A combined efficiency parameter that includes the occluded area for the mounts was developed to obtain an optimized tube length obtained. Based on the results, a length of 2.7 m for the absorber + 0.2 m for the coupler was chosen to minimize any bending and optimize optical efficiency while maintaining ease of mounting. The associated particle TTS system was designed, built and successfully tested at GTI. It includes storage, receiving and lock hoppers and piping that simulates the transfer of captured solar energy to an actual industrial furnace. Tests over 77 charge-discharge cycles demonstrated <2% particle degradation, with no problematic particle accumulations and no flow interruptions. The piping pressure drop was about 5 psi. The team also worked with Stanley Consultants (Stanley) to prepare conceptual and preliminary engineering packages to facilitate follow-on development and commercialization efforts. These include process and instrumentation diagram’s (P&ID’s), general arrangements, electrical one-line, project definitions document, equipment data sheets, schedule, and construction cost estimate for 2 MWth system. Updated HSS technology commercialization and customer engagement plans and detailed costs and evaluated market trade-offs and manufacturing.

03 NATURAL GAS↗

Performance Metrics for Monitoring Parallel Program Executions

Existing tools for debugging performance of parallel programs either provide graphical representations of program execution or profiles of program executions. However, for performance debugging tools to be useful, such information has to be augmented with information that highlights the cause of poor program performance. Identifying the cause of poor performance necessitates the need for not only determining the significance of various performance problems on the execution time of the program, but also needs to consider the effect of interprocessor communications of individual source level data structures. In this paper, we present a suite of normalized indices which provide a convenient mechanism for focusing on a region of code with poor performance and highlights the cause of the problem in terms of processors, procedures and data structure interactions. All the indices are generated from trace files augmented with data structure information.. Further, we show with the help of examples from the NAS benchmark suite that the indices help in detecting potential cause of poor performance, based on augmented execution traces obtained by monitoring the program.

Sarukkai, Sekkar R.↗

Assessment of the CTF subchannel code for modeling a large-break loss-of-coolant accident reflood transient

With increased industry interest in extending reactor operating cycles, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program has been investigating the behavior of high-burnup fuel during design basis accidents such as the large-break loss-of-coolant accident (LBLOCA) with consideration for risk of fuel fragmentation, relocation, and dispersal (FFRD). As part of that activity, the NEAMS subchannel thermal/ hydraulics (T/H) code, CTF, is being used for modeling of LBLOCA and to determine the impact of subchannel resolution on results. Although CTF includes a wide range of models for LBLOCA conditions, the code has not been used for this application while maintained at Oak Ridge National Laboratory (ORNL) until now. Therefore, here, in this work, a preliminary assessment of several of these models was performed using openly available reflood experimental data from the Flooding Experiments in Blocked Arrays (FEBA) tests. One coarse mesh and one fine mesh model were set up in CTF for high and low flooding rate tests performed in the unblocked FEBA facility. A coarse TRACE model was set up to be as consistent as possible with the coarse CTF model to allow for code-to-code benchmarking. The assessment shows a tendency of the codes to over-predict peak cladding temperature (PCT) near the top of the bundle and to quench early. Advanced spacer grid models were shown to improve upper bundle predictions in CTF. The resolved CTF model over-predicted PCT by a larger degree in the center channels in the low-flooding rate test, and it is believed that the radiative heat transfer model, which was not used in this study, may be needed to correct this over-prediction. Finally, this work demonstrates the importance of the droplet model in determining quench time and vapor temperature and PCT prediction, which necessitates a more in-depth validation of these models in the future.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

First high-power helicon results from DIII-D

Abstract More than 0.6 MW of rf power at 476 MHz has been coupled to DIII-D plasmas by launching helicon (whistler) waves with a traveling-wave antenna (comb-line) in the fast-wave polarization (Van Compernolle et al 2021 Nucl. Fusion 61 116034) which resulted in the observation of electron heating of the core plasma with single-pass absorption based on ray-tracing in L-mode discharges. The coupling performance of the 1.5 m wide 30-element comb-line traveling-wave antenna has been consistent with expectations based on the 2015–2016 experiments on DIII-D with a low-power 12-element prototype (Pinsker et al 2018 Nucl. Fusion 58 106007). The conditioning process that was necessary to carry out high-power experiments is discussed; rf-specific impurities have not been observed. Parametric decay instabilities have been observed and are being investigated as a potential edge absorption mechanism (Porkolab et al 2023 AIP Conf. Proc. 2984 070004).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Indoor Wireless Localization of Uncooperative Sources Using a Ray Tracing Model

Indoor geolocation of radio frequency (RF) trans- mitters is challenging due to site-specific multipath effects, especially when the sources are uncooperative. A source being uncooperative means that a-priori the transmit time, location, and power are unknown. It is proposed to use a site-specific ray tracing model to generate realistic indoor RF responses, perform geolocation using multiple methods, and compare their performance. This work will look at two types of geolocation algorithms: (1) time-difference of arrival (TDOA) and (2) re- ceived signal strength Indicator (RSSI) fingerprinting or pattern- matching-based methods. An indoor space will be simulated with a grid of fixed receivers and a grid of transmit locations using Remcom’s Wireless InSite. Using the output of the Wireless InSite simulation the response from any given transmit location can be generated and used to evaluate geolocation performance.

indoor source localization, Wireless InSite, re- c↗

A Scalable Gaussian Process Approach to Shear Mapping with MuyGPs

Analysis of cosmic shear is an integral part of understanding structure growth across cosmic time, which in turn provides us with information about the nature of dark energy. Conventional methods generate shear maps from which we can infer the matter distribution in the universe. Current methods (e.g., Kaiser–Squires inversion) for generating these maps, however, are tricky to implement and can introduce bias. Recent alternatives construct a spatial process prior for the lensing potential, which allows for inference of the convergence and shear parameters given lensing shear measurements. Realizing these spatial processes, however, scales cubically in the number of observations—an unacceptable expense as near-term surveys expect billions of correlated measurements. Therefore, we present a linearly scaling shear map construction alternative using a scalable Gaussian process prior called MuyGPs. MuyGPs avoids cubic scaling by conditioning interpolation on only nearest neighbors and fits hyperparameters using batched leave-one-out cross-validation. This work is the first step toward a full, scalable mass mapping method. We work in a simplified regime where we validate our method by interpolating and analyzing maps given noisy point-estimate data from all three shear fields, taken from a suite of N -body ray-tracing simulations. We also show that we can perform these operations at the scale of billions of galaxies on high-performance computing platforms.

79 ASTRONOMY AND ASTROPHYSICS↗

NLR HPC Kestrel Jobs Data

Overview: Anonymized job-level records from the Kestrel HPC system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, utilization, energy estimates, and efficiency metrics. Sensitive fields (user, account, job name, submit line, working directory, submit script, and job type) are replaced with 7-character cryptographic hashes. System & Timeframe: Kestrel is located at the NLR campus. Standard compute nodes have 104 cores and 256 GB RAM; bigmem nodes have 2,000 GB. GPU nodes (gpu-h100 partition) use NVIDIA H100 GPUs. Data covers jobs submitted August 2023 through December 2025. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.kestrel.job-anon.zip — Anonymized job records (Hive-partitioned Parquet) datacard.md — Full dataset documentation ~11 million rows, 50 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct with timezone-aware export (SLURM_TIME_FORMAT="%Y-%m-%dT%H:%M:%S%z"), loaded into PostgreSQL. Calculated columns updated via database triggers and batch functions. All timestamps use timestamptz and correctly handle DST transitions. Preprocessing: Anonymization of name, user, account, submit_line, work_dir, submit_script, and job_type via 7-char hex hashes Derived columns: queue_wait, cpu_eff, max/min/avg_mem_eff, energy estimates Simplified job state mapping (e.g., "CANCELLED by 132357" → "CANCELLED") Boolean flags: python_job, reframe_job Temporal decomposition: year, month, day, day_of_week, hour, minute from submit_time Shared node tracking: shared_job_count, nodes_shared, jobs_shared Key Variables: Scheduling: job_id, partition, state_simple, submit_time, start_time, end_time, queue_wait Resources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max/min/avg_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, consumed_energy_raw_joules, consumed_energy_raw_watt_hours Sharing: shared_job_count, nodes_shared, jobs_shared Partitions: short, standard, debug, gpu-h100 Job States: CANCELLED, COMPLETED, FAILED, PENDING, RUNNING QoS Levels: normal, high Important Notes: Timestamps include timezone offsets; DST transitions are handled correctly, though adding intervals across DST boundaries requires offset adjustment shared_job_count reflects physical node co-residency, not use of the shared partition Job step records and raw Slurm JSONB fields are excluded Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗

NLR HPC Eagle Jobs Data and Additional Energy Metrics

Overview: Anonymized job-level records from the Eagle high-performance computing (HPC) system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, resource utilization, CPU/GPU energy consumption, and efficiency metrics. Sensitive fields (user, account, job name) are replaced with cryptographic hashes. System & Timeframe: Eagle was a 2,000-node, 8-petaflop system operated at NLR from 2019–2024. Data covers the full operational lifetime of the system. Slurm data was processed nightly; timestamps are in Mountain Time. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.eagle.job-anon.zip — Core anonymized job records (Hive-partitioned Parquet) esif.hpc.eagle.job-anon-energy-metrics.zip — Same records with additional iLO and Ganglia energy metrics datacard.md — Full dataset documentation ~13.8 million rows, 62 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct through a pipeline: Eagle Jobs API → Redpanda → StreamSets → HPCMON API → PostgreSQL. Node-level power from iLO (HP Integrated Lights-Out); GPU power from Ganglia monitoring, joined to jobs via node lists and time ranges. Preprocessing: Anonymization of name, user, and account fields via cryptographic hashing Derived columns: queue_wait, cpu_eff, max_mem_eff Simplified job state mapping (e.g., "CANCELLED BY 12345" → "CANCELLED") QoS accounting rules (buy-in, standby, or Slurm QoS value) CPU energy estimated from TDP (200W, Intel Xeon Gold 6154, 18 cores) Timezone-aware columns (_tz) sourced from LEX accounting database to correctly handle DST transitions Key Variables: Scheduling: job_id, partition, state_simple, submit_time_tz, start_time_tz, end_time_tz, queue_waitResources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, node_energy_total_watt_hours (iLO), gpu0/1_energy_total_watt_hours (Ganglia) Partitions: bigmem, bigmem-8600, bigscratch, csc, dav, ddn, debug, gpu, haswell, long, mono, short, standard Job States: CANCELLED, COMPLETED, FAILED, NODE_FAIL, OUT_OF_MEMORY, PENDING, RUNNING, TIMEOUT QoS Levels: Unknown, normal, buy-in, debug, penalty, high, standby Important Notes: Non-_tz timestamp columns may be off by one hour across DST boundaries; use _tz columns for time difference calculations Energy fields are null for jobs without monitoring coverage Job step records and raw Slurm JSONB fields are excluded from this extract Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗