Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “million core hours”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

14 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

The ePIC Simulation Campaign Workflow on the Open Science Grid

The ePIC collaboration is realizing the first experiment of the future Electron-Ion Collider (EIC) at the Brookhaven National Laboratory that will allow for a precision study of the nucleons and the nucleus at the scale of sea quarks and gluons through the study of electron-proton/ion collisions. This paper will discuss the current workflow for running centralized simulation campaigns for ePIC on the Open Science Grid (OSG) infrastructure. This involves monthly releases of ePIC software and container deployments to CVMFS, generation of input datasets in HepMC format according to collaboration-defined policy, using Snakemake in CI/CD for validation and benchmarking, and submitting jobs to the OSG condor scheduler for opportunistic running on available resources. File transfers utilize XrootD, and Rucio is used for data management. The workflow is continuously refined to improve daily throughput (currently 50-100k core hours per day) and minimize job failures. Since May 2023, monthly simulation campaigns employing the workflow have cumulatively used over 20 million core hours on the OSG and produced over 350 TB of simulation data. The campaigns incorporate simulations for the broad science program of the EIC and are actively used for the detector and physics studies in preparation of the Technical Design Report (TDR).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

HEPCloud Operations at Fermilab—The First Five Years

The HEPCloud Facility at Fermilab has now been in production operation for five years. This facility is a unified provisioning gateway to US high performance computing centers, including NERSC, OLCF, and ALCF, other large supercomputers run by the NSF, and commercial clouds. HEPCloud delivers hundreds of millions of core-hours yearly for CMS. HEPCloud also serves other Fermilab experiments including DUNE, Mu2e, Muon g-2, and NOvA. In this paper we present the practical considerations of operating a distributed facility such as HEPCloud. We also mention some of the interesting research and development that HEPCloud has been used for including GPU-based machine learning inference servers, and tests of Quantum Computing.

Timm, Steven [Fermilab]↗
DOE OSTI2024

Accelerating multiscale electronic stopping power predictions with time-dependent density functional theory and machine learning

Knowing the rate at which particle radiation releases energy in a material, the “stopping power,” is key to designing nuclear reactors, medical treatments, semiconductor and quantum materials, and many other technologies. While the nuclear contribution to stopping power, i.e., elastic scattering between atoms, is well understood in the literature, the route for gathering data on the electronic contribution has for decades remained costly and reliant on many simplifying assumptions, including that materials are isotropic. We establish a method that combines time-dependent density functional theory (TDDFT) and machine learning to reduce the time to assess new materials to hours on a supercomputer and provide valuable data on how atomic details influence electronic stopping. Our approach uses TDDFT to compute the electronic stopping from first principles in several directions and then machine learning to interpolate to other directions at a cost of 10 million times fewer core-hours. We demonstrate the combined approach in a study of proton irradiation in aluminum and employ it to predict how the depth of maximum energy deposition, the “Bragg Peak,” varies depending on the incident angle—a quantity otherwise inaccessible to modelers and far outside the scales of quantum mechanical simulations. The lack of any experimental information requirement makes our method applicable to most materials, and its speed makes it a prime candidate for enabling quantum-to-continuum models of radiation damage. The prospect of reusing valuable TDDFT data for training the model makes our approach appealing for applications in the age of materials data science.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Surface Roughness Effects from Additive Manufacturing in High Efficiency Gas Turbine Combustion Systems

In the past, clean combustion systems were characterized by high system development costs due to growing complexity and escalating manufacturing costs from conventional manufacturing processes. As a result, high efficiency concepts are difficult to design and more difficult to be cost-effectively manufactured. In recent years, with the introduction of additive manufacturing (AM) technologies, the rapid prototyping and mass production processes of clean combustion systems are promising to be significantly simplified with significant reduction in terms of engine manufacturing cost and engine energy cost. Compared with conventional manufacturing built parts, the AM process enabled a simpler design to be adopted for the nozzle, reducing the number of required braze and weld joints from twenty-five to just five. The resulting nozzle was 25% lighter and five times more durable and contributed to a 15% reduction in fuel burn in comparison with the previous model produced. Applying these improvements to a fleet of 5,000 turbofan engines at 150 kN thrust would result in fuel cost savings of $ \$ $6B annually (at $ \$ $5/gallon Jet-A fuel price, 700 gallon/hour fuel consumption rate, and 2,300 operational hours per year), and reduce CO2 emissions by more than 25 million tons per year. These advances support core Department of Energy (DOE) missions in energy efficiency, improving productivity, and environmental sustainability. Maximizing the benefit of these new capabilities will require high prediction capability of high speed turbulent flow with wall modeled Large Eddy Simulation (LES). GE Aviation maintains that advanced simulation technology and supercomputing is required in order to provide the appropriate boundary conditions to realize the maximum potential of AM and Ceramic Matrix Composite to reduce cooling flow, a first order penalty on the Brayton cycle. The algorithm developed using the ANSYS/Fluent software would provide the foundation for entirely new avenues of research and development with potential multi-billion dollar impact to the US economy, and significant reduction in carbon based emissions across the aerospace and power generation industries. The formulation of this iWLES (integral wall model for LES) is generic and allows to capture the changes in flow dynamics that have a significant impact on the wall bounded flow characteristics, such as swirler effective area, bulk swirl number, local pressure distribution, exit velocity profile, and turbulence kinetic energy profile. A periodic channel flow with rough flat plate is simulated using LES (Wall-Adapting Local Eddy-viscosity) model to verify the implementation of iWLES in the Fluent User Defined Function (UDF). As the flow fields are highly sensitive due to surface roughness of the wall bounded flows in the combustion systems, there is significant potential to conduct further LES studies focusing on the turbulence boundary layer interaction. Accurately capturing near wall physics will elucidate the impact of rough surfaces on combustor flow and aero-thermal interactions.

42 ENGINEERING↗
DOE OSTI2023

Surface Roughness Effects from Additive Manufacturing in High Efficiency Gas Turbine Combustion Systems

In the past, clean combustion systems were characterized by high system development costs due to growing complexity and escalating manufacturing costs from conventional manufacturing processes. As a result, high efficiency concepts are difficult to design and more difficult to be cost-effectively manufactured. In recent years, with the introduction of additive manufacturing (AM) technologies, the rapid prototyping and mass production processes of clean combustion systems are promising to be significantly simplified with significant reduction in terms of engine manufacturing cost and engine energy cost. Compared with conventional manufacturing built parts, the AM process enabled a simpler design to be adopted for the nozzle, reducing the number of required braze and weld joints from twenty-five to just five. The resulting nozzle was 25% lighter and five times more durable and contributed to a 15% reduction in fuel burn in comparison with the previous model produced. Applying these improvements to a fleet of 5,000 turbofan engines at 150 kN thrust would result in fuel cost savings of $6B annually (at $5/gallon Jet-A fuel price, 700 gallon/hour fuel consumption rate, and 2,300 operational hours per year),and reduce CO2 emissions by more than 25 million tons per year. These advances support core Department of Energy (DOE)missions in energy efficiency, improving productivity, and environmental sustainability. Maximizing the benefit of these new capabilities will require high prediction capability of high speed turbulent flow with wall modeled Large Eddy Simulation (LES). GE Aviation maintains that advanced simulation technology and supercomputing is required in order to provide the appropriate boundary conditions to realize the maximum potential of AM and Ceramic Matrix Composite to reduce cooling flow, a first order penalty on the Brayton cycle. The algorithm developed using the ANSYS/Fluent software would provide the foundation for entirely new avenues of research and development with potential multi-billion dollar impact to the US economy, and significant reduction in carbon based emissions across the aerospace and power generation industries. The formulation of this iWLES (integral wall model for LES) is generic and allows to capture the changes in flow dynamics that have a significant impact on the wall bounded flow characteristics, such as swirler effective area, bulk swirl number, local pressure distribution, exit velocity profile, and turbulence kinetic energy profile. A periodic channel flow with rough flat plate is simulated using LES (Wall-Adapting Local Eddy-viscosity) model to verify the implementation of iWLES in the Fluent User Defined Function (UDF). As the flow fields are highly sensitive due to surface roughness of the wall bounded flows in the combustion systems, there is significant potential to conduct further LES studies focusing on the turbulence boundary layer interaction. Accurately capturing near wall physics will elucidate the impact of rough surfaces on combustor flow and aero-thermal interactions.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

(Invited) Fuel Cell Component Durability for Million Mile Fuel Cell Trucks

While significant advances have been made and early commercial fuel cell light-duty vehicles (LDVs) are starting to be produced, fuel cells in the heavy-duty-vehicle (HDV) transportation sector (including trucks, long-haul semitrailers, maritime, trains, etc.) are nascent, despite the fact that advantages of fuel cells compared to both diesel and electric powertrains are very compelling in terms of emissions, charging time, efficiency, power-to-weight ratio, among others. However, the fuel-cell technology for HDVs requires a paradigm shift in fuel-cell research and development compared to LDVs, where the emphasis becomes efficiency and improvements in durability instead of a focus on increased power densities and lower cell costs. Heavy-duty applications require significantly longer vehicle lifetimes (>25,000 hours/1,000,000 miles for heavy-duty trucks), and therefore require improved fuel cell durability compared to light-duty vehicles. In 2020, HFTO formed the Million Mile Fuel Cell Truck Consortium (M2FCT) that includes a core team of five national laboratories to overcome durability and efficiency challenges in PEMFCs for heavy-duty applications with an initial focus on long-haul trucks. While targets and testing protocols have been developed for light-duty vehicles, the same level of targets and testing protocols have not been established for heavy-duty transportation. With operational times of greater than > 25,000 hours required, the need for well-developed accelerated stress tests (ASTs) is amplified. Results from these ASTs demonstrate the need for more durable electrode layers and well-controlled potential variations. Finally, this presentation will provide an overview of the DOE's Fuel Cell R&D approach, highlighting past and current activities, as well as strategies to enable fuel cell competiveness for heavy-duty applications.

25 ENERGY STORAGE↗
DOE OSTI2025

NLR HPC Kestrel Jobs Data

Overview: Anonymized job-level records from the Kestrel HPC system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, utilization, energy estimates, and efficiency metrics. Sensitive fields (user, account, job name, submit line, working directory, submit script, and job type) are replaced with 7-character cryptographic hashes. System & Timeframe: Kestrel is located at the NLR campus. Standard compute nodes have 104 cores and 256 GB RAM; bigmem nodes have 2,000 GB. GPU nodes (gpu-h100 partition) use NVIDIA H100 GPUs. Data covers jobs submitted August 2023 through December 2025. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.kestrel.job-anon.zip — Anonymized job records (Hive-partitioned Parquet) datacard.md — Full dataset documentation ~11 million rows, 50 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct with timezone-aware export (SLURM_TIME_FORMAT="%Y-%m-%dT%H:%M:%S%z"), loaded into PostgreSQL. Calculated columns updated via database triggers and batch functions. All timestamps use timestamptz and correctly handle DST transitions. Preprocessing: Anonymization of name, user, account, submit_line, work_dir, submit_script, and job_type via 7-char hex hashes Derived columns: queue_wait, cpu_eff, max/min/avg_mem_eff, energy estimates Simplified job state mapping (e.g., "CANCELLED by 132357" → "CANCELLED") Boolean flags: python_job, reframe_job Temporal decomposition: year, month, day, day_of_week, hour, minute from submit_time Shared node tracking: shared_job_count, nodes_shared, jobs_shared Key Variables: Scheduling: job_id, partition, state_simple, submit_time, start_time, end_time, queue_wait Resources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max/min/avg_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, consumed_energy_raw_joules, consumed_energy_raw_watt_hours Sharing: shared_job_count, nodes_shared, jobs_shared Partitions: short, standard, debug, gpu-h100 Job States: CANCELLED, COMPLETED, FAILED, PENDING, RUNNING QoS Levels: normal, high Important Notes: Timestamps include timezone offsets; DST transitions are handled correctly, though adding intervals across DST boundaries requires offset adjustment shared_job_count reflects physical node co-residency, not use of the shared partition Job step records and raw Slurm JSONB fields are excluded Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

NLR HPC Eagle Jobs Data and Additional Energy Metrics

Overview: Anonymized job-level records from the Eagle high-performance computing (HPC) system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, resource utilization, CPU/GPU energy consumption, and efficiency metrics. Sensitive fields (user, account, job name) are replaced with cryptographic hashes. System & Timeframe: Eagle was a 2,000-node, 8-petaflop system operated at NLR from 2019–2024. Data covers the full operational lifetime of the system. Slurm data was processed nightly; timestamps are in Mountain Time. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.eagle.job-anon.zip — Core anonymized job records (Hive-partitioned Parquet) esif.hpc.eagle.job-anon-energy-metrics.zip — Same records with additional iLO and Ganglia energy metrics datacard.md — Full dataset documentation ~13.8 million rows, 62 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct through a pipeline: Eagle Jobs API → Redpanda → StreamSets → HPCMON API → PostgreSQL. Node-level power from iLO (HP Integrated Lights-Out); GPU power from Ganglia monitoring, joined to jobs via node lists and time ranges. Preprocessing: Anonymization of name, user, and account fields via cryptographic hashing Derived columns: queue_wait, cpu_eff, max_mem_eff Simplified job state mapping (e.g., "CANCELLED BY 12345" → "CANCELLED") QoS accounting rules (buy-in, standby, or Slurm QoS value) CPU energy estimated from TDP (200W, Intel Xeon Gold 6154, 18 cores) Timezone-aware columns (_tz) sourced from LEX accounting database to correctly handle DST transitions Key Variables: Scheduling: job_id, partition, state_simple, submit_time_tz, start_time_tz, end_time_tz, queue_waitResources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, node_energy_total_watt_hours (iLO), gpu0/1_energy_total_watt_hours (Ganglia) Partitions: bigmem, bigmem-8600, bigscratch, csc, dav, ddn, debug, gpu, haswell, long, mono, short, standard Job States: CANCELLED, COMPLETED, FAILED, NODE_FAIL, OUT_OF_MEMORY, PENDING, RUNNING, TIMEOUT QoS Levels: Unknown, normal, buy-in, debug, penalty, high, standby Important Notes: Non-_tz timestamp columns may be off by one hour across DST boundaries; use _tz columns for time difference calculations Energy fields are null for jobs without monitoring coverage Job step records and raw Slurm JSONB fields are excluded from this extract Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

AICCA: AI-Driven Cloud Classification Atlas

Clouds play an important role in the Earth’s energy budget, and their behavior is one of the largest uncertainties in future climate projections. Satellite observations should help in understanding cloud responses, but decades and petabytes of multispectral cloud imagery have to date received only limited use. This study describes a new analysis approach that reduces the dimensionality of satellite cloud observations by grouping them via a novel automated, unsupervised cloud classification technique based on a convolutional autoencoder, an artificial intelligence (AI) method good at identifying patterns in spatial data. Our technique combines a rotation-invariant autoencoder and hierarchical agglomerative clustering to generate cloud clusters that capture meaningful distinctions among cloud textures, using only raw multispectral imagery as input. Cloud classes are therefore defined based on spectral properties and spatial textures without reliance on location, time/season, derived physical properties, or pre-designated class definitions. We use this approach to generate a unique new cloud dataset, the AI-driven cloud classification atlas (AICCA), which clusters 22 years of ocean images from the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua and Terra instruments—198 million patches, each roughly 100 km × 100 km (128 × 128 pixels)—into 42 AI-generated cloud classes, a number determined via a newly-developed stability protocol that we use to maximize richness of information while ensuring stable groupings of patches. AICCA thereby translates 801 TB of satellite images into 54.2 GB of class labels and cloud top and optical properties, a reduction by a factor of 15,000. The 42 AICCA classes produce meaningful spatio-temporal and physical distinctions and capture a greater variety of cloud types than do the nine International Satellite Cloud Climatology Project (ISCCP) categories—for example, multiple textures in the stratocumulus decks along the West coasts of North and South America. We conclude that our methodology has explanatory power, capturing regionally unique cloud classes and providing rich but tractable information for global analysis. AICCA delivers the information from multi-spectral images in a compact form, enables data-driven diagnosis of patterns of cloud organization, provides insight into cloud evolution on timescales of hours to decades, and helps democratize climate research by facilitating access to core data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

The high level trigger and express data production at STAR

To meet the demands of the Beam Energy Scan phase-II (BES-II) program, the STAR experiment at the Relativistic Heavy Ion Collider (RHIC) developed a dual real-time framework consisting of a High Level Trigger (HLT) and an Express Data Production system (xProduction). The HLT operates online within the Data Acquisition (DAQ) chain on a dedicated multi-core CPU cluster with the option to offload compute-intensive kernels to Xeon Phi coprocessors. It uses parallelized algorithms, such as the Cellular Automaton (CA) Track Finder, to perform rapid tracking, vertexing, and event filtering. This allows it to select events of interest in real time and provide immediate feedback on detector and beam conditions. In contrast, the xProduction workflow runs concurrently and independently of the DAQ loop. It applies near offline-quality calibration and reconstruction within hours of data collection. The xProduction input is the express data stream, whose content can be enriched by HLT trigger/priority selections under DAQ/HLT resource constraints, and it uses the STAR calibration/conditions framework, incorporating online calibration/QA information when available. This enables early preliminary physics analysis, including the reconstruction of rare signals, such as hyperons and hypernuclei. It also provides collaboration-wide access to analysis-ready datasets. Together, the HLT and xProduction systems form a complementary architecture: the HLT performs online event selection while the xProduction chain delivers high-quality results within a short amount of time. This integrated framework has enabled the prompt reconstruction of the $^5_Λ$ He hypernucleus with high statistical significance and the efficient processing of hundreds of millions of heavy-ion collision events. In conclusion, its demonstrated scalability and robustness establish a model for future high-luminosity experiments requiring both online event filtering and rapid access to analysis-quality data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗